Know a great AI tool or AI news source? Submit it to AiByts
Generative AI2 min read

ttok 1.0

Release: ttok 1.0 I released ttok 0.4, ran uv tool upgrade ttok, piped a file into the new version... and realized that it was defaulting to the GPT-4 tokenizer when it should very clearly default to GPT-5/GPT-6 instead! I figured switching the default was a reasonable excuse to finally ship a 1.0.

By Simon WillisonSimon Willison

Read the full story

Originally published by Simon Willison on Oct 9, 2026.

Read on Simon Willison(opens in a new tab)

Comments

Sign in to join the discussion.

No comments yet — be the first to share your thoughts.