← Back to all news
Simon Willison

ttok 1.0

Read the original on Simon Willison →

Simon Willison announces the release of ttok 1.0 after discovering that the previous version defaulted to the GPT‑4 tokenizer instead of the expected GPT‑5/GPT‑6 tokenizer. He explains that switching the default was a suitable reason to ship the new version. The release notes reference an experiment by William Liu that confirms the tokenizers for GPT‑5 and GPT‑6 models are likely identical, as all seven models report the same token count across 31 test fixtures.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at Simon Willison.

Related stories

Simon Willison
Oct 8

ttok 0.4

ttok 0.4 is a command‑line tool for counting tokens using OpenAI’s tiktoken library. The release fixes a Click warning, updates continuous integration, and adds a new --list-models command to display available models. It can be used with uvx to count tokens from any input, such as piping a file into the tool.

llmsnlp
More like this →
Simon Willison
Sep 29

GPT 6.1 Sol: Near-Astra intelligence for a fifth of the price

Simon Willison comments on GPT 6.1‑Sol, describing it as "Near‑Astra intelligence for a fifth of the price." He notes that the model’s pelican illustrations are similar to those of the GPT‑6 family and provides links to the live‑blog of the keynote and to the pelican images. The post is tagged with AI, OpenAI, generative‑AI, LLMs, and playful references to pelican‑riding‑a‑bicycle.

llms
More like this →
Simon Willison
2d ago

Introducing Kimi K3.1 Pro

Simon Willison announces the release of Kimi K3.1 Pro on the Kimi API, noting it is not yet open‑weights but full weights will be available by Nov 4 2026. The model offers a high‑speed variant 2‑3× faster at double the price, with US dollar pricing of $2.00/million input tokens and $10/million output tokens—matching GPT‑6.1 Sol and half the cost of Claude Opus 5.5. Benchmarks from Moonshot show Kimi roughly on par with Opus 5.5 and GPT‑6 Astra, scoring 55 in Artificial Analysis, ahead of several competitors.

llmsbenchmarks
More like this →
Simon Willison
Sep 22

llm 0.36

The release of llm 0.36 introduces new OpenAI models gpt-6-sol and gpt-6-luna, and adds support for model plugins to declare that they do not support conversations via supports_conversation = False. When such models receive assistant or tool history, llm raises a ConversationNotSupported error and the chat interface rejects them before starting a session. Additional changes include wrapping reasoning traces in Markdown output with <details> tags and bug fixes from five contributors.

llms
More like this →
Simon Willison
Sep 7

llm 0.35

The article announces the release of llm version 0.35, which introduces a new OpenAI model named gpt-6-astra for GPT-6 Astra. It highlights the addition of this model to the llm library and tags the release with openai, llm, and gpt-6-astra.

llms
More like this →