Simon Willison

ttok 0.4

Read the original on Simon Willison →

ttok 0.4 is a command‑line tool for counting tokens using OpenAI’s tiktoken library. The release fixes a Click warning, updates continuous integration, and adds a new --list-models command to display available models. It can be used with uvx to count tokens from any input, such as piping a file into the tool.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at Simon Willison.

Simon Willison
Oct 9

ttok 1.0

Simon Willison announces the release of ttok 1.0 after discovering that the previous version defaulted to the GPT‑4 tokenizer instead of the expected GPT‑5/GPT‑6 tokenizer. He explains that switching the default was a suitable reason to ship the new version. The release notes reference an experiment by William Liu that confirms the tokenizers for GPT‑5 and GPT‑6 models are likely identical, as all seven models report the same token count across 31 test fixtures.

Simon Willison
Oct 6

llm-openai-decisions 0.1a0

Simon Willison announces the release of the llm-openai-decisions 0.1a0 plugin, which interfaces with OpenAI’s new Jev-style Decisions API. The plugin, inspired by llm-typesafe, supports image and text input and offers the same three question types (yes/no, choices, scores) as Jev, with pricing at 10¢ per million input tokens. Installation is simple via `llm install llm-openai-decisions`, and an example query demonstrates image-based evaluation.

Simon Willison
3d ago

Quoting Armin Ronacher

Simon Willison reflects on the long history of flawed software development, noting that the proliferation of bad code over the past three decades is now being penalized by the universe. He cites Armin Ronacher’s perspective that the rise of AI, while entertaining, has amplified the consequences of these past mistakes. The piece underscores the growing importance of addressing security and reliability in the age of generative AI.

Simon Willison
Sep 11

Quoting Boris Cherny

The article discusses how production code generated by Claude, Anthropic’s AI, should meet higher standards than human-written code. Anthropic enforces this through numerous guardrails such as lint rules, extensive testing, Claude-driven end‑to‑end tests, daily fuzzers, automated code and security reviews, and automated refactoring. These measures aim to prevent the code from becoming difficult to maintain.

Simon Willison
6d ago

llm-echo 0.5

The article announces the release of llm-echo version 0.5, a debug plugin that simulates an LLM by echoing back prompts without actual model inference. The new version updates token usage calculations to include tool calls, system prompts, and reasoning tokens. An example shows how to invoke the plugin and view the resulting prompt and token usage.

Simon Willison
Sep 7

llm 0.35

The article announces the release of llm version 0.35, which introduces a new OpenAI model named gpt-6-astra for GPT-6 Astra. It highlights the addition of this model to the llm library and tags the release with openai, llm, and gpt-6-astra.