Simon Willison

llm-typesafe 0.1a0

Read the original on Simon Willison →

Simon Willison released the llm-typesafe 0.1a0 plugin, adding support for TypeSafe AI’s Jev model to the LLM tool. Users install it with `llm install llm-typesafe`, set an API key, and can then ask Jev-model questions such as yes/no, choice, or scoring queries via the `llm -m jev` command. The release includes examples for each question type and references a README for further details.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at Simon Willison.

Simon Willison
Aug 29

Introducing Hy4 Preview

Simon Willison introduces Hy4 Preview, a new large language model from Tencent featuring 770 B total parameters, 49 B active parameters, a 1 M token context window, and 1.56 TB of storage on Hugging Face. The release marks a significant increase over Hy3, which had 295 B total parameters, 21 B active parameters, a 256 k token context window, and 598 GB of storage. Willison also shares the model’s chat template, highlighting two reasoning effort levels—‘high’ (default) and ‘no_think’—and demonstrates a sample prompt that showcases the model’s reasoning trace. whyItMatters":"The article provides concrete details on Hy4’s scale and configuration, illustrating Tencent’s advancement in large‑language‑model capabilities and offering practical insights into its usage through the chat template and reasoning settings."

Simon Willison
4d ago

Quoting Thariq Shihipar

The article announces that Claude Code will now support AGENTS.md files starting with version 2.1.277. If a CLAUDE.md file is absent in a folder, Claude will automatically look for and use AGENTS.md, leveraging Claude Code mods to customize the harness. The built‑in mod is available for use, and users can also create their own custom project instructions.

Simon Willison
10h ago

llm 0.36

The release of llm 0.36 introduces new OpenAI models gpt-6-sol and gpt-6-luna, and adds support for model plugins to declare that they do not support conversations via supports_conversation = False. When such models receive assistant or tool history, llm raises a ConversationNotSupported error and the chat interface rejects them before starting a session. Additional changes include wrapping reasoning traces in Markdown output with <details> tags and bug fixes from five contributors.

Google AI Blog
Feb 21, 2024

Advances in private training for production on-device language models

Posted by Zheng Xu, Research Scientist, and Yanxiang Zhang, Software Engineer, Google Language models (LMs) trained to predict the next word given input text are the key technology for many applications [ 1 , 2 ]. In Gboard , LMs are used to improve users’ typing experience by supporting features like next word prediction (NWP), Smart Compose , smart completion and suggestion , slide to type , and proofread .

By Google AI