Google AI Blog By Google AI

Advances in private training for production on-device language models

Read the original on Google AI Blog →

Posted by Zheng Xu, Research Scientist, and Yanxiang Zhang, Software Engineer, Google Language models (LMs) trained to predict the next word given input text are the key technology for many applications [ 1 , 2 ]. In Gboard , LMs are used to improve users’ typing experience by supporting features like next word prediction (NWP), Smart Compose , smart completion and suggestion , slide to type , and proofread .

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at Google AI Blog.

Google AI Blog
Mar 14, 2024

Cappy: Outperforming and boosting large multi-task language models with a small scorer

Posted by Yun Zhu and Lijuan Liu, Software Engineers, Google Research Large language model (LLM) advancements have led to a new paradigm that unifies various natural language processing (NLP) tasks within an instruction-following framework. This paradigm is exemplified by recent multi-task LLMs, such as T0 , FLAN , and OPT-IML .

By Google AI
Google AI Blog
Jan 31, 2024

MobileDiffusion: Rapid text-to-image generation on-device

Posted by Yang Zhao, Senior Software Engineer, and Tingbo Hou, Senior Staff Software Engineer, Core ML Text-to-image diffusion models have shown exceptional capabilities in generating high-quality images from text prompts. However, leading models feature billions of parameters and are consequently expensive to run, requiring powerful desktops or servers (e.

By Google AI
Simon Willison
Aug 29

Introducing Hy4 Preview

Simon Willison introduces Hy4 Preview, a new large language model from Tencent featuring 770 B total parameters, 49 B active parameters, a 1 M token context window, and 1.56 TB of storage on Hugging Face. The release marks a significant increase over Hy3, which had 295 B total parameters, 21 B active parameters, a 256 k token context window, and 598 GB of storage. Willison also shares the model’s chat template, highlighting two reasoning effort levels—‘high’ (default) and ‘no_think’—and demonstrates a sample prompt that showcases the model’s reasoning trace. whyItMatters":"The article provides concrete details on Hy4’s scale and configuration, illustrating Tencent’s advancement in large‑language‑model capabilities and offering practical insights into its usage through the chat template and reasoning settings."

Simon Willison
Sep 22

llm-typesafe 0.1a0

Simon Willison released the llm-typesafe 0.1a0 plugin, adding support for TypeSafe AI’s Jev model to the LLM tool. Users install it with `llm install llm-typesafe`, set an API key, and can then ask Jev-model questions such as yes/no, choice, or scoring queries via the `llm -m jev` command. The release includes examples for each question type and references a README for further details.