Google AI Blog

MobileDiffusion: Rapid text-to-image generation on-device

Posted by Yang Zhao, Senior Software Engineer, and Tingbo Hou, Senior Staff Software Engineer, Core ML Text-to-image diffusion models have shown exceptional capabilities in generating high-quality images from text prompts. However, leading models feature billions of parameters and are consequently expensive to run, requiring powerful desktops or servers (e.

Google AI Blog
Feb 21, 2024

Advances in private training for production on-device language models

Posted by Zheng Xu, Research Scientist, and Yanxiang Zhang, Software Engineer, Google Language models (LMs) trained to predict the next word given input text are the key technology for many applications [ 1 , 2 ]. In Gboard , LMs are used to improve users’ typing experience by supporting features like next word prediction (NWP), Smart Compose , smart completion and suggestion , slide to type , and proofread .

By Google AI
Google AI Blog
Feb 23, 2024

VideoPrism: A foundational visual encoder for video understanding

Posted by Long Zhao, Senior Research Scientist, and Ting Liu, Senior Staff Software Engineer, Google Research An astounding number of videos are available on the Web, covering a variety of content from everyday moments people share to historical moments to scientific observations, each of which contains a unique record of the world. The right tools could help researchers analyze these videos, transforming how we understand the world around us.

By Google AI
Simon Willison
Sep 13

shot-scraper 1.12

Shot‑scraper 1.12 adds WebP support, allowing users to capture web page screenshots in WebP format with an optional quality setting. The new --quality flag controls compression, while omitting it produces lossless images. WebP screenshots are reported to be significantly smaller than JPEG or PNG equivalents.

Google AI Blog
Mar 19, 2024

ScreenAI: A visual language model for UI and visually-situated language understanding

Posted by Srinivas Sunkara and Gilles Baechler, Software Engineers, Google Research Screen user interfaces (UIs) and infographics, such as charts, diagrams and tables, play important roles in human communication and human-machine interaction as they facilitate rich and interactive user experiences. UIs and infographics share similar design principles and visual language (e.

By Google AI
Simon Willison
Sep 8

Introducing ChatGPT Images 2.5

Simon Willison announces the release of ChatGPT Images 2.5, noting that OpenAI’s image generation models have processed over 3 billion images across ChatGPT Images and the GPT‑Image API. The new version improves instruction‑following across multiple turns, speeds up responses, and better preserves subjects from reference photos. Two new API model IDs—gpt‑image‑2.5‑sunburst and gpt‑image‑2.5‑flare—are available, with Sunburst recommended for precision editing and Flare for fast, high‑quality everyday generation. Willison has updated his openai_image.py CLI tool to accept reference images, demonstrating its use with a raccoon scientist prompt.

Simon Willison
Sep 5

Introducing GPT-6 Astra for developers

Simon Willison introduces GPT‑6 Astra, a new model that offers improved attention to detail, better prompt comprehension, and the ability to generate more sophisticated outputs. The model excels at creating 3D renderings, producing detailed scenes such as gardens, shipyards, animals, cityscapes, and even Dyson spheres. Willison highlights its whimsical creativity, noting examples like a pelican wearing a red neckerchief riding a bicycle.

Google AI Blog
Mar 14, 2024

Cappy: Outperforming and boosting large multi-task language models with a small scorer

Posted by Yun Zhu and Lijuan Liu, Software Engineers, Google Research Large language model (LLM) advancements have led to a new paradigm that unifies various natural language processing (NLP) tasks within an instruction-following framework. This paradigm is exemplified by recent multi-task LLMs, such as T0 , FLAN , and OPT-IML .

By Google AI
Simon Willison
Sep 2

llm-gemini 0.34

The release of llm-gemini 0.34 introduces the new Gemini 3.8‑Flash model, available in low, medium, and high thinking levels, and fixes an issue where async responses failed to record the resolved model version. The update also notes that Google has released Gemini 3.8‑Flash (and a restricted 3.8 Flash Cyber version) today, with example outputs (pelicans) demonstrating the model’s performance across the different thinking levels. The author highlights Gemini Flash’s speed, low cost, and competence in generating HTML, JavaScript, and Markdown‑SVG content, citing a 13‑second, 1.8‑cent example of an HTML output.