OpenAI Blog
Thinking with images
Read the original on OpenAI Blog →The Flow has not summarised this story yet — read it at OpenAI Blog.
Related stories
arXiv Computer Vision
Sep 15
How and What to Imagine? Visual Thinking in Unified Multimodal Models for Cross-View Spatial Reasoning
arXiv:2605.27310v2 Announce Type: replace Abstract: Cross-view spatial reasoning remains a weak spot for vision-language models (VLMs): they reason in language and discard the fine-grained geometry t...
arXiv AI
Jun 11
MentisOculi: Revealing the Limits of Reasoning with Mental Imagery
arXiv:2602. 02465v2 Announce Type: replace Abstract: Frontier models are transitioning from multimodal large language models (MLLMs) that merely ingest visual information to unified multimodal models (UMMs) capable of native interleaved generation.
arXiv AI
Jun 9
Optical Reasoning: Rethinking Images as an Expressive Reasoning Medium Beyond Text
arXiv:2606. 09585v1 Announce Type: new Abstract: Chain-of-Thought (CoT) improves the performance of Large Language Models (LLMs) and has been extended to Multimodal Large Language Models (MLLMs).
arXiv AI
Jun 2
Limits of Spatial Imagery Reasoning in Frontier LLM Models
arXiv:2603. 26779v2 Announce Type: replace-cross Abstract: Large Language Models (LLMs) have demonstrated impressive reasoning capabilities, yet they struggle with spatial tasks that require mental simulation, such as mental rotation.
arXiv AI
3d ago
Rethinking Multi-Image Re-Representation in Multi-Image Understanding
The paper introduces Mosaic, a multi-image visual harness that lets large language‑vision models (MLLMs) construct visual intermediates using ten composable image operations. It evaluates five re‑representation settings on existing multi‑image benchmarks and a new grounding‑focused benchmark, MosaicBench, finding that visual re‑representation benefits tasks requiring precise visual evidence more than those dominated by high‑level semantics. MosaicAgent‑8B is trained via reinforcement learning to compose these operations without demonstration trajectories, demonstrating diverse problem‑solving patterns.
arXiv Computation and Language
Sep 25
Multimodal Thinking with Renderable Programs
The paper introduces SVGLM, a framework that integrates scalable vector graphics (SVG) primitives into vision‑language models to enable image generation within reasoning tasks. By treating SVG both as image descriptions and text instructions, SVGLM offers a compact and interpretable method for connecting text and image reasoning. The authors provide a curated SVG‑based image editing dataset and demonstrate strong SVG generation and image‑aware reasoning performance on a mathematical benchmark.