arXiv Computer Vision
WM-VLM: Probing Internal World Models for Interleaved Visual-Textual Reasoning
Read the original on arXiv Computer Vision →The Flow has not summarised this story yet — read it at arXiv Computer Vision.
Related stories
arXiv AI
Oct 16
CoWorld Reasoner: Agentic Multimodal Reasoning with the Evolving Video World Model-Driven Harness
CoWorld Reasoner is an agentic framework that leverages a Video World Model (VWM) as a unified visual reasoning engine for Vision‑Language Models (VLMs). It exposes multiple visual operations through tools and skills, allowing the VLM to decide when to imagine, select an operation, generate visual content, and interpret the resulting evidence. The framework includes a VLM‑VWM Harness Co‑Evolution mechanism that jointly refines tools, skills, and execution code based on feedback, while keeping model weights fixed. Across seven benchmarks covering spatial, temporal, causal, and perceptual reasoning, CoWorld Reasoner outperforms direct VLM reasoning and improves accuracy on all benchmarks, achieving notable gains on MMSI and ERQA.
arXiv AI
Jun 2
Limits of Spatial Imagery Reasoning in Frontier LLM Models
arXiv:2603. 26779v2 Announce Type: replace-cross Abstract: Large Language Models (LLMs) have demonstrated impressive reasoning capabilities, yet they struggle with spatial tasks that require mental simulation, such as mental rotation.
arXiv AI
Aug 5
SpatialCLI: Learning to Reason With Spatial Tools, Then Without Them
arXiv:2607. 27703v2 Announce Type: replace Abstract: Vision-language models (VLMs) are increasingly used in embodied agents to interpret visual inputs, reason about spatial relationships, and make task-level decisions based on that reasoning.
arXiv Machine Learning
Oct 9
WOVEN: Weaving Visual World Modeling into Multimodal LLMs
WOVEN is a new training source and benchmark for visual transition reasoning, comprising 36,076 examples across 20 scenes, 5 actions, and 8 reasoning types. The study shows that current multimodal large language models (MLLMs) have a systematic deficit in spatial, embodied, physical, and temporal reasoning, and that training on WOVEN improves performance on 22 of 26 external benchmarks by up to 27.3 percentage points. The authors also provide a training recipe that prioritizes reasoning operations and larger visual changes for robust visual world modeling.
arXiv AI
Jun 12
GeoWorld-VLM: Geometry from World Models for Vision-Language Models
arXiv:2605. 16713v2 Announce Type: replace-cross Abstract: Modern Vision-Language Models (VLMs) achieve strong semantic recognition, yet remain brittle on elementary spatial relations such as left of, on, behind, and between.
arXiv AI
Jun 16
Thinking with Visual Grounding
arXiv:2606. 16122v1 Announce Type: new Abstract: Visual thinking should not only sound right; it should show its evidence.