Code as Worlds: Agentic Discovery of Executable World Representations for Physical Reasoning
Read the original on arXiv Computer Vision →The Flow has not summarised this story yet — read it at arXiv Computer Vision.
The Flow has not summarised this story yet — read it at arXiv Computer Vision.
arXiv:2601.13247v2 Announce Type: replace-cross Abstract: Current Large Language Models (LLMs) exhibit a critical modal disconnect: they possess vast semantic knowledge but lack the procedural ground...
arXiv:2608. 04575v1 Announce Type: cross Abstract: Reliable physical reasoning from video requires understanding how objects move, interact, and respond to interventions.
arXiv:2609.39135v1 Announce Type: new Abstract: Physical reasoning from video requires inferring latent physical properties and dynamics beyond direct observation. Direct VLM inference remains unreli...
CoWorld Reasoner is an agentic framework that leverages a Video World Model (VWM) as a unified visual reasoning engine for Vision‑Language Models (VLMs). It exposes multiple visual operations through tools and skills, allowing the VLM to decide when to imagine, select an operation, generate visual content, and interpret the resulting evidence. The framework includes a VLM‑VWM Harness Co‑Evolution mechanism that jointly refines tools, skills, and execution code based on feedback, while keeping model weights fixed. Across seven benchmarks covering spatial, temporal, causal, and perceptual reasoning, CoWorld Reasoner outperforms direct VLM reasoning and improves accuracy on all benchmarks, achieving notable gains on MMSI and ERQA.
PhysVista is a new benchmark that evaluates physical intelligence in Vision‑Language Models (VLMs) by integrating perception, reasoning, and plausibility assessment into a closed cognitive loop. It distinguishes between event‑level and scale‑level reasoning and tests models on both real‑world and AI‑generated videos to provide a holistic, fine‑grained analysis of physical understanding. Experiments show significant gaps in VLMs’ physical reasoning and plausibility assessment, underscoring the need for more principled, physically grounded multimodal designs.
The paper introduces Code World Model, a framework that decouples world evolution from visual rendering by using a coding agent as a world brain. The agent reasons about events, generates executable code to maintain persistent state, and a proxy representation links this state to a video model for high‑fidelity visual output. Experiments with MiniMax‑H3 show that the system can follow proxy‑based spatiotemporal specifications while preserving rich visual dynamics, illustrating a new approach to open‑ended world modeling.