S-Agent 2.0: Spatial Reasoning with a General Coding Agent
Read the original on arXiv AI →The Flow has not summarised this story yet — read it at arXiv AI.
The Flow has not summarised this story yet — read it at arXiv AI.
arXiv:2606. 13673v1 Announce Type: cross Abstract: Spatial reasoning, the ability to determine where objects are, how they relate, and how they move in 3D, remains a fundamental challenge for vision-language models (VLMs).
arXiv:2606. 12830v1 Announce Type: cross Abstract: While recent vision-language models (VLMs) demonstrate strong multimodal understanding, they remain limited in spatial reasoning tasks that require active evidence acquisition and multi-step visual interaction.
The paper introduces DeSpatial, a framework that separates spatial understanding into perception and reasoning. It uses a shared 3D perception tool with joint segmentation–depth co-refinement and cross-view instance fusion to produce a unified, metric, gravity-aligned 3D scene. DeSpatial achieves state‑of‑the‑art results on VSI‑Bench, MindCube‑Tiny, ViewSpatial, and VSI‑SUPER, demonstrating that the main bottleneck in spatial reasoning is precise 3D perception.
arXiv:2604.12102v3 Announce Type: replace Abstract: We describe compute-grounded reasoning (CGR), a design pattern in which code computes selected sub-problems from explicit intermediate representati...
The paper introduces PEPS, a training‑free framework that improves spatial reasoning in Vision‑Language Models by parsing queries into a compact set of executable requirements before execution. PEPS uses a typed FESM schema (Frame, Entity, State, Metric) to commit queries, then selectively grounds primitives via fixed geometric APIs and verifies sufficiency, allowing early termination or targeted repair. Experiments on spatial reasoning benchmarks show that PEPS boosts accuracy while reducing refinement rounds, API cost, and latency compared to existing tool‑integrated baselines.
Code4Scene is a benchmark that evaluates coding agents on constructing and editing 3D scenes in Unreal Engine. It tests agents on two tasks: construction, where they must build a scene from open‑ended language, and editing, where they must recover a target scene from reference images while preserving everything else. The benchmark measures task fulfillment, artifact integrity, and physical validity, revealing that construction and editing performance are correlated but not interchangeable, with agents struggling most with spatial composition and precise edits.