Grounding Isn't Knowing: Do VLMs Need Object Localization for Spatial Reasoning?
Read the original on arXiv Computer Vision →The Flow has not summarised this story yet — read it at arXiv Computer Vision.
The Flow has not summarised this story yet — read it at arXiv Computer Vision.
Vision-language models (VLMs) can answer spatial questions, yet the mechanisms connecting object grounding to spatial reasoning remain poorly understood. It is underexplored whether spatial reasoning...
The paper introduces S‑Space, a linear subspace within multimodal language models where object‑token representations encode continuous spatial coordinates along horizontal, vertical, and distance axes. This subspace is intrinsic, readable under non‑spatial queries, and serves as an internal spatial workspace: perception maps object locations into it, reasoning transforms it for viewpoint changes, and verbal responses selectively access it. Diagnostic experiments using S‑Space reveal that while models can form spatial representations, they struggle with spatial transformations needed for reliable reasoning across viewpoint changes.
arXiv:2609.06880v1 Announce Type: cross Abstract: Reasoning over language instructions in embodied tasks such as robotics often requires understanding spatial relations from a speaker's situated pers...
arXiv:2606. 16122v1 Announce Type: new Abstract: Visual thinking should not only sound right; it should show its evidence.
arXiv:2609.38716v1 Announce Type: cross Abstract: Large Vision-Language Models (LVLMs) have made remarkable progress across visual perception tasks, yet spatial reasoning remains a persistent weaknes...
arXiv:2605. 20448v2 Announce Type: replace-cross Abstract: Vision-language models reliably name objects in a scene, but do they represent the 3D layout those objects inhabit?