S-Space: Exploring Spatial Workspace in Multimodal Language Models

The paper introduces S‑Space, a linear subspace within multimodal language models where object‑token representations encode continuous spatial coordinates along horizontal, vertical, and distance axes. This subspace is intrinsic, readable under non‑spatial queries, and serves as an internal spatial workspace: perception maps object locations into it, reasoning transforms it for viewpoint changes, and verbal responses selectively access it. Diagnostic experiments using S‑Space reveal that while models can form spatial representations, they struggle with spatial transformations needed for reliable reasoning across viewpoint changes.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

• llms
• multimodal