arXiv Machine Learning August 14, 2026 By Turhan Can Kargin, Wojciech Jasi\'nski, Adam Pardyl, Bartosz Zieli\'nski, Marcin Przewi\k{e}\'zlikowski

SpaRRTa: A Synthetic Benchmark for Evaluating Spatial Intelligence in Visual Foundation Models

Read the original on arXiv Machine Learning →

arXiv:2601. 11729v2 Announce Type: replace-cross Abstract: Visual Foundation Models (VFMs), such as DINO and CLIP, excel in semantic understanding of images but exhibit limited spatial reasoning capabilities, which limits their applicability to embodied systems.

Summary generated by The Flow from the publisher's feed. The full article lives at arXiv Machine Learning.

arXiv Machine Learning

Aug 4

SpatioLM: Towards General Physical Spatial Intelligence in Vision-Language Models

arXiv:2608. 01899v1 Announce Type: cross Abstract: Vision-Language Models (VLMs) perform well on commonsense reasoning tasks but struggle with visual spatial reasoning.

By Jing Wu, Jianhua Wu, Jiayi Guan, Jiahong Chen, Jinghui Lu, Hangjun Ye, Bingzhao Gao, Long Chen

llms robotics fine-tuning multimodal

arXiv AI

Jun 6

Learning Geometric Representations from Videos for Spatial Intelligent Multimodal Large Language Models

arXiv:2606. 05833v1 Announce Type: cross Abstract: Multimodal Large Language Models (MLLMs) excel at 2D semantic understanding but lack intrinsic 3D awareness, resulting in representations that fail to maintain geometric and spatial consistency across video frames.

By Haibo Wang, Lifu Huang

llms diffusion multimodal benchmarks

arXiv AI

Jun 18

OneCanvas: 3D Scene Understanding via Panoramic Reprojection

arXiv:2606. 19253v1 Announce Type: cross Abstract: Existing approaches to 3D scene understanding in Vision-Language Models (VLMs) either rely on complex, model-specific geometry encoders or large training budgets in pursuit of spatial reasoning.

By Bart{\l}omiej Baranowski, Dave Zhenyu Chen, Matthias Nie{\ss}ner

llms rag robotics multimodal benchmarks

arXiv AI

Jul 28

Spatial-IQ: Deconstructing Spatial Intelligence via Hierarchical Capability Tests

arXiv:2607. 22864v1 Announce Type: cross Abstract: Multimodal large language models (MLLMs) excel at visual interpretation but fail on spatial reasoning tasks that humans solve reliably.

By Patrick Rim, Tom Long, Ekta Prashnani, Ruth Rosenholtz, Ben Boudaoud, Peter Xenopoulos, Alex Wong, Joohwan Kim, Jae-Hyun Jung

llms reinforcement-learning multimodal benchmarks

arXiv Machine Learning

Jun 19

Do Vision-Language Models Understand 3D Scenes or Just Catalogue Objects?

arXiv:2605. 20448v2 Announce Type: replace-cross Abstract: Vision-language models reliably name objects in a scene, but do they represent the 3D layout those objects inhabit?

By Animesh Maheshwari, Divyansh Sahu, Nishit Verma

llms robotics multimodal benchmarks

arXiv AI

Jul 7

SpatialThinker: Reinforcing Scene Graph-Grounded Spatial Reasoning via Dense Rewards

arXiv:2511. 07403v2 Announce Type: replace-cross Abstract: Multimodal large language models (MLLMs) have achieved remarkable progress in vision-language tasks, but continue to struggle with spatial reasoning.

By Hunar Batra, Haoqin Tu, Hardy Chen, Yuanze Lin, Cihang Xie, Ronald Clark

llms reinforcement-learning fine-tuning multimodal benchmarks

Related stories

SpatioLM: Towards General Physical Spatial Intelligence in Vision-Language Models

Learning Geometric Representations from Videos for Spatial Intelligent Multimodal Large Language Models

OneCanvas: 3D Scene Understanding via Panoramic Reprojection

Spatial-IQ: Deconstructing Spatial Intelligence via Hierarchical Capability Tests

Do Vision-Language Models Understand 3D Scenes or Just Catalogue Objects?

SpatialThinker: Reinforcing Scene Graph-Grounded Spatial Reasoning via Dense Rewards