arXiv:2610.02117v1 Announce Type: cross
Abstract: On-policy self-distillation has recently emerged as an effective approach for improving language-model reasoning by supervising students with a froze...
By Sophia Sirko-Galouchenko, Monika Wysoczanska, Andrei Bursuc, Nicolas Thome, Spyros Gidaris
The paper introduces Multi-View Relational Distillation (MVRD), a method that distills patch-wise cosine similarities across multiple views from geometry‑grounded vision models into vision‑language models (VLMs). By focusing on relational geometry rather than raw teacher features, MVRD preserves the pretrained alignment between visual and textual representations while enhancing spatial reasoning. Experiments show that MVRD outperforms supervised fine‑tuning and feature distillation, approaching feature‑fusion performance with fewer parameters and lower latency, and it generalizes to 3D scene understanding tasks such as object grounding, dense captioning, and question answering.
By Kiet T. Nguyen, Hanbo Shim, Jinwoo Kim, Seunghoon Hong
The paper introduces Geometry-Privileged Distillation (GPD), a method that incorporates depth, semantic, and bird’s-eye-view cues as compact text routed to a teacher model during on-policy self-distillation. By applying a privileged KL loss only to incorrect trajectories, GPD enhances spatial reasoning in vision‑language models while keeping the deployed model RGB‑only. Experiments on a 4B backbone show that GPD outperforms prior methods on multiple spatial reasoning benchmarks, with ablations confirming the benefits of 3D cues, question‑conditioned routing, and selective distillation.
By Hongxing Li, Yixin Li, Dingming Li, Zixuan Wang, Yuchen Yan, Wenqi Zhang, Weiming Lu, Yongliang Shen
arXiv:2609.38716v1 Announce Type: cross
Abstract: Large Vision-Language Models (LVLMs) have made remarkable progress across visual perception tasks, yet spatial reasoning remains a persistent weaknes...
By Rafi Ibn Sultan, Xiangyu Zhou, Md. Sajid Alam Chowdhury, Chengyin Li, Prashant Khanduri, Marco Brocanelli, Dongxiao Zhu
arXiv:2511. 07403v2 Announce Type: replace-cross Abstract: Multimodal large language models (MLLMs) have achieved remarkable progress in vision-language tasks, but continue to struggle with spatial reasoning.
By Hunar Batra, Haoqin Tu, Hardy Chen, Yuanze Lin, Cihang Xie, Ronald Clark
arXiv:2606. 17539v1 Announce Type: cross Abstract: Spatial VLMs have made substantial progress in geometric perception, yet complex spatial reasoning requiring multi-step inference over depth, distance, and scene relations remains challenging.
By Yatai Ji, An-Chieh Cheng, Yang Fu, Yukang Chen, Han Zhang, Zhaojing Yang, Wei Huang, Ka Chun Cheung, Song Han, Vidya Nariyambut Murali, Pavlo Molchanov, Jan Kautz, Simon See, Hongxu Yin, Ping Luo, Sifei Liu
arXiv:2606. 11719v1 Announce Type: cross Abstract: Spatial reasoning remains a persistent challenge for multimodal large language models (MLLMs).
By Enhan Zhao, Wei Wu, Yuanrui Zhang, Xueliang Zhao, Di He
arXiv:2510.13394v4 Announce Type: replace
Abstract: Spatial reasoning ability is crucial for Vision Language Models (VLMs) to support real-world applications in diverse domains including robotics, au...
By Xinmiao Huang, Qisong He, Zhenglin Huang, Boxuan Wang, Zhuoyun Li, Guangliang Cheng, Yi Dong, Xiaowei Huang
SpatialASM is a framework that teaches Large Vision‑Language Models (LVLMs) to perform Active Spatial Mentalization (ASM), enabling them to proactively plan and imagine viewpoints during spatial reasoning tasks. The method uses an allocentric novel‑view generator to create explicit ASM trajectories and perspective‑taking tasks, providing two forms of supervision that guide LVLMs in adaptive view planning and scene imagination. Experiments on seven spatial benchmarks show that SpatialASM improves performance across four LVLM backbones while preserving their general vision capabilities.
By Yuhong Liu, Shenxi Wu, Junyi Chi, Beichen Zhang, Xuanlang Dai, Jiaqi Wang, Yuhang Zang, Dahua Lin
arXiv:2606. 03988v1 Announce Type: new Abstract: Vision language models (VLMs) excel at many tasks but still struggle with spatial reasoning when critical information is not directly observable.
By Mahtab Bigverdi, Lindsey Li, Weikai Huang, Yiming Liu, Jaemin Cho, Jieyu Zhang, Tuhin Kundu, Chris Dangjoo Kim, Zelun Luo, Linda Shapiro, Ranjay Krishna
arXiv:2606. 11918v1 Announce Type: new Abstract: Current Large Reasoning Models (LRMs) exhibit remarkable general capabilities but significantly underperform in spatial reasoning tasks.
By Theo Uscidda, Marta Tintore Gazulla, Maks Ovsjanikov, Federico Tombari, Leonidas Guibas
Video-OPSD introduces a post‑training framework for Video Large Language Models that leverages privileged visual evidence to enhance on‑policy self‑distillation. The method constructs a self‑teacher conditioned only on annotated evidence frames, while the student processes the full video, allowing the teacher to provide more focused supervision. Additionally, an evidence‑guided token optimization scheme weights distillation based on each token’s reliance on privileged evidence, improving perceptually grounded reasoning. Experiments demonstrate consistent gains over standard OPSD and comparable performance to GRPO with less training time.
By Ziyue Wang, Shiqi Huang, Weiwen Xu, Bihan Wen, Xudong Jiang