arXiv Computer Vision By Zhenyu Liu, Zhangquan Chen, Keyi Chen, Mingze Sun, Xiang An, Haodong Jing, Ruqi Huang

Spatial-OPSD: Self-Improving Spatial Reasoning via Label-Free Self-Distillation

Read the original on arXiv Computer Vision →

Spatial-OPSD is a label‑free self‑improvement framework for vision‑language models that leverages spatial priors such as depth, 3D relations, and camera geometry to provide dense token‑level supervision. During training, a privileged teacher uses these priors while the student learns from only the original visual‑language input, and a recursive round‑wise scheme allows repeated self‑improvement without moving the teacher. Across four VLM families, one round of Spatial‑OPSD improves the five‑benchmark average, and three rounds push a strong spatially specialized model to the open‑source frontier, achieving the highest average among open models and best results on three of five spatial reasoning benchmarks.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computer Vision.

arXiv Computer Vision
6d ago

Multi-View Relational Distillation for Spatial Reasoning with Vision-Language Models

The paper introduces Multi-View Relational Distillation (MVRD), a method that distills patch-wise cosine similarities across multiple views from geometry‑grounded vision models into vision‑language models (VLMs). By focusing on relational geometry rather than raw teacher features, MVRD preserves the pretrained alignment between visual and textual representations while enhancing spatial reasoning. Experiments show that MVRD outperforms supervised fine‑tuning and feature distillation, approaching feature‑fusion performance with fewer parameters and lower latency, and it generalizes to 3D scene understanding tasks such as object grounding, dense captioning, and question answering.

By Kiet T. Nguyen, Hanbo Shim, Jinwoo Kim, Seunghoon Hong
arXiv AI
Oct 9

Distilling Routed 3D Privilege for Spatial Reasoning in Vision-Language Models

The paper introduces Geometry-Privileged Distillation (GPD), a method that incorporates depth, semantic, and bird’s-eye-view cues as compact text routed to a teacher model during on-policy self-distillation. By applying a privileged KL loss only to incorrect trajectories, GPD enhances spatial reasoning in vision‑language models while keeping the deployed model RGB‑only. Experiments on a 4B backbone show that GPD outperforms prior methods on multiple spatial reasoning benchmarks, with ablations confirming the benefits of 3D cues, question‑conditioned routing, and selective distillation.

By Hongxing Li, Yixin Li, Dingming Li, Zixuan Wang, Yuchen Yan, Wenqi Zhang, Weiming Lu, Yongliang Shen
arXiv AI
Jun 17

Reinforcing Dual-Path Reasoning in Spatial Vision Language Models

arXiv:2606. 17539v1 Announce Type: cross Abstract: Spatial VLMs have made substantial progress in geometric perception, yet complex spatial reasoning requiring multi-step inference over depth, distance, and scene relations remains challenging.

By Yatai Ji, An-Chieh Cheng, Yang Fu, Yukang Chen, Han Zhang, Zhaojing Yang, Wei Huang, Ka Chun Cheung, Song Han, Vidya Nariyambut Murali, Pavlo Molchanov, Jan Kautz, Simon See, Hongxu Yin, Ping Luo, Sifei Liu