arXiv Computer Vision By Yu Zhang, Xiaogang Wang, Yuhang Cheng, Jingrui Li, Wenbo Chen

Zhengrong-Spatial-Aware 1.0: Advancing 3D Multimodal Intelligence

Read the original on arXiv Computer Vision →

The paper introduces two end‑to‑end multimodal adaptation pipelines for 3D‑aware visual question answering on a custom spatial dataset. One pipeline fine‑tunes HiSpatial‑3B, adding metric‑scale 3D point maps to RGB inputs, while the other adapts Qwen3‑VL using memory‑efficient QLoRA supervised fine‑tuning. The engineering stack includes dataset conversion, image‑annotation alignment, monocular geometry preprocessing, instruction construction, mixed‑domain training, checkpoint management, batch inference, and automated evaluation, achieving significant accuracy gains on both the target spatial benchmark and a styled split.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computer Vision.

arXiv AI
Sep 10

MV-STRIDE: Enabling MLLMs to Master Multi-View Spatial Reasoning via Hierarchical Capability Modeling

MV-STRIDE is a Multi‑View hierarchical Spatial Reasoning dataset that models dependencies among perception, scene understanding, and contextual reasoning to support 3D spatial cognition. It introduces a QA generation pipeline that enforces cross‑view constraints, producing multi‑level reasoning tasks with chain‑of‑thought supervision. Experiments show that training on MV‑STRIDE yields state‑of‑the‑art performance on multi‑view spatial benchmarks, enabling MLLMs to reason robustly across diverse viewpoints.

By Jin Xu, Xiaojian Huang, Zhuodong Luo, Zhihong Zhang, Xin Liu, Jiansheng Wei, Xinzhi Wang, Jie Zhao, Xuejin Chen
arXiv AI
Oct 2

Task-Adaptive Grounded 3D-Programmers Using 2D VLMs

The paper introduces 3D-Prog, a framework that adapts powerful 2D vision‑language models (VLMs) for reliable 3D understanding, manipulation, and generation. It does so by employing Canonical Coordinate Framing (CCF) to anchor inputs and outputs in a shared Euclidean coordinate system, resolving axis ambiguity, metric scale, and reference issues, and Task‑Adaptive Feedback (TAF) to close the reasoning loop with dynamic, task‑specific feedback. Together, CCF and TAF enable 2D VLMs to perform open‑vocabulary 3D tasks without retraining, yielding consistent, interpretable, and high‑quality results across diverse 3D scenarios.

By Arman Raayatsanati, Sombit Dey, Anna-Maria Halacheva, Jan-Nico Zaech, Luc Van Gool, Danda Pani Paudel
arXiv AI
6d ago

Zooming without Zooming v2: From Seeing Details to Connecting Evidence for Generalizable Multimodal Perception

The paper introduces EvidenceConnect, a data‑synthesis framework that generates training examples by zooming into related image regions to create questions requiring comparison, aggregation, or chaining of visual evidence. By retaining only reference answers agreed upon by independent vision‑language models and discarding questions that survive region ablation, the authors train base VLMs with RLVR to produce Zooming without Zooming v2 (ZwZ2). Although the synthesized data are not benchmark‑specific, ZwZ2 shows improvements across fine‑grained and spatial perception, embodied spatial reasoning, multimodal long‑context understanding, multimodal agent tasks, and general visual reasoning, demonstrating that strengthening the shared capability of connecting evidence yields more generalizable multimodal perception.

By Lai Wei, Yatai Li, Liangbo He, Jun Lan, Renjie Gu, Linhan Cao, Junkai Lin, Huijia Zhu, Weiqiang Wang, Linghe Kong, Yue Wang, Zhuosheng Zhang, Weiran Huang
arXiv Computation and Language
Sep 30

Imagine3D-LLM: Teaching MLLMs to Imagine 3D Scenes Before Answering

arXiv:2609.38177v1 Announce Type: cross Abstract: Reasoning about the 3D world from multi-view images remains a fundamental challenge for Multimodal Large Language Models (MLLMs). While modern MLLMs...

By Jaewoo Jung, Hyeonseo Yu, Honggyu An, Jisang Han, Mungyeom Kim, Minkyeong Jeon, Heeseong Shin, Wonjun Moon, Federico Tombari, Daniel Barath, Marc Pollefeys, Seungryong Kim, Sunghwan Hong