ReGuLaR introduces a relation‑grounded latent reasoning framework for large vision‑language models, explicitly anchoring latent states to key objects and their inter‑object relations. It employs a training‑time ReGFormer to focus reasoning on question‑relevant visual evidence, while inference proceeds without the ReGFormer. The authors also create the RGROUNDING‑351K dataset and demonstrate that ReGuLaR outperforms existing methods across diverse benchmarks, achieving state‑of‑the‑art results.
By Zihu Wang, Karthik Somayaji N. S, Hejia Geng, Peng Li
arXiv:2609.35942v1 Announce Type: new
Abstract: Recent work in visual question answering has shown that vision-language models can exhibit strong reasoning capabilities by translating visual inputs i...
By Ting-Chih Chen, Emile van Krieken, Shujian Yu, Filip Ilievski
UVU is a vision-language unified autoregressive framework that integrates visual supervision directly into the pre-training stage of multimodal large language models. By using continuous visual encoding and a large-scale iterative hierarchical clustering algorithm to build a pixel-level visual codebook, UVU enables lossless representation of visual inputs and autoregressive generation of pixel-level image tokens alongside textual tokens. This approach synergizes pixel-level visual perception with semantic-level visual understanding, allowing models to internalize visual reconstruction capabilities and improve multimodal understanding performance.
By Zhehan Kan, Xinghua Jiang, Yubo Zhu, Yanlin Liu, Xiaochen Yang, Zhixiang Wei, Shifeng Liu, Qingmin Liao, Wenming Yang, Xin Li, Yinsong Liu, Deqiang Jiang, Xing Sun
arXiv:2606. 15753v1 Announce Type: new Abstract: Embodied reasoning requires models to perceive task-relevant objects and spaces in physical environments and maintain consistent visual grounding throughout multi-step reasoning.
By Yaoting Huang, Yifu Yuan, Linqi Han, Chengwen Li, Shuoheng Zhang, Xianze Yao, Hongyao Tang, Yan Zheng, Jianye Hao
arXiv:2507.00754v3 Announce Type: replace
Abstract: The integration of Large Language Model (LLMs) blocks with Vision Transformers (ViTs) holds immense promise for vision-only tasks by leveraging the...
By Selim Kuzucu, Muhammad Ferjad Naeem, Anna Kukleva, Federico Tombari, Bernt Schiele
arXiv:2610.20083v1 Announce Type: new
Abstract: Visual world knowledge is a core capability of multimodal large language models (MLLMs), underpinning knowledge-intensive visual question answering and...
By Chen Chen, Zheming Liang, Jiaqi Wang
The paper introduces Latent Visual Contrastive Reasoning, a branch-aware latent reasoning framework that generates multiple question-conditioned latent visual branches as soft hypotheses over image tokens. It trains these branches using bounding‑box evidence annotations and a soft contrastive branch‑evidence alignment objective, encouraging evidence‑relevant branches to align with annotated visual regions while contrasting against negative evidence. Experiments on perception‑intensive visual reasoning benchmarks demonstrate that the method improves performance over the corresponding backbone and single‑path latent reasoning baselines at both 3B and 7B scales.
By Kegeng Tang, Jingbo Wang, Yangming Zhang, Huanshu Zhang, Shaogang Ren, Zihao Wang
arXiv:2602. 14065v2 Announce Type: replace Abstract: Knowledge-intensive Visual Question Answering (KI-VQA) frequently suffers from severe knowledge conflicts caused by the inherent limitations of open-domain retrieval.
By Kai Ye, Xianwei Mao, Sheng Zhou, Zirui Shao, Ye Mo, Liangliang Liu, Haikuan Huang, Bin Li, Jiajun Bu
WeakMCN introduces a multi-task collaborative network that jointly learns weakly supervised referring expression comprehension (WREC) and segmentation (WRES) using a dual-branch architecture. The WREC branch employs anchor-based contrastive learning and serves as a teacher for the WRES branch, while two novel modules—Dynamic Visual Feature Enhancement (DVFE) and Collaborative Consistency Module (CCM)—facilitate cross-task collaboration. Experiments on RefCOCO, RefCOCO+, and RefCOCOg show significant performance gains over single-task baselines, with up to 3.91% and 13.11% improvements on WREC and WRES respectively, and strong generalization in semi-supervised settings.
By Silin Cheng, Yang Liu, Xinwei He, Sebastien Ourselin, Lei Tan, Gen Luo
arXiv:2601. 07761v2 Announce Type: replace Abstract: Large Vision-Language Models (LVLMs) face a fundamental dilemma in video reasoning: they are caught between the prohibitive computational costs of verbose reasoning and the hallucination risks of efficient, ungrounded approaches.
By Yanxiang Huang, Guohua Gao, Zhaoyang Wei
arXiv:2606. 30498v1 Announce Type: cross Abstract: Human decision-making interprets the world through high-level concepts, such as recognizing a bird by its belly color.
By Laines Schmalwasser, Jan Blunk, Niklas Penzel, Julia Niebling, Joachim Denzler
ProAR introduces a goal‑oriented reasoning framework for autoregressive video models, adding goal‑frame prediction via an asymmetric attention mask and future representation self‑alignment to guide intermediate states. These mechanisms combine sparse target supervision with dense step‑wise guidance, enabling coherent, goal‑directed generation while keeping computational costs modest. Experiments demonstrate consistent performance gains across visual reasoning benchmarks and training efficiency, achieving comparable results to fully trained baselines with only 25% of the training steps.
By Linghui Shen, Tinghui Zhu, Sheng Zhang, Muhao Chen