arXiv AI By Sparsh Tiwari, Gesina Schwalbe, Bettina Finzel

Weakly supervised concept Bottleneck Learning for Robust Two stage Object centric visual reasoning

Read the original on arXiv AI →

The Flow has not summarised this story yet — read it at arXiv AI.

arXiv Computer Vision
4d ago

ReGuLaR: Relation-Grounded Latent Reasoning for Large Vision-Language Models

ReGuLaR introduces a relation‑grounded latent reasoning framework for large vision‑language models, explicitly anchoring latent states to key objects and their inter‑object relations. It employs a training‑time ReGFormer to focus reasoning on question‑relevant visual evidence, while inference proceeds without the ReGFormer. The authors also create the RGROUNDING‑351K dataset and demonstrate that ReGuLaR outperforms existing methods across diverse benchmarks, achieving state‑of‑the‑art results.

By Zihu Wang, Karthik Somayaji N. S, Hejia Geng, Peng Li
arXiv Computer Vision
Sep 24

UVU: Improving Multimodal Understanding via Vision-Language Unified Autoregressive Paradigm

UVU is a vision-language unified autoregressive framework that integrates visual supervision directly into the pre-training stage of multimodal large language models. By using continuous visual encoding and a large-scale iterative hierarchical clustering algorithm to build a pixel-level visual codebook, UVU enables lossless representation of visual inputs and autoregressive generation of pixel-level image tokens alongside textual tokens. This approach synergizes pixel-level visual perception with semantic-level visual understanding, allowing models to internalize visual reconstruction capabilities and improve multimodal understanding performance.

By Zhehan Kan, Xinghua Jiang, Yubo Zhu, Yanlin Liu, Xiaochen Yang, Zhixiang Wei, Shifeng Liu, Qingmin Liao, Wenming Yang, Xin Li, Yinsong Liu, Deqiang Jiang, Xing Sun