← Back to all news
arXiv AI By Amirmohammad Izadi, Hosein Hasani, Fatemeh Askari, Mobin Bagherian, Sadegh Mohammadian, Mohammad Izadi, Mahdieh Soleymani Baghshah

Uncovering Grounding IDs: How External Cues Shape Multi-Modal Binding

Read the original on arXiv AI →

The paper introduces Grounding IDs, latent identifiers that emerge when external visual cues—such as symbols or grid lines—structure both visual and textual modalities in large vision-language models. These IDs improve the alignment between visual components and their textual descriptions, enhancing cross‑modal grounding, reducing hallucinations, and boosting overall performance on multimodal tasks. The study demonstrates that partition‑inducing cues lead to more accurate connections and better attention between related components.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

Related stories

arXiv Machine Learning
Jun 26

Staying VIGILant: Mitigating Visual Laziness via Counterfactual Visual Alignment in MLLMs

arXiv:2606. 26387v1 Announce Type: cross Abstract: Multimodal large language models (MLLMs) extend large language models (LLMs) with visual perception, enabling joint reasoning over images and text.

By Xi Xiao, Chen Liu, Chih-Ting Liao, Yunbei Zhang, Qizhen Lan, Yuxiang Wei, Lin Zhao, Janet Wang, Jianyang Gu, Muchao Ye, Tianyang Wang, Hao Xu
llmsreinforcement-learningmultimodalbenchmarkssafety
More like this →
arXiv AI
Sep 28

Skip the Talk, Re-Focus on Vision: Latent Reasoning for Reasoning Segmentation in Multimodal Large Language Models

The paper introduces LIRSeg, a method that replaces explicit Chain-of-Thought reasoning in multimodal large language models with a compact set of learnable latent tokens for reasoning segmentation. LIRSeg is trained in two stages—spatial alignment and GRPO—while employing extreme-advantage sampling, decoupled exploration-stability updates, and latent diversity amplification to enhance token informativeness. Experiments show that LIRSeg improves segmentation accuracy and reasoning efficiency, achieving significant gIoU gains over the VisionReasoner baseline and reducing reasoning tokens by about 16×.

By Tianhang Guo, Yulin He, Wei Chen, Wenjuan Zhou, Yuhang Li, Xinbiao Gan
llmsagentscomputer-visionroboticsmultimodalbenchmarkssafety
More like this →
arXiv Computation and Language
3d ago

MagiC: Evaluating Multimodal Cognition Toward Grounded Visual Reasoning

MagiC is a benchmark for grounded multimodal cognition that evaluates vision‑language models on answer accuracy, step‑by‑step reasoning quality, grounding fidelity, and self‑correction. It contains about 5,500 weakly supervised QA examples generated from strong model outputs and 900 human‑curated examples with fine‑grained annotations, including rationales and bounding box groundings. The benchmark tests 15 models ranging from 7B to 70B parameters, introduces new metrics such as MagiScore and StepSense, and includes diagnostic settings to probe robustness against adversarial visual cues and introspective error correction.

By Chengfei Wu, Ronald Seoh, Bingxuan Li, Liqiang Zhang, Fengrong Han, Dan Goldwasser
llmsnlpmultimodalbenchmarkssafety
More like this →