arXiv AI

Zooming without Zooming v2: From Seeing Details to Connecting Evidence for Generalizable Multimodal Perception

The paper introduces EvidenceConnect, a data‑synthesis framework that generates training examples by zooming into related image regions to create questions requiring comparison, aggregation, or chaining of visual evidence. By retaining only reference answers agreed upon by independent vision‑language models and discarding questions that survive region ablation, the authors train base VLMs with RLVR to produce Zooming without Zooming v2 (ZwZ2). Although the synthesized data are not benchmark‑specific, ZwZ2 shows improvements across fine‑grained and spatial perception, embodied spatial reasoning, multimodal long‑context understanding, multimodal agent tasks, and general visual reasoning, demonstrating that strengthening the shared capability of connecting evidence yields more generalizable multimodal perception.

arXiv AI
3d ago

VideoLVR: Latent Visual Reasoning over Grounded Video Evidence

VideoLVR introduces a method for multimodal large language models to maintain visual grounding during chain-of-thought reasoning by constructing latent visual evidence from local video regions at relevant moments. It uses a visual token prediction objective that unifies visual evidence reconstruction and text generation, allowing models to interleave text tokens with latent visual states. The approach is further extended with reinforcement learning, treating visual tokens as actions and optimizing policies with final-answer rewards, thereby improving video understanding without expanding the multimodal context.

By Shilong Li, Xingyuan Bu, Hao Shi, Yun Xing, Weixin Feng, Qiangpeng Yang, Shilei Wen
arXiv AI
Sep 1

Evidence-Grounded Trustworthy Multimodal Reasoning and Evaluation Benchmark in Complex Urban Scenes

arXiv:2506.09557v2 Announce Type: replace-cross Abstract: While Multimodal Large Language Models (MLLMs) demonstrate impressive performance in benign scenarios, their cognitive reliability deteriorat...

By Zhaoyang Wei, Bowen Jiang, Xumeng Han, Jiashu Li, Xuehui Yu, Yuling Liu, Guorong Li, Zhenjun Han, Jianbin Jiao
arXiv AI
Aug 12

Evidence-Grounded Trustworthy Multimodal Reasoning and Evaluation Benchmark in Complex Urban Scenes

arXiv:2608. 10954v1 Announce Type: cross Abstract: While Multimodal Large Language Models (MLLMs) demonstrate impressive performance in benign scenarios, their cognitive reliability deteriorates significantly in complex scenes under adverse conditions.

By Zhaoyang Wei, Bowen Jiang, Xumeng Han, Jiashu Li, Xuehui Yu, Yuling Liu, Guorong Li, Zhenjun Han, Jianbin Jiao
arXiv Computer Vision
Oct 9

Look Back, Think Ahead: Visual Memory on Demand for Efficient Multimodal Reasoning

The paper introduces ViMoD, a lightweight framework that dynamically manages visual memory for multimodal large language models. ViMoD uses Deformable Aggregation of Region-wise Tokens (DART) to create content‑adaptive coarse representations linked to recoverable fine tokens, and Temporal Routing for Adaptive Contextual Evidence (TRACE) to anticipate and adjust evidence needs during reasoning. On the Qwen3‑VL‑4B model, ViMoD achieves superior performance across eight reasoning benchmarks with only a 20% visual token budget and minimal additional parameters.

By Yicheng Xue, Han Wu, Jufeng Yang, Minjing Dong, Xinghao Chen, Hanting Chen, Jianyuan Guo
arXiv Computer Vision
Oct 12

TerraAgent: Demonstration-Grounded Multi-Agent Reasoning for Long-Context Remote Sensing Visual Question Answering

The paper introduces TerraAgent, a training‑free framework that enhances remote sensing visual question answering by integrating three modules: GDR for demonstration retrieval, MACE for evidence‑typed sub‑question decomposition, and CVA for counterfactual evidence auditing. It demonstrates significant improvements on multiple benchmarks, raising accuracy, visual‑dependency scores, and reducing prior‑only answers and hallucinations without fine‑tuning.

By Jingwen Huang, Yiming Fang, Hanxiao Wu, Boyuan He, Keyi Luo
arXiv AI
Oct 16

CoWorld Reasoner: Agentic Multimodal Reasoning with the Evolving Video World Model-Driven Harness

CoWorld Reasoner is an agentic framework that leverages a Video World Model (VWM) as a unified visual reasoning engine for Vision‑Language Models (VLMs). It exposes multiple visual operations through tools and skills, allowing the VLM to decide when to imagine, select an operation, generate visual content, and interpret the resulting evidence. The framework includes a VLM‑VWM Harness Co‑Evolution mechanism that jointly refines tools, skills, and execution code based on feedback, while keeping model weights fixed. Across seven benchmarks covering spatial, temporal, causal, and perceptual reasoning, CoWorld Reasoner outperforms direct VLM reasoning and improves accuracy on all benchmarks, achieving notable gains on MMSI and ERQA.

By Dongjie Cheng, Ruifeng Yuan, Ran Wei, Ning Song, Yongqi Li, Wenjie Li
arXiv AI
Sep 25

Mind What Matters for Reasoning: Aligning Cross-Modal Attention via Selective Probability Mass Concentration

The paper introduces Selective Probability Mass Concentration (sPMC), a training framework that strengthens implicit visual grounding in multimodal large language models by selectively regularizing attention heads most responsive to visual evidence. sPMC treats attention over visual tokens as a spatial probability distribution and encourages mass to concentrate on semantically relevant regions using segmentation-derived priors, while leaving other heads unconstrained. Across six multimodal benchmarks, sPMC yields an average zero‑shot improvement of 3% and gains up to 11.3% for various models by regularizing only 3%–15% of their attention heads.

By Jiaqi Deng, Zonghan Wu, Zhan Heng, Xiaoshui Huang, Huan Huo, Guandong Xu