arXiv Computer Vision
4d ago

Perception or Reasoning? Diagnosing and Tackling Reinforcement Learning Bottlenecks in VLMs

The paper introduces Perception and Reasoning Attribution (PARA), a method that quantifies how much of a vision‑language model’s errors can be fixed by better perception versus stronger reasoning. PARA reveals that reinforcement learning (RL) benefits more from improving reasoning than perception, and motivates a new group‑relative attention distillation objective called GRAD. GRAD directly guides weaker rollouts toward the visual attention patterns of the best rollouts, consistently boosting performance across multiple model scales and benchmarks.

By Zeyuan Yang, Zhuohao Chen, Jiaben Chen, Yao Zhang, Maohao Shen, Chuang Gan
arXiv Computer Vision
Oct 9

SPLIT-RL: Staged Perception-Language Reasoning Training with Claim-Level Advantages

SPLIT-RL introduces a staged post‑training method that separates visual reasoning (VR) and language reasoning (LR) into distinct phases, allowing each phase to be optimized with a phase‑specific reward. The approach includes Claim‑Level Advantage (CLA‑GRPO), which breaks VR rollouts into atomic visual claims and assigns fine‑grained advantages based on visual‑type group formation. Experiments on Qwen3‑VL and InternVL models show that SPLIT‑RL improves average accuracy by 1.4–6.1 points over GRPO and enhances both VR and LR capabilities.

By Raja Kumar, Rajat Koner, Ritwick Chaudhry, Zhuowei Li, Nishant Sankaran, Yifan Xing
arXiv AI
Oct 9

VICO: Visual Environments Co-Evolving for Vision-Language Model Reasoning

VICO proposes a co‑evolutionary framework where a vision‑language model (actor) and an Environment‑as‑Rewriter (EnvRewriter) are trained together. The EnvRewriter edits visual structures—such as scene graphs, chart tables, or protected region masks—to generate new training samples whose difficulty is calibrated to the actor’s current performance via a pass‑rate reward. Across nine multimodal benchmarks, VICO‑8B outperforms its base model by up to +5.0 % on out‑of‑domain tasks and surpasses other co‑evolution baselines while requiring far fewer labeled samples.

By Meng Lu, Ligeng Zhu, Olivia Xiao, Yuchen Zhuang, Zihan Wang, Kuncheng Wu, Bangya Liu, Yu Wang, Charles Fleming, Wenqi Shi, Xuan Wang
Hugging Face Trending Papers
Jul 15

SD-MAR: Multi-image Analytical Reasoning via Synthetic Data and Reinforcement Learning

Vision Language Models (VLMs) demonstrate strong perceptual abilities but remain limited in tasks requiring analytical reasoning across multiple visual states, such as multi-image comparison, change detection, and multi-step visual inference. These capabilities are critical for real-world multimodal applications where reasoning must be grounded in systematic differences between visual contexts.