arXiv Computer Vision
Oct 23

RECAP: Looking Once Is Not Enough for Vision-Language Reasoning

The paper introduces RECAP, a training method that enhances vision‑language models by incorporating temporally localized reactivation of image evidence—called visual revisit—into the reinforcement learning process. Visual revisit peaks are shown to predict correctness and causally improve performance; masking them hurts accuracy more than masking non‑peaks, while adding revisit peaks to failed reasoning partially restores correct answers. RECAP applies revisit‑conditioned advantage estimation, dynamic discounting, and gated value prediction to propagate final rewards through visually important reasoning steps, achieving significant gains on HallusionBench and other benchmarks without extra rewards or inference‑time changes.

By Zhaolu Kang, Tailong Luo, Chenxin Li, Yingjie He, Zhenyu Yu, Fengyu Zhou, Jiachen Qian, Lei Wei, Shuang Chen, Jiachen Li, Eric Hanchen Jiang, Rongchao Zhang, Zhengtao Yao, Hoi Leong Lee, Guansu Wang, Kaiyue Zhou
Hugging Face Trending Papers
Oct 27

VGIQA: Fine-Grained Image Quality Assessment with Visual Grounding Rewards

VGIQA is a new image quality assessment model that provides both local and global quality evaluations. It uses a two‑stage training process—starting with a cold‑start phase and then reinforcement learning guided by local quality reward functions. The model demonstrates superior performance on the newly introduced VGSR‑2K dataset, outperforming existing open‑source multi‑modal large language models such as Qwen2.5‑VL‑72B‑Instruct and Qwen3‑VL‑32B‑Instruct, and it also improves degradation perception tasks.

arXiv Computer Vision
Oct 16

Perception or Reasoning? Diagnosing and Tackling Reinforcement Learning Bottlenecks in VLMs

The paper introduces Perception and Reasoning Attribution (PARA), a method that quantifies how much of a vision‑language model’s errors can be fixed by better perception versus stronger reasoning. PARA reveals that reinforcement learning (RL) benefits more from improving reasoning than perception, and motivates a new group‑relative attention distillation objective called GRAD. GRAD directly guides weaker rollouts toward the visual attention patterns of the best rollouts, consistently boosting performance across multiple model scales and benchmarks.

By Zeyuan Yang, Zhuohao Chen, Jiaben Chen, Yao Zhang, Maohao Shen, Chuang Gan
arXiv Computer Vision
6d ago

VGIQA: Fine-Grained Image Quality Assessment with Visual Grounding Rewards

VGIQA is a new image quality assessment model that provides both local and global quality evaluations. It uses a two-stage training process—initial cold-start followed by reinforcement learning—with local quality reward functions. The model outperforms existing large multimodal language models on the newly introduced VGSR-2K dataset and improves performance on degradation perception tasks.

By Weichang Wang, Liyu Chen, Shuyue Guan, Jie Hu, Fei Gao, Wei Li, Nannan Wang