arXiv AI By Wang Jingxin

From Reward Signal to Visual Utility: A Controlled Audit of Medical VLM Post-Training

Read the original on arXiv AI →

arXiv:2609. 31450v1 Announce Type: cross Abstract: Medical vision-language model (VLM) post-training is commonly evaluated through answer accuracy.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv Machine Learning
Oct 3

Same Reward, Different Skills: When Multimodal RL Learns to Look

The paper demonstrates that reinforcement learning with verifiable rewards (RLVR) can improve vision‑language benchmark performance even when models are trained without visual input. When real images are introduced at test time, models trained blind recover about half of the performance gain at 3B parameters and nearly four‑fifths at 7B, but extended real‑image training can erode grounding while benchmark gains persist. The authors propose a visual resolvability rule and show that requiring visual evidence for correct answers leads to significant improvements in target discovery and generalization to unseen question types, while controls confirm that the gains stem from actual visual grounding rather than artifacts.

By Haocun Ye, Xinlong Jiang, Qile Chen, Bingyu Wang, Teng Zhang, Shubai Chen, Tingyu Wu, Zhenkun Zheng, Yiqiang Chen
arXiv Computer Vision
Oct 19

When Evidence Vanishes: Distilling Visual-Evidence Dependency in Medical Vision-Language Models

The paper introduces Evidence-Conditioned Dependency Distillation (ECDD), a method that trains compact medical vision‑language models to rely on visual evidence by pairing each training image with a control matched to the evidence level and distilling the teacher’s drop in answer margin across the pair. ECDD preserves task accuracy while making answer support more sensitive to evidence removal, outperforming standard knowledge distillation and alignment baselines in three medical VQA settings. The approach applies to various evidence types, such as clinical regions, surgical instruments, or whole‑image content.

By Qizhen Lan, Yiling Ma, Ruiqi Chen, Mengchen Fan, Xi Xiao, Lin Zhao, Liang He, Baocheng Geng, Pulin Che, Tianyang Wang, Xiaoqian Jiang
arXiv AI
Oct 26

From Visual Affinity to Learning Credit in Multimodal Reinforcement Learning

The paper introduces Outcome-Conditioned Visual Credit (OVC), a plug‑in framework for multimodal reinforcement learning that separates visual association measurement from token‑level credit assignment. OVC uses Relative Visual Encoding to create a context‑relative visual coordinate and Outcome‑Conditioned Evidence Calibration to adjust token contributions based on outcome‑discriminative evidence. When applied to GSPO-token, OVC improves mean accuracy by 1.86–2.39 percentage points across six benchmarks without requiring additional reward models or inference‑time modules.

By Yuhang Han, Dingning Liu, Yujie Chen, Yaojie Zhang, Jingwei Song, Zequn Yang, Xuanming Shang, Li Ding, Zhijiang Guo, Linfeng Zhang
arXiv Computation and Language
Sep 4

Attend to Evidence: Evidence-Anchored Spatial Attention Supervision for Multimodal RLVR

The paper introduces EASE, a method that enhances multimodal reinforcement learning with verifiable rewards (RLVR) by adding visual‑evidence process supervision. EASE transforms annotated evidence regions into smoothed visual‑token targets and uses them to guide attention during RL training, but only on high‑reward trajectories. Experiments on Qwen2.5‑VL‑7B, Qwen3‑VL‑4B, and Qwen3‑VL‑8B show that EASE improves average scores over DAPO by 2.5 to 3.1 points across perception, hallucination, visual math, and multimodal reasoning benchmarks, and diagnostics confirm better alignment of visual attention with annotated evidence.

By Ruina Hu, Chen Wang, Lai Wei, Jionghao Bai, Bin Yu, Weiran Huang, Kai Wang, Yue Wang