arXiv Computation and Language
Sep 4

MedQA-MM: Shortcuts Behind Medical Visual Reasoning

The paper introduces MedQA-MM, a benchmark that exposes shortcut reasoning in medical multimodal multiple-choice questions. By auditing prompts, images, and modalities, the authors show that models often rely on textual cues rather than visual evidence, with full-input accuracy at 62.63% but only 5.21% when restricted to text. The study highlights the need for route-level evidence to validate true medical image reasoning.

By Benlu Wang, Yifan Zhang, Jiaqing Yu, Chin Siang Ong, Juncheng Huang, Zhuohao Li, Zhenyu Zhang, Arman Cohan, Hong Yu, Zonghai Yao
arXiv AI
Sep 7

Constructing and Evaluating Clinical Reasoning Trajectories for Medical Agent

The paper introduces MedTraj, a framework that constructs, evaluates, and optimizes multi‑step reasoning trajectories for medical AI agents. It parses each trajectory into observations, evidence, numbered steps, and a conclusion, scoring them on coherence, evidence support, hallucination, completeness, and traceability. Experiments on CareQA, PubMedQA, and CECMed show that incorporating quality‑weighted trajectory context improves reasoning coherence and correctness while significantly reducing hallucinations.

By Yunqi Zhu, Wensheng Zhang, Xuebing Yang