Medical multimodal reasoning models are typically trained on teacher-generated rationales, discarding the valid reasoning in students' own failed trajectories, while general-domain correction methods...
arXiv:2603.10359v2 Announce Type: replace
Abstract: Distilling reasoning capabilities from Large Reasoning Models (LRMs) into smaller models is typically constrained by the limitations of rejection s...
By Wenjing Zhang, Jiangze Yan, Jieyun Huang, Yi Shen, Shuming Shi, Ping Chen, Ning Wang, Zhaoxiang Liu, Kai Wang, Shiguo Lian
arXiv:2610.16713v1 Announce Type: cross
Abstract: Teacher rationales can help a smaller model answer health professions questions, but they can also reinforce errors. We examined when they help and h...
By Tiago Martinelli, Jo\~ao Paulo Papa, Adriano Jos\'e Pereira
arXiv:2610.03515v1 Announce Type: new
Abstract: On-policy self-distillation (OPSD) uses reference solutions as privileged hindsight to supervise student-generated reasoning trajectories. However, ref...
By Chenglei Shen, Haoyang Yao, Weijie Yu, Song Jin, Xiao Zhang, Jun Xu
The paper introduces MedQA-MM, a benchmark that exposes shortcut reasoning in medical multimodal multiple-choice questions. By auditing prompts, images, and modalities, the authors show that models often rely on textual cues rather than visual evidence, with full-input accuracy at 62.63% but only 5.21% when restricted to text. The study highlights the need for route-level evidence to validate true medical image reasoning.
By Benlu Wang, Yifan Zhang, Jiaqing Yu, Chin Siang Ong, Juncheng Huang, Zhuohao Li, Zhenyu Zhang, Arman Cohan, Hong Yu, Zonghai Yao
The paper introduces MedTraj, a framework that constructs, evaluates, and optimizes multi‑step reasoning trajectories for medical AI agents. It parses each trajectory into observations, evidence, numbered steps, and a conclusion, scoring them on coherence, evidence support, hallucination, completeness, and traceability. Experiments on CareQA, PubMedQA, and CECMed show that incorporating quality‑weighted trajectory context improves reasoning coherence and correctness while significantly reducing hallucinations.
By Yunqi Zhu, Wensheng Zhang, Xuebing Yang
arXiv:2606. 31825v1 Announce Type: cross Abstract: Recent multimodal large language models have shown great promise in clinical image reasoning, but existing post-training pipelines remain predominantly outcome-centric, relying on final answer correctness or sequence-level preferences.
By Junha Jung, Minbyul Jeong, Suhyeon Lim, Sungwook Jung, Jaehoon Yun, Taeyun Roh, Mujeen Sung, Jaewoo Kang
arXiv:2610.15239v1 Announce Type: new
Abstract: Most benchmarks for large language models in medicine are built from licensing examinations and theoretical questions. The few that draw on real clinic...
By Anurag Sharma, Aditya Sharma, Sapna Baalwan
arXiv:2610.03176v1 Announce Type: new
Abstract: We study hindsight-guided distillation for rare disease diagnosis on ZebraMap: a 1.5B student is fine-tuned on chain-of-thought traces from a 8B teache...
By Aarav Singh, Animesh Pathak, Navyansh Singh
arXiv:2606. 12169v1 Announce Type: cross Abstract: High-stakes clinical use of large vision-language models (LVLMs) requires reasoning that is grounded in visual evidence and clinical knowledge, not just correct final answers.
By Negin Baghbanzadeh, Pritam Sarkar, Michael Colacci, Abeer Badawi, Adibvafa Fallahpour, Arash Afkanpour, Leonid Sigal, Ali Etemad, Elham Dolatabadi
arXiv:2607. 24838v1 Announce Type: cross Abstract: In medical multiple-choice question answering (MCQA), Retrieval-Augmented Generation (RAG) can supplement the domain knowledge of language models (LMs).
By Seongwon Seo, Seung Hwan Cho, Young-Min Kim
arXiv:2603. 24481v2 Announce Type: replace Abstract: Miscalibrated confidence scores are a practical obstacle to deploying AI in clinical settings.
By John Ray B. Martinez