arXiv:2603. 25821v3 Announce Type: replace-cross Abstract: We present Doctorina MedBench, an evaluation framework for agent-based medical AI based on the simulation of physician-patient interactions.
By Anna Kozlova, Stanislau Salavei, Pavel Satalkin, Hanna Plotnitskaya, Sergey Parfenyuk, Andy Nkansah
arXiv:2610.34878v1 Announce Type: new
Abstract: Disease diagnosis is a key application of large language model (LLM) agents in healthcare. However, existing medical agents are primarily trained and e...
By Sirry Chen, Fangke Chen, Xuanwen Ding, Wei Chen, Zhongyu Wei
The paper introduces a retrieval‑augmented multi‑agent framework that automatically generates instance‑specific evaluation rubrics for medical language models. By retrieving authoritative medical evidence, decomposing it into atomic facts, and combining these with user interaction constraints, the system produces fine‑grained criteria that outperform GPT‑4o on HealthBench and LLMEval‑Med. The generated rubrics also guide response refinement, improving medical LLM output quality by 9.2%.
By Yinzhu Chen, Abdine Maiga, Hossein A. Rahmani, Emine Yilmaz
arXiv:2606. 29746v1 Announce Type: new Abstract: Navigating the deluge of heterogeneous medical data, from academic literature (PubMed) to clinical guidelines (Web) and private knowledge bases, remains a critical bottleneck for evidence-based medicine.
By Maolin Liu, Fanyu Xu, Ruoqing Xu, Jiahang Zhang, Hao Wang, Rui Wang
MedResearcher‑R1 is a medical deep‑research agent that uses a Knowledge‑Informed Trajectory Synthesis (KISA) framework to build medical knowledge graphs and generate complex multi‑hop question‑answer pairs, especially for rare medical entities. It also incorporates a medical retrieval engine and general‑purpose tools to reliably synthesize medical evidence. The resulting 2,100+ trajectories across 12 specialties enable supervised fine‑tuning and reinforcement learning, producing a 32B model that outperforms larger proprietary systems on MedBrowseComp and shows strong performance on GAIA and xBench benchmarks.
By Ailing Yu, HaoYang Hong, Lan Yao, Jingnan Liu, Zhe Chen, Jiajun Yin, Yuan Wang, Xinhao Liao, Zhiling Ye, Ji Li, Yun Yue, Hansong Xiao, Hualei Zhou, Chunxiao Guo, Peng Wei, Junwei Liu, Jinjie Gu
arXiv:2509. 02594v3 Announce Type: replace-cross Abstract: Evaluating large language models (LLMs) on their ability to generate high-quality, accurate, situationally aware answers to clinical questions requires going beyond conventional benchmarks to assess how these systems behave in complex, high-stakes clinical scenarios.
By Sandhanakrishnan Ravichandran, Shivesh Kumar, Rogerio Corga Da Silva, Miguel Romano, Reinhard Berkels, Michiel van der Heijden, Olivier Fail, Valentine Emmanuel Gnanapragasam