arXiv AI August 18, 2026 By Yakun Zhu, Zhongzhen Huang, Linjie Mu, Yutong Huang, Wei Nie, Jiaji Liu, Shaoting Zhang, Pengfei Liu, Xiaofan Zhang

DiagnosisArena: Benchmarking Diagnostic Reasoning for Large Language Models

Read the original on arXiv AI →

arXiv:2505. 14107v5 Announce Type: replace-cross Abstract: The emergence of groundbreaking large language models capable of performing complex reasoning tasks holds significant promise for addressing various scientific challenges, including those arising in complex clinical scenarios.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv AI

Aug 25

ClinicalGPT-R1: Pushing reasoning capability of generalist disease diagnosis with large language model

ClinicalGPT‑R1 is a reasoning‑enhanced generalist large language model designed for disease diagnosis. It was trained on 20,000 real‑world clinical records and uses diverse training strategies to improve diagnostic reasoning. In benchmarks, it outperforms GPT‑4o on Chinese diagnostic tasks and matches GPT‑4 performance in English, demonstrating superior disease‑diagnosis capabilities.

By Wuyang Lan, Wenzheng Wang, Changwei Ji, Guoxing Yang, Yongbo Zhang, Xiaohong Liu, Luonan Chen, Shengge Li, Song Wu, Guangyu Wang

llms benchmarks

arXiv Computer Vision

Aug 25

Sparse Multi-Stage Expert-Agent Routing for Complex Clinical Reasoning

arXiv:2608.21948v1 Announce Type: new Abstract: Complex clinical reasoning requires models to update diagnostic hypotheses as new evidence emerges and to coordinate different medical specialities und...

By Sike Xiang, Shuang Chen, Qian sun, Jia Cheng, Yusi Wei, Amir Atapour-Abarghouei

llms agents

arXiv AI

Sep 1

SUP-MIMIC: A Multi-Task Clinical Diagnosis Benchmark for Evaluating LLMs' Robustness to Contradictory Evidence

arXiv:2608.29582v1 Announce Type: cross Abstract: Current evaluations of large language models (LLMs) primarily focus on factual knowledge retrieval, overlooking the fundamental challenge of navigati...

By Yi Yu, Bo Wang, Chong Feng, Ge Shi, Xia Liu, Ziyi Yang, Xuewen Shi

llms benchmarks safety

arXiv AI

Jul 10

Aligning Clinical Needs and AI Capabilities: A Survey on LLMs for Medical Reasoning

arXiv:2607. 07761v1 Announce Type: new Abstract: Large language models (LLMs) have emerged as important tools in healthcare, showing growing potential for clinical reasoning and patient care.

By Qi Peng, Jiatong Li, Sirui Huang, Yiyang Jiang, Kaisong Gong, Ronger Ding, Shijie Ye, Changmeng Zheng, Yi Cai, Xiaobo Yang, Jin Huang, Xiao-Yong Wei, Qing Li

llms benchmarks safety

arXiv AI

Jun 24

A specialized reasoning large language model for accelerating rare disease diagnosis: a randomized AI physician assistance trial

arXiv:2606. 24510v1 Announce Type: new Abstract: Rare diseases affect millions of individuals worldwide, yet timely diagnosis remains a major public health challenge due to scarcity of specialized clinical expertise.

By Haichao Chen, Songchi Zhou, Zhengyun Zhao, Shikai Hu, Xianghong Jin, Hongwei Ji, Li He, Shuli Li, Yiming Qin, Xin Tan, Runfeng Shi, Yih Chung Tham, Jiaye Zhu, Ye Li, Ye Jin, Longhao Cao, Dawei Li, Honghan Wu, Hongqiu Gu, Guanqiao Li, Tudor Groza, Chunying Li, Dian Zeng, Weihong Yu, Gareth Baynam, Saumya Shekhar Jamuar, Min Shen, Shuyang Zhang, Bin Sheng, Sheng Yu, Tien Yin Wong

llms benchmarks

arXiv AI

Jun 16

LiteOdyssey: A Lightweight Reasoning AI Agent for Interpretable Rare-Disease Diagnosis

arXiv:2606. 16149v1 Announce Type: new Abstract: Most medical AI systems improve by scaling additional machinery: more fine-tuning data, more agents, and/or larger retrieval databases.

By Minh-Ha Nguyen, Erica Gray, Chih-Ting Yang, Rizwan Hamid, Lingyao Li, Siyuan Ma, Thomas A. Cassini, Cathy Shyr

llms agents fine-tuning benchmarks

One email a morning, machine-written

Related stories

ClinicalGPT-R1: Pushing reasoning capability of generalist disease diagnosis with large language model

Sparse Multi-Stage Expert-Agent Routing for Complex Clinical Reasoning

SUP-MIMIC: A Multi-Task Clinical Diagnosis Benchmark for Evaluating LLMs' Robustness to Contradictory Evidence

Aligning Clinical Needs and AI Capabilities: A Survey on LLMs for Medical Reasoning

A specialized reasoning large language model for accelerating rare disease diagnosis: a randomized AI physician assistance trial

LiteOdyssey: A Lightweight Reasoning AI Agent for Interpretable Rare-Disease Diagnosis