The article reviews existing tools for assessing clinical reasoning in large language models, identifying six key dimensions—problem representation, temporal synthesis, differential and management reasoning, counterfactual reasoning, calibrated uncertainty, and reasoning faithfulness. It finds that no single instrument covers all dimensions, with some aspects reasonably addressed while others, especially faithfulness and counterfactual reasoning, remain weakly evaluated. The authors propose combining current tools through binary rubric items, separate completeness and correctness scores, importance weighting, safety caps, temporal consistency checks, and chance‑corrected reliability reporting, and call for further design work on uncertainty, counterfactual reasoning, and faithfulness in longitudinal free‑text contexts.
By Zhangshu Joshua Jiang, Zina Ibrahim, James T. Teo
The paper presents a method for reconstructing clinical timelines by extracting structured evidence for narrative events and jointly revising their estimated times, while preserving unique identifiers linked to source spans. It introduces GAVEL, a large language model judge that verifies disagreements between timelines against notes and structured records, citing evidence for its decisions. Evaluation on clinician-annotated discharge summaries shows that adding structured evidence improves timestamp agreement for some models, and GAVEL consistently favors multimodal timelines over text-only ones.
By Sayantan Kumar, Nicolas Grimaldi, Jack Cummins, Jeremy C. Weiss
arXiv:2606. 09030v1 Announce Type: cross Abstract: Clinical early warning systems built on electronic health records, in which clinical observations are recorded as irregularly sampled medical time series (ISMTS), must deliver both calibrated risk scores for patient triage and interpretable rationales that clinicians can verify.
By Hyeongwon Jang, Gyouk Chu, Changhun Kim, Joonhyung Park, Hangyul Yoon, Eunho Yang
arXiv:2610.00562v1 Announce Type: cross
Abstract: Longitudinal clinical reasoning requires large language models (LLMs) to identify and integrate relevant evidence distributed across extended patient...
By Taye Akinrele, Noorbakhsh Amiri Golilarz, Subash Neupane, Sudip Mittal, Shahram Rahimi
Understanding the temporal progression of symptoms in clinical narratives is critical for disease monitoring, safety surveillance, and causality assessment. Clinical narratives, however, rarely provide explicit temporal anchors.
arXiv:2605.20292v2 Announce Type: replace
Abstract: Numerical time-series models effectively process irregular electronic health record (EHR) trajectories, but do not expose which temporal patterns s...
By Kwanhyung Lee, Juhwan Choi, Jongheon Kim, Joohyung Lee, Hyeongwon Jang, Jeonguk Lee, Jisoo Jung, Eunho Yang