arXiv:2608. 03731v1 Announce Type: new Abstract: Patient-facing medical LLMs and agents increasingly answer symptom questions before clinician contact, where the key safety question is what action the user should take next.
arXiv:2609.14823v1 Announce Type: new Abstract: Multimodal clinical decision-making requires reliable reasoning over heterogeneous evidence from electronic health records, medical images, and physiol...
arXiv:2609.00296v1 Announce Type: new Abstract: Large language model (LLM) agents are increasingly proposed for healthcare tasks such as clinical documentation, evidence retrieval, patient messaging,...
The paper introduces a benchmark of 400 synthetic healthcare workflow episodes to evaluate large language model (LLM) agents’ reliability in escalating care when evidence is missing or conflicting. It finds that while clean decision accuracy is high (0.97), models miss a large proportion of necessary escalations (32–97%) under uncertainty, and even the largest 9.7B model’s performance drops to 0.78 in conflict scenarios. A workflow-aware controller improves utility and reduces missed escalations, but its effectiveness is limited by lexical generalization failures.
TRACER is a training‑free multimodal harness that builds minute‑level action records from continuous video and merges them with clinical data into hourly reports, enabling an LLM agent to query and inspect both modalities. In evaluation, TRACER achieved up to 84.8% accuracy on action detection and 61.0% accuracy on clinician‑informed QA, outperforming the strongest baseline. Across 280 patients and ~60,000 camera‑hours, TRACER detected significantly less purposeful activity in patients with a positive delirium assessment compared to those without (p < 0.0001).
arXiv:2607. 09142v1 Announce Type: new Abstract: Large language models (LLMs) are increasingly deployed in online medical consultation, yet existing benchmarks remain poorly aligned with real clinical practice.
arXiv:2608. 20331v1 Announce Type: cross Abstract: Personalized interpretation of medical reports has emerged as an increasingly important need among patients.
The paper introduces Clinical Intent Extraction (CIE), a task that transforms fragmented clinical action annotations into complete structured records called Clinical Intent Representation (CIR). CIR decomposes each action into verb, type, coded target, timing, condition, request‑intent (aligned to HL7 FHIR) and modality, adding dimensions absent in prior datasets. By re‑expressing five heterogeneous corpora into CIR, the authors create CIRCA, a benchmark of 10,011 harmonized intents with human‑validated subsets, crosswalks, and a deterministic FHIR R4 mapper, and demonstrate that existing models perform poorly on the full task, highlighting the need for targeted development.
MedBenchAgent is a multi‑agent framework that automates the entire process of constructing medical vision‑language model benchmarks, from deriving the benchmark specification to generating and auditing evaluation items. It uses a Benchmark Intermediate Representation (BIR) to encode task definitions, evidence mappings, evaluation protocols, and item specifications, separating planning from instantiation. The system achieves a Task‑Space F1 of 90.9% and demonstrates high audit pass rates, outperforming existing task induction methods and showing portability across specialized medical domains.
arXiv:2606. 20164v1 Announce Type: cross Abstract: Real-world clinical decision support requires reasoning over heterogeneous and longitudinal patient information rather than answering isolated medical questions.
arXiv:2610.16175v1 Announce Type: new Abstract: Real-world studies (RWS) analyze routinely collected healthcare data, such as electronic health records and insurance claims, to estimate treatment eff...
arXiv:2508. 16674v2 Announce Type: replace-cross Abstract: Medical report understanding from real-world document images is essential for generating patient-facing explanations and enabling structured information exchange in clinical systems.