arXiv AI
Aug 12
Selective Prediction Reduces the Negative Effects of Automation Bias Overall but Increases False Negatives
arXiv:2508. 07617v2 Announce Type: replace-cross Abstract: AI has the potential to augment human decision making.
Position: Medical AI Neglects Real Treatment Outcomes
arXiv:2608. 14598v1 Announce Type: new Abstract: Medical AI has rapidly improved its ability to perform diagnostic and prognostic tasks that lead to treatment decisions.
Related stories
arXiv AI
Jun 30
An AI agent for treatment reasoning over a biomedical tool universe
arXiv:2606. 28692v1 Announce Type: new Abstract: Treatment reasoning underpins every therapeutic decision, integrating disease context, comorbidities, medications, contraindications, and evolving biomedical knowledge to select an appropriate therapy.
arXiv AI
Jun 17
First, do NOHARM: towards clinically safe large language models
arXiv:2512. 01241v3 Announce Type: replace-cross Abstract: Large language models (LLMs) are routinely used by physicians and patients for medical advice, yet their clinical safety profiles remain poorly characterized.
arXiv AI
Jul 15
First, do NOHARM: a medical safety benchmark and randomized study of physician and AI teaming on clinical consultations
arXiv:2512. 01241v4 Announce Type: replace-cross Abstract: Large language models (LLMs) and medical AI tools are routinely used by physicians and patients for medical advice, yet their clinical safety profiles remain poorly characterized.
arXiv AI
Jul 28
Principles and Guidelines for Randomized Controlled Trials in AI Evaluation
arXiv:2605. 02050v2 Announce Type: replace-cross Abstract: This work establishes a framework for standardizing AI evaluation RCTs (sometimes called human uplift studies).
arXiv AI
6d ago
Teaching agentic AI to learn expert reasoning for rare disease diagnosis
arXiv:2606. 16149v3 Announce Type: replace Abstract: Rare disease diagnosis depends on expert reasoning that is scarce and difficult to transfer; off-the-shelf large language models (LLMs) rank the correct disease first in only 35.
arXiv AI
Jul 22
Doctorina MedBench-ICD10: A Dialogue-Based Benchmark and Evaluation Framework for Agent-Based Medical AI
arXiv:2603. 25821v2 Announce Type: replace-cross Abstract: We present Doctorina MedBench, a comprehensive evaluation framework for agent-based medical AI based on the simulation of realistic physician-patient interactions.
arXiv AI
Jul 17
MedFailBench: A Clinician-Built Open-Source Benchmark for Medical AI Safety Boundary Inspection
arXiv:2607. 15166v1 Announce Type: new Abstract: Most medical AI benchmarks measure whether a model knows the correct answer.
arXiv AI
Jun 17
Treatment Response Optimized Clinical Decision Support AI System via Digital Twin Simulation
arXiv:2606. 17405v1 Announce Type: new Abstract: Clinical decision support AI systems (CDSASs) must adapt to evolving patient conditions in real-time while adhering to strict safety constraints.
arXiv AI
Jun 16
Medical world models: representing medical states, modelling clinical dynamics and guiding intervention policies
arXiv:2606. 16721v1 Announce Type: new Abstract: Medical diagnosis and treatment are dynamic processes in which patient states evolve over time and clinical interventions alter future outcomes.
arXiv AI
Jun 30
Expert Evaluation of Clinical AI Tools on Real Point-of-Care Clinical Queries
arXiv:2606. 28960v1 Announce Type: new Abstract: Physicians now pose millions of clinical questions to AI tools each week, yet these tools are evaluated largely on hypothetical or exam-style questions, not those actually asked in practice.
arXiv Machine Learning
Aug 11
Integrating RCTs, RWD, AI/ML and Statistics: Next-Generation Evidence Synthesis
arXiv:2511. 19735v2 Announce Type: replace-cross Abstract: Randomized controlled trials (RCTs)have been the cornerstone of clinical evidence; however, their cost, duration, and restrictive eligibility criteria limit power and external validity.