arXiv Computation and Language

CT-$\Delta$Bench: A Benchmark for Longitudinal 3D Medical Imaging Difference Reporting with Vision-Language Models

CT‑ΔBench is a new benchmark designed to evaluate vision‑language models on longitudinal 3D medical imaging difference reporting. It provides patient‑level split data, change‑aware metrics, and physician‑validated references to assess clinically meaningful interval changes between two CT scans. The paper also introduces DeltaMed, a baseline model that directly reasons over paired CT scans, and compares it to an indirect two‑stage approach that first generates single‑timepoint reports before differencing.

arXiv Machine Learning
Oct 23

Diagnostic Loss: Asymmetric Supervision for Radiology Report Generation

The paper introduces Diagnostic Loss (DLoss), an objective designed to align radiology report generation with the asymmetric requirement of accurately stating supported diagnoses while avoiding unsupported ones. DLoss operates on decoder token probabilities, aggregating mass over vocabularies for supported and unsupported diagnoses and applying asymmetric pooling to encourage correct diagnoses and suppress spurious ones. Applied to various 3D MedVLMs on 50,000 abdominal CT scans, DLoss improves diagnostic faithfulness without compromising conventional language‑generation metrics.

By Ignacy Kolton, Wenxuan Li, Zongwei Zhou, Jaros{\l}aw B. \'Cwik{\l}a, Arkadiusz Sitek, Pedro R. A. S. Bassi, Szymon P{\l}otka
arXiv AI
Jul 13

Evaluating Retrieval-Augmented Generation vs. Long-Context Input for Clinical Reasoning over EHRs

arXiv:2508. 14817v2 Announce Type: replace-cross Abstract: Objective: To evaluate whether retrieval-augmented generation (RAG) can serve as an efficient alternative to long-context prompting for clinical reasoning over electronic health records (EHRs).

By Skatje Myers, Dmitriy Dligach, Timothy A. Miller, Samantha Barr, James Landefeld, Yanjun Gao, Matthew Churpek, Anoop Mayampurath, Majid Afshar
arXiv Machine Learning
Jun 5

A Vision-language Framework for Comparative Reasoning in Radiology

arXiv:2606. 06407v1 Announce Type: cross Abstract: Medical imaging artificial intelligence has achieved strong performance in isolated image interpretation, but remains poorly aligned with radiological practice, where diagnosis and follow-up rely on comparison across prior studies and analogous reference cases.

By Tengfei Zhang, Ziheng Zhao, Lisong Dai, Xiaoman Zhang, Pengcheng Qiu, Ya Zhang, Yanfeng Wang, Weidi Xie
arXiv AI
Oct 15

Toward Guarantees for Clinical Reasoning in Vision Language Models via Formal Verification

The paper introduces a neurosymbolic verification framework that audits the internal consistency of vision-language models (VLMs) when generating radiology reports. By autoformalizing free‑text findings into structured propositional evidence and using an SMT solver (Z3) alongside a clinical knowledge base, the system determines whether each diagnostic claim is entailed, hallucinated, or omitted. Evaluation on seven VLMs across five chest X‑ray benchmarks reveals distinct reasoning failure modes—such as conservative observation and stochastic hallucination—that traditional metrics miss, and shows that enforcing solver‑backed entailment can eliminate unsupported hallucinations and improve diagnostic soundness and precision.

By Vikash Singh, Debargha Ganguly, Haotian Yu, Chengwei Zhou, Prerna Singh, Brandon Lee, Vipin Chaudhary, Gourav Datta
arXiv Machine Learning
Jul 20

LLM4EHR: Aligning Clinical Time Series with Medical Event Sequences via Large Language Models

arXiv:2607. 15447v1 Announce Type: new Abstract: Recent research in clinical machine learning, focusing on outcome predictions in intensive care unit (ICU), has shifted from bespoke supervised models to foundation models, utilising modern representation learning methods.

By Jingteng Li, Alexander Capstick, Louise Rigny, Iona Biggart, Neil J Sebire, Payam Barnaghi