arXiv AI
Standardizing Longitudinal Radiology Report Evaluation via Large Language Model Annotation
Read the original on arXiv AI →The Flow has not summarised this story yet — read it at arXiv AI.
Related stories
arXiv Computation and Language
1d ago
Improving Health Literacy through Lay Summarization of Radiological Reports: An Evaluation of BioNER and Retrieval-Augmented Generation
The paper examines how Retrieval-Augmented Generation (RAG) and Named Entity Recognition (NER) affect the quality of lay summaries of radiology reports. Using a framework that extracts clinically relevant findings via NER and grounds them with RAG, the authors evaluate few‑shot and fine‑tuned versions of Qwen and BioBART. Results show that NER consistently improves readability and overall quality, RAG alone offers no benefit and can introduce hallucinations, and the best performance comes from fine‑tuned BioBART with NER.
arXiv AI
Jul 8
Harrison.Rad 1.5 Technical Report: A radiology foundation model that can draft reports from images, priors and clinical context
arXiv:2607. 05880v1 Announce Type: cross Abstract: Imaging demand is growing faster than the radiology workforce can expand, and reporting backlogs cannot be resolved through training and recruitment alone.
arXiv Computation and Language
Aug 27
MTDiag: A Multi-Turn Diagnostic Dataset Towards Clinically Meaningful LLM Evaluation
MTDiag is a newly released multi-turn diagnostic dialogue dataset designed to evaluate large language models (LLMs) in clinically meaningful ways. It is built from DDXPlus, MIMIC-IV, and AJCR case reports, covering both common emergency department presentations and rare conditions, and normalizes cases into a canonical schema using UMLS concept identifiers and ICD-10 codes. The dataset includes a UserLM‑8B utterance‑generation pipeline and physician‑validated natural‑language utterances, and introduces clinical knowledge‑grounded metrics that go beyond simple diagnostic accuracy for multi‑turn differential diagnosis tasks.
arXiv AI
Aug 24
ASTAR: Automated induction of STAndardized radiology Reporting templates from large-scale clinical free-text corpora
ASTAR is an LLM-based framework that automatically generates standardized radiology reporting templates from large-scale clinical free-text corpora, eliminating the manual, expert-driven template construction process. In experiments on 4,215 fetal brain MRI reports from multiple centers, ASTAR‑induced templates outperformed two expert‑curated templates in template coverage, information fidelity, diagnostic fidelity, and expert‑rated usability. The approach reduces template development time from weeks of committee deliberation to hours of automated processing.
arXiv AI
Jul 3
MedRepBench: A Comprehensive Benchmark for Medical Report Interpretation
arXiv:2508. 16674v2 Announce Type: replace-cross Abstract: Medical report understanding from real-world document images is essential for generating patient-facing explanations and enabling structured information exchange in clinical systems.
arXiv Computer Vision
2d ago
RadMatch: Auditable Radiology Report Evaluation via Finding-Level Matching
arXiv:2609.01470v1 Announce Type: new Abstract: As AI systems are increasingly used to draft radiology reports, reliably evaluating their clinical quality remains a critical challenge. Large language...