arXiv AI

Key Coverage Matters: Semi-Structured Extraction of OCR Clinical Reports

The paper presents a method for extracting key information from OCR‑digitized clinical reports, addressing challenges posed by heterogeneous documents and noisy OCR output. It introduces an open key space that is iteratively mined, normalized, clustered, and verified to build a canonical key inventory, and defines key coverage as a metric for inventory completeness. Experiments on reports from over 20 hospitals using a 0.2B BERT model show that performance improves steadily with key coverage, achieving high F1 scores when the top 90 keys are covered and outperforming a fine‑tuned Qwen3‑0.6B baseline.

arXiv AI

Aug 20

MedStruct-S: A Benchmark for Key Discovery, Key-Conditioned QA and Semi-Structured Extraction from OCR Clinical Reports

MedStruct‑S is a benchmark for semi‑structured information extraction from OCR‑derived clinical reports, covering key discovery, key‑conditioned QA, and end‑to‑end key‑value extraction. It contains 3,582 annotated real‑world report pages and evaluates models under unknown keys and OCR noise. Experiments show encoder‑only models excel at non‑null key‑conditioned QA, while fine‑tuned decoder‑only models achieve the strongest overall performance across model sizes.

By Yingyun Li, Yu Wang, Haiyang Qian

computer-vision nlp fine-tuning benchmarks

arXiv AI

Jul 3

MedRepBench: A Comprehensive Benchmark for Medical Report Interpretation

arXiv:2508. 16674v2 Announce Type: replace-cross Abstract: Medical report understanding from real-world document images is essential for generating patient-facing explanations and enabling structured information exchange in clinical systems.

By Fangxin Shang, Yuan Xia, Dalu Yang, Yahui Wang, Binglin Yang

llms computer-vision multimodal benchmarks safety

arXiv AI

Jul 9

Health System Scale Semantic Search Across Unstructured Clinical Notes

arXiv:2604. 25605v2 Announce Type: replace-cross Abstract: Introduction: Semantic search, which retrieves documents based on conceptual similarity rather than keywords, offers advantages for retrieval of clinical information.

By Faith Wavinya Mutinda, Spandana Makeneni, Anna Lin, Shivaji Dutta, Irit R. Rasooly, Patrick Dibussolo, Shivani Kamath Belman, Hessam Shahriari, Kevin Murphy, Alex B. Ruan, Barbara H. Chaiyachati, Sanjay Chainani, Robert W. Grundmeier, Scott M. Haag, Jeffrey M. Miller, Heather M. Griffis, Ian M. Campbell

llms rag benchmarks

arXiv AI

Jun 12

EDEN: A Large-Scale Corpus of Clinical Notes for Italian

arXiv:2606. 12569v1 Announce Type: cross Abstract: We present EDEN (Emergency Department Electronic Notes), a new and unique large-scale corpus of clinical notes produced in Emergency Departments of Italian hospitals.

By Tiziano Labruna, Guido Bertolini, Pietro Ferrazzi, Bernardo Magnini

llms benchmarks

arXiv AI

Jul 13

Evaluating Retrieval-Augmented Generation vs. Long-Context Input for Clinical Reasoning over EHRs

arXiv:2508. 14817v2 Announce Type: replace-cross Abstract: Objective: To evaluate whether retrieval-augmented generation (RAG) can serve as an efficient alternative to long-context prompting for clinical reasoning over electronic health records (EHRs).

By Skatje Myers, Dmitriy Dligach, Timothy A. Miller, Samantha Barr, James Landefeld, Yanjun Gao, Matthew Churpek, Anoop Mayampurath, Majid Afshar

llms rag

arXiv AI

Jul 2

SHIELD: A Diverse Clinical Note Dataset and Distilled Small Language Models for Enterprise-Scale De-identification

arXiv:2605. 03301v2 Announce Type: replace-cross Abstract: De-identification of clinical text is a prerequisite for the secondary use of electronic health records.

By Jose D. Posada, David Love, Somalee Datta, Priya Desai

llms efficiency benchmarks

arXiv AI

Jul 3

eCream-MedCorpus A Large-Scale Corpus of Clinical Notes for Italian

arXiv:2606. 12569v2 Announce Type: replace-cross Abstract: We present eCream-MedCorpus, a new and unique large-scale dataset of clinical notes produced in Emergency Departments of Italian hospitals.

By Tiziano Labruna, Guido Bertolini, Pietro Ferrazzi, Bernardo Magnini

llms benchmarks

arXiv AI

Jul 8

eCREAM-MedCorpus A Large-Scale Corpus of Clinical Notes for Italian

arXiv:2606. 12569v3 Announce Type: replace-cross Abstract: We present eCREAM-MedCorpus, a new and unique large-scale dataset of clinical notes produced in Emergency Departments of Italian hospitals.

By Tiziano Labruna, Guido Bertolini, Pietro Ferrazzi, Bernardo Magnini

llms benchmarks

arXiv AI

Jun 11

Self-Prompting Small Language Models for Privacy-Sensitive Clinical Information Extraction

arXiv:2605. 04221v2 Announce Type: replace-cross Abstract: Clinical named entity recognition from dental progress notes is challenging because documentation is highly unstructured, domain-specific, and often privacy-sensitive.

By Yao-Shun Chuang, Tushti Mody, Uday Pratap Singh, Shirindokht Shiraz, Chun-Teh Lee, Ryan Brandon, Muhammad F Walji, Xiaoqian Jiang, Bunmi Tokede

llms nlp reinforcement-learning fine-tuning benchmarks safety

arXiv AI

Jul 22

M-RAG: Semantic Key-Value Indexing for Retrieval-Augmented Generation

arXiv:2603. 26667v2 Announce Type: replace-cross Abstract: Retrieval-augmented generation (RAG) turns external documents into evidence for large language models.

By Xu Sun, Tongkai Xu, Baiheng Xie, Li Huang, Qiang Gao, Kunpeng Zhang

llms rag

arXiv AI

Jun 30

MedCase-Structured: A Text-to-FHIR Dataset for Benchmarking Diagnostic Reasoning in Clinically Realistic EHR Settings

arXiv:2605. 30295v2 Announce Type: replace-cross Abstract: Large language models (LLMs) show promise for clinical reasoning and decision support, but evaluation in realistic, electronic health record-congruent settings remains limited.

By Valentina Bui Muti, Eug\'enie Dulout, Ziquan Fu

llms benchmarks

arXiv AI

Aug 25

Future Querying: Can LLMs Serve as Implicit Medical World Models?

arXiv:2608.23248v1 Announce Type: cross Abstract: Traditional clinical prediction models rely on task-specific pipelines and curated, structured data, which scale poorly and underutilize unstructured...

By Siri Willems, James Butterworth, Lore Goetschalckx, Peter Vrancx, Philippe Modard, Elke Giets, Ludovic Denoyer

llms fine-tuning safety

Related stories