arXiv Computation and Language

Perturbation-Based Data Selection for Medical Question Answering

arXiv Computation and Language
Sep 30

TriageRA-CCF: Source-Side Clinical Confidence and Coverage Signals for Adaptive Rank Budgeting in Medical LLMs

The paper introduces TriageRA-CCF, a method for adaptively allocating low‑rank LoRA channels in medical large language models based on source‑side signals: answer confidence, clinical coverage, and a counterfactual close‑miss proxy. By supervising a budget router that selects among 2, 4, or 8 active ranks, the approach improves average accuracy over existing LoRA variants on Qwen3‑8B and Llama3.1‑8B, though gains vary across benchmarks. Ablation studies confirm that each signal contributes to better budget decisions, though their combined effect is not uniformly superior across all backbones.

By Shucan Ji, Yining Huang, Hongliang Guo
arXiv AI
Jun 16

EHRNote-ChatQA: A Benchmark for Evidence-Grounded Multi-Turn Clinical Question Answering over Longitudinal Discharge Summaries

arXiv:2606. 15735v1 Announce Type: cross Abstract: Discharge summaries are crucial clinical documents containing the context of a patient's overall hospital stay, and are routinely reviewed by medical experts for patient readmission, ongoing care, and diagnostic decision-making.

By Jiyoun Kim, Muhan Yeo, Eunhye Jang, Jeewon Yang, Hangyul Yoon, Su Ji Lee, Hee Jo Han, Hee-Jae Jung, Doyun Kwon, Jun young Lee, Jaehun Lee, Jung-Oh Lee, Sunjun Kweon, Jong Hak Moon, Daseul Kim, Minjae Cho, Edward Choi
arXiv AI
Oct 21

A general-purpose System One decision model for clinical records

The paper introduces Clinical System One (CS1), a 4‑billion‑parameter decision model that rapidly produces typed judgments from clinical records. Trained on 12.4 million Q&A pairs from 3.6 million patients, CS1 can answer multiple questions in a single forward pass, providing probability estimates for uncertain cases. In evaluations on 963,408 held‑out patients and 21 external datasets, CS1 outperformed larger open models and, when paired with a language‑model agent, efficiently identified trial‑eligible patients with far fewer tokens.

By Andrew Zhang, Trinh T. L. Vuong, Sophia J. Wagner, Dongmin Bang, Tong Ding, Yuchang Su, Mary Cipperman, Christina S. Chen, Judith Lefkes, Ramin Kahidi, Ming Y. Lu, Caiwei Tian, Tianhao Luo, Jingnan Ma, Rowland Pettit, Long Phi Le, Faisal Mahmood
arXiv AI
Aug 20

MedStruct-S: A Benchmark for Key Discovery, Key-Conditioned QA and Semi-Structured Extraction from OCR Clinical Reports

MedStruct‑S is a benchmark for semi‑structured information extraction from OCR‑derived clinical reports, covering key discovery, key‑conditioned QA, and end‑to‑end key‑value extraction. It contains 3,582 annotated real‑world report pages and evaluates models under unknown keys and OCR noise. Experiments show encoder‑only models excel at non‑null key‑conditioned QA, while fine‑tuned decoder‑only models achieve the strongest overall performance across model sizes.

By Yingyun Li, Yu Wang, Haiyang Qian
arXiv AI
Oct 5

From Retrieval to Typed Decisions: Calibrated System One Models from Biomedical Sentence Encoders

The paper introduces SBERT2S1, a method that transforms Sentence-Transformers encoders into typed decision models for biomedical text, and presents BIODECIDE, a suite for evaluating such models, along with MEDLINE‑S1, a large training set of 243k decisions derived from NLM indexing. Experiments show that retrieval‑trained encoders improve zero‑shot matching of content‑bearing options, and that a prior‑fused residual (PFR) head benefits most from retrieval pre‑training, while a cross‑head (C) head generally outperforms PFR across all objectives. The authors also release code, data, and a model, and discuss calibration and reward‑normalisation effects in their RLCD recipe.

By Pritam Deka