arXiv AI

EHRAdapt: Adapting Pretrained Language Models to Electronic Health Records with Semantic Priors for Rare Clinical Events

EHRAdapt is an adapter that maps electronic health record tuples directly into a frozen language model’s embedding space, using learned embeddings for modality, time gaps, and dedicated vectors for event codes. It represents each event vector as a sum of a frozen, ontology‑trained semantic prior and a low‑rank evidence residual, enabling robust learning even for rare clinical events. Experiments on four million patient records with three large language model backbones show that the full adapter outperforms all ablations in next‑event prediction and improves rare‑disease discrimination in classification tasks.

arXiv AI
Jun 30

Primary ICD Category Prediction using LLM-based Probing

arXiv:2606. 28798v1 Announce Type: new Abstract: Objective: ICD codes are central to reimbursement, research, and population health surveillance, yet automated coding systems often struggle to integrate diagnostic signals from both clinical narratives and structured electronic health record (EHR) variables.

By Chengyuan Liu, Xinyue Zhang, Yao Li, Guanting Chen
arXiv Machine Learning
Jul 20

LLM4EHR: Aligning Clinical Time Series with Medical Event Sequences via Large Language Models

arXiv:2607. 15447v1 Announce Type: new Abstract: Recent research in clinical machine learning, focusing on outcome predictions in intensive care unit (ICU), has shifted from bespoke supervised models to foundation models, utilising modern representation learning methods.

By Jingteng Li, Alexander Capstick, Louise Rigny, Iona Biggart, Neil J Sebire, Payam Barnaghi
arXiv Machine Learning
Jun 24

PORTER: Language-Grounded Event Representations for Portable Structured EHR Foundation Models

arXiv:2606. 24102v1 Announce Type: cross Abstract: Most electronic health record (EHR) foundation models encode clinical events as discrete event tokens from a fixed vocabulary and therefore cannot directly represent events containing unseen concepts or new combinations of concepts and attributes such as numeric values.

By Lin Lawrence Guo, Adam Paul Yan, Emily Vettese, Lillian Sung
arXiv Machine Learning
Jun 8

One Loss to Rule Them All: Marked Time-to-Event for Structured EHR Foundation Models

arXiv:2602. 00541v2 Announce Type: replace Abstract: Clinical events captured in Electronic Health Records (EHR) are irregularly sampled and may consist of a mixture of discrete events and numerical measurements, such as laboratory values or treatment dosages.

By Zilin Jing, Vincent Jeanselme, Yuta Kobayashi, Simon A. Lee, Chao Pang, Aparajita Kashyap, Yanwei Li, Xinzhuo Jiang, Shalmali Joshi
arXiv AI
3d ago

Discrete Neural Interlingua for Ontology-Agnostic EHR Modeling

The paper introduces MEDIATOR, a discrete, ontology‑agnostic tokenizer that maps any clinical concept—whether encoded, synonymous, or free‑text—into a shared vector‑quantized codebook. By collapsing equivalent expressions and organizing distinct concepts in a medically meaningful space, MEDIATOR serves as the token interface for an EHR Transformer, boosting mean AUPRC by 4.0 points on 20 MIMIC‑III tasks and 8.6 points in zero‑shot transfer to 14 eICU tasks, while enabling full event coverage and transferable attribution across hospitals.

By Tong Ding, Caiwei Tian, Dongmin Bang, Ming Y. Lu, Sophia J. Wagner, Andrew Zhang, Rowland Pettit, Long Phi Le, Faisal Mahmood
arXiv AI
Sep 1

CoLa-ICD: A Knowledge-Enhanced Framework for Long-Tail Automated Medical Coding

CoLa-ICD is a knowledge‑enhanced framework designed to improve automatic medical coding of ICD codes in long, imbalanced clinical documents. It enriches ICD labels with external terms, models dependencies among related codes, and strengthens the alignment between label semantics and clinical evidence, particularly for rare codes. Experiments demonstrate that CoLa-ICD achieves state‑of‑the‑art performance in AUC, F1, and P@k, with larger gains in larger and sparser label spaces.

By Yihang Cheng, Veronica Liesaputra, Andrew Trotman
arXiv Machine Learning
Sep 18

Pretrained Medical Representations for the Practical Screening of Drug Repositioning Candidates

The paper introduces a unified pre‑training framework for medical representations that incorporates hierarchical sub‑token aggregation, partial masking, and cross‑reference mechanisms to better capture the structure of medical codes. The resulting model outperforms existing BERT‑based approaches on pre‑training tasks and downstream clinical predictions, such as dementia onset and hospitalization. An in‑silico drug repositioning study for Alzheimer’s disease demonstrates the framework’s ability to rediscover known drugs and prioritize new hypotheses without external literature, establishing a workflow for hypothesis generation and prioritization based on observational data.

By Yuhei Fujioka, Daitaro Misawa, Shingo Fukuma