arXiv AI

Patients-like-me: A Variational LM--GNN Framework for Explainable Clinical Prediction

arXiv:2608. 04193v1 Announce Type: cross Abstract: Language models (LMs) offer strong textual representations for electronic health records (EHRs), but they encode patient sequences in isolation and provide limited explainability.

arXiv AI
Sep 7

REFINE: LLM Refinement over Budgeted Text-Attributed Graphs for Personalized Medical Concept Representation

REFINE is a framework that refines medical concept representations by creating patient‑specific temporal graphs from a global text‑attributed knowledge graph. It uses a reinforcement learning policy to allocate a personalized graph expansion budget for each observed code, then processes the resulting graph with a heterogeneous GNN and a frozen LLM that refines representations via graph‑aware soft prompts. Experiments on MIMIC‑III and MIMIC‑IV demonstrate that REFINE consistently improves various EHR prediction backbones, surpasses strong baselines, and shows robust gains across ablation studies, KG selection, and data insufficiency scenarios.

By Mohsen Nayebi Kerdabadi, Arya Hadizadeh Moghaddam, Dongjie Wang, Zijun Yao
arXiv Machine Learning
Sep 21

HERMES: Contrast-Aware Knowledge Graph Reasoning from Clinical Notes for Patient Outcome Prediction

HERMES is a graph-based framework that uses only clinical text to predict patient outcomes. It builds personalized Knowledge Graphs from clinical notes via Large‑Language‑Model‑guided extraction and Contrastive Logic Modeling, capturing temporal dynamics and treatment changes. A Graph Attention Network then synthesizes patient representations, and experiments on MIMIC‑III and MIMIC‑IV show HERMES outperforms text‑only baselines for in‑hospital mortality and 30‑day readmission prediction.

By Gia-Bach Nguyen, Hoang-Ha Nguyen, Tuan-Cuong Vuong, Trang Mai Xuan, Duy Quoc Ngo, Tien-Cuong Nguyen, Huan Vu, Thien Van Luong
arXiv Machine Learning
Oct 22

Are Joint-Embedding Predictive Objectives Effective for Longitudinal EHRs?

Masked language modelling (MLM) remains the dominant pretraining objective for transformer encoders on longitudinal electronic health records (EHRs), but reconstructing individual events can overemphasise noisy observations and fails to encourage learning higher‑level patient states. Joint‑Embedding Predictive Architectures (JEPAs), which predict representations in latent space, were tested on MIMIC‑IV data and, while training stably, consistently underperformed standard MLM. The study found that larger target sizes increase prediction error, yet reducing target size does not improve downstream performance, indicating that stable latent prediction alone is insufficient for competitive EHR representation learning and underscoring the difficulty of defining clinically meaningful latent targets for EHR.

By Ashvin Gupta, Brendan Delaney, Alessandra Russo
arXiv AI
Oct 27

Bridging the Divide: End-to-End Sequence-Graph Learning

The paper "Bridging the Divide: End-to-End Sequence-Graph Learning" introduces BRIDGE, an architecture that jointly learns from sequential and relational data by coupling a sequence model with a graph module under a single objective. It adds a token-level cross-attention layer, TOKENXATTN, to enable fine-grained message passing between events in neighboring sequences. Experiments on relationship prediction and fraud detection show that BRIDGE outperforms static graph models, temporal graph methods, and sequence-only baselines on ranking and classification metrics.

By Yuen Chen, Yulun Wu, Samuel Sharpe, Igor Melnyk, Nam H. Nguyen, Furong Huang, C. Bayan Bruss, Rizal Fathony
arXiv Machine Learning
Jul 20

LLM4EHR: Aligning Clinical Time Series with Medical Event Sequences via Large Language Models

arXiv:2607. 15447v1 Announce Type: new Abstract: Recent research in clinical machine learning, focusing on outcome predictions in intensive care unit (ICU), has shifted from bespoke supervised models to foundation models, utilising modern representation learning methods.

By Jingteng Li, Alexander Capstick, Louise Rigny, Iona Biggart, Neil J Sebire, Payam Barnaghi