arXiv AI

Multimodal Prompt Learning with Irregular EHRs for Robust Monitoring of Critical Care Patients

arXiv Machine Learning
Jul 27

Autoregressive EHR Foundation Models with Multimodal Inputs

arXiv:2607. 22264v1 Announce Type: new Abstract: Autoregressive foundation models trained on tokenized electronic health records (EHRs) can support zero-shot clinical prediction, yet most operate on structured event codes alone, and do not incorporate multiple modalities in a principled way.

By Yuxuan Liu, Joshua Placidi, Jinpei Han, Alfred John Balston, Marek Rei, A. Aldo Faisal
arXiv Machine Learning
Aug 28

NeoTriFuse: Reliability-Aware Multimodal Fusion under Missingness Heterogeneity for Neonatal Mortality Risk Prediction

NeoTriFuse is a reliability‑aware multimodal fusion framework designed to predict neonatal mortality risk from bedside monitoring data that suffers from extreme class imbalance, heterogeneous risk factors, multi‑scale temporal dynamics, and significant missingness. The method treats missing data as an explicit reliability signal, dynamically adjusting modality contributions during fusion through gating mechanisms that incorporate static perinatal variables, local‑global temporal encoders, and patient‑level statistical summaries. NeoTriFuse achieves competitive performance (F1 ≈ 0.674, AUROC ≈ 0.945) and ablation studies show that its temporal architecture and patient‑level summary branch are key contributors, with reliability‑aware gating further improving threshold‑dependent metrics under heterogeneous observation completeness.

By Jiyuan Tian, Qincheng Shen, Ye Lin, Yu Gao, Haohui Lu
arXiv Machine Learning
Aug 19

Mr.Dec: Daily-Scale Longitudinal Multimodal Modeling for 30-Day Readmission Prediction

Mr.Dec is a new Transformer‑decoder model that predicts 30‑day hospital readmission by treating each admission as a chronological sequence of daily multimodal events, integrating Electronic Health Record updates and Chest X‑ray findings. It uses disease‑specific supervised contrastive learning to shape a diagnosis‑aware latent space and preserves day‑level clinical signals that other methods often compress. Experiments on MIMIC‑IV and MIMIC‑CXR datasets show state‑of‑the‑art performance and the model can highlight "Critical Days" for actionable real‑time risk stratification.

By Minjun Kim, Jong Hak Moon