arXiv Machine Learning

Multimodal Attention-based Deep Learning for Emergency Triage with Electronic Health Records

arXiv:2607. 16662v1 Announce Type: new Abstract: Accurate emergency triage decision is critical to avoid clinical deterioration, morbidity, and mortality.

arXiv AI
Sep 7

Cross-modal triage network: a multimodal deep learning framework for severity-based triage and visual explainability in chest radiographs

The paper introduces the Cross‑Modal Triage Network (CMTN), a multimodal deep‑learning model that fuses a Swin Transformer V2 visual encoder with a PubMedBERT text encoder to perform severity‑based triage, pathology detection, and generate visual explanations for chest radiographs. Trained on 34,639 image‑text pairs from MIMIC‑CXR‑JPG, the CMTN achieves high ordinal agreement with reference labels (QWK = 0.9341) and excellent pathology detection (macro‑AUROC = 0.9970) while operating with 34 ms latency. However, a blinded clinical audit revealed low agreement with expert radiologists (QWK = 0.1399) and only modest spatial‑semantic concordance in heatmaps, underscoring the gap between algorithmic performance and clinical judgment.

By Zinah Ghulam, Richa Mittal, Eranga Ukwatta
arXiv Machine Learning
Sep 15

Representing Clinical Conditions on Vital Signs from Healthy Individuals using Latent Modeling

The paper introduces a deep generative model using conditional variational autoencoders to augment vital sign data from healthy individuals so that it mimics patterns of specific clinical conditions. Trained on a publicly available ICU dataset, the model learns the underlying dynamics of ICU data and reshapes healthy data to align with target clinical labels. A proposed distance metric demonstrates that the generated samples are more aligned with intended clinical labels than baseline methods.

By Rafael Pina, Varuna De Silva, Mindula Illeperuma
arXiv AI
Sep 1

Scalable Clinical Data Infrastructure and Comparative ML Evaluation for Hospitalisation Risk Prediction in Elderly Patients with Multiple Long-Term Conditions using CPRD

arXiv:2608.29419v1 Announce Type: cross Abstract: Deep learning architectures are increasingly proposed for patient trajectory modeling in electronic health records (EHRs), yet their advantage over s...

By Asra Aslam, Volodymyr Chapman, Maurice M. O'Connell, Aseel S. Abuzour, Michael Abaho, Danushka Bollegala, Gary Leeming, Eduard Shantsila, Andrew Clegg, Lauren E. Walker, Iain Edward Buchan, Samuel D. Relton
arXiv AI
Oct 9

Reading the Whole Heart: Latent-Attention Masked Autoencoders for Multimodal Cardiac Representation Learning

The paper introduces Latent-Attention Masked Autoencoder (LAMAE), a multimodal masked autoencoder that learns patient-level representations by exchanging information directly in the latent space through a shared latent-attention module. LAMAE integrates complementary modalities—electrocardiogram, echocardiography, and chest X-rays—within a study-view-entity hierarchy, enabling aggregation of variable observations and handling missing modalities. Pretraining on over 500,000 MIMIC-IV hospital stays, LAMAE outperforms modality-specific pretraining and strong contrastive and vision-language baselines on multimodal hospital-stay tasks such as in-hospital mortality, ICD-10 and DRG coding, and length of stay, while remaining competitive on unimodal tasks.

By Andrea Agostini, Simon B\"ohi, Moritz Vandenhirtz, Samuel Ruiperez-Campillo, Max Kr\"ahenmann, Silke M\"uhlstedt, Irene Cannistraci, Ece \"Ozkan Elsen, Julia E. Vogt, Thomas M. Sutter
arXiv Machine Learning
Jul 27

Autoregressive EHR Foundation Models with Multimodal Inputs

arXiv:2607. 22264v1 Announce Type: new Abstract: Autoregressive foundation models trained on tokenized electronic health records (EHRs) can support zero-shot clinical prediction, yet most operate on structured event codes alone, and do not incorporate multiple modalities in a principled way.

By Yuxuan Liu, Joshua Placidi, Jinpei Han, Alfred John Balston, Marek Rei, A. Aldo Faisal