DIGOM (Disentangled Interaction Graphs for Outcome prediction in Multimodal healthcare) is a graph-based framework that jointly models intra‑patient cross‑modal, cross‑patient same‑modal, and cross‑patient cross‑modal interactions. It learns a sparse multiplex graph with patient‑adaptive connectivity through a differentiable sampling mechanism, enabling end‑to‑end learning without a fixed neighbor count. Evaluated on MIMIC‑IV and NIH‑TB datasets across five clinical prediction tasks, DIGOM achieves the highest AUROC while using fewer connections than existing multi‑interaction approaches, and shows robustness to missing modalities and task‑specific connectivity patterns.
arXiv:2608. 06430v1 Announce Type: new Abstract: Learning from Electronic Health Records (EHRs) has gained significant attention due to its potential to improve clinical prediction.
arXiv:2609.21164v1 Announce Type: new Abstract: Integrating diverse data modalities --- such as clinical notes, laboratory results, and medical imaging --- is essential for advancing clinical decisio...
arXiv:2607. 09982v1 Announce Type: new Abstract: Electronic health record (EHR) data are inherently multimodal, and leveraging multiple modalities can improve predictive performance.
Multimodal fusion learning (MFL) has shown great potential in the medical domain, where we are faced with disparate data modalities such as imaging, clinical records, and omics. However, existing MFL strategies face several major challenges.
arXiv:2609.06668v1 Announce Type: new Abstract: Multimodal graphs couple node attributes in different modalities, such as text and images, with relational structure, enabling topological structure an...
arXiv:2604. 16878v2 Announce Type: replace Abstract: Early prediction of severe clinical deterioration and remaining length of stay can enable timely intervention and better resource allocation in high-acuity settings such as the ICU.
arXiv:2608. 02769v1 Announce Type: cross Abstract: Multimodal supervised learning seeks to leverage multiple heterogeneous data sources to improve predictive performance.
arXiv:2607. 15687v1 Announce Type: new Abstract: Multimodal-attributed graphs (MAGs), whose nodes carry modalities such as images and text alongside topological structure, now pervade applications including social platforms, e-commerce, and biomedical networks, offering richer semantic signals than single-modality graphs.
arXiv:2604.04614v3 Announce Type: replace Abstract: Deep learning-based modeling of multimodal Electronic Health Records (EHRs) has become an important approach for clinical diagnosis and risk predic...
arXiv:2605. 22547v3 Announce Type: replace-cross Abstract: Medical image diagnosis has achieved significant progress with deep learning, yet existing methods often rely on isolated visual evidence and lack the ability to effectively leverage similar cases and external knowledge.
The paper presents a newly curated, multi-center, multi-modal, and longitudinal lung cancer dataset comprising 1,365 patients with whole-slide images, CT scans, PET scans, structured clinical data, transcriptomics, and follow-up information. The dataset features substantial, non-uniform missingness across modalities, making it ideal for evaluating robust multi-modal fusion strategies. Benchmarks on 12‑month overall survival, disease‑specific survival, and longitudinal hazard prediction demonstrate that integrating complementary modalities consistently outperforms uni-modal approaches, even under severe missing data.
DeMMO is an interpretable framework that models longitudinal digital mobility outcomes (DMOs) across multiple diseases and outcomes using multi-task learning. It introduces a cross-disease, cross-outcome relation-learning mechanism that learns signed relationships from longitudinal DMO coefficient matrices, allowing selective information sharing even when disease cohorts lack shared participants. Evaluated on the Mobilise‑D dataset, DeMMO outperforms nine strong baselines and identifies reliable longitudinal DMO patterns for clinical validation.