arXiv AI

Interpretable Multimodal MRI-Clinical Fusion for Functional Outcome Prediction After Acute Ischemic Stroke

This study assessed whether day‑1 multimodal MRI can improve prediction of three‑month functional outcome after acute ischemic stroke. Using pretrained ResNet embeddings from ADC, DWI, and FLAIR scans combined with clinical data, the authors found that clinical‑only models performed well (AUC≈0.90), while MRI‑only models were less discriminative (AUC≈0.67‑0.73). Among multimodal combinations, FLAIR‑clinical fusion yielded the best performance (AUC≈0.95), with age, NIHSS subscores, ADC lesion burden, and learned FLAIR features identified as key contributors.

arXiv AI
Sep 1

Federated Learning for MRI-based BrainAGE: a multicenter study on post-stroke functional outcome prediction

arXiv:2506.15626v3 Announce Type: replace-cross Abstract: $\textbf{Objective:}$ Brain-predicted age difference (BrainAGE) is a neuroimaging biomarker reflecting brain health. However, training robust...

By Vincent Roca, Marc Tommasi, Paul Andrey, Aur\'elien Bellet, Markus D. Schirmer, Hilde Henon, Laurent Puy, Julien Ramon, Gr\'egory Kuchcinski, Martin Bretzner, Renaud Lopes
arXiv Computer Vision
Sep 14

Learning Sparse Latent Predictive Foundation Model for Multimodal Neuroimaging

The paper introduces Neuro‑JEPA, a sparse multimodal foundation model that learns unified representations of brain MRI across T1w, T2w, and FLAIR sequences using a latent predictive objective and a Mixture‑of‑Experts architecture. It was pretrained on over 1.5 million scans from 428,647 studies and systematically evaluates architectural, masking, objective, and sparsity choices for robust multimodal representation learning. Across 47 tasks from three health systems and 12 public datasets, Neuro‑JEPA consistently outperforms a simple CNN baseline, demonstrating its effectiveness for both clinical and research applications.

By Haoxu Huang, Long Chen, Jingyun Chen, Jinu Hyun, James Ryan Loftus, Kara Melmed, Daniel Orringer, Jennifer Frontera, Seena Dehkharghani, Arjun Masurkar, Narges Razavian
arXiv Computer Vision
Sep 14

A Multimodal Explainable Deep Learning Framework for Alzheimer's Disease Diagnosis using 3D Magnetic Resonance Imaging and Clinical Data

The study presents an explainable multimodal deep‑learning framework that combines a 3D CNN for T1‑weighted MRI with a feedforward network for harmonized clinical and demographic data to diagnose Alzheimer’s disease. Using 6,479 ADNI records and 1,703 OASIS‑3 records, the authors compare various model configurations on three‑way and pairwise diagnostic tasks, finding that performance and explanations vary by task, modality, fusion strategy, and cohort. SHAP and Integrated Gradients consistently highlight the MMSE score as the most influential tabular feature, while CAM‑based explanations differ across model setups and cohorts, indicating that explainability is not a stable property under cohort shift.

By Yusuf Brima, Marcellin Atemkeng, Lakshmana Rao Namamula, Antoine Vacavant
arXiv AI
Jun 9

Comparative evaluation of training strategies using partially labelled datasets for segmentation of white matter hyperintensities and stroke lesions in FLAIR MRI

arXiv:2601. 20503v2 Announce Type: replace-cross Abstract: White matter hyperintensities (WMH) and ischaemic stroke lesions (ISL) are key imaging biomarkers of cerebral small vessel disease (SVD) detectable on magnetic resonance imaging (MRI).

By Jesse Phitidis, Alison Q. Smithard, William N. Whiteley, Joanna M. Wardlaw, Miguel O. Bernabeu, Maria Vald\'es Hern\'andez
arXiv AI
Jun 17

Probing, Fusion, and Trustworthiness: A Systematic Evaluation of Foundation Model Representations for Multimodal Cancer Analysis

arXiv:2606. 17115v1 Announce Type: cross Abstract: Foundation models (FMs) have emerged as powerful representation extractors for medical data, yet their generalizability to datasets under distribution shift remains underexplored.

By Jingyu Hu, Giuseppe Tripodi, Reed Naidoo, Sarah F. McGough, Tapabrata Chakraborti
arXiv Machine Learning
Jul 2

Explainability in mulimodal deep transformation models for stroke outcome prediction

arXiv:2504. 06299v2 Announce Type: replace-cross Abstract: Multimodal prediction models based on imaging and clinical data are increasingly used for clinical decision support, yet their interpretability remains limited.

By Lisa Herzog, Jonas Br\"andli, Maurice Schneeberger, Loran Avci, Nordin Dari, Martin H\"ansel, Hakim Baazaoui, Pascal B\"uhler, Susanne Wegener, Beate Sick
arXiv Computer Vision
Sep 18

Ischemic Stroke Segmentation and Net Water Uptake Quantification on Multicenter Non-Contrast CT Using Supervised Target-Domain Adaptation

This study presents a domain-aware deep learning framework based on nnU-Net for segmenting ischemic stroke lesions on non‑contrast CT scans and quantifying net water uptake (NWU). Trained on data from Hamburg and the Acute Ischemic Stroke Dataset, the model was fine‑tuned on small target‑domain subsets from Boston and ISLES, achieving median Dice scores of 0.68 and 0.56 for lesions ≥30 mL, and an NWU mean absolute error of 1.37 percentage points on the Boston cohort. The results demonstrate that target‑domain adaptation can enable accurate NCCT‑only infarct segmentation and low‑error NWU estimation across heterogeneous multicenter datasets.

By Linus Britt, Maximilian Nielsen, Susan Klapproth, Andre Kemmling, Michael H. Lev, Gabriel Broocks, Rene Werner, Thilo Sentker
arXiv AI
Oct 9

Bi-temporal Image-driven Acute Stroke Evolution Analysis

The paper introduces a bi‑temporal framework that links admission computed tomography perfusion (CTP) data with follow‑up diffusion‑weighted MRI (DWI) outcomes in acute ischemic stroke. By extracting statistical, radiomic, and deep‑learning features from CTP and classifying tissue into six outcome‑aware regions, the authors demonstrate that CTP signatures can distinguish salvaged versus infarcted penumbra and identify non‑hypoperfused tissue that later infarcts. Cross‑dataset validation on the ISLES'24 dataset confirms consistent feature‑space separations, suggesting that admission CTP contains richer outcome information than traditional core‑penumbra delineation.

By Md Sazidur Rahman, Kjersti Engan, Kathinka D{\ae}hli Kurz, Mahdieh Khanmohammadi
arXiv Computer Vision
Sep 22

Enabling Vision and Cross-Modal Learning for Multimodal Stroke Recurrence Prediction: An Interpretable Two-Step Framework

arXiv:2609.22271v1 Announce Type: new Abstract: Multimodal stroke recurrence prediction requires effective integration of heterogeneous clinical and imaging data, yet modality imbalance often causes...

By Christian Gapp, Elias Tappeiner, Martin Welk, Karl Fritscher, Stephanie Mangesius, Constantin Eisenschink, Philipp Deisl, Michael Knoflach, Astrid E. Grams, Elke R. Gizewski, Rainer Schubert
arXiv AI
Jul 7

EPRA U-Net: An Efficient Pyramid Residual Attention Framework for Accurate Infarct Segmentation in Diffusion-Weighted MRI

arXiv:2607. 03568v1 Announce Type: cross Abstract: Objective: Accurate identification of acute ischemic infarcts on diffusion-weighted magnetic resonance imaging (DWI) is a critical prerequisite for reliable lesion quantification and effective clinical decision support in the management of cerebrovascular events.

By Hasan Ulutas, Muhammet Emin Sahin, Mustafa Fatih Erkoc, Esra Yuce, Turker Tuncer, Sengul Dogan, Serkan Kiranyaz
arXiv AI
Jun 12

BrainDINO: A Brain MRI Foundation Model for Generalizable Clinical Representation Learning

arXiv:2604. 27277v3 Announce Type: replace-cross Abstract: Brain MRI underpins a wide range of neuroscientific and clinical applications, yet most learning-based methods remain task-specific and require substantial labeled data.

By Yizhou Wu, Shansong Wang, Yuheng Li, Mojtaba Safari, Mingzhe Hu, Chih-Wei Chang, Harini Veeraraghavan, Xiaofeng Yang