Multimodal-Conditioned Latent Diffusion Models for Spatiotemporal Brain MRI Forecasting
Read the original on arXiv AI →The Flow has not summarised this story yet — read it at arXiv AI.
The Flow has not summarised this story yet — read it at arXiv AI.
arXiv:2604. 22700v2 Announce Type: replace Abstract: Modeling and predicting neurodegenerative disease progression from medical images remains a major challenge in medical AI, with significant implications for early diagnosis, disease monitoring, and treatment planning.
arXiv:2603. 05693v2 Announce Type: replace-cross Abstract: Accurate longitudinal analysis of brain MRI is often hindered by evolving lesions, which bias automated neuroimaging pipelines.
arXiv:2606. 18354v1 Announce Type: cross Abstract: Recent advances in generative machine learning models have significantly improved medical imaging, offering promising solutions for data augmentation, privacy preservation, and improved model generalization.
The paper introduces a multimodal latent diffusion model that jointly synthesizes volumetric MRI scans and tabular clinical data within a shared latent space using cross‑attention. By fusing the modalities through a variational autoencoder before diffusion, the model reconstructs MRI and tabular data with separate decoders, producing anatomically plausible images that align with synthesized clinical attributes. Evaluation on the German National Cohort dataset shows high‑fidelity image generation and superior tabular performance compared to CTGAN, marking the first demonstration of joint MRI‑tabular modeling in a single diffusion framework.
arXiv:2606. 19651v1 Announce Type: new Abstract: Three-dimensional (3D) brain MRI is central to clinical neurology and neuro-oncology, where generative models could augment under-represented cohorts, simulate disease trajectories, and support privacy-preserving data sharing.
The study presents an explainable multimodal deep‑learning framework that combines a 3D CNN for T1‑weighted MRI with a feedforward network for harmonized clinical and demographic data to diagnose Alzheimer’s disease. Using 6,479 ADNI records and 1,703 OASIS‑3 records, the authors compare various model configurations on three‑way and pairwise diagnostic tasks, finding that performance and explanations vary by task, modality, fusion strategy, and cohort. SHAP and Integrated Gradients consistently highlight the MMSE score as the most influential tabular feature, while CAM‑based explanations differ across model setups and cohorts, indicating that explainability is not a stable property under cohort shift.