arXiv Machine Learning
Jun 16

Lesion-DDPM: Lesion-Enhanced 3D Diffusion for MS MRI Synthesis

arXiv:2606. 15457v1 Announce Type: cross Abstract: 3D FLAIR MRI is widely recommended as one of the standard MRI sequences for brain imaging in multiple sclerosis (MS), but publicly available MS datasets remain relatively small and vary across scanners, acquisition protocols, and lesion patterns.

By Weidong Zhang, Yongchan Jung, Shafayat Mowla Anik, Furen Xiao, Vasudevan Janarthanan, Enkhzaya Chuluunbaatar, Byeong Kil Lee, Jeeho Ryoo
arXiv AI
1d ago

Multimodal synthesis of MRI and tabular data with diffusion in a joint latent space via cross-attention

The paper introduces a multimodal latent diffusion model that jointly synthesizes volumetric MRI scans and tabular clinical data within a shared latent space using cross‑attention. By fusing the modalities through a variational autoencoder before diffusion, the model reconstructs MRI and tabular data with separate decoders, producing anatomically plausible images that align with synthesized clinical attributes. Evaluation on the German National Cohort dataset shows high‑fidelity image generation and superior tabular performance compared to CTGAN, marking the first demonstration of joint MRI‑tabular modeling in a single diffusion framework.

By Daniel Mensing, Jan Kapar, Jochen G. Hirsch, Matthias G\"unther, Horst Hahn, Marvin N. Wright