Multimodal synthesis of MRI and tabular data with diffusion in a joint latent space via cross-attention

The paper introduces a multimodal latent diffusion model that jointly synthesizes volumetric MRI scans and tabular clinical data within a shared latent space using cross‑attention. By fusing the modalities through a variational autoencoder before diffusion, the model reconstructs MRI and tabular data with separate decoders, producing anatomically plausible images that align with synthesized clinical attributes. Evaluation on the German National Cohort dataset shows high‑fidelity image generation and superior tabular performance compared to CTGAN, marking the first demonstration of joint MRI‑tabular modeling in a single diffusion framework.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

• diffusion
• multimodal