arXiv Machine Learning
Oct 23

SciFusion: Physics-Guided Compositional Diffusion for Multimodal 3D Scientific Image Generation

SciFusion is a multimodal framework that uses a latent diffusion backbone to generate unified 3D scientific images. It introduces a compositional conditioning scheme that separates each modality into domain, object, and contrast representations, allowing knowledge transfer and zero‑shot synthesis of unseen compositions. The model also incorporates physics‑informed objectives specific to MRI, CT, and electron microscopy to ensure generated images respect modality‑dependent image formation processes, and demonstrates improved fidelity and cross‑domain generalization across 15 imaging modalities.

By Luoxi Wang, Alessio Quercia, Hanno Scharr, Arya Bangun
arXiv AI
Aug 11

Compositional Cross-Modality Translation via Whole-Volume Multitask Latent Flow Matching

arXiv:2608. 08135v1 Announce Type: cross Abstract: Cross-modality medical image translation can reduce the burden of multi-modal acquisitions, yet the field remains constrained by two coupled limitations: methods operate on 2D slices or 3D patches rather than whole volumes, and train a separate model for each translation task.

By Daniele Molino, Alessio Zoboli, Camillo Maria Caruso, Valerio Guarrasi, Paolo Soda
Hugging Face Trending Papers
Jul 7

WING: A Window-Prior-Based Generative Network with Gated Inception for Cross-Modality CT Synthesis

Generating CT volumes from MRI and CBCT can improve treatment planning in adaptive radiotherapy while avoiding additional radiation exposure. However, direct regression of CT intensities is challenged by the inherently high dynamic range and long-tailed distributions, thereby averaging out sparse yet clinically important structures.