arXiv Computer Vision

Beyond Training from Scratch: Foundation Models for Data-Efficient and Generalizable Cardiac MRI Reconstruction

arXiv Computer Vision
Sep 2

CMRVision: A Foundation Model for Cardiac MR Image Analysis

CMRVision is a cardiac magnetic resonance (CMR) foundation model trained with DINOv3-style self‑supervised learning on 36 million multi‑center, multi‑sequence CMR images. It outperforms prior natural‑image, medical‑image, supervised, and CMR baselines on multi‑task segmentation (cine, LGE, mapping) and cine view classification, achieving Dice scores of 0.940–0.967 for LV and 0.855–0.905 for myocardium, and a zero‑shot Dice of 0.692 on unseen LGE long‑axis views. The model demonstrates robust cross‑view generalization and highest average accuracy (0.906) for cine view classification.

By Athira J. Jacob, Puneet Sharma, Daniel Rueckert
arXiv Machine Learning
Aug 27

FlowMoDL: Model-Based Deep Learning with Conjugate-Gradient Data Consistency for Highly Accelerated 4D Flow MRI Reconstruction

FlowMoDL is an unrolled neural network designed for highly accelerated 4D flow MRI reconstruction, optimizing both anatomical magnitude and phase-derived velocity accuracy. It alternates a learned (3+1)D spatiotemporal denoiser with conjugate‑gradient data‑consistency updates, using a dual‑pathway conditioning scheme to handle acceleration factors from 10× to 50×. Trained with a deep‑supervision composite loss that penalizes velocity magnitude and angular errors, FlowMoDL outperforms classical and deep‑learning baselines on the multi‑center CMRx4DFlow dataset, achieving superior gradient‑step efficiency and robust convergence across all acceleration factors.

By Tristan Gottwald, Michelle Bruch, Mubashir-Ul Hassan, Fatma Alickovic, Milan Kloiber, Daniel Tenbrinck, Torsten Panholzer, Melanie Schaller, Jana Hutter
arXiv Machine Learning
Sep 10

One Shared LoRA Weight for MRI Reconstruction across Acceleration Factors

The paper introduces Shared LoRA, a parameter‑efficient approach for accelerated MRI reconstruction that uses a single set of LoRA adapters and a lightweight gating network to handle multiple acceleration factors. By freezing a pretrained SHFormer backbone and training the adapters on randomly sampled acceleration factors, the method learns reconstruction knowledge across factors. Experiments demonstrate that Shared LoRA achieves competitive PSNR and SSIM while using only about 5.3% of the total model parameters, and it generalizes well to unseen neighboring factors.

By Zhiwei Zhao, Weikang Gong, Zhongnian Li, Xinzheng Xu
arXiv AI
Aug 24

Consistency Models for Fast MRI Reconstruction Using Regularization by Denoising

The paper introduces CM-RED, a fast MRI reconstruction method that combines a pretrained consistency model with the regularization by denoising framework. By integrating controlled noise injection into accelerated proximal gradient updates, CM-RED achieves high‑quality reconstructions on fastMRI knee and brain datasets with only four network function evaluations. It consistently outperforms existing diffusion‑ and consistency‑based approaches in quantitative metrics, visual fidelity, and robustness to hyperparameter changes.

By Merve G\"ulle, Junno Yun, Ya\c{s}ar Utku Al\c{c}alar, Mehmet Ak\c{c}akaya
arXiv Computer Vision
Sep 24

nnFoundation: 3D Foundation Models for Radiology

nnFoundation introduces complementary convolutional and transformer-based 3D foundation models for radiology, trained on 2.1 million CT, MRI, and PET volumes from 125 datasets. The models are evaluated on 108 tasks—including segmentation, detection, classification, report generation, and image retrieval—under domain shift, low-data, and low-compute scenarios, consistently outperforming prior 3D foundation models and training from scratch. Performance varies by task type, with convolutional models excelling at spatially localized tasks and transformer models at global semantic reasoning, and dynamic alignment with dataset characteristics further enhances transferability.

By Constantin Ulrich Harsy, Tassilo Wald, Karol Gotkowski, Yannick Kirchhoff, Marcel Knopp, Maximilian Rokuss, Elisa Stegmeier, Philipp Schader, Dasha Trofimova, Raphael Stock, Kim-Celine Kahl, Stephen Schaumann, Selen Erkan, David Zimmerer, Stefan Denner, Moritz Langenberg, Sebastian Ziegler, Katharina Eckstein, Maximilian Fischer, Jonathan Suprijadi, B\'alint Kov\'acs, Benjamin Hamm, Anand Deshpande, Dimitrios Bounias, Nico Disch, Shuhan Xiao, Jessica K\"achele, Jan Sellner, Rajesh Baidya, Jeremias Traub, Lars Kr\"amer, Maximilian Zenk, Tim R\"adsch, Stefan Dvoretskii, Robin Peretzke, Jonathan Deissler, Alexandra Ertl, Partha Ghosh, Kris Dreher, Stefan Dinkelacker, Annika Reinke, Evangelia Christodoulou, Numan Saeed, Yoland Savriama, Santiago Estrada, David K\"ugler, Laura Alexandra Daza Barragan, Cristina Isabel Gonzalez Osorio, Jan Peeken, Michael Baumgartner, Marvin Teichmann, Guillaume Chabin, Matthias Kirchler, Valentin Koch, for the ALFA study, Markus Hohenhaus, Dimitri Koslov, Nina Decker, Mohammad Yaqub, Arnd Heuser, Martin Reuter, Julia A. Schnabel, Tobias Heimann, Florin Ghesu, Paul Brachmann, Claus P. Heu{\ss}el, Alexander Radbruch, Gianluca Brugnara, Aditya Rastogi, Martha Foltyn-Dumitru, Heinz-Peter Schlemmer, Ignaz Reicht, Julius C. Holzschuh, Michael Bach, Bram Stieltjes, Kai Schlamp, Lena Maier-Hein, Marco Nolden, Ralf Floca, Paul F. J\"ager, Philipp Vollmuth, Fabian Isensee, Klaus H. Maier-Hein