arXiv Computer Vision

Mamba-driven MRI-to-CT Synthesis for MRI-only Radiotherapy Planning

arXiv Computer Vision
Sep 24

nnFoundation: 3D Foundation Models for Radiology

nnFoundation introduces complementary convolutional and transformer-based 3D foundation models for radiology, trained on 2.1 million CT, MRI, and PET volumes from 125 datasets. The models are evaluated on 108 tasks—including segmentation, detection, classification, report generation, and image retrieval—under domain shift, low-data, and low-compute scenarios, consistently outperforming prior 3D foundation models and training from scratch. Performance varies by task type, with convolutional models excelling at spatially localized tasks and transformer models at global semantic reasoning, and dynamic alignment with dataset characteristics further enhances transferability.

By Constantin Ulrich Harsy, Tassilo Wald, Karol Gotkowski, Yannick Kirchhoff, Marcel Knopp, Maximilian Rokuss, Elisa Stegmeier, Philipp Schader, Dasha Trofimova, Raphael Stock, Kim-Celine Kahl, Stephen Schaumann, Selen Erkan, David Zimmerer, Stefan Denner, Moritz Langenberg, Sebastian Ziegler, Katharina Eckstein, Maximilian Fischer, Jonathan Suprijadi, B\'alint Kov\'acs, Benjamin Hamm, Anand Deshpande, Dimitrios Bounias, Nico Disch, Shuhan Xiao, Jessica K\"achele, Jan Sellner, Rajesh Baidya, Jeremias Traub, Lars Kr\"amer, Maximilian Zenk, Tim R\"adsch, Stefan Dvoretskii, Robin Peretzke, Jonathan Deissler, Alexandra Ertl, Partha Ghosh, Kris Dreher, Stefan Dinkelacker, Annika Reinke, Evangelia Christodoulou, Numan Saeed, Yoland Savriama, Santiago Estrada, David K\"ugler, Laura Alexandra Daza Barragan, Cristina Isabel Gonzalez Osorio, Jan Peeken, Michael Baumgartner, Marvin Teichmann, Guillaume Chabin, Matthias Kirchler, Valentin Koch, for the ALFA study, Markus Hohenhaus, Dimitri Koslov, Nina Decker, Mohammad Yaqub, Arnd Heuser, Martin Reuter, Julia A. Schnabel, Tobias Heimann, Florin Ghesu, Paul Brachmann, Claus P. Heu{\ss}el, Alexander Radbruch, Gianluca Brugnara, Aditya Rastogi, Martha Foltyn-Dumitru, Heinz-Peter Schlemmer, Ignaz Reicht, Julius C. Holzschuh, Michael Bach, Bram Stieltjes, Kai Schlamp, Lena Maier-Hein, Marco Nolden, Ralf Floca, Paul F. J\"ager, Philipp Vollmuth, Fabian Isensee, Klaus H. Maier-Hein
arXiv Computer Vision
Aug 28

Parameter-Efficient pretrained-CT-to-MRI Transfer for Rectal Cancer Segmentation: Performance-Calibration Trade-offs

The paper introduces SWIFT, a Swin V2‑based model pretrained on 10,444 3D CT volumes and fine‑tuned for rectal cancer segmentation on T2‑weighted MRI. Four configurations—full fine‑tuning (SWIFT), decoder compression (SWIFTe), low‑rank adaptation (SWIFTe‑LoRA), and a LoRA‑decoder ensemble (SWIFTe‑LDE4)—were evaluated on 247 cases, showing that SWIFTe reduces parameters by 70.1% while improving tumor detection and radiomic agreement. The study also demonstrates a trade‑off between detection and boundary agreement, and highlights that SWIFTe‑LDE4 achieves the lowest calibration errors after temperature scaling.

By Aneesh Rangnekar, Jorge Tapias Gomez, Joseph O Deasy, Harini Veeraraghavan
arXiv Computer Vision
Aug 27

Synergistic Modality-and-Slice Memory Framework for Cross-Modal 3D Brain Tumor Segmentation

The paper introduces MSM‑Seg, a dual‑memory segmentation framework for 3D multi‑modal brain tumor segmentation. It combines a modality‑and‑slice memory attention module to capture cross‑modal and spatial‑slice dependencies, a multi‑scale category‑agnostic prompt encoder for whole‑tumor guidance, and a modality‑adaptive fusion decoder to integrate complementary decoding information. Experiments on various MRI datasets show that MSM‑Seg surpasses state‑of‑the‑art methods for metastases and glioma tumor segmentation.

By Yuxiang Luo, Qing Xu, Hai Huang, Yuqi Ouyang, Xiangjian He, Zhen Chen, Wenting Duan, Jiebo Luo
arXiv Computer Vision
Sep 16

Anatomy-Change-Aware Bidirectional Selective State-Space Memory for Clinically Deployed Thoracic Radiotherapy Auto-Contouring

The paper introduces DAMM‑Net++, a 2.5D neural network for thoracic organ‑at‑risk and target volume segmentation that tackles inter‑slice surface incoherence, small low‑contrast target failure, and lack of per‑case reliability signals. Its core is an anatomy‑change‑aware bidirectional selective state‑space memory that propagates context across axial slices, complemented by a boundary‑aware decoder and an uncertainty head for calibrated per‑voxel confidence. Evaluations on 2,146 patients, an external cohort, and a reader study show high Dice scores (0.955), low HD95 (3.78 mm), significant time savings (75‑80 %) for clinicians, and improved junior‑reader performance, with the system fully integrated into a clinical workflow.

By Galib Ahmed, Istiak Ahmed, Aritra Islam Saswato, Asib Mostakim Fony, Kazi Shahriar Sanjid, Md. Tanzim Hossain, Md. Anwarul Islam, Md. Nishan Khan, Md. Misbah Khan, Labiba Faiza Karim, Jobaer Rahman, S M Hasibul Hoque, Rahnuma Shahrin Rista, Kamruzzaman Rumman, Md Arifur Rahman, Syed Md. Akram Hussain, Mohammad Ashrafuzzaman Khan, M. Monir Uddin