arXiv AI
Sep 28

Combining General and Domain-Specific Pretext Tasks for Brain MR Image Segmentation

The paper investigates combining a domain‑specific self‑supervised task—voxel‑level brain age prediction—with a general task—image inpainting—to pretrain models for brain MRI segmentation. A multitask pretraining framework jointly optimizes both objectives, yielding representations that outperform single‑task pretraining and training from scratch on three segmentation benchmarks (multiple sclerosis lesions, ischemic stroke lesions, and cortical structures). The study demonstrates that integrating domain‑specific and general self‑supervised tasks benefits the development of generalizable neuroimaging foundation models.

By Tasneem Nasser, Susanne Schmid, Roberto Souza, Naser El-Sheimy
arXiv Machine Learning
Oct 21

Convergent Performance, Divergent Mechanisms in LoRA-Adapted Vision Foundation Models for Brain MRI

The study examines how LoRA adaptation of four Vision Foundation Models—DINOv3, SigLIP2, MerMED-FM, and BiomedCLIP—affects brain MRI tasks. Despite achieving similar segmentation accuracy (mean Dice 78‑81%), the models exhibit distinct internal dynamics, with early‑to‑mid layers being most crucial for segmentation. Restricting LoRA to these layers yields comparable performance while mitigating negative impacts on Alzheimer’s disease classification.

By Cecilia Diana-Albelda, Fiona Kekwick, Raghav Mehta, Aleksandra Kulbaka, Paul M. Matthews, Jesus Bescos, \'Alvaro Garc\'ia-Mart\'in, Wenjia Bai, Bernhard Kainz
arXiv Computer Vision
Aug 27

Synergistic Modality-and-Slice Memory Framework for Cross-Modal 3D Brain Tumor Segmentation

The paper introduces MSM‑Seg, a dual‑memory segmentation framework for 3D multi‑modal brain tumor segmentation. It combines a modality‑and‑slice memory attention module to capture cross‑modal and spatial‑slice dependencies, a multi‑scale category‑agnostic prompt encoder for whole‑tumor guidance, and a modality‑adaptive fusion decoder to integrate complementary decoding information. Experiments on various MRI datasets show that MSM‑Seg surpasses state‑of‑the‑art methods for metastases and glioma tumor segmentation.

By Yuxiang Luo, Qing Xu, Hai Huang, Yuqi Ouyang, Xiangjian He, Zhen Chen, Wenting Duan, Jiebo Luo