arXiv Computer Vision

A4-MR: Abnormality-aware Anatomical Alignment for MR

A4-MR is a 3D vision‑language foundation model trained on about 50,000 MRI studies, designed to learn anatomy localization, align image and text representations at the anatomical level, and distinguish healthy from abnormal anatomy. It outperforms existing models on abnormality detection, knee segmentation, and abdominal organ segmentation, and localizes 3D anatomy comparably to MedSAM2 without prompts. These results show that anatomy‑level multimodal alignment and abnormality‑aware representation can support a wide range of MRI tasks with a single model.

arXiv AI
Aug 14

Mr3D-VL: A generalist vision language foundation model for Multiparametric 3D Magnetic Resonance Imaging

arXiv:2608. 12689v1 Announce Type: cross Abstract: Multi-parametric magnetic resonance imaging (mpMRI) is a cornerstone for brain tumor diagnosis and treatment, yet current AI models face critical limitations: their lack of natural language interaction and interpretability impedes spatial information integration and cross-modal reasoning required clinically.

By Zhi Qiao, Xintong Wu, Yichu He, Feng Shi
arXiv Computer Vision
Sep 2

CMRVision: A Foundation Model for Cardiac MR Image Analysis

CMRVision is a cardiac magnetic resonance (CMR) foundation model trained with DINOv3-style self‑supervised learning on 36 million multi‑center, multi‑sequence CMR images. It outperforms prior natural‑image, medical‑image, supervised, and CMR baselines on multi‑task segmentation (cine, LGE, mapping) and cine view classification, achieving Dice scores of 0.940–0.967 for LV and 0.855–0.905 for myocardium, and a zero‑shot Dice of 0.692 on unseen LGE long‑axis views. The model demonstrates robust cross‑view generalization and highest average accuracy (0.906) for cine view classification.

By Athira J. Jacob, Puneet Sharma, Daniel Rueckert
arXiv Computer Vision
1d ago

Multimodal Hierarchical Mixture-of-Experts for 3D Medical Vision-Language Modeling

arXiv:2611.08185v1 Announce Type: new Abstract: Medical 3D scans and reports are inherently hierarchical, with diagnostic cues concentrated in specific anatomical regions across multiple levels of or...

By Gizem Mert, Szymon P{\l}otka, Pedro R. A. S. Bassi, Wenxuan Li, Zongwei Zhou, Jaros{\l}aw B. \'Cwik{\l}a, Arkadiusz Sitek, Ewa Szczurek
arXiv AI
Aug 24

Volumetric Radiology AI in the Era of Multimodal Large Language Models

The article reviews how multimodal large language models (MLLMs) are expanding radiology AI beyond image‑specific tasks to multimodal reasoning, yet volumetric radiology poses a representational challenge because clinical interpretation needs full 3‑D spatial context and quantitative data. It surveys over 200 studies, categorizing advances in volumetric representation, multimodal understanding, and agentic orchestration, and introduces a Claim‑Design‑Validation framework to align technical, workflow, and clinical claims. The review emphasizes that native volumetric modeling and agentic capabilities must match spatial, quantitative, contextual, and workflow demands, and that clinical credibility hinges on faithful 3‑D representation, traceable behavior, proper validation, and defined human oversight.

By Zanting Ye, Shengyuan Liu, Xin Liu, Chenhui Wang, Zhisong Wang, Jiashuai Liu, Zipei Wang, Cheng Wang, Wentao Pan, Mengjie Fang, Di Dong, Mohammad Salmanpour, Arman Rahmim, Yu Gu, Yong Xia, Hongming Shan, Yixuan Yuan, Yefeng Zheng, Lijun Lu
arXiv AI
Sep 24

NV-Reason-CT: 3D Visual Language Model for CT Analysis

NV-Reason-CT is a generative vision‑language model designed for chest and abdominal CT analysis that preserves native 3D visual encoding and incorporates radiologist‑guided reasoning. The system couples a 3D vision transformer with a language model, feeding all visual tokens and their 3D coordinates directly into language decoding to maintain volumetric spatial information. Trained on a curated corpus of about 550,000 multimodal instruction examples, the model supports abnormality classification, report generation, and interactive reasoning, achieving strong performance on CT benchmarks and reducing expert interpretation time by 50%.

By Andriy Myronenko, Dong Yang, Yucheng Tang, Baris Turkbey, Benjamin Simon, Stephanie Harmon, Rikhil Makwana, Mariam Aboian, Sena Azamat, Ibrahim Ethem Hamamci, Sezgin Er, Bjoern Menze, Marc Edgar, Yufan He, Pengfei Guo, Daguang Xu
Hugging Face Trending Papers
Jul 20

SAMRI-3D: Adapting SAM2 for 3D MRI Segmentation with Global Volume Tokens

Foundation models such as Segment Anything Model 2 (SAM2) have transformed natural-image and video segmentation, and recent work has begun adapting them to medical imaging. These adaptations, however, are largely general-purpose models that treat MRI as one modality among many; large-scale, MRI-specific modelling and benchmarking remain limited, even though MRI's low soft-tissue contrast leaves many boundaries effectively invisible on individual slices.