arXiv Computer Vision

DGCM-SSFA: Dual-Granularity Cross-Modulation and Sparse Strip Frequency Attention for Efficient 3T-to-7T MRI Synthesis

DGCM-SSFA is a compact multi‑domain attention framework that synthesizes high‑fidelity 7T MRI from routine 3T scans using only 11 million parameters. It combines a Dual‑Granularity Cross‑Modulated Feature Modulator (DGCM) and a Sparse Strip Frequency Attention (SSFA) module within a U‑Net Transformer backbone to enhance local edge details and capture global spatial context efficiently. Experiments on UNC and BNU 3T‑to‑7T datasets show competitive structural fidelity, achieving SSIM scores of 0.8431 (BNU T2w) and 0.8100 (BNU T1w) while remaining far smaller than Transformer‑based alternatives.

arXiv Computer Vision
Aug 25

Tumor-aware augmentation with task-guided attention analysis improves rectal cancer segmentation from magnetic resonance images

arXiv:2605.05522v3 Announce Type: replace-cross Abstract: Although self-supervised pretraining is expected to learn broadly transferable representations, its effectiveness across imaging modalities s...

By Aneesh Rangnekar, Joao Miranda, Natally Horvat, Stephanie Chahwan, Samir Alrayess, Aditya Apte, Aditi Iyer, Eve LoCastro, Revathi Ravella, Marc J Gollub, Iva Petkovska, Jesse Joshua Smith, Paul Romesser, Julio Garcia-Aguilar, Harini Veeraraghavan, Joseph O Deasy
arXiv AI
Oct 9

SRUG: A Fusion-Driven Generator Network for Medical Image Translation

SRUG is a supervised, fusion‑driven generator network designed for paired MRI sequence synthesis. It eliminates the generator‑discriminator competition by directly learning a deterministic source‑to‑target mapping, using a residual encoder, full‑resolution stem, and a nested multi‑scale decoder to preserve structural fidelity. Experiments on BraTS 2023 and IXI demonstrate competitive reconstruction quality and cross‑dataset transferability, supporting direct supervised generation as a practical approach for medical image translation.

By Xihe Qiu, Yang Dai, Xiaoyu Tan, Sijia Li, Fenghao Sun, Lu Gan, Liang Liu
arXiv Computer Vision
Oct 16

Mixture of Multi-Sequence Feature Difference for Contrast-Enhanced MRI Synthesis

The paper presents a method for synthesizing contrast‑enhanced MRI (CE‑MRI) from non‑contrast sequences using a novel Mixture of Feature Difference (MoFD) module. MoFD dynamically weights and aggregates features from individual sequences and their explicit differences, improving image fidelity and perceptual quality over baseline approaches. Experiments on UCSF‑PDGM and UPenn‑GBM datasets show that the synthesized images reconstruct tumor regions well and yield segmentation performance comparable to real CE‑MRI, with regression‑based training achieving higher structural fidelity.

By Jonghun Kim, Junmo Kwon, Hyunjin Park
arXiv Computer Vision
2d ago

AGGR-Mamba: Mamba-based Network with Attention-Guided Gated Residual Refinement for Undersampled MRI Reconstruction

AGGR-Mamba is a lightweight output‑stage refinement network for undersampled brain MRI reconstruction that builds on a Mamba backbone. The method first generates an initial reconstruction and then applies an Attention Refine Head to recalibrate local anatomical structures, edge textures, and residual‑error regions, followed by a gated residual refinement branch that selectively preserves informative residual features while suppressing redundant responses. Experiments on the IXI brain MRI dataset with T1‑ and T2‑weighted images at acceleration factors R=4 and R=8 show that AGGR‑Mamba achieves competitive PSNR and SSIM performance across different reconstruction settings.

By Yue Zhuo, Wenbin Deng, Lingjun Liu, Xuhang Chen, Zhonghua Xie
arXiv Computer Vision
Oct 12

Learning Features, Not Layouts: Feature-Axis Attention as a Transfer Prior for Medical Imaging

The paper introduces FAD‑ViT, a vision transformer that decouples spatial and feature axes of global attention, making feature‑axis attention the primary operator. Experiments on 23 medical imaging tasks show that shifting global attention from spatial to feature leaves from‑scratch performance unchanged but significantly boosts transfer learning, achieving up to three times the gain with fewer parameters and lower compute. The study demonstrates that prioritizing feature‑axis attention is a simple, cost‑effective design choice for improving medical image transfer.

By Aon Safdar, Mohamed Saadeldin
arXiv Computer Vision
Sep 28

Cross-Modality Structural Guidance in 3D Latent Diffusion for Robust FLAIR Super-Resolution

The paper introduces MR‑DiffuSR, a 3‑D latent diffusion framework that uses high‑resolution T1w structural priors to guide super‑resolution of thick‑slice FLAIR MRI scans. By applying cross‑modality structural swin attention and a mixed‑scale degradation strategy, the method avoids hallucinations and remains robust across varying slice thicknesses. On ADNI datasets, MR‑DiffuSR outperforms CNN and 2‑D diffusion baselines, achieving high PSNR, SSIM, and low LPIPS, and maintains strong white‑matter hyperintensity segmentation performance even at 7 mm equivalent slice thickness.

By Haoyu Lan, Jiazhen Zhang, John Onofrey, Bino Varghese, Nasim Sheikh-Bahaei, Arthur W. Toga, Jeiran Choupan
arXiv Computer Vision
Sep 14

Learning Sparse Latent Predictive Foundation Model for Multimodal Neuroimaging

The paper introduces Neuro‑JEPA, a sparse multimodal foundation model that learns unified representations of brain MRI across T1w, T2w, and FLAIR sequences using a latent predictive objective and a Mixture‑of‑Experts architecture. It was pretrained on over 1.5 million scans from 428,647 studies and systematically evaluates architectural, masking, objective, and sparsity choices for robust multimodal representation learning. Across 47 tasks from three health systems and 12 public datasets, Neuro‑JEPA consistently outperforms a simple CNN baseline, demonstrating its effectiveness for both clinical and research applications.

By Haoxu Huang, Long Chen, Jingyun Chen, Jinu Hyun, James Ryan Loftus, Kara Melmed, Daniel Orringer, Jennifer Frontera, Seena Dehkharghani, Arjun Masurkar, Narges Razavian
arXiv Computer Vision
Aug 27

Synergistic Modality-and-Slice Memory Framework for Cross-Modal 3D Brain Tumor Segmentation

The paper introduces MSM‑Seg, a dual‑memory segmentation framework for 3D multi‑modal brain tumor segmentation. It combines a modality‑and‑slice memory attention module to capture cross‑modal and spatial‑slice dependencies, a multi‑scale category‑agnostic prompt encoder for whole‑tumor guidance, and a modality‑adaptive fusion decoder to integrate complementary decoding information. Experiments on various MRI datasets show that MSM‑Seg surpasses state‑of‑the‑art methods for metastases and glioma tumor segmentation.

By Yuxiang Luo, Qing Xu, Hai Huang, Yuqi Ouyang, Xiangjian He, Zhen Chen, Wenting Duan, Jiebo Luo