arXiv Computer Vision

BrainDiff: Longitudinal Report Generation for Multimodal Brain MRI

arXiv Computer Vision
Sep 11

Brain-PACE: A Deep Siamese MRI Framework for Modelling Longitudinal Brain Acceleration

Brain-PACE is a deep Siamese MRI framework that directly estimates the pace of structural brain ageing from paired T1‑weighted MRI scans, extending the LILAC model with spatial attention, soft label distribution learning, and a Cramér distance objective. In a study of participants with mild cognitive impairment, 42.6 % showed accelerated ageing, and faster Brain‑PACE scores correlated with greater functional and cognitive impairment as well as higher regional tau burden in key brain regions. The method improves probabilistic performance, reduces prediction bias, and provides predictive uncertainty, offering a complementary longitudinal imaging phenotype sensitive to early neurodegeneration.

By Samuel Maddox (School of Computing Sciences, University of East Anglia), Jacob Newman (School of Computing Sciences, University of East Anglia), Saber Sami (Norwich Medical School, University of East Anglia), Michal Mackiewicz (School of Computing Sciences, University of East Anglia), for the Alzheimer's Disease Neuroimaging Initiative, the Australian Imaging Biomarkers, Lifestyle flagship study of ageing
arXiv AI
Oct 1

GateSPINE: Gated Cross-View Fusion for Lumbar Spine MRI Report Generation

GateSPINE is a vision‑language framework designed for automated lumbar spine MRI report generation. It fuses sagittal T1 and T2 volumes using a training‑free gated cross‑view fusion module, then encodes the fused sagittal and axial volumes with parallel 3D encoders before decoding the combined representation into a report. Evaluated on three datasets, GateSPINE achieves the highest clinical efficacy F1 scores, improving recall across all datasets while remaining competitive on standard natural language generation metrics.

By Hoang Nguyen Van, Cuong Vuong Tuan, Trang Mai Xuan, Bien Tran Van, Nam Tran Van, Thien Van Luong
arXiv Computer Vision
Sep 3

Asymmetric Paired-Annotation Learning for Multi-Structure ULF Pediatric Brain MRI Segmentation

The paper introduces AURA, an nnU-Net-based asymmetric supervision strategy for segmenting ultra‑low‑field (0.064 T) pediatric brain MRI. It treats high‑field‑derived (HF) and low‑field‑edited (LF) annotations as distinct observations, anchoring training to the HF mask while gating LF contributions through a reliability mechanism. On a 16‑case development split, AURA achieved Dice scores comparable to HF‑only training and improved boundary metrics, demonstrating its potential for ULF MRI segmentation.

By Ha-Hieu Pham, Dang P. M. Cao, Minh Hoang Pham, Khanh Nguyen Vo Ngoc, Thanh-Huy Nguyen, Ulas Bagci, Huy-Hieu Pham
arXiv AI
Oct 2

MIRTO: a registration-gated, multiverse-tested evaluation protocol for unsupervised anomaly segmentation in brain MRI

MIRTO is an evaluation protocol for unsupervised anomaly segmentation in brain MRI that explicitly documents key methodological choices—such as registration alignment, threshold setting, and false‑positive budgeting—and measures their impact. It applies a registration check, uses validation data for thresholding, reports realized false‑positive volumes, and repeats each comparison across 15,552 evaluation pipelines with bootstrap intervals. In a study on four UAD methods and 312 BraTS 2020 subjects, MIRTO revealed that an axis‑order mismatch dramatically lowered a diffusion model’s voxel AUROC, and that many performance differences were driven by lesion definition and threshold transfer rather than model quality.

By Negin Kafee Hernashki, Soumick Chatterjee
arXiv Computer Vision
Sep 14

Learning Sparse Latent Predictive Foundation Model for Multimodal Neuroimaging

The paper introduces Neuro‑JEPA, a sparse multimodal foundation model that learns unified representations of brain MRI across T1w, T2w, and FLAIR sequences using a latent predictive objective and a Mixture‑of‑Experts architecture. It was pretrained on over 1.5 million scans from 428,647 studies and systematically evaluates architectural, masking, objective, and sparsity choices for robust multimodal representation learning. Across 47 tasks from three health systems and 12 public datasets, Neuro‑JEPA consistently outperforms a simple CNN baseline, demonstrating its effectiveness for both clinical and research applications.

By Haoxu Huang, Long Chen, Jingyun Chen, Jinu Hyun, James Ryan Loftus, Kara Melmed, Daniel Orringer, Jennifer Frontera, Seena Dehkharghani, Arjun Masurkar, Narges Razavian