arXiv Machine Learning

MnemoDyn: Learning Resting State Dynamics from 40K FMRI sequences

arXiv Computer Vision
Sep 14

Learning Sparse Latent Predictive Foundation Model for Multimodal Neuroimaging

The paper introduces Neuro‑JEPA, a sparse multimodal foundation model that learns unified representations of brain MRI across T1w, T2w, and FLAIR sequences using a latent predictive objective and a Mixture‑of‑Experts architecture. It was pretrained on over 1.5 million scans from 428,647 studies and systematically evaluates architectural, masking, objective, and sparsity choices for robust multimodal representation learning. Across 47 tasks from three health systems and 12 public datasets, Neuro‑JEPA consistently outperforms a simple CNN baseline, demonstrating its effectiveness for both clinical and research applications.

By Haoxu Huang, Long Chen, Jingyun Chen, Jinu Hyun, James Ryan Loftus, Kara Melmed, Daniel Orringer, Jennifer Frontera, Seena Dehkharghani, Arjun Masurkar, Narges Razavian
arXiv AI
Oct 9

SRUG: A Fusion-Driven Generator Network for Medical Image Translation

SRUG is a supervised, fusion‑driven generator network designed for paired MRI sequence synthesis. It eliminates the generator‑discriminator competition by directly learning a deterministic source‑to‑target mapping, using a residual encoder, full‑resolution stem, and a nested multi‑scale decoder to preserve structural fidelity. Experiments on BraTS 2023 and IXI demonstrate competitive reconstruction quality and cross‑dataset transferability, supporting direct supervised generation as a practical approach for medical image translation.

By Xihe Qiu, Yang Dai, Xiaoyu Tan, Sijia Li, Fenghao Sun, Lu Gan, Liang Liu
arXiv AI
Sep 21

Rhamba: Region-Aware Hybrid Attention-Mamba Framework for Self-Supervised Learning in Resting-State fMRI

Rhamba is a region‑aware pretraining framework for resting‑state fMRI that combines anatomically guided masking with hybrid Attention‑Mamba architectures. The study pretrained models on the ABIDE dataset using three masking strategies (Any, Majority, Pure) and evaluated four architectural variants, finding that the Mamba‑Attention (MA) hybrid achieved the best average AUROC on downstream schizophrenia and ADHD classification tasks. Explainable AI via Integrated Gradients highlighted that performance depends on the interaction between masking strategy and architecture rather than a single dominant configuration.

By Pankaj Pandey, Ruthwik Reddy Doodipala, Pratheek Eranki, Carolina Torres-Rojas, Manob Jyoti Saikia, Ranganatha Sitaram
arXiv AI
Jul 28

Real-time Reconstruction of Human Visual Perception from fMRI

arXiv:2607. 22753v1 Announce Type: cross Abstract: Real-time closed-loop neurofeedback based on functional magnetic resonance imaging (fMRI) has led to important scientific and clinical advances.

By Rishab S. Iyer, Jiaxin Cindy Tu, Cesar Kadir Torrico Villanueva, Anish Mahishi, Ross P. Kempner, Jacob S. Prince, Ernest W. Lo, Akash Bhowmick, Hritik Arasu, Amaar Chughtai, Elizabeth A. McDevitt, Paul S. Scotti, Kenneth A. Norman
arXiv AI
Oct 31

Latent Prediction Yields Cross-Subject Alignable Representations in Sensory-Evoked fMRI

The study investigates whether self‑supervised learning can produce useful representations from fMRI data alone. Using a joint embedding predictive architecture, participant‑specific encoders are trained without access to stimulus images or derived representations. The resulting embeddings perform competitively on brain captioning, image reconstruction, and cross‑participant generalization, and can be aligned unsupervised across participants, enabling a decoding head trained on one subject to work on another with minimal loss of performance.

By Serwan Jassim, Victoria Bosch, Daniel Anthes, Elia Bruni, Tim Kietzmann