arXiv AI

Flattening the Connectome Spectrum: A Spectral Filter for FC Induces a Pretraining Target for fMRI Encoders

arXiv Machine Learning
Sep 24

A Scaling Study for fMRI Foundation Models

The study investigates how data volume, model size, and training duration affect the performance of fMRI foundation models. Using over 200 datasets and 10,000 GPU‑hours, the authors find that larger models benefit more from additional data, and that at a fixed compute budget, increasing data yields greater gains than enlarging the model. By selecting optimal combinations of data, size, and duration, they produce models that outperform existing fMRI foundation models on out‑of‑distribution tasks while requiring less pretraining compute.

By Wenhao Ye, Xuanye Pan, Junfeng Xia, Junxiang Zhang, Mo Wang, Quanying Liu
arXiv Machine Learning
Jul 9

STST-JEPA: Shallow-Target Spatio-Temporal Joint Embedding Prediction Architecture For EEG Self-Supervised Learning

arXiv:2607. 06629v1 Announce Type: new Abstract: Brain age -- the age inferred from a physiological recording -- is an emerging biomarker whose deviation from chronological age tracks neurological and psychiatric burden, and EEG is an attractive substrate for it because it is cheap, portable, and temporally rich.

By Roy Segal, Yoni Svechinsky, Tomer Fekete
arXiv Machine Learning
Sep 7

Brain4FMs: A Benchmark of Foundation Models for Electrical Brain Signal

Brain4FMs is a unified benchmark for evaluating brain foundation models (BFMs) on both scalp EEG and intracranial EEG (iEEG). It incorporates 17 representative models and 21 public datasets spanning clinical diagnosis, sleep staging, communication, and affective computing, and offers dataset-aware preprocessing, cross‑subject evaluation, and standardized downstream workflows. The benchmark highlights that no single BFM consistently outperforms others across all tasks, modalities, and adaptation protocols, prompting further exploratory analyses of model‑specific spatial, spectral, and discrete representations.

By Fanqi Shen, Enhong Yang, Jiahe Li, Junru Hong, Xiaoran Pan, Zhizhang Yuan, Meng Li, Yang Yang
arXiv AI
3d ago

Combining General and Domain-Specific Pretext Tasks for Brain MR Image Segmentation

The paper investigates combining a domain‑specific self‑supervised task—voxel‑level brain age prediction—with a general task—image inpainting—to pretrain models for brain MRI segmentation. A multitask pretraining framework jointly optimizes both objectives, yielding representations that outperform single‑task pretraining and training from scratch on three segmentation benchmarks (multiple sclerosis lesions, ischemic stroke lesions, and cortical structures). The study demonstrates that integrating domain‑specific and general self‑supervised tasks benefits the development of generalizable neuroimaging foundation models.

By Tasneem Nasser, Susanne Schmid, Roberto Souza, Naser El-Sheimy
arXiv AI
3d ago

Neural State Prediction: Obstructing Shortcut Learning in EEG Foundation Models

Neural State Prediction (NSP) is a latent‑predictive framework designed to curb shortcut learning in EEG foundation models. By using a target encoder updated with an exponential moving average, identity residualization, and topology‑separated context, NSP constrains both the prediction target and the available context. Trained on 2.2 million EEG segments, NSP outperforms baselines on 14 datasets in the EEG‑FM‑Bench, achieving 63.94 % macro balanced accuracy.

By Kieren Yu, Ziyang Liu, Chang Huang, Jintai Chen, Kaishun Wu