arXiv Computer Vision
Oct 16

FlatClip: Reusing Image Foundation Models for fMRI Representation Learning via Cortical Flatmaps

FlatClip is a method that leverages frozen image foundation models to predict fMRI activity by mapping cortical signals onto anatomy‑linked flatmaps and extracting features with a SigLIP2 encoder. Only a lightweight downstream probe is trained, avoiding fMRI‑specific encoder pretraining or fine‑tuning. Experiments on four resting‑state benchmarks show FlatClip surpasses ROI‑level baselines on HCP and ADNI, while its performance varies on PPMI and remains below the best voxel‑level models; on NSD visual‑fMRI decoding, restricting inputs to task‑active cortex improves recognition, and spatial perturbations confirm the importance of cortical arrangement and input‑region selection.

By Mo Wang, Wenhao Ye, Zihan Ning, Jiayu Zuo, Junfeng Xia, Hongkai Wen, Quanying Liu
Hugging Face Trending Papers
Jun 3

Coarse-to-fine Hierarchical Architecture with Sequential Mamba for Brain Reconstruction

Understanding the relationship between deep visual representations and the human visual system is a fundamental challenge in computational neuroscience. While modern vision models achieve strong performance in image recognition, their correspondence with the hierarchical organization of the human visual cortex remains an open question.

arXiv Machine Learning
Oct 22

BrainPro: Process-conditioned Pretraining with Topographic Retrieval for Large EEG Models

BrainPro is a process‑conditioned self‑supervised pretraining framework for large EEG models that addresses two underexplored challenges: the underuse of mental‑process cues in masked pretraining and the variability of electrode montages across datasets. It maps dataset‑specific montages to a universal channel‑region template, retrieves spatial filters to create a topographically aligned basis, and learns a shared encoder along with process‑specific branches conditioned on protocol cues. Experiments on nine public BCI benchmarks show that BrainPro outperforms baselines, with ablations indicating that topographic retrieval and process‑conditioned representation learning jointly enhance EEG decoding.

By Yi Ding, Muyun Jiang, Weibang Jiang, Shuailei Zhang, Xinliang Zhou, Chenyu Liu, Shanglin Li, Yong Li, Cuntai Guan