FlatClip: A Geometry-Aware Surface-Level Baseline for fMRI Representation Learning
Read the original on arXiv Computer Vision →The Flow has not summarised this story yet — read it at arXiv Computer Vision.
The Flow has not summarised this story yet — read it at arXiv Computer Vision.
FlatClip is a method that leverages frozen image foundation models to predict fMRI activity by mapping cortical signals onto anatomy‑linked flatmaps and extracting features with a SigLIP2 encoder. Only a lightweight downstream probe is trained, avoiding fMRI‑specific encoder pretraining or fine‑tuning. Experiments on four resting‑state benchmarks show FlatClip surpasses ROI‑level baselines on HCP and ADNI, while its performance varies on PPMI and remains below the best voxel‑level models; on NSD visual‑fMRI decoding, restricting inputs to task‑active cortex improves recognition, and spatial perturbations confirm the importance of cortical arrangement and input‑region selection.
arXiv:2606. 04772v1 Announce Type: cross Abstract: Understanding the relationship between deep visual representations and the human visual system is a fundamental challenge in computational neuroscience.
arXiv:2606. 11500v1 Announce Type: cross Abstract: The success of large-scale deep learning models in neuroscience is fundamentally constrained by severe data heterogeneity.
Understanding the relationship between deep visual representations and the human visual system is a fundamental challenge in computational neuroscience. While modern vision models achieve strong performance in image recognition, their correspondence with the hierarchical organization of the human visual cortex remains an open question.
BrainPro is a process‑conditioned self‑supervised pretraining framework for large EEG models that addresses two underexplored challenges: the underuse of mental‑process cues in masked pretraining and the variability of electrode montages across datasets. It maps dataset‑specific montages to a universal channel‑region template, retrieves spatial filters to create a topographically aligned basis, and learns a shared encoder along with process‑specific branches conditioned on protocol cues. Experiments on nine public BCI benchmarks show that BrainPro outperforms baselines, with ablations indicating that topographic retrieval and process‑conditioned representation learning jointly enhance EEG decoding.
arXiv:2609.34167v2 Announce Type: replace Abstract: Foundation models pre-trained on large-scale fMRI datasets have shown strong downstream performance, but at substantial data and computation cost....