arXiv AI

Controlled Evaluation of EEG Foundation Models: Random Initialisation, Band-Power and Validation-Selected Probes

The paper evaluates five publicly released EEG foundation models and an in‑house JEPA‑style model using a protocol that includes three key controls: an untrained encoder, spectral band‑power features, and a probe layer selected without test‑set look‑ahead. The study finds that selecting the probe layer by test score can modestly improve peak performance and alter the peak‑versus‑output relationship, that random initialization can match or surpass pretraining on certain tasks, and that full fine‑tuning rarely yields gains beyond seed variability. These findings lead the authors to propose four new reporting practices and to release all experimental results for re‑analysis.

arXiv Machine Learning
Jun 2

OmniEEG-Bench: A Standardized Evaluation Benchmark for EEG Foundation Models

arXiv:2606. 00815v1 Announce Type: new Abstract: Electroencephalography (EEG) supports a variety of brain-computer interface (BCI) tasks ranging from brain-state monitoring to human-LLM interactions.

By Ziling Lu, Zongsheng Li, Xinke Shen, Kexin Lou, Yingyue Xin, Xiaoqi Chen, Shinan Wang, Xiang Chen, Jiahao Fan, Chenyu Huang, Xin Xu, Zhoujie Hou, Chen Wei, Quanying Liu
arXiv Machine Learning
Sep 17

Dataset-Dependent Effects of Cross-Depth Aggregation and Soft-Routed Experts in EEG Foundation Model Fine-Tuning

The study investigates whether adding specialized modules—cross‑depth Attention Residuals (AttnRes) and soft‑routed expert banks—to a fully fine‑tuned EEG foundation model improves performance on various EEG decoding tasks. Across four datasets (FACED, ISRUC, SEED‑V, PhysioNet‑MI), AttnRes alone boosts mean balanced accuracy on three datasets, while the full model with experts only benefits two. However, these gains come with significant computational overhead, and the effects are dataset‑dependent rather than consistently positive.

By Mingyang Jiang, Yamin Li, Daniel Moyer, Fan Ma, Hua Xu, Catie Chang
arXiv Machine Learning
Sep 22

Comparative Analysis of State-of-the-Art Foundation Models for Sleep Analysis Under Channel Reduction

The study compares six state‑of‑the‑art sleep‑staging foundation models on the MESA polysomnography dataset under three signal conditions: EEG only, ECG only, and EEG+ECG. Results show that EEG alone yields the highest accuracy (BIOT macro‑F1 = 0.7237), while switching to ECG alone incurs a consistent accuracy loss of about 0.35 macro‑F1 and reduces data rate to one‑third. Adding ECG to EEG offers little benefit for most models, indicating that EEG carries most of the sleep‑staging signal and that wearable‑compatible ECG alone is a viable but less accurate alternative.

By Hassan Mehdi, Riku Klen, Ayse Kosal Bulbul, Suzanne Timmons, Abdulhamit Subasi, Wei Chen, Zou Zhu, Muhammad Irfan
arXiv AI
Oct 1

NeuroAtlas: Benchmarking Foundation Models for Clinical EEG and Brain-Computer Interfaces

NeuroAtlas is the largest EEG benchmark to date, comprising 42 datasets and 260,000 hours of clinical EEG data across epilepsy, sleep medicine, brain age estimation, and brain‑computer interfaces. The study evaluates foundation models (FMs) for EEG against supervised baselines and generic time‑series FMs, finding that EEG‑specific FMs do not consistently outperform generic ones. It also demonstrates that standard machine‑learning metrics are inadequate for clinical relevance, advocating for task‑specific measures such as event‑level decision quality, hypnogram features, and brain‑age gap.

By Konstantinos Kontras, Trui Osselaer, Stylianos G. Mouslech, Angeliki-Ilektra Karaiskou, Guido Gagliardi, Thomas Strypsteen, Mohammad Hossein Badiei, Anku Rani, Maarten Vanmarcke, Miguel Bhagubai, Chanakya Ekbote, Jaedong Hwang, Christos Chatzichristos, Paul Pu Liang, Maarten De Vos
arXiv Machine Learning
Sep 7

Brain4FMs: A Benchmark of Foundation Models for Electrical Brain Signal

Brain4FMs is a unified benchmark for evaluating brain foundation models (BFMs) on both scalp EEG and intracranial EEG (iEEG). It incorporates 17 representative models and 21 public datasets spanning clinical diagnosis, sleep staging, communication, and affective computing, and offers dataset-aware preprocessing, cross‑subject evaluation, and standardized downstream workflows. The benchmark highlights that no single BFM consistently outperforms others across all tasks, modalities, and adaptation protocols, prompting further exploratory analyses of model‑specific spatial, spectral, and discrete representations.

By Fanqi Shen, Enhong Yang, Jiahe Li, Junru Hong, Xiaoran Pan, Zhizhang Yuan, Meng Li, Yang Yang
arXiv AI
Sep 2

EEG-AS: Instance-Level Foundation Model Selection for EEG Foundation Models via Behavior Reconstruction

EEG-AS is an instance-level algorithm selection framework designed for EEG foundation models. It characterizes each EEG instance using latent embeddings, handcrafted neurophysiological features, and an anchor foundation model, then learns to reconstruct the behaviors of other foundation models from privileged prediction tokens. During inference, EEG-AS estimates these behaviors without running the full model portfolio, enabling efficient selection among seven EEG foundation models and significantly reducing the performance gap between the single best solver and the oracle upper bound across seven public EEG benchmarks.

By Yunzhen Zhang, Ruoxi Piao, Hasan Onur Keles, Mustafa Misir
Hugging Face Trending Papers
Jul 27

Stress-Testing EEG Foundation Models for Clinical Decoding: Dataset Identity and Targeted Negative Controls

Pretrained EEG foundation models are increasingly proposed for clinical decoding, but their transfer across populations and robustness to negative controls remain unclear. We benchmark six models (LaBraM, EEGMamba, CBraMod, REVE, BENDR, and BIOT) on five clinical tasks across four datasets using frozen linear probes with leave-one-subject-out, subject-grouped, or explicitly identified recording-level splits.

arXiv Machine Learning
Aug 4

EEG-FM-Compass: Progress, Benchmarking, and Future Directions for EEG Foundation Models

arXiv:2601. 17883v3 Announce Type: replace Abstract: Electroencephalography (EEG) foundation models (FMs) have recently emerged as a promising paradigm for brain-computer interfaces, aiming to learn transferable neural representations from large-scale heterogeneous recordings.

By Dingkun Liu, Yuheng Chen, Zhu Chen, Zhenyao Cui, Yaozhi Wen, Jiayu An, Jingwei Luo, Dongrui Wu