arXiv Machine Learning

Dataset-Dependent Effects of Cross-Depth Aggregation and Soft-Routed Experts in EEG Foundation Model Fine-Tuning

The study investigates whether adding specialized modules—cross‑depth Attention Residuals (AttnRes) and soft‑routed expert banks—to a fully fine‑tuned EEG foundation model improves performance on various EEG decoding tasks. Across four datasets (FACED, ISRUC, SEED‑V, PhysioNet‑MI), AttnRes alone boosts mean balanced accuracy on three datasets, while the full model with experts only benefits two. However, these gains come with significant computational overhead, and the effects are dataset‑dependent rather than consistently positive.

arXiv AI
Oct 26

Controlled Evaluation of EEG Foundation Models: Random Initialisation, Band-Power and Validation-Selected Probes

The paper evaluates five publicly released EEG foundation models and an in‑house JEPA‑style model using a protocol that includes three key controls: an untrained encoder, spectral band‑power features, and a probe layer selected without test‑set look‑ahead. The study finds that selecting the probe layer by test score can modestly improve peak performance and alter the peak‑versus‑output relationship, that random initialization can match or surpass pretraining on certain tasks, and that full fine‑tuning rarely yields gains beyond seed variability. These findings lead the authors to propose four new reporting practices and to release all experimental results for re‑analysis.

By Mingyu Jeon, Suwan Cho, Jae Young Suh
arXiv Machine Learning
Jun 2

OmniEEG-Bench: A Standardized Evaluation Benchmark for EEG Foundation Models

arXiv:2606. 00815v1 Announce Type: new Abstract: Electroencephalography (EEG) supports a variety of brain-computer interface (BCI) tasks ranging from brain-state monitoring to human-LLM interactions.

By Ziling Lu, Zongsheng Li, Xinke Shen, Kexin Lou, Yingyue Xin, Xiaoqi Chen, Shinan Wang, Xiang Chen, Jiahao Fan, Chenyu Huang, Xin Xu, Zhoujie Hou, Chen Wei, Quanying Liu
arXiv Machine Learning
Aug 31

One Model for All: Universal Pre-training for EEG based Emotion Recognition across Heterogeneous Datasets and Paradigms

The paper introduces ‘One Model for All’, a universal pre‑training framework that tackles EEG‑based emotion recognition across diverse datasets and paradigms. It decouples learning into a univariate self‑supervised contrastive pre‑training stage using a Unified Channel Schema, followed by a multivariate fine‑tuning stage that employs an Adaptive Resampling Transformer and a Graph Attention Network to model spatio‑temporal dependencies. Experiments demonstrate state‑of‑the‑art performance on within‑subject benchmarks (SEED 99.27%, DEAP 93.69%, DREAMER 93.93%) and superior cross‑dataset transfer, with ablation studies highlighting the critical role of the GAT module.

By Xiang Li, You Li, Yazhou Zhang
arXiv AI
Oct 9

Beyond Accuracy: Robustness, Interpretability and Expressiveness of EEG Foundation Models

The paper evaluates EEG foundation models (EEG‑FMs) beyond clean accuracy, testing six models and a supervised baseline across ten datasets. It finds that no single model excels in all robustness tests, that attribution methods reveal task‑appropriate brain region relevance, and that poor head‑only performance is largely due to pooling strategies rather than representation quality. The study also shows that fine‑tuning repurposes late blocks while early blocks already encode task information.

By Urban \v{S}irca, Maryam Alimardani, Stefanos Zafeiriou, Konstantinos Barmpas
arXiv Machine Learning
Aug 4

EEG-FM-Compass: Progress, Benchmarking, and Future Directions for EEG Foundation Models

arXiv:2601. 17883v3 Announce Type: replace Abstract: Electroencephalography (EEG) foundation models (FMs) have recently emerged as a promising paradigm for brain-computer interfaces, aiming to learn transferable neural representations from large-scale heterogeneous recordings.

By Dingkun Liu, Yuheng Chen, Zhu Chen, Zhenyao Cui, Yaozhi Wen, Jiayu An, Jingwei Luo, Dongrui Wu
arXiv Machine Learning
Sep 14

BRIDGE-EEG: Bridging Self-Supervised Pretraining and Efficient Deployment for Cross-Dataset EEG Classification

BRIDGE-EEG is an efficient multi‑task EEG classification pipeline that leverages self‑supervised pretraining while dramatically reducing model size. It maps heterogeneous EEG recordings to a unified 62‑channel time‑frequency representation, pretrains an SE‑ResNet18 teacher with SimCLR, and distills it into smaller SE‑ResNet8 and SE‑ResNet4 students. The compact models achieve accuracy comparable to or better than larger foundation models on abnormality detection and emotion recognition, and they consume up to three times less energy on edge devices, enabling deployment on wearable hardware.

By Meghna Roy Chowdhury, Chengwei Zhou, Haotian Yu, Gourav Datta, Shreyas Sen
arXiv Machine Learning
Sep 18

Beyond Flattened Tokens: Structure-Preserving EEG Decoding with Reusable TriDim Blocks

The paper introduces TriDim, a reusable block that preserves the three EEG axes—channel, short‑term temporal, and long‑term temporal—by applying feed‑forward transformations and cross‑axis attention. Stacking these blocks yields TriDimEEG, a standalone EEG decoder that outperforms fifteen other models on eight datasets, achieving a 4.3% relative accuracy gain. Replacing Transformer blocks in existing EEG foundation models with TriDim blocks improves downstream accuracy by 7.4% on average while reducing parameters by 17.0% to 47.3%.

By Shiyue Su, Song Wang, Zekai Zhan, Junjie Zeng, Ziling Lu, Zongsheng Li, Xinyuan Ye, Zhiyuan Ma, Xinke Shen, Quanying Liu
arXiv Machine Learning
Sep 17

iMINDBench: iEEG Multi-Institution Neural Decoding Benchmark

iMINDBench is a new benchmark for intracranial electroencephalography (iEEG) neural decoding that evaluates models on fifteen tasks across three naturalistic movie‑watching datasets from multiple institutions. It standardizes preprocessing tracks and evaluation splits to enable consistent comparisons. The study shows that pretrained systems outperform baselines within their tracks, but strong spectral baselines remain competitive, and scaling up supervised data yields only modest or task‑dependent gains.

By Geeling Chau, Saba Hashemi, Yonghyeon Gwon, Eshani Patel, Jan DeWitt, Christopher Wang, Andrii Zahorodnii, Sabera J Talukder, Danny Dongyeop Han, Chun Kee Chung, Maryam M Shanechi, Yisong Yue