arXiv AI By Weishan Ye, Yue Pan, Li Zhang, Gan Huang, Zhen Liang

Brain-Token Learning: Microstate-Based Tokenization and Multi-Scale Interaction for Long-Horizon EEG Sequence Modeling

Read the original on arXiv AI →

The Flow has not summarised this story yet — read it at arXiv AI.

arXiv Machine Learning
Oct 15

NeuroDETR: Multiscale Discrete Spatiotemporal Tokenization for Asynchronous EEG Event Detection

NeuroDETR is a novel multiscale discrete spatiotemporal tokenization framework designed for asynchronous EEG event detection. It combines structured tokenization, event-aware feature refinement, and a sparse attention module called FOCAL to capture both brief and sustained neural responses while preserving spatial hierarchy across EEG channels. Experiments on eight diverse EEG datasets show that NeuroDETR achieves state‑of‑the‑art performance in jointly classifying events and estimating their onsets and offsets.

By Yaozhi Wen, Kun Zhao, Wei Wei, Haoyang Chen, Kangning Wang, Yi Sun, Shaowei Gu, Dingkun Liu, Shuang Qiu, Huiguang He
arXiv AI
4d ago

Quantifying Trait-State Hierarchy in EEG Foundation Model and Signal Processing Embeddings

The paper investigates how EEG embeddings from signal processing and foundation models encode trait and state information. Using a hierarchy metric and kNN purity on a BCI dataset, it finds that most embeddings form a macro‑trait hierarchy with micro‑states inside, which hampers state discrimination. Normalizing embeddings reduces trait leakage and improves state classification accuracy by about 10%, and fine‑tuning shifts the hierarchy toward macro‑state organization, enhancing decoding performance.

By Anusha Madapura, Aditya Kommineni, Shrikanth Narayanan
arXiv Machine Learning
Oct 22

BrainCodes: A Lightweight EEG Foundation Model over Discrete Neural Codes

BrainCodes is a lightweight EEG foundation model that uses a quantization-based neural tokenizer and a spatiotemporal encoder to learn transferable EEG features from over 800 hours of data across more than 1,000 participants. The model is pretrained with a self‑supervised objective that encourages spatial connectivity and sensitivity to narrowband neural oscillations, enabling it to match or surpass state‑of‑the‑art performance on tasks such as sleep staging, attention assessment, and cognitive load estimation. It achieves these results while using up to 97% fewer trainable parameters, making it suitable for low‑resource wearable devices, and its evaluation framework analyzes the geometry and invariances of the learned representations.

By Kleanthis Avramidis, Ivan Tashev, Dimitra Emmanouilidou