arXiv AI

Adaptive Anisotropic Attention for Axis-Structured Signals

The paper introduces Adaptive Anisotropic Attention (AAA), a method that splits self‑attention into temporal and spatial paths for axis‑structured signals like EEG. A learned gate combines the two paths for each token, and the resulting AXON model outperforms dense attention baselines on six EEG tasks and shows transfer to audio spectrograms. The study demonstrates that aligning attention with the natural axes of structured data provides a beneficial inductive bias.

Hugging Face Trending Papers
Sep 8

Adaptive Anisotropic Attention for Axis-Structured Signals

The paper introduces Adaptive Anisotropic Attention (AAA), a method that splits self‑attention into temporal and spatial paths for axis‑structured signals like EEG. A learned gate combines the two paths for each token, and the resulting AXON model outperforms dense attention baselines on six EEG tasks and shows benefits in audio spectrogram experiments. The study demonstrates that aligning attention with natural signal axes provides a useful inductive bias.

arXiv AI
Sep 7

ProCA: Progressive Contrastive Alignment for Robust EEG Visual Decoding

ProCA: Progressive Contrastive Alignment for Robust EEG Visual Decoding introduces a model‑agnostic framework that adaptively aligns EEG signals with visual semantics. It replaces fixed visual or textual anchors with EEG‑aware class‑level contrastive supervision and employs structure‑consistent interpolation to preserve channel‑wise and temporal importance. Across multiple evaluation settings—including subject‑dependent, subject‑independent, strict cross‑subject transfer, and continual adaptation—ProCA delivers significant performance gains, achieving relative Top‑1 improvements ranging from 7.4% to 28.1%.

By Kanglei Zhou, Chunyan Lan, Dongyang Li, Jun Zhu, Liyuan Wang
arXiv Machine Learning
Aug 4

EEG-FM-Compass: Progress, Benchmarking, and Future Directions for EEG Foundation Models

arXiv:2601. 17883v3 Announce Type: replace Abstract: Electroencephalography (EEG) foundation models (FMs) have recently emerged as a promising paradigm for brain-computer interfaces, aiming to learn transferable neural representations from large-scale heterogeneous recordings.

By Dingkun Liu, Yuheng Chen, Zhu Chen, Zhenyao Cui, Yaozhi Wen, Jiayu An, Jingwei Luo, Dongrui Wu
arXiv Machine Learning
Sep 22

Adaptive Forgetting for Nonstationary Optimization: Towards Robust EEG Decoding

The paper introduces AFOR, a tensor‑wise adaptive optimizer for EEG decoding that replaces the fixed second‑moment decay coefficient used in Adam/AdamW with a dynamic coefficient estimated online from local gradient state. AFOR combines a Residual‑Alignment Signal Scorer (RASS) to assess gradient quality and an Adaptive Forgetting Controller (AFC) to map this score to a bounded per‑step decay coefficient, with cumulative‑product initialization correction for consistency. In cross‑subject experiments on three EEG benchmarks, AFOR outperforms standard optimizers, improving mean test accuracy by 3.00%, 2.07%, and 4.38% over Adam.

By Hongyu Zhu, Lin Chen, Jing Chen, Yuting Zhou, Mingsheng Shang
arXiv Machine Learning
Sep 7

Brain4FMs: A Benchmark of Foundation Models for Electrical Brain Signal

Brain4FMs is a unified benchmark for evaluating brain foundation models (BFMs) on both scalp EEG and intracranial EEG (iEEG). It incorporates 17 representative models and 21 public datasets spanning clinical diagnosis, sleep staging, communication, and affective computing, and offers dataset-aware preprocessing, cross‑subject evaluation, and standardized downstream workflows. The benchmark highlights that no single BFM consistently outperforms others across all tasks, modalities, and adaptation protocols, prompting further exploratory analyses of model‑specific spatial, spectral, and discrete representations.

By Fanqi Shen, Enhong Yang, Jiahe Li, Junru Hong, Xiaoran Pan, Zhizhang Yuan, Meng Li, Yang Yang
arXiv AI
Jun 8

LuMamba: Latent Unified Mamba for Electrode Topology-Invariant and Efficient EEG Modeling

arXiv:2603. 19100v2 Announce Type: replace Abstract: Electroencephalography (EEG) enables non-invasive monitoring of brain activity across clinical and neurotechnology applications, yet building foundation models for EEG remains challenging due to differing electrode topologies and computational scalability, as Transformer architectures incur quadratic sequence complexity.

By Dana\'e Broustail, Anna Tegon, Thorir Mar Ingolfsson, Yawei Li, Luca Benini