arXiv AI By Isabella C. Maia, Salem Said, Pedro L. C. Rodrigues, Marco Congedo

Escaping the Capacity Ceiling: Routing on the Stiefel Manifold for Bilinear SPD Layers

Read the original on arXiv AI →

The paper introduces SCAP (Stiefel Cross-Attention Pool), a routing layer that uses a pool of Stiefel filters combined via cross‑attention to create a sample‑specific bilinear map. SCAP addresses the capacity ceiling problem of standard ReEig nonlinearity in SPD networks, where a single filter cannot align multiple domains. Experiments on five cross‑domain EEG motor‑imagery datasets show SCAP improves balanced accuracy over fixed‑filter SPDNet and matches or surpasses three domain‑adaptive baselines on most datasets.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv Machine Learning
Oct 9

SPD-MetaFormer is what you need for small-data brain decoding

The paper introduces SPD-MetaFormer, an attention‑free architecture for decoding brain signals from small datasets. It shows that existing attention‑based models on the SPD manifold (MAtt and GBWAtt) learn nearly uniform weights, and that replacing learned weights with uniform ones does not degrade performance. SPD-MetaFormer uses uniformly weighted Fréchet aggregation with a geodesic residual and a shared spectral feedforward map, achieving competitive results on three EEG benchmarks while maintaining SPD‑valued token states until classification.

By Zhida Wang, Wei Lyu, Guo Yu, Sui Tang
arXiv Computer Vision
Oct 7

RPA: Residual Patch-Token Adapter for Image Retrieval from EEG and MEG

The paper introduces the Residual Patch Adapter (RPA), a lightweight module that aligns EEG and MEG signals with all patch tokens from an intermediate layer of a Vision Transformer, rather than a single global embedding. Ablation studies show that retaining the full set of patch tokens is crucial for effective alignment, while the CLS token adds little value. Using RPA, the authors achieve state‑of‑the‑art Top‑1 accuracies on THINGS‑EEG2 and THINGS‑MEG datasets, and demonstrate that the approach generalizes to other brain encoders and can be swapped with various neural network backbones.

By Yuhui Jin, Yonghao Song, Bingchuan Liu
arXiv Computer Vision
Sep 23

Shallow to Deep: Aligning Token Pruning with Stage-wise Roles in LVLMs

The paper introduces STD, a hierarchical token pruning framework for Large Vision‑Language Models that aligns pruning strategies with the functional roles of different network stages. By using high‑frequency spectral analysis in shallow layers, Gaussian‑smoothed attention in intermediate layers, and a stability‑adaptive trigger in deep layers, STD preserves essential visual information while aggressively reducing token counts. Experiments demonstrate that STD outperforms existing pruning methods, achieving up to 94.4% token reduction and a 3.9× speed‑up on LLaVA‑NeXT‑7B.

By Shuo Zhang, Jintao Tong, Yixiong Zou, Yuhua Li, Ruixuan Li
arXiv Machine Learning
Aug 31

One Model for All: Universal Pre-training for EEG based Emotion Recognition across Heterogeneous Datasets and Paradigms

The paper introduces ‘One Model for All’, a universal pre‑training framework that tackles EEG‑based emotion recognition across diverse datasets and paradigms. It decouples learning into a univariate self‑supervised contrastive pre‑training stage using a Unified Channel Schema, followed by a multivariate fine‑tuning stage that employs an Adaptive Resampling Transformer and a Graph Attention Network to model spatio‑temporal dependencies. Experiments demonstrate state‑of‑the‑art performance on within‑subject benchmarks (SEED 99.27%, DEAP 93.69%, DREAMER 93.93%) and superior cross‑dataset transfer, with ablation studies highlighting the critical role of the GAT module.

By Xiang Li, You Li, Yazhou Zhang