arXiv AI

ProCA: Progressive Contrastive Alignment for Robust EEG Visual Decoding

ProCA: Progressive Contrastive Alignment for Robust EEG Visual Decoding introduces a model‑agnostic framework that adaptively aligns EEG signals with visual semantics. It replaces fixed visual or textual anchors with EEG‑aware class‑level contrastive supervision and employs structure‑consistent interpolation to preserve channel‑wise and temporal importance. Across multiple evaluation settings—including subject‑dependent, subject‑independent, strict cross‑subject transfer, and continual adaptation—ProCA delivers significant performance gains, achieving relative Top‑1 improvements ranging from 7.4% to 28.1%.

arXiv AI
Oct 16

Neural Visual Decoding via Cognitive guided Adaptive Blurring and Information Constrained Alignment

The paper introduces CAIA, a framework that enhances EEG-based visual decoding by adaptively blurring visual features to match neural granularity and applying an information-constrained alignment on EEG signals. It incorporates cognitive-guided adaptive blurring, spectral sparsity regularization, and a distribution-aware boundary calibration loss to improve signal-to-noise ratio and alignment robustness. Experiments show CAIA outperforms previous methods in both subject-dependent and subject-independent zero-shot brain-to-image retrieval tasks.

By Fan Yin, Chuhang Zheng, Peiliang Gong, Donghai Guan, Qi Zhu
arXiv Machine Learning
Oct 16

Semantic Alignment of EEG and Text: A Contrastive Learning Framework for Decoding Imagined Speech

The paper introduces a multimodal contrastive learning framework that aligns EEG recordings of imagined speech with language representations from a frozen text encoder. By training an EEG encoder with a composite objective that balances semantic reweighting and class discrimination, the method preserves separability among 39 intent categories while embedding EEG signals into a language embedding space. Experiments on the Chisco dataset show comparable decoding performance to a task‑optimized classifier, and additional metrics such as MaxCosine and semantic axes demonstrate intrinsic reliability and broader semantic structure beyond fixed categories.

By Shahryar G. Namdari, Francesco Iacomi, Riccardo Barbieri, Luca Mainardi
arXiv Machine Learning
Oct 8

Multimodal LLMs Can Learn to Read Brain Signals: A Vision--Language Model for Unified Multi-Task EEG Decoding

The paper introduces BraVista, a visual-language framework that transforms multichannel EEG signals into structured images and uses instruction‑conditioned vision‑language models for unified multi‑task EEG decoding. By continuing post‑training of a general‑domain VLM, BraVista adapts to neural signals without large‑scale EEG‑specific pretraining, achieving strong performance across sleep staging, emotion recognition, cognitive workload classification, and abnormal EEG detection. Analyses show that the EEG‑to‑image representation is crucial and that the model’s performance degrades gradually with added noise, indicating reliance on genuine EEG information.

By Parastoo Azizeddin, Omid Sharafi, Maryam M. Shanechi
arXiv Computer Vision
Oct 7

RPA: Residual Patch-Token Adapter for Image Retrieval from EEG and MEG

The paper introduces the Residual Patch Adapter (RPA), a lightweight module that aligns EEG and MEG signals with all patch tokens from an intermediate layer of a Vision Transformer, rather than a single global embedding. Ablation studies show that retaining the full set of patch tokens is crucial for effective alignment, while the CLS token adds little value. Using RPA, the authors achieve state‑of‑the‑art Top‑1 accuracies on THINGS‑EEG2 and THINGS‑MEG datasets, and demonstrate that the approach generalizes to other brain encoders and can be swapped with various neural network backbones.

By Yuhui Jin, Yonghao Song, Bingchuan Liu