arXiv Machine Learning

Semantic Alignment of EEG and Text: A Contrastive Learning Framework for Decoding Imagined Speech

The paper introduces a multimodal contrastive learning framework that aligns EEG recordings of imagined speech with language representations from a frozen text encoder. By training an EEG encoder with a composite objective that balances semantic reweighting and class discrimination, the method preserves separability among 39 intent categories while embedding EEG signals into a language embedding space. Experiments on the Chisco dataset show comparable decoding performance to a task‑optimized classifier, and additional metrics such as MaxCosine and semantic axes demonstrate intrinsic reliability and broader semantic structure beyond fixed categories.

arXiv AI
Sep 7

ProCA: Progressive Contrastive Alignment for Robust EEG Visual Decoding

ProCA: Progressive Contrastive Alignment for Robust EEG Visual Decoding introduces a model‑agnostic framework that adaptively aligns EEG signals with visual semantics. It replaces fixed visual or textual anchors with EEG‑aware class‑level contrastive supervision and employs structure‑consistent interpolation to preserve channel‑wise and temporal importance. Across multiple evaluation settings—including subject‑dependent, subject‑independent, strict cross‑subject transfer, and continual adaptation—ProCA delivers significant performance gains, achieving relative Top‑1 improvements ranging from 7.4% to 28.1%.

By Kanglei Zhou, Chunyan Lan, Dongyang Li, Jun Zhu, Liyuan Wang
arXiv AI
Sep 17

A Survey on Bridging EEG Signals and Generative AI: From Image and Text to Beyond

This survey reviews recent advances in converting non‑invasive EEG signals into images, text, and audio using generative AI techniques such as GANs, VAEs, transformers, and diffusion models. It summarizes datasets, feature‑encoding methods, evaluation metrics, and key challenges, noting that EEG‑to‑image models mainly use encoder‑decoder architectures, EEG‑to‑text leverages transformer language models, and EEG‑to‑audio maps signals to mel‑spectrograms for vocoder synthesis. The paper highlights the limitations of small, heterogeneous datasets, poor cross‑subject generalization, and the lack of standardized benchmarks, while providing open‑source resources to support reproducible research.

By Shreya Shukla, Jose Torres, Akshaj Murhekar, Christina Liu, Abhijit Mishra, Jacek Gwizdka, Shounak Roychowdhury
arXiv Machine Learning
Aug 21

Decoding silent reading from non-invasive EEG

arXiv:2608. 20186v1 Announce Type: new Abstract: Non-invasive decoding of inner speech faces a fundamental data problem: a corpus pairing brain activity with a person's spontaneous inner monologue cannot be collected, and the available proxy paradigms (cued repetitive and retrospectively reported generative inner speech) are slow to acquire, poorly time-locked, and subject compliance is unverifiable.

By Ingo Marquardt, Anthilia Alchanat, Priyanka Jain