arXiv Machine Learning

Decoding silent reading from non-invasive EEG

arXiv:2608. 20186v1 Announce Type: new Abstract: Non-invasive decoding of inner speech faces a fundamental data problem: a corpus pairing brain activity with a person's spontaneous inner monologue cannot be collected, and the available proxy paradigms (cued repetitive and retrospectively reported generative inner speech) are slow to acquire, poorly time-locked, and subject compliance is unverifiable.

arXiv Machine Learning
3d ago

Deep LLM layers expose passage-level context in EEG during silent reading

The study investigates how information about words and passage context is represented across the layers of the Llama‑3.1‑8B language model during silent reading, using EEG recordings. Decoders trained on each layer show that word‑level decodability peaks in early layers and diminishes toward the final layer, while a context‑tracking component increases with depth. Even a single 0.5‑second EEG window can capture passage‑level information, and control experiments confirm that this context tracking is driven by the text rather than by word decoding or session artifacts.

By Ingo Marquardt, Anthilia Alchanat, Priyanka Jain
arXiv Machine Learning
6d ago

Semantic Alignment of EEG and Text: A Contrastive Learning Framework for Decoding Imagined Speech

The paper introduces a multimodal contrastive learning framework that aligns EEG recordings of imagined speech with language representations from a frozen text encoder. By training an EEG encoder with a composite objective that balances semantic reweighting and class discrimination, the method preserves separability among 39 intent categories while embedding EEG signals into a language embedding space. Experiments on the Chisco dataset show comparable decoding performance to a task‑optimized classifier, and additional metrics such as MaxCosine and semantic axes demonstrate intrinsic reliability and broader semantic structure beyond fixed categories.

By Shahryar G. Namdari, Francesco Iacomi, Riccardo Barbieri, Luca Mainardi
arXiv AI
Jul 24

Transition-Related Potentials as Markers of Narrative Comprehension in Continuous EEG

arXiv:2607. 20720v1 Announce Type: cross Abstract: Harnessing the potential of electroencephalography (EEG) for brain research is fundamentally limited by intrinsic noise and the diffuse projection of brain-generated activity over the scalp.

By B\'alint Csan\'ady, P\'eter Vedres, Krist\'of Zsolt Mak\'o, Orsolya Papp-Zipernovszky, M\'arta Volosin, D\'avid Apagyi, Andr\'as Luk\'acs, Andr\'as B\'alint Kov\'acs, Zoltan Nadasdy
arXiv Machine Learning
6d ago

Cross-subject decoding of imagined speech from scalp EEG: a leakage-controlled evaluation on three public corpora

The study evaluated whether imagined speech decoded from scalp EEG can transfer across individuals using three public datasets. Across 482 participant pairs, cross‑subject decoding accuracy was essentially at chance, while within‑subject decoding only surpassed chance in one dataset. The results suggest that imagined‑speech content does not generalize between people and that larger single‑condition datasets are more beneficial than further model development.

By Blessing Isoyiza Adeika, Onyema Osuagwu
arXiv AI
Sep 7

ProCA: Progressive Contrastive Alignment for Robust EEG Visual Decoding

ProCA: Progressive Contrastive Alignment for Robust EEG Visual Decoding introduces a model‑agnostic framework that adaptively aligns EEG signals with visual semantics. It replaces fixed visual or textual anchors with EEG‑aware class‑level contrastive supervision and employs structure‑consistent interpolation to preserve channel‑wise and temporal importance. Across multiple evaluation settings—including subject‑dependent, subject‑independent, strict cross‑subject transfer, and continual adaptation—ProCA delivers significant performance gains, achieving relative Top‑1 improvements ranging from 7.4% to 28.1%.

By Kanglei Zhou, Chunyan Lan, Dongyang Li, Jun Zhu, Liyuan Wang
arXiv Machine Learning
Oct 2

Removing Timing Shortcuts Improves Non-Invasive Brain-to-Text

The study shows that previously reported gains in decoding spoken words from non‑invasive brain recordings can largely be replicated without any brain data, due to a timing shortcut where overlapping windows reveal word durations. By processing each window independently rather than jointly, the authors eliminate this shortcut, enabling the neural network to learn genuine brain‑based word information. This change improves performance and makes two existing strategies—aggregating predictions from multiple neural responses and incorporating a pretrained language model—significantly more effective, achieving a word error rate of 36.6% on a perceived speech benchmark.

By Dulhan Jayalath, Oiwi Parker Jones
arXiv Machine Learning
Jul 22

Is EEG-to-Text Feasible in Real-World Scenarios? An In-Depth Analysis Using a Neuropsychology-Inspired Benchmark

arXiv:2607. 18749v1 Announce Type: new Abstract: Translating brain signals into text could restore communication for people with severe paralysis, yet practically usable systems to date rely on invasive electrocorticography (ECoG).

By Zihan Zhang (Research Center for Social Computing and Interactive Robotics, Harbin Institute of Technology), Yu Bao (Research Center for Social Computing and Interactive Robotics, Harbin Institute of Technology, Shanghai Innovation Institute), Xiao Ding (Research Center for Social Computing and Interactive Robotics, Harbin Institute of Technology), Tianyi Jiang (State Key Laboratory for Novel Software Technology, Nanjing University), Kai Xiong (Zhongguancun Laboratory)