arXiv Machine Learning
Thought-deciphering via hierarchical EEG-to-text alignment
Read the original on arXiv Machine Learning →The Flow has not summarised this story yet — read it at arXiv Machine Learning.
Related stories
arXiv Machine Learning
Oct 16
Semantic Alignment of EEG and Text: A Contrastive Learning Framework for Decoding Imagined Speech
The paper introduces a multimodal contrastive learning framework that aligns EEG recordings of imagined speech with language representations from a frozen text encoder. By training an EEG encoder with a composite objective that balances semantic reweighting and class discrimination, the method preserves separability among 39 intent categories while embedding EEG signals into a language embedding space. Experiments on the Chisco dataset show comparable decoding performance to a task‑optimized classifier, and additional metrics such as MaxCosine and semantic axes demonstrate intrinsic reliability and broader semantic structure beyond fixed categories.
arXiv AI
Jul 29
Joint Text-Audio Alignment for EEG-to-Text Decoding in Chinese Speech Production and Perception
arXiv:2607. 25626v1 Announce Type: new Abstract: Decoding speech information directly from scalp electroencephalography (EEG) into text provides a potential non-invasive neural communication pathway for individuals with severe speech and motor impairments.
arXiv AI
Jun 6
Brain-CLIPLM: Semantic Compression for EEG-to-Text Decoding
arXiv:2604. 16370v2 Announce Type: replace-cross Abstract: Decoding natural language from non-invasive electroencephalography (EEG) remains constrained by low signal-to-noise ratio and limited information bandwidth.
arXiv Machine Learning
Jul 22
Is EEG-to-Text Feasible in Real-World Scenarios? An In-Depth Analysis Using a Neuropsychology-Inspired Benchmark
arXiv:2607. 18749v1 Announce Type: new Abstract: Translating brain signals into text could restore communication for people with severe paralysis, yet practically usable systems to date rely on invasive electrocorticography (ECoG).
arXiv Machine Learning
Oct 23
EEG-Captioner: Grounding EEG-to-Language Generation in Fundamental Signal Properties
EEG-Captioner introduces a new EEG-to-language framework that grounds language generation in measurable EEG signal properties. The authors built a large dataset of 160,781 EEG segments annotated with question‑answer pairs targeting spectral, spatial, temporal, and lateral properties, and paired each segment with a feature‑grounded caption. Their Dual‑Domain EEG Encoder jointly models temporal waveforms and spectral‑spatial representations, achieving a macro‑averaged balanced accuracy of 88.81% on signal‑level QA and improving caption factual consistency from 82.06% to 83.46% compared to caption‑only models.
arXiv AI
Sep 7
ProCA: Progressive Contrastive Alignment for Robust EEG Visual Decoding
ProCA: Progressive Contrastive Alignment for Robust EEG Visual Decoding introduces a model‑agnostic framework that adaptively aligns EEG signals with visual semantics. It replaces fixed visual or textual anchors with EEG‑aware class‑level contrastive supervision and employs structure‑consistent interpolation to preserve channel‑wise and temporal importance. Across multiple evaluation settings—including subject‑dependent, subject‑independent, strict cross‑subject transfer, and continual adaptation—ProCA delivers significant performance gains, achieving relative Top‑1 improvements ranging from 7.4% to 28.1%.