The Flow has not summarised this story yet — read it at arXiv Computation and Language.
The paper investigates whether large models are necessary for speech brain‑computer interfaces (BCIs) and introduces BEST, a two‑stage framework that uses hierarchical intermediate representations and a compact decoder to map neural activity directly to text. BEST achieves low word error rates (6.19% and 1.62%) on the Brain‑to‑Text ’24 and ’25 benchmarks while using only 3.85% of the parameters of comparable methods. The study also highlights that decoder scaling yields non‑monotonic gains, cross‑modal alignment is more critical than model size, and overfitting harms sequence‑level performance.
Brain2Qwerty v2 is a model that decodes natural sentences from real‑time magnetoencephalography (MEG) recordings, achieving an average word error rate of 39% across 22,000 sentences typed by nine subjects. The model uses character, word, and sentence‑level representations and shows that decoding accuracy improves log‑linearly with more data, narrowing the gap to intracranial brain‑computer interfaces. AI contributes by replacing hand‑crafted event detection with deep learning, fine‑tuning large language models for semantic extraction, and employing AI agents to refine the decoding pipeline through automated code development.
SCRIBE is a framework that uses a neuroscience-informed semantic space and an ensemble of large language models to generate interpretable, word-level semantic representations of arbitrary text. In a behavioral study with 921 participants, SCRIBE’s representations varied systematically with context and captured 75‑81% of the estimated human noise ceiling. When applied to brain activity recorded while participants listened to naturalistic stories, SCRIBE predicted neural responses in language-selective brain regions better than non-contextual representations and explained unique brain-predictive information beyond syntactic features.
LibriBrain100 is a new large‑scale MEG dataset for speech decoding that contains over 100 hours of high‑quality recordings while subjects listened to naturalistic continuous speech. The dataset more than doubles the size of the original LibriBrain release, with a record 80 hours from a single subject and additional 40‑minute recordings from 32 subjects. The authors demonstrate the value of deep within‑subject data and broad multi‑subject data by achieving state‑of‑the‑art word‑classification performance and showing that supervised fine‑tuning can compensate for limited per‑subject data, all supported by open‑source tools and a public competition leaderboard.
arXiv:2607. 19394v1 Announce Type: cross Abstract: Generalizing across subjects remains challenging in invasive neural recordings because electrode configurations, anatomical structures, and neural signal patterns vary substantially across individuals.
The paper introduces MD‑SigLIP, a margin‑regularized structured semantic alignment framework that directly aligns brain embeddings with text embeddings in a shared semantic space for retrieval‑based decoding. It builds on duplicate‑aware sigmoid contrastive learning and adds a listwise margin‑regularized term to enforce structured ranking constraints between positive semantic clusters and negative samples. Experiments show that this approach achieves state‑of‑the‑art retrieval performance in both full‑vocabulary and subset evaluation settings.