arXiv AI
Aug 20

Accurate Decoding of Natural Sentences from Non-Invasive Brain Recordings

Brain2Qwerty v2 is a model that decodes natural sentences from real‑time magnetoencephalography (MEG) recordings, achieving an average word error rate of 39% across 22,000 sentences typed by nine subjects. The model uses character, word, and sentence‑level representations and shows that decoding accuracy improves log‑linearly with more data, narrowing the gap to intracranial brain‑computer interfaces. AI contributes by replacing hand‑crafted event detection with deep learning, fine‑tuning large language models for semantic extraction, and employing AI agents to refine the decoding pipeline through automated code development.

By Mingfang Zhang, Jarod L\'evy, Cedric Rommel, J\'er\'emy Rapin, Corentin Bel, Julie Bonnaire, Daniel Nieto, Pierre Bourdillon, Svetlana Pinet, St\'ephane d'Ascoli, Thomas Moreau, Jean-R\'emi King
arXiv Machine Learning
Aug 27

LibriBrain100: One Hundred Hours of Broad and Deep MEG Data for Neural Speech Decoding at Scale

LibriBrain100 is a new large‑scale MEG dataset for speech decoding that contains over 100 hours of high‑quality recordings while subjects listened to naturalistic continuous speech. The dataset more than doubles the size of the original LibriBrain release, with a record 80 hours from a single subject and additional 40‑minute recordings from 32 subjects. The authors demonstrate the value of deep within‑subject data and broad multi‑subject data by achieving state‑of‑the‑art word‑classification performance and showing that supervised fine‑tuning can compensate for limited per‑subject data, all supported by open‑source tools and a public competition leaderboard.

By Francesco Mantegna, Dulhan Jayalath, Gereon Elvers, Tasha Kim, Benjamin Ballyk, Alex Fung, SungJun Cho, Teyun Kwon, Luisa Kurth, Miran \"Ozdogan, Gilad Landau, Pratik Somaiya, Natalie Voets, Mark Woolrich, Oiwi Parker Jones
arXiv Machine Learning
Aug 19

Margin-Regularized Structured Semantic Alignment for Brain-Language Correspondence

The paper introduces MD‑SigLIP, a margin‑regularized structured semantic alignment framework that directly aligns brain embeddings with text embeddings in a shared semantic space for retrieval‑based decoding. It builds on duplicate‑aware sigmoid contrastive learning and adds a listwise margin‑regularized term to enforce structured ranking constraints between positive semantic clusters and negative samples. Experiments show that this approach achieves state‑of‑the‑art retrieval performance in both full‑vocabulary and subset evaluation settings.

By Jiaqi Wang, Huawen Hu, Shu Zhang