arXiv:2608. 20186v1 Announce Type: new Abstract: Non-invasive decoding of inner speech faces a fundamental data problem: a corpus pairing brain activity with a person's spontaneous inner monologue cannot be collected, and the available proxy paradigms (cued repetitive and retrospectively reported generative inner speech) are slow to acquire, poorly time-locked, and subject compliance is unverifiable.
By Ingo Marquardt, Anthilia Alchanat, Priyanka Jain
iMINDBench is a new benchmark for intracranial electroencephalography (iEEG) neural decoding that evaluates models on fifteen tasks across three naturalistic movie‑watching datasets from multiple institutions. It standardizes preprocessing tracks and evaluation splits to enable consistent comparisons. The study shows that pretrained systems outperform baselines within their tracks, but strong spectral baselines remain competitive, and scaling up supervised data yields only modest or task‑dependent gains.
By Geeling Chau, Saba Hashemi, Yonghyeon Gwon, Eshani Patel, Jan DeWitt, Christopher Wang, Andrii Zahorodnii, Sabera J Talukder, Danny Dongyeop Han, Chun Kee Chung, Maryam M Shanechi, Yisong Yue
NeuroDETR is a novel multiscale discrete spatiotemporal tokenization framework designed for asynchronous EEG event detection. It combines structured tokenization, event-aware feature refinement, and a sparse attention module called FOCAL to capture both brief and sustained neural responses while preserving spatial hierarchy across EEG channels. Experiments on eight diverse EEG datasets show that NeuroDETR achieves state‑of‑the‑art performance in jointly classifying events and estimating their onsets and offsets.
By Yaozhi Wen, Kun Zhao, Wei Wei, Haoyang Chen, Kangning Wang, Yi Sun, Shaowei Gu, Dingkun Liu, Shuang Qiu, Huiguang He
The study investigates how information about words and passage context is represented across the layers of the Llama‑3.1‑8B language model during silent reading, using EEG recordings. Decoders trained on each layer show that word‑level decodability peaks in early layers and diminishes toward the final layer, while a context‑tracking component increases with depth. Even a single 0.5‑second EEG window can capture passage‑level information, and control experiments confirm that this context tracking is driven by the text rather than by word decoding or session artifacts.
By Ingo Marquardt, Anthilia Alchanat, Priyanka Jain
The paper introduces PAIR, an EEG benchmark that records brain activity from 20 participants while they watch naturalistic video clips and immediately recall them. The dataset allows direct comparison between perception and recall of the same content, and the authors evaluate several decoding models on tasks ranging from fine‑grained semantic classification to meta‑feature decoding (motion, color, object number, face, human presence) and a state‑decoding task distinguishing perception from recall. Results show comparable performance across many model–task pairs, with slightly higher perception accuracy in some coarse‑grained comparisons, and strong separability between perception and recall at the state level, even after removing alpha‑band activity.
By Zikai Fang, Tian-Yi Zhou, Xuan-Hao Liu, Yixi Li, Xiaoyu Xing, Yutong Pei, Bao-Liang Lu, Wei-Long Zheng
arXiv:2601. 01095v3 Announce Type: replace-cross Abstract: Multimodal large language models (MLLMs) have achieved impressive progress in vision-language reasoning, yet their ability to understand temporally unfolding narratives in videos remains underexplored.
By Hyeonjeong Ha, Jinjin Ge, Bo Feng, Kaixin Ma, Gargi Chakraborty