Hugging Face Trending Papers

NEUROTOKEN: Joint Source and Directional AAD with Envelope Decoding via Conditional Flow Matching

arXiv Machine Learning
Oct 3

NEUROTOKEN: Joint Source and Directional AAD with Envelope Decoding via Conditional Flow Matching

The paper introduces NEUROTOKEN, a unified neural network for auditory attention decoding (AAD) that jointly predicts the attended speaker’s direction and source by modeling the conditional likelihood of the attended envelope given EEG. It employs a conditional flow‑matching head (ATTUNEFLOW) and two inference‑time ensembles (QUADTRACK and ENV‑FLOW) to improve source‑AAD accuracy and reduce variance across subjects. Experiments on KU Leuven, DTU, and NJU datasets show significant gains over existing baselines and reveal that prior direction‑AAD results overestimate performance under stricter protocols.

By Ali Alavi, Donald S. Williamson
arXiv Machine Learning
6d ago

Cross-subject decoding of imagined speech from scalp EEG: a leakage-controlled evaluation on three public corpora

The study evaluated whether imagined speech decoded from scalp EEG can transfer across individuals using three public datasets. Across 482 participant pairs, cross‑subject decoding accuracy was essentially at chance, while within‑subject decoding only surpassed chance in one dataset. The results suggest that imagined‑speech content does not generalize between people and that larger single‑condition datasets are more beneficial than further model development.

By Blessing Isoyiza Adeika, Onyema Osuagwu
arXiv AI
Oct 2

Multi-Party Backchannel Prediction: a Diagnosis, a Benchmark, and a Ceiling

The paper introduces a multi‑party backchannel prediction benchmark built from the AMI meeting corpus, featuring 682 masked‑listener views, 190 speakers, and 18,697 backchannel events. A state‑of‑the‑art dyadic model performs at chance when applied zero‑shot to meetings, but its frozen acoustic features are still informative, and retraining improves performance to an AUROC of 0.751. The study reveals that listener conditioning helps only for listeners seen during training, that speaker identity is entangled with useful cues, and that backchannel rates vary significantly across individuals, prompting the authors to report both AUROC and event‑F1 metrics. whyItMatters":"The benchmark and evaluation tools provide a standardized, person‑disjoint testbed for advancing multi‑party backchannel prediction research."

By Mohammed Hafsati, Ahmed Loughzali
arXiv AI
Aug 25

Cross-Subject Generalization in Decoding Perceived Speech from Non-Invasive Brain Recordings

The paper introduces a Cross-Subject Perceived Speech Decoding (CPSD) framework that tackles the challenge of decoding perceived speech from non‑invasive brain recordings across different subjects. CPSD uses a two‑stage training process: first, contrastive learning pre‑trains a source model on multiple subjects to capture shared representations; second, personal specialization fine‑tunes the model for a target subject by extracting consistent components and further training on that subject’s data. A Positional Encoding‑based Spatial Attention (PESA) module is added to remap MEG/EEG data into a standardized reference space, improving cross‑subject consistency. Evaluations on three datasets (Armeni 2022, PKUEEG 2025, Broderick 2018) show that CPSD outperforms baseline methods by more than 6.8%, 15.4%, and 15.8% in Top‑10 accuracy, demonstrating its effectiveness, efficiency, and robustness.

By Aoke Zhang, Bo Wang, Xihong Wu, Heping Cheng, Jing Chen