arXiv Machine Learning

OneEEG: A Unified Signal-Visual Multimodal Language Model with Task-Aware Mixture of Projectors for Multi-Task EEG Understanding

OneEEG is a unified signal‑visual multimodal language model designed for multi‑task EEG understanding. It jointly learns from numerical EEG data and visual EEG renderings, employing a task‑aware Mixture of Projectors to align diverse EEG features with a large language model’s embedding space. The authors introduce the OneEEG‑Instruct dataset for instruction tuning and the OneEEG‑Bench benchmark to evaluate performance, demonstrating that existing multimodal LLMs struggle with EEG inputs while OneEEG outperforms them across various tasks.

arXiv Machine Learning

Oct 8

Multimodal LLMs Can Learn to Read Brain Signals: A Vision--Language Model for Unified Multi-Task EEG Decoding

The paper introduces BraVista, a visual-language framework that transforms multichannel EEG signals into structured images and uses instruction‑conditioned vision‑language models for unified multi‑task EEG decoding. By continuing post‑training of a general‑domain VLM, BraVista adapts to neural signals without large‑scale EEG‑specific pretraining, achieving strong performance across sleep staging, emotion recognition, cognitive workload classification, and abnormal EEG detection. Analyses show that the EEG‑to‑image representation is crucial and that the model’s performance degrades gradually with added noise, indicating reliance on genuine EEG information.

By Parastoo Azizeddin, Omid Sharafi, Maryam M. Shanechi

llms multimodal

arXiv Computation and Language

2d ago

EEG-HealthLLM: Hierarchical Adaptation of Large Language Models for Unified Heterogeneous EEG Health Assessment

EEG-HealthLLM introduces a hierarchical adaptation framework that unifies heterogeneous EEG health assessments using large language models. Task‑specific EEG adapters preserve unique spatio‑temporal dynamics, while a shared LoRA module in the LLM backbone captures common high‑level assessment semantics. The new EEG‑HealthBench benchmark reorganizes five EEG datasets into five health‑assessment tasks, and experiments show EEG‑HealthLLM achieves the highest average balanced accuracy and macro‑F1, improving performance while reducing adapter size by 80%.

By Ruidong Ma, Jisheng Dang, Ronghao Lin, Bimei Wang, Jingwen Zhao, Wenjun Ma, Wei-Shi Zheng, Meng Wang, Qi Tian, Tat-Seng Chua

llms fine-tuning

arXiv Machine Learning

Aug 4

SingLEM: Single-Channel Large EEG Model

arXiv:2509. 17920v2 Announce Type: replace Abstract: Current deep learning models for electroencephalography (EEG) are often task-specific and depend on large labeled datasets, limiting their adaptability.

By Jamiyan Sukhbaatar, Satoshi Imamura, Ibuki Inoue, Shoya Murakami, Kazi Mahmudul Hassan, Seungwoo Han, Ingon Chanpornpakdi, Toshihisa Tanaka

llms

arXiv AI

Jul 24

Multimodal Pretraining for Generalizable EEG Representation Learning

arXiv:2607. 21384v1 Announce Type: new Abstract: Electroencephalography (EEG) models used for epilepsy are often limited to specific datasets and tasks.

By Targol Bakhtiarvand, Jugal Kalita, Adham Atyabi

llms rag computer-vision fine-tuning multimodal benchmarks safety

arXiv AI

Aug 6

BrainBench: Benchmarking Large Language Models for Comprehensive EEG Understanding

arXiv:2608. 04156v1 Announce Type: new Abstract: Electroencephalography (EEG) analysis extends beyond assigning predefined labels to recordings; it requires workflows connecting natural-language instructions, signal processing, quantitative evidence, and scientific interpretation.

By Yangxuan Zhou, Sha Zhao, Yuning Chen, Chen Wu, Jiquan Wang, Shijian Li, Gang Pan

llms agents benchmarks

arXiv AI

Jun 16

EEG-FM-Bench: A Comprehensive Benchmark for the Systematic Evaluation and Diagnostic Analyses of EEG Foundation Models

arXiv:2508. 17742v3 Announce Type: replace-cross Abstract: Electroencephalography foundation models (EEG-FMs) have advanced brain signal analysis, but the lack of standardized evaluation benchmarks impedes model comparison and scientific progress.

By Wei Xiong, Jiangtong Li, Jie Li, Kun Zhu, Changjun Jiang

fine-tuning benchmarks safety

arXiv Machine Learning

Jun 2

OmniEEG-Bench: A Standardized Evaluation Benchmark for EEG Foundation Models

arXiv:2606. 00815v1 Announce Type: new Abstract: Electroencephalography (EEG) supports a variety of brain-computer interface (BCI) tasks ranging from brain-state monitoring to human-LLM interactions.

By Ziling Lu, Zongsheng Li, Xinke Shen, Kexin Lou, Yingyue Xin, Xiaoqi Chen, Shinan Wang, Xiang Chen, Jiahao Fan, Chenyu Huang, Xin Xu, Zhoujie Hou, Chen Wei, Quanying Liu

llms benchmarks

arXiv Machine Learning

Aug 13

Continuous-Latent Predictive Modeling with Semantic Alignment for EEG-Language Foundation Models

arXiv:2608. 11656v1 Announce Type: new Abstract: Recent advances in EEG foundation models have demonstrated the potential of large-scale pretraining to enable generalizable neural decoding across subjects, recording environments, and datasets.

By Myeong-Ju Cho, Hye-Bin Shin, Seo-Hyun Lee, Seong-Whan Lee

llms rag diffusion benchmarks safety

arXiv AI

Jun 2

EvoBrain: Continual Learning of EEG Foundation Models Across Heterogeneous BCI Tasks

arXiv:2606. 01767v1 Announce Type: new Abstract: Electroencephalography (EEG) is the cornerstone of non-invasive brain-computer interfaces (BCIs), yet conventional decoding relies on fragmented, task-specific architectures that severely limit cross-task scalability.

By Yangxuan Zhou, Sha Zhao, Jiquan Wang, Shijian Li, Gang Pan

fine-tuning efficiency benchmarks

arXiv Machine Learning

1d ago

Recasting Visual Language Models as EEG Foundation Models for Clinical Neurodiagnostics

arXiv:2611.05538v1 Announce Type: new Abstract: Historically automated electroencephalography (EEG) systems was done using task-specific supervised models trained on purposely annotated data. A more...

By Xin Zhou, Elena Sergeeva, Nan Bi, Wenyu Song, Lijun Yin, Hao Deng

llms fine-tuning

arXiv AI

Aug 26

Taming foundation model with invariance-oriented pre-training for broad-spectrum EEG analysis across signal-level, brain-state, and brain-health tasks

arXiv:2608.24597v1 Announce Type: cross Abstract: Electroencephalography (EEG) is a widely used window into human brain function, but most EEG models remain tied to a one-dataset-one-model supervised...

By Yulong Dou, Han Wu, Guo Chen, Fangmao Ju, Zhiming Cui, Dinggang Shen

fine-tuning benchmarks

arXiv AI

Aug 14

EEG-PRIME: Prototype-Aligned Representation Learning with Multi-Level Conditioning for EEG Decoding

arXiv:2608. 13072v1 Announce Type: new Abstract: Electroencephalography (EEG) decoding models often generalize poorly across datasets and subjects due to domain shifts in acquisition protocols and individual neurophysiology.

By Shuailei Zhang, Muyun Jiang, Wei Zhang, Jinbo Chen, Zhiwei Guo, Yong Li, Yi Ding, Cuntai Guan

rag fine-tuning benchmarks

Related stories