arXiv AI

Masked Autoencoders Learn Perception-Relevant Representations from Resting State Neural Data

arXiv:2607. 22615v1 Announce Type: cross Abstract: Clinical neuroprosthetics face a data bottleneck: labeled perception trials are scarce while hours of spontaneous neural activity are largely underutilized.

arXiv Machine Learning
Oct 5

NeuroLens: Learning Latent Embeddings of Neural Semantics from Chronic Recordings

NeuroLens is a self‑supervised model that learns denoised, semantically informative latent embeddings from chronic neural recordings using a Joint‑Embedding Predictive Architecture. It maps changing neural populations into a common latent space and predicts future latent states, thereby reducing sensitivity to transient recording variability. Across chronic intracortical data in mice and humans, NeuroLens improves decoding of decision‑making and semantic task variables, supports multi‑day pretraining, rapid few‑shot adaptation, and yields more stable decoding over time than existing baselines.

By Hanrui Lyu, Baiyuan Chen, Tianshu Tan, Matthew R. Whiteway, Maxwell D. Melin, Ji Xia, Linyang He, Bradly C. Stadie, Anne Churchland, Liam Paninski, Yizi Zhang
arXiv AI
Sep 21

Rhamba: Region-Aware Hybrid Attention-Mamba Framework for Self-Supervised Learning in Resting-State fMRI

Rhamba is a region‑aware pretraining framework for resting‑state fMRI that combines anatomically guided masking with hybrid Attention‑Mamba architectures. The study pretrained models on the ABIDE dataset using three masking strategies (Any, Majority, Pure) and evaluated four architectural variants, finding that the Mamba‑Attention (MA) hybrid achieved the best average AUROC on downstream schizophrenia and ADHD classification tasks. Explainable AI via Integrated Gradients highlighted that performance depends on the interaction between masking strategy and architecture rather than a single dominant configuration.

By Pankaj Pandey, Ruthwik Reddy Doodipala, Pratheek Eranki, Carolina Torres-Rojas, Manob Jyoti Saikia, Ranganatha Sitaram
arXiv AI
Jul 28

Neonatal Hypoxic-ischaemic Encephalopathy Classification from the EEG and HRV Signals Using a Conformer based Masked Autoencoder

arXiv:2607. 23554v1 Announce Type: cross Abstract: In this paper, we propose the MAEConformer, a novel self-supervised learning framework that combines the Conformer architecture with the Masked Autoencoder (MAE) paradigm for large-scale representation learning from unlabelled electroencephalography (EEG) and heart rate variability (HRV) signals.

By Shuwen Yu, William P Marnane, Geraldine B. Boylan, Gordon Lightbody
arXiv AI
Sep 28

Neural State Prediction: Obstructing Shortcut Learning in EEG Foundation Models

Neural State Prediction (NSP) is a latent‑predictive framework designed to curb shortcut learning in EEG foundation models. By using a target encoder updated with an exponential moving average, identity residualization, and topology‑separated context, NSP constrains both the prediction target and the available context. Trained on 2.2 million EEG segments, NSP outperforms baselines on 14 datasets in the EEG‑FM‑Bench, achieving 63.94 % macro balanced accuracy.

By Kieren Yu, Ziyang Liu, Chang Huang, Jintai Chen, Kaishun Wu
arXiv AI
Sep 1

EEGDM: Learning EEG Representation with Latent Diffusion Model

EEGDM introduces a self‑supervised framework that uses latent diffusion models to generate EEG signals, moving beyond traditional masked reconstruction. The method employs an EEG encoder to produce a compact representation that conditions the diffusion denoising process, allowing joint optimization of encoder and generator. Experiments demonstrate that EEGDM can reconstruct high‑quality EEG, learn robust representations, and perform competitively on various downstream tasks.

By Shaocong Wang, Tong Liu, Yihan Li, Ming Li, Kairui Wen, Pei Yang, Wenqi Ji, Minjing Yu, Yong-Jin Liu