arXiv Computer Vision

Adaptive Cortically Constrained EEG-Vision Alignment for Zero-Shot Brain-to-Image Retrieval

The paper introduces an adaptive cortically constrained method for aligning EEG signals with visual representations in zero‑shot brain‑to‑image retrieval. It reconstructs EEG into ROI‑level source patterns, encodes them with a Neuro‑ROI Attention Encoder, and applies evidence‑based adaptive visual supervision to account for response‑wise variability. On the THINGS‑EEG dataset, the approach achieves strong 200‑way retrieval performance and offers ROI‑level attribution for interpretability.

arXiv AI
Oct 31

NeuroBridge: Bio-Inspired Self-Supervised EEG-to-Image Decoding via Cognitive Priors and Bidirectional Semantic Alignment

NeuroBridge is a self‑supervised framework for EEG‑to‑image decoding that uses Cognitive Prior Augmentation (CPA) to introduce perceptual variability and a Shared Semantic Projector (SSP) to align EEG and image features in a shared semantic space. The method achieves significant gains over prior work, improving top‑1 accuracy by 12.3% and top‑5 accuracy by 10.2% on a 200‑way zero‑shot retrieval task in intra‑subject experiments. Extensive tests show the approach is robust, scalable, and effective for neural visual decoding.

By Wenjiang Zhang, Sifeng Wang, Yuwei Su, Xinyu Li, Chen Zhang, Suyu Zhong
arXiv AI
Oct 16

Neural Visual Decoding via Cognitive guided Adaptive Blurring and Information Constrained Alignment

The paper introduces CAIA, a framework that enhances EEG-based visual decoding by adaptively blurring visual features to match neural granularity and applying an information-constrained alignment on EEG signals. It incorporates cognitive-guided adaptive blurring, spectral sparsity regularization, and a distribution-aware boundary calibration loss to improve signal-to-noise ratio and alignment robustness. Experiments show CAIA outperforms previous methods in both subject-dependent and subject-independent zero-shot brain-to-image retrieval tasks.

By Fan Yin, Chuhang Zheng, Peiliang Gong, Donghai Guan, Qi Zhu
arXiv AI
Sep 7

ProCA: Progressive Contrastive Alignment for Robust EEG Visual Decoding

ProCA: Progressive Contrastive Alignment for Robust EEG Visual Decoding introduces a model‑agnostic framework that adaptively aligns EEG signals with visual semantics. It replaces fixed visual or textual anchors with EEG‑aware class‑level contrastive supervision and employs structure‑consistent interpolation to preserve channel‑wise and temporal importance. Across multiple evaluation settings—including subject‑dependent, subject‑independent, strict cross‑subject transfer, and continual adaptation—ProCA delivers significant performance gains, achieving relative Top‑1 improvements ranging from 7.4% to 28.1%.

By Kanglei Zhou, Chunyan Lan, Dongyang Li, Jun Zhu, Liyuan Wang
arXiv Machine Learning
Oct 5

ZeroMAG: Zero-Shot Multimodal Adapter Generation for Plug-and-Play EEG Foundation Models

ZeroMAG is a zero‑shot multimodal adapter generation framework that extends frozen EEG foundation models to heterogeneous multimodal recordings using only unlabeled target data. It constructs a configuration‑invariant adapter and generates adapter weights in a latent space learned from source adapters, without target‑side optimization. Across six held‑out target datasets and three EFM backbones, ZeroMAG improves balanced accuracy by 7.22 percentage points over EEG‑only inference and 4.89 points over direct weight regression, approaching supervised multimodal adaptation.

By Yubo Wang, Jingying Ma, Xinliang Zhou, Yangxuan Zhou, Jiquan Wang, Sha Zhao, Yiyuan Yang, Yi Ding, Ziyu Jia, Chenyu Liu, Cuntai Guan
arXiv Computer Vision
Oct 7

RPA: Residual Patch-Token Adapter for Image Retrieval from EEG and MEG

The paper introduces the Residual Patch Adapter (RPA), a lightweight module that aligns EEG and MEG signals with all patch tokens from an intermediate layer of a Vision Transformer, rather than a single global embedding. Ablation studies show that retaining the full set of patch tokens is crucial for effective alignment, while the CLS token adds little value. Using RPA, the authors achieve state‑of‑the‑art Top‑1 accuracies on THINGS‑EEG2 and THINGS‑MEG datasets, and demonstrate that the approach generalizes to other brain encoders and can be swapped with various neural network backbones.

By Yuhui Jin, Yonghao Song, Bingchuan Liu
arXiv Machine Learning
Aug 20

SCORE: Subject Coordinate Recovery for Label-Free Cross-Subject EEG-to-Image Retrieval

SCORE: Subject Coordinate Recovery for Label-Free Cross-Subject EEG-to-Image Retrieval proposes a new framework that aligns EEG signals from different subjects into a common image space without requiring labeled calibration data. By training on source subjects and estimating an orthogonal transformation at deployment, SCORE recovers target EEG coordinates and selects reliable EEG-image landmarks through hubness-corrected matching. The method achieves state‑of‑the‑art Top‑1/Top‑5 accuracy on two public benchmarks, outperforming existing baselines by significant margins.

By Zhenyao Cui, Siyuan Kan, Siyang Li, Ziwei Wang, Dongrui Wu
arXiv Machine Learning
Aug 20

Beyond Trial Averaging: Anchoring Neural and Visual Representations for Few-Repetition Brain-to-Image Retrieval

The paper introduces NEAR, a neural-anchor-based retrieval framework that improves brain-to-image retrieval when only a few neural trials are available. By treating a high‑repetition center as an anchor, NEAR uses a denoiser to pull noisy queries toward the anchor and a small network to predict pseudo anchors for candidate images, thereby aligning both neural and visual representations. Experiments on EEG, MEG, and fMRI datasets show consistent gains, including a 5.7–9.3 percentage point improvement in 200‑way Top‑1 accuracy on THINGS‑EEG2 with only one or four repetitions.

By Zhenyao Cui, Siyuan Kan, Dingkun Liu, Dongrui Wu