← Back to all news
arXiv Computer Vision By Ye Wang, Haokun Ren, Wei Wu, Guoyin Wang, Zhuliang Yu, Hong Yu, Ke Liu

Adaptive Cortically Constrained EEG-Vision Alignment for Zero-Shot Brain-to-Image Retrieval

Read the original on arXiv Computer Vision →

The paper introduces an adaptive cortically constrained method for aligning EEG signals with visual representations in zero‑shot brain‑to‑image retrieval. It reconstructs EEG into ROI‑level source patterns, encodes them with a Neuro‑ROI Attention Encoder, and applies evidence‑based adaptive visual supervision to account for response‑wise variability. On the THINGS‑EEG dataset, the approach achieves strong 200‑way retrieval performance and offers ROI‑level attribution for interpretability.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computer Vision.

Related stories

arXiv AI
Oct 31

NeuroBridge: Bio-Inspired Self-Supervised EEG-to-Image Decoding via Cognitive Priors and Bidirectional Semantic Alignment

NeuroBridge is a self‑supervised framework for EEG‑to‑image decoding that uses Cognitive Prior Augmentation (CPA) to introduce perceptual variability and a Shared Semantic Projector (SSP) to align EEG and image features in a shared semantic space. The method achieves significant gains over prior work, improving top‑1 accuracy by 12.3% and top‑5 accuracy by 10.2% on a 200‑way zero‑shot retrieval task in intra‑subject experiments. Extensive tests show the approach is robust, scalable, and effective for neural visual decoding.

By Wenjiang Zhang, Sifeng Wang, Yuwei Su, Xinyu Li, Chen Zhang, Suyu Zhong
multimodalbenchmarkssafety
More like this →
arXiv AI
Oct 16

Neural Visual Decoding via Cognitive guided Adaptive Blurring and Information Constrained Alignment

The paper introduces CAIA, a framework that enhances EEG-based visual decoding by adaptively blurring visual features to match neural granularity and applying an information-constrained alignment on EEG signals. It incorporates cognitive-guided adaptive blurring, spectral sparsity regularization, and a distribution-aware boundary calibration loss to improve signal-to-noise ratio and alignment robustness. Experiments show CAIA outperforms previous methods in both subject-dependent and subject-independent zero-shot brain-to-image retrieval tasks.

By Fan Yin, Chuhang Zheng, Peiliang Gong, Donghai Guan, Qi Zhu
efficiencymultimodalsafety
More like this →
arXiv AI
Sep 7

ProCA: Progressive Contrastive Alignment for Robust EEG Visual Decoding

ProCA: Progressive Contrastive Alignment for Robust EEG Visual Decoding introduces a model‑agnostic framework that adaptively aligns EEG signals with visual semantics. It replaces fixed visual or textual anchors with EEG‑aware class‑level contrastive supervision and employs structure‑consistent interpolation to preserve channel‑wise and temporal importance. Across multiple evaluation settings—including subject‑dependent, subject‑independent, strict cross‑subject transfer, and continual adaptation—ProCA delivers significant performance gains, achieving relative Top‑1 improvements ranging from 7.4% to 28.1%.

By Kanglei Zhou, Chunyan Lan, Dongyang Li, Jun Zhu, Liyuan Wang
multimodalsafety
More like this →