← Back to all news
arXiv Computer Vision

Adaptive Cortically Constrained EEG-Vision Alignment for Zero-Shot Brain-to-Image Retrieval

The paper introduces an adaptive cortically constrained method for aligning EEG signals with visual representations in zero‑shot brain‑to‑image retrieval. It reconstructs EEG into ROI‑level source patterns, encodes them with a Neuro‑ROI Attention Encoder, and applies evidence‑based adaptive visual supervision to account for response‑wise variability. On the THINGS‑EEG dataset, the approach achieves strong 200‑way retrieval performance and offers ROI‑level attribution for interpretability.

Related stories

arXiv AI
Sep 7

ProCA: Progressive Contrastive Alignment for Robust EEG Visual Decoding

ProCA: Progressive Contrastive Alignment for Robust EEG Visual Decoding introduces a model‑agnostic framework that adaptively aligns EEG signals with visual semantics. It replaces fixed visual or textual anchors with EEG‑aware class‑level contrastive supervision and employs structure‑consistent interpolation to preserve channel‑wise and temporal importance. Across multiple evaluation settings—including subject‑dependent, subject‑independent, strict cross‑subject transfer, and continual adaptation—ProCA delivers significant performance gains, achieving relative Top‑1 improvements ranging from 7.4% to 28.1%.

By Kanglei Zhou, Chunyan Lan, Dongyang Li, Jun Zhu, Liyuan Wang
multimodalsafety
More like this →
arXiv Machine Learning
Aug 20

SCORE: Subject Coordinate Recovery for Label-Free Cross-Subject EEG-to-Image Retrieval

SCORE: Subject Coordinate Recovery for Label-Free Cross-Subject EEG-to-Image Retrieval proposes a new framework that aligns EEG signals from different subjects into a common image space without requiring labeled calibration data. By training on source subjects and estimating an orthogonal transformation at deployment, SCORE recovers target EEG coordinates and selects reliable EEG-image landmarks through hubness-corrected matching. The method achieves state‑of‑the‑art Top‑1/Top‑5 accuracy on two public benchmarks, outperforming existing baselines by significant margins.

By Zhenyao Cui, Siyuan Kan, Siyang Li, Ziwei Wang, Dongrui Wu
benchmarkssafety
More like this →
arXiv Machine Learning
Aug 20

Beyond Trial Averaging: Anchoring Neural and Visual Representations for Few-Repetition Brain-to-Image Retrieval

The paper introduces NEAR, a neural-anchor-based retrieval framework that improves brain-to-image retrieval when only a few neural trials are available. By treating a high‑repetition center as an anchor, NEAR uses a denoiser to pull noisy queries toward the anchor and a small network to predict pseudo anchors for candidate images, thereby aligning both neural and visual representations. Experiments on EEG, MEG, and fMRI datasets show consistent gains, including a 5.7–9.3 percentage point improvement in 200‑way Top‑1 accuracy on THINGS‑EEG2 with only one or four repetitions.

By Zhenyao Cui, Siyuan Kan, Dingkun Liu, Dongrui Wu
safety
More like this →
Hugging Face Trending Papers
Aug 19

Beyond Trial Averaging: Anchoring Neural and Visual Representations for Few-Repetition Brain-to-Image Retrieval

The paper introduces NEAR, a neural‑anchor‑based retrieval framework that improves brain‑to‑image retrieval when only a few neural trials are available. By treating the high‑repetition center as an anchor, a denoiser pulls noisy queries toward it while a small network predicts pseudo anchors for candidate images, aligning both neural and visual representations. Across EEG, MEG, and fMRI datasets, NEAR consistently boosts retrieval accuracy, notably raising 200‑way Top‑1 accuracy on THINGS‑EEG2 by 5.7–9.3 percentage points with just one to four repetitions.

safety
More like this →