The study investigates whether self‑supervised learning can produce useful representations from fMRI data alone. Using a joint embedding predictive architecture, participant‑specific encoders are trained without access to stimulus images or derived representations. The resulting embeddings perform competitively on brain captioning, image reconstruction, and cross‑participant generalization, and can be aligned unsupervised across participants, enabling a decoding head trained on one subject to work on another with minimal loss of performance.
By Serwan Jassim, Victoria Bosch, Daniel Anthes, Elia Bruni, Tim Kietzmann
The paper introduces the Residual Patch Adapter (RPA), a lightweight module that aligns EEG and MEG signals with all patch tokens from an intermediate layer of a Vision Transformer, rather than a single global embedding. Ablation studies show that retaining the full set of patch tokens is crucial for effective alignment, while the CLS token adds little value. Using RPA, the authors achieve state‑of‑the‑art Top‑1 accuracies on THINGS‑EEG2 and THINGS‑MEG datasets, and demonstrate that the approach generalizes to other brain encoders and can be swapped with various neural network backbones.
By Yuhui Jin, Yonghao Song, Bingchuan Liu
The paper introduces CAIA, a framework that enhances EEG-based visual decoding by adaptively blurring visual features to match neural granularity and applying an information-constrained alignment on EEG signals. It incorporates cognitive-guided adaptive blurring, spectral sparsity regularization, and a distribution-aware boundary calibration loss to improve signal-to-noise ratio and alignment robustness. Experiments show CAIA outperforms previous methods in both subject-dependent and subject-independent zero-shot brain-to-image retrieval tasks.
By Fan Yin, Chuhang Zheng, Peiliang Gong, Donghai Guan, Qi Zhu
arXiv:2605.23137v3 Announce Type: replace-cross
Abstract: Electroencephalography (EEG) visual decoding remains challenging due to the modality gap between low-SNR neural signals and highly structured...
By Jiahe Meng, Weiming Zeng, Yueyang Li, Bo Chai, Hongjie Yan, Zhiguo Zhang, Wai Ting Siok, Nizhuan Wang
ProCA: Progressive Contrastive Alignment for Robust EEG Visual Decoding introduces a model‑agnostic framework that adaptively aligns EEG signals with visual semantics. It replaces fixed visual or textual anchors with EEG‑aware class‑level contrastive supervision and employs structure‑consistent interpolation to preserve channel‑wise and temporal importance. Across multiple evaluation settings—including subject‑dependent, subject‑independent, strict cross‑subject transfer, and continual adaptation—ProCA delivers significant performance gains, achieving relative Top‑1 improvements ranging from 7.4% to 28.1%.
By Kanglei Zhou, Chunyan Lan, Dongyang Li, Jun Zhu, Liyuan Wang
The paper introduces an adaptive cortically constrained method for aligning EEG signals with visual representations in zero‑shot brain‑to‑image retrieval. It reconstructs EEG into ROI‑level source patterns, encodes them with a Neuro‑ROI Attention Encoder, and applies evidence‑based adaptive visual supervision to account for response‑wise variability. On the THINGS‑EEG dataset, the approach achieves strong 200‑way retrieval performance and offers ROI‑level attribution for interpretability.
By Ye Wang, Haokun Ren, Wei Wu, Guoyin Wang, Zhuliang Yu, Hong Yu, Ke Liu
The paper introduces a multimodal contrastive learning framework that aligns EEG recordings of imagined speech with language representations from a frozen text encoder. By training an EEG encoder with a composite objective that balances semantic reweighting and class discrimination, the method preserves separability among 39 intent categories while embedding EEG signals into a language embedding space. Experiments on the Chisco dataset show comparable decoding performance to a task‑optimized classifier, and additional metrics such as MaxCosine and semantic axes demonstrate intrinsic reliability and broader semantic structure beyond fixed categories.
By Shahryar G. Namdari, Francesco Iacomi, Riccardo Barbieri, Luca Mainardi
arXiv:2606. 00121v1 Announce Type: cross Abstract: Reconstructing visual stimuli from brain recordings has been a meaningful and challenging task in brain decoding.
By Yizhuo Lu, Changde Du, Qiongyi Zhou, Liuyun Jiang, Huiguang He
arXiv:2606. 15989v1 Announce Type: cross Abstract: Aligning neural activity across subjects offers the promise of discovering shared computational principles and generalizable decoders.
By Angeliki Papathanasiou, Jascha Achterberg, Thomas E. Nichols, Rui Ponte Costa
arXiv:2608. 13072v1 Announce Type: new Abstract: Electroencephalography (EEG) decoding models often generalize poorly across datasets and subjects due to domain shifts in acquisition protocols and individual neurophysiology.
By Shuailei Zhang, Muyun Jiang, Wei Zhang, Jinbo Chen, Zhiwei Guo, Yong Li, Yi Ding, Cuntai Guan
ProtoEEG introduces a prototype‑mediated framework for aligning EEG signals with visual data, using a shared 64‑prototype codebook to generate structured representations for retrieval and image generation. The method employs prototype contrast, distribution alignment, instance anchors, and diversity regularization to train the system, achieving state‑of‑the‑art performance on THINGS‑EEG2 and EEG‑ImageNet benchmarks. Ablation studies confirm that prototype contrast and identity preservation are critical for high accuracy, while prototype analyses reveal distributed assignments across the codebook.
By Kieren Yu, Chang Huang, Ziyang Liu, Kaishun Wu
arXiv:2607. 12364v1 Announce Type: cross Abstract: EEG-to-image evaluation should distinguish visual fidelity from recoverable meaning.
By Sukriti Tiwari, BHVSP Subrahmanyam, Nidhi Goyal, Sai Amrit Patnaik