arXiv Computer Vision
Deep Models, Shallow Alignment: Uncovering the Granularity Mismatch in Neural Decoding
Read the original on arXiv Computer Vision →The Flow has not summarised this story yet — read it at arXiv Computer Vision.
Related stories
arXiv Computer Vision
Sep 16
Extremely coarse learning objectives induce human-aligned representations in AI vision models
arXiv:2605.05556v2 Announce Type: replace Abstract: Artificial neural networks trained on visual tasks develop internal representations resembling those of the primate visual system, a discovery that...
arXiv Computer Vision
Oct 7
RPA: Residual Patch-Token Adapter for Image Retrieval from EEG and MEG
The paper introduces the Residual Patch Adapter (RPA), a lightweight module that aligns EEG and MEG signals with all patch tokens from an intermediate layer of a Vision Transformer, rather than a single global embedding. Ablation studies show that retaining the full set of patch tokens is crucial for effective alignment, while the CLS token adds little value. Using RPA, the authors achieve state‑of‑the‑art Top‑1 accuracies on THINGS‑EEG2 and THINGS‑MEG datasets, and demonstrate that the approach generalizes to other brain encoders and can be swapped with various neural network backbones.
arXiv AI
Oct 16
Neural Visual Decoding via Cognitive guided Adaptive Blurring and Information Constrained Alignment
The paper introduces CAIA, a framework that enhances EEG-based visual decoding by adaptively blurring visual features to match neural granularity and applying an information-constrained alignment on EEG signals. It incorporates cognitive-guided adaptive blurring, spectral sparsity regularization, and a distribution-aware boundary calibration loss to improve signal-to-noise ratio and alignment robustness. Experiments show CAIA outperforms previous methods in both subject-dependent and subject-independent zero-shot brain-to-image retrieval tasks.
arXiv AI
Jun 2
Versatile Framework with Semantic and Structural guidance for Image Reconstruction from Brain Activity
arXiv:2606. 00121v1 Announce Type: cross Abstract: Reconstructing visual stimuli from brain recordings has been a meaningful and challenging task in brain decoding.
arXiv AI
Sep 7
ProCA: Progressive Contrastive Alignment for Robust EEG Visual Decoding
ProCA: Progressive Contrastive Alignment for Robust EEG Visual Decoding introduces a model‑agnostic framework that adaptively aligns EEG signals with visual semantics. It replaces fixed visual or textual anchors with EEG‑aware class‑level contrastive supervision and employs structure‑consistent interpolation to preserve channel‑wise and temporal importance. Across multiple evaluation settings—including subject‑dependent, subject‑independent, strict cross‑subject transfer, and continual adaptation—ProCA delivers significant performance gains, achieving relative Top‑1 improvements ranging from 7.4% to 28.1%.
arXiv AI
Jun 16
Task-guided cross-subject latent alignment: a multi-encoder-decoder VAE
arXiv:2606. 15989v1 Announce Type: cross Abstract: Aligning neural activity across subjects offers the promise of discovering shared computational principles and generalizable decoders.