The study investigates whether transferring relational structure from human mental representations to deep neural networks (DNNs) can improve fine‑grained alignment between the two. Using unsupervised Gromov‑Wasserstein optimal transport, the authors show that fine‑tuning pre‑trained DNNs with Relational Knowledge Distillation (RKD) brings the networks close enough to human representations to align at the individual‑object level on a test set of concepts not seen during training. The improvement is driven mainly by a more human‑like global structure of category distances, while local nearest‑neighbor overlap remains largely unchanged.
arXiv:2605.05556v2 Announce Type: replace Abstract: Artificial neural networks trained on visual tasks develop internal representations resembling those of the primate visual system, a discovery that...
The study explores how to fine‑tune visual brain encoding models so that their internal representations better match individual human perceptual similarity judgments. Using similarity data from 100 images collected from eight participants in the Natural Scenes Dataset, the authors adapted a generic similarity model (DreamSim) to create personalized perceptual similarity models for each subject. They then fine‑tuned each participant’s baseline encoder with either generic or personalized similarity information, finding that models trained with personalized judgments were most aligned with human perceptual similarity and preserved inter‑subject correlations of those judgments.
arXiv:2608. 04234v1 Announce Type: cross Abstract: We study the problem of aligning data from multiple modalities into a shared representation space, focusing on settings where strong pretrained unimodal encoders are available but cross-modal paired data are scarce.
arXiv:2606. 28399v1 Announce Type: cross Abstract: The structure of human visual representations underpins our capacity for adaptive behaviour.
arXiv:2609.23561v1 Announce Type: new Abstract: Deploying efficient neural networks is essential in resource-constrained environments, yet compact models often sacrifice interpretability - a critical...
arXiv:2609.40047v1 Announce Type: cross Abstract: Gromov-Wasserstein multidimensional scaling (GW-MDS) learns low-dimensional representations from relational data but remains transductive, providing...
arXiv:2602. 23353v2 Announce Type: replace-cross Abstract: The Platonic Representation Hypothesis posits that neural networks trained on different modalities converge toward a shared statistical model of the world.
The paper introduces a method for selecting the best vision‑language model for a downstream task by analyzing the internal dynamics of the visual encoder. It represents each task with layer‑wise conductance and uses an entropy‑regularized alignment to derive a target‑conditioned block importance distribution. The proposed Directional Conductance Divergence (DCD) metric captures asymmetric transferability, enabling accurate prediction of model rankings without direct inference, and achieves a 14.7% NDCG@5 improvement over SWAB on 48 VLMs across 21 datasets.
The study investigates how vision models represent objects compared to humans during physical reasoning tasks. By comparing segmentation outputs from several architectures (DINOv2, SegFormer, DeepLabV3+, UPerNet) to human behavior in time‑to‑collision and change‑detection tasks, the authors find that briefly trained models are too coarse, fully trained models are too fine, and an intermediate training stage best matches the coarse, volumetric bodies humans use. Larger models reach this intermediate alignment earlier, suggesting that resource constraints drive the emergence of human‑like representations in general‑purpose vision systems.
arXiv:2609.10224v1 Announce Type: new Abstract: Vision-language models such as CLIP embed images and text in a shared space, where modality-specific distributions often remain separated. Existing acc...
arXiv:2601.21948v2 Announce Type: replace Abstract: Neural visual decoding is a central problem in brain-computer interface research, aiming to reconstruct human visual perception and to elucidate th...
arXiv:2409. 10094v3 Announce Type: replace-cross Abstract: Out-of-Distribution (OoD) detection aims to justify whether a given sample is from the training distribution of the classifier-under-protection, i.