Extremely coarse learning objectives induce human-aligned representations in AI vision models
Read the original on arXiv Computer Vision →The Flow has not summarised this story yet — read it at arXiv Computer Vision.
The Flow has not summarised this story yet — read it at arXiv Computer Vision.
arXiv:2601.21948v2 Announce Type: replace Abstract: Neural visual decoding is a central problem in brain-computer interface research, aiming to reconstruct human visual perception and to elucidate th...
arXiv:2606. 28399v1 Announce Type: cross Abstract: The structure of human visual representations underpins our capacity for adaptive behaviour.
The study explores how to fine‑tune visual brain encoding models so that their internal representations better match individual human perceptual similarity judgments. Using similarity data from 100 images collected from eight participants in the Natural Scenes Dataset, the authors adapted a generic similarity model (DreamSim) to create personalized perceptual similarity models for each subject. They then fine‑tuned each participant’s baseline encoder with either generic or personalized similarity information, finding that models trained with personalized judgments were most aligned with human perceptual similarity and preserved inter‑subject correlations of those judgments.
arXiv:2603. 13994v2 Announce Type: replace-cross Abstract: Vision foundation models trained with self-supervised objectives achieve strong performance across diverse tasks and exhibit emergent object segmentation properties.
The study investigates how vision models represent objects compared to humans during physical reasoning tasks. By comparing segmentation outputs from several architectures (DINOv2, SegFormer, DeepLabV3+, UPerNet) to human behavior in time‑to‑collision and change‑detection tasks, the authors find that briefly trained models are too coarse, fully trained models are too fine, and an intermediate training stage best matches the coarse, volumetric bodies humans use. Larger models reach this intermediate alignment earlier, suggesting that resource constraints drive the emergence of human‑like representations in general‑purpose vision systems.
arXiv:2605.13675v2 Announce Type: replace-cross Abstract: Deep neural networks trained with different architectures, objectives, and datasets have been reported to converge on similar visual represen...