arXiv AI

An In-Silico Audit of Topographic Organization in a Multimodal Brain-Response Model

The study evaluates TRIBE v2, a multimodal brain‑response model that predicts fMRI activity from video, audio, and text. Using mapping stimuli and a fitting pipeline, the authors find that TRIBE v2 fails to reproduce classic topographic maps—no contralateral retinotopy, no polar‑angle map, and no tonotopic gradient—yet it accurately captures motion selectivity in area MT+. These results highlight limitations in the model’s spatial and frequency encoding while confirming its utility for feature‑identity‑based analyses.

arXiv AI
Sep 30

Similar Choices, Different Attention: Cross-Modal Associations in Humans and Vision-Language Models

The study compares human and vision‑language model (VLM) responses to cross‑modal association tasks, using identical stimuli (a pseudo‑word and two images) and recording both choices and eye movements. While larger VLMs show some alignment with human choices, their attention patterns correlate poorly with human gaze, performing no better than a simple center‑bias baseline. Fine‑tuning VLMs on human choices improves choice alignment but not attention alignment, and training on human gaze improves attention correlation without affecting choice accuracy.

By Sumin Hong, Katsumi Ibaraki, Renee Shi, David Chiang, Toby Jia-Jun Li
Hugging Face Trending Papers
Jun 3

Coarse-to-fine Hierarchical Architecture with Sequential Mamba for Brain Reconstruction

Understanding the relationship between deep visual representations and the human visual system is a fundamental challenge in computational neuroscience. While modern vision models achieve strong performance in image recognition, their correspondence with the hierarchical organization of the human visual cortex remains an open question.