The human brain processes dynamic visual input through hierarchically organized, functionally specialized regions. While recent in silico brain encoding models can synthesize optimal stimuli to probe selectivity in different brain regions, prior work has been largely limited to static images, leaving dynamic visual processing underexplored.
arXiv:2606. 04772v1 Announce Type: cross Abstract: Understanding the relationship between deep visual representations and the human visual system is a fundamental challenge in computational neuroscience.
By Hoang-Son Vo, Van-Hung Bui, Minh-Huy Mai-Duc, Tien-Dung Mai, Soo-Hyung Kim
Understanding the relationship between deep visual representations and the human visual system is a fundamental challenge in computational neuroscience. While modern vision models achieve strong performance in image recognition, their correspondence with the hierarchical organization of the human visual cortex remains an open question.
arXiv:2609.36366v1 Announce Type: cross
Abstract: Understanding how the brain parses actions and events from time-varying natural inputs is a central challenge in neuroscience. Recent work has used d...
By Iishaan Inabathini, Margaret M. Henderson
arXiv:2609.36391v1 Announce Type: cross
Abstract: An ongoing challenge in sensory neuroscience is to characterize the feature dimensions encoded by cortical populations. Recent approaches probe featu...
By Junru Zhao, Hanfei Guo, Andrew Luo, Margaret M. Henderson
arXiv:2607. 17625v1 Announce Type: cross Abstract: Modern video transformers typically ignore principles from primate vision and are rarely evaluated against neural data, limiting their biological interpretability.
By Amir Hosein Fadaei, Mahyar Maleki, Mohammad-Reza A. Dehaqani
The paper presents a unified framework that links vision foundation models to fMRI brain activity using sparse, interpretable visual prototypes. By replacing black‑box features with these prototypes and applying a linear readout, the model reveals which visual concepts drive neural responses, maps cortical organization through voxel tuning, and enables controlled stimulus synthesis to probe cortical selectivity. This approach provides a transparent, prototype‑based representation for studying visual representations in the human brain.
By Shi Chen, Seoyoung Ahn, Doris Tsao
The study investigates how internal representations of video diffusion models align with human visual cortex responses. It finds that representations used for future video generation in an autoregressive (AR) model better match cortical activity than those for observed video, with future‑generation alignment concentrated in higher‑order visual areas. A behavioral experiment further shows that humans prefer videos enhanced by layers that align more strongly with cortical responses.
By Chang-Bae Bang, Hyungjin Chung, Byung-Hoon Kim
Neurons++ is a visual‑stream framework that reconstructs both static images and dynamic videos from fMRI data. It builds on the earlier Neurons model by extending from video‑only to image‑and‑video reconstruction and replacing parallel task conditioning with a serial, cortex‑inspired decoding pipeline. The approach first pre‑trains on image‑fMRI pairs for stable spatial‑semantic initialization, then fine‑tunes separately for image and video tasks, organizing fMRI representations into spatial, semantic, language‑level, and temporal cues, and achieves state‑of‑the‑art video reconstruction with competitive image results while enabling neural‑to‑visual interpretability and ROI‑guided semantic modulation.
By Haonan Wang, Yuchen Wang, Jingyu Lu, Qixiang Zhang, Lehan Wang, Xuanqi Huang, Xiaomeng Li
arXiv:2606. 00121v1 Announce Type: cross Abstract: Reconstructing visual stimuli from brain recordings has been a meaningful and challenging task in brain decoding.
By Yizhuo Lu, Changde Du, Qiongyi Zhou, Liuyun Jiang, Huiguang He
arXiv:2606. 30319v1 Announce Type: cross Abstract: Modeling the bidirectional correspondence between external sensory stimuli and internal neural activity has emerged as a critical frontier in neuroscience.
By Haitao Wu, Qirui Zhang, Zhouheng Yao, Shangquan Sun, Qihao Zheng, Mianxin Liu, Chi Zhang, Wanli Ouyang, Chunfeng Song, Changqing Zhang, Jiamin Wu
The paper introduces Vis‑Lens, a framework that combines a variational autoencoder and a diffusion model to generate natural, realistic images that match preferred visual representations in both artificial neural networks and the human visual cortex. By applying an activation‑based prior, the method regularizes a structured visual representation landscape, enabling direct modification of latent codes without per‑image optimization. Experiments using fMRI data demonstrate that Vis‑Lens improves activation modulation and image realism compared to recent state‑of‑the‑art approaches.
By Yusong Zhao, Edgar Y. Walker, Hao Wang, Mi Lu