Hugging Face Trending Papers

NEvo: Neural-Guided Evolutionary Video Synthesis for Dynamic Visual Selectivity

The human brain processes dynamic visual input through hierarchically organized, functionally specialized regions. While recent in silico brain encoding models can synthesize optimal stimuli to probe selectivity in different brain regions, prior work has been largely limited to static images, leaving dynamic visual processing underexplored.

arXiv Computer Vision
Aug 28

NEvo: Neural-Guided Evolutionary Video Synthesis for Dynamic Visual Selectivity

NEvo is a neural‑guided evolutionary video synthesis framework that generates dynamic stimuli optimized for specific brain regions in the visual cortex. It performs evolutionary search over a structured prompt space, guided by a dynamic encoding model that predicts voxel‑level responses to video inputs, thereby discovering hyper‑activating videos that outperform handcrafted localizers. The synthesized videos recover known selectivities across ventral, dorsal, and lateral pathways and reveal systematic differences in sensitivity to temporal dynamics, offering new insights into the progression of social‑dynamic features along the lateral stream.

By Yingtian Tang, Sogand Salehi, Ming Zhou, Amir Zamir, Leyla Isik, Martin Schrimpf
Hugging Face Trending Papers
Jun 3

Coarse-to-fine Hierarchical Architecture with Sequential Mamba for Brain Reconstruction

Understanding the relationship between deep visual representations and the human visual system is a fundamental challenge in computational neuroscience. While modern vision models achieve strong performance in image recognition, their correspondence with the hierarchical organization of the human visual cortex remains an open question.

arXiv AI
3d ago

Prototypes of the Mind: A Unified Framework for Probing the Visual Brain

The paper presents a unified framework that links vision foundation models to fMRI brain activity using sparse, interpretable visual prototypes. By replacing black‑box features with these prototypes and applying a linear readout, the model reveals which visual concepts drive neural responses, maps cortical organization through voxel tuning, and enables controlled stimulus synthesis to probe cortical selectivity. This approach provides a transparent, prototype‑based representation for studying visual representations in the human brain.

By Shi Chen, Seoyoung Ahn, Doris Tsao
arXiv Machine Learning
Jun 30

BrainJanus: A Unified Model for Understanding and Generation across Brain, Vision, and Language

arXiv:2606. 30319v1 Announce Type: cross Abstract: Modeling the bidirectional correspondence between external sensory stimuli and internal neural activity has emerged as a critical frontier in neuroscience.

By Haitao Wu, Qirui Zhang, Zhouheng Yao, Shangquan Sun, Qihao Zheng, Mianxin Liu, Chi Zhang, Wanli Ouyang, Chunfeng Song, Changqing Zhang, Jiamin Wu
arXiv Computer Vision
Oct 12

Neurons++: A Unified Visual-Stream Framework for Image and Video Reconstruction from fMRI with Neural-to-Visual Interpretability

Neurons++ is a visual‑stream framework that reconstructs both static images and dynamic videos from fMRI data. It builds on the earlier Neurons model by extending from video‑only to image‑and‑video reconstruction and replacing parallel task conditioning with a serial, cortex‑inspired decoding pipeline. The approach first pre‑trains on image‑fMRI pairs for stable spatial‑semantic initialization, then fine‑tunes separately for image and video tasks, organizing fMRI representations into spatial, semantic, language‑level, and temporal cues, and achieves state‑of‑the‑art video reconstruction with competitive image results while enabling neural‑to‑visual interpretability and ROI‑guided semantic modulation.

By Haonan Wang, Yuchen Wang, Jingyu Lu, Qixiang Zhang, Lehan Wang, Xuanqi Huang, Xiaomeng Li
arXiv Computer Vision
Nov 9

Structured Visual Landscape: Generating Preferred Representations in Biological and Artificial Neural Networks

The paper introduces Vis‑Lens, a framework that combines a variational autoencoder and a diffusion model to generate natural, realistic images that match preferred visual representations in both artificial neural networks and the human visual cortex. By applying an activation‑based prior, the method regularizes a structured visual representation landscape, enabling direct modification of latent codes without per‑image optimization. Experiments using fMRI data demonstrate that Vis‑Lens improves activation modulation and image realism compared to recent state‑of‑the‑art approaches.

By Yusong Zhao, Edgar Y. Walker, Hao Wang, Mi Lu