arXiv Machine Learning

The Platonic brain bridge hypothesis: human brain networks as an architectural prior for omni models

The paper introduces the Platonic brain bridge hypothesis, asserting that omni models—capable of jointly processing video, audio, and text—naturally develop brain‑like representations, and that this relationship is bidirectional. Experiments show that seven omni models exhibit stable brain‑like representations across participants, and their internal states outperform others on the Algonauts 2025 out‑of‑distribution leaderboard. Building on this, the authors propose three brain‑to‑model methods: Brain‑MoE assigns a brain‑pretrained expert to each of seven cortical networks, improving benchmark accuracy; Brain‑AVQA generates video‑based questions using the most responsive brain network, outperforming shuffled mappings; and Brain‑Scope uses sparse autoencoders to pinpoint a small subset of networks whose removal weakens brain prediction, demonstrating that human brain networks can serve as a practical architectural prior for omni models.

arXiv AI
Oct 21

Omni-Woodpecker: Hallucination Correction via Evidence-Prior Rebalancing for Omni LLMs

Omni-Woodpecker (OWP) is a training‑free framework designed to reduce cross‑modal hallucinations in Omni LLMs by rebalancing fused representations. It identifies conflicts between modality‑specific views, separates grounding evidence from competing priors via orthogonal decomposition, and adaptively suppresses misleading priors while restoring ignored evidence before decoding. Experiments show OWP improves performance on CMM, AVHBench, and several general reasoning benchmarks, and generalizes across different Omni LLM architectures.

By Zijian Liu, Chaoyou Fu, Yan Yang, Caifeng Shan, Ran He
arXiv AI
Jun 16

OmniMouse: Scaling properties of multi-modal, multi-task Brain Models on 150B Neural Tokens

arXiv:2604. 18827v2 Announce Type: replace-cross Abstract: Scaling data and artificial neural networks has transformed AI, driving breakthroughs in language and vision.

By Konstantin F. Willeke, Polina Turishcheva, Alex Gilbert, Goirik Chakrabarty, Hasan A. Bedel, Paul G. Fahey, Yongrong Qiu, Marissa A. Weis, Michaela Vystr\v{c}ilov\'a, Taliah Muhammad, Lydia Ntanavara, Rachel E. Froebe, Kayla Ponder, Zheng Huan Tan, Emin Orhan, Erick Cobos, Sophia Sanborn, Katrin Franke, Fabian H. Sinz, Alexander S. Ecker, Andreas S. Tolias
arXiv AI
Jun 4

A Unified Geometric Space for Topological Alignment Between Transformer-Based Models and Human Brain Networks

arXiv:2510. 24342v2 Announce Type: replace Abstract: Prior brain-AI alignment studies are typically constrained by specific inputs and tasks, limiting their ability to capture organizational properties across models with different modalities.

By Silin Chen, Yuzhong Chen, Caiwei Wang, Zifan Wang, Junhao Wang, Zifeng Jia, Keith M Kendrick, Tuo Zhang, Lin Zhao, Dezhong Yao, Tianming Liu, Xi Jiang
arXiv AI
Oct 2

CortexBridge: Cortical Alignment of EEG Montages for Foundation Models

CortexBridge is a lightweight adapter that aligns arbitrary EEG electrode montages into a shared cortical latent space by combining EEG features with electrode and atlas coordinates. When evaluated on five BCI datasets from MOABB with three frozen foundation models, it improves performance in 13 of 15 tasks, achieving average balanced‑accuracy gains of 0.80% (EEGPT), 0.70% (LaBraM), and 3.26% (CBraMod), with a maximum 13.02% improvement on a 12‑class SSVEP task. Visualizations show task‑dependent spatial patterns, such as a concentrated representation in the Yeo Visual network for SSVEP versus auditory P300.

By Jiazhen Hong, Xiaotian Zhou, Zihao Ding, Kailong Wang, Yu Wu
arXiv AI
Sep 25

Training Object Permanence in World Models

The paper introduces WROP, a dataset of 150 hand‑designed cognitive tasks aimed at testing object permanence in video generation models. Using Blender, the authors generate over 10,000 samples per task, compiling a 1.5 M‑sample training corpus and a 300‑question exam. They evaluate 14 video models, showing that their 16B world model, PWM‑WROP, ranks first among continuation models and third overall in a blind Elo study.

By Haotian Zhang, Fengyuan Yu, Dezhi Luo, Haoran Sun, Zehong Zhao, Qingying Gao, Yihan Li, Siyuan An, Huayi Qin, Yilan Zhang, Zhengze Jiang, Pinyuan Feng, Renrui Zhang, Ziyu Guo, Letian Wang, Mengyue Yang, Kangfu Mei, Maijunxian Wang, Ran Ji, Vikash Kumar, Freda Shi, Chandra Sripada, Vincent C. Muller, Philip Torr, Alan Yuille, Nikolaus Kriegeskorte, Felix Juefei-Xu, Lvmin Zhang, Jieneng Chen, Yilun Du, Hokin Deng
arXiv AI
2d ago

AutoBCI: Forecast-Guided Agentic Neural Architecture Discovery for EEG-Based Brain-Computer Interfaces

AutoBCI is an agentic framework that discovers and selects EEG decoding architectures across diverse tasks such as emotion recognition, motor imagery, and sleep staging. It employs a Designer Agent that performs Pool‑Guided Architecture Discovery (PGAD) and a Forecaster Agent that uses Performance Estimation from Early Knowledge (PEEK) to predict full‑budget validation performance from early learning curves. Evaluated on 14 EEG datasets with six large language models, AutoBCI’s best architecture (Claude Opus 5.5) achieves 64.16% average test balanced accuracy, slightly surpassing the strongest baseline, and PEEK reduces prediction error by 38.1% compared to the best‑observed‑score baseline.

By Muyun Jiang, Yi Ding, Wei Zhang, Jinbo Chen, Chenyu Liu, Zhenjie Yang, Yuxin Li, Jingyuan Chen, Yuhao Lu, Yong Li, Shuailei Zhang, Cuntai Guan
arXiv AI
Aug 11

EgoBrain: Synergizing Minds and Eyes For Human Action Understanding

arXiv:2506. 01353v3 Announce Type: replace Abstract: The integration of brain-computer interfaces (BCIs), in particular electroencephalography (EEG), with artificial intelligence (AI) has shown tremendous promise in decoding human cognition and behavior from neural signals.

By Nie Lin, Yansen Wang, Dongqi Han, Weibang Jiang, Jingyuan Li, Ryosuke Furuta, Yoichi Sato, Dongsheng Li