arXiv Computation and Language

Cognitive Expert Language Models Better Align with the Corresponding Brain Systems

The study investigates whether language models tailored to specific cognitive domains better align with corresponding brain systems. By prompting and fine‑tuning large language models into six domain experts—sensory, spatial, numerical, reasoning, social, and abstract—the authors find that each expert’s representations more closely match the brain region associated with its domain than other experts. This domain‑specific alignment holds across multiple base models and fMRI datasets, while overall prediction accuracy remains largely unchanged, indicating that regional alignment can be obscured when summarizing across the brain.

arXiv AI
Oct 16

Decomposing Brain-LLM Alignment with Interpretable Semantic Representations

The study investigates how a large language model (LLaMA2‑7B) aligns with human brain activity during naturalistic language comprehension by using SCRIBE, an interpretable semantic representation of 65 neurocognitively grounded properties. Variance partitioning on fMRI data from seven participants reveals that shared variance between LLaMA2‑7B and SCRIBE dominates across the brain, yet both representations also contribute unique variance. Further analysis shows that concrete semantic properties correlate more strongly with shared variance, while abstract properties do not show increased unique variance, and ablation experiments demonstrate that multiple semantic dimensions cumulatively influence both shared and unique brain-predictive variance.

By Camila Kolling, Mariya Toneva
arXiv Machine Learning
Oct 8

Brain alignment of reasoning and action representations from vision-language and action models during naturalistic gameplay

arXiv:2605.19352v2 Announce Type: replace-cross Abstract: Understanding how humans and artificial intelligence systems predict and plan by interacting with their environment is a fundamental challeng...

By Subba Reddy Oota, Anant Khandelwal, Khushbu Pahwa, Satya Sai Srinath Namburi, Tanmoy Chakraborty, Bapi S. Raju, Manish Gupta
arXiv AI
Aug 11

Large Language Models Align with the Human Brain during Creative Thinking

arXiv:2604. 03480v2 Announce Type: replace-cross Abstract: Creative thinking is a fundamental aspect of human cognition, and divergent thinking-the capacity to generate novel and varied ideas-is widely regarded as its core generative engine.

By Mete Ismayilzada, Simone A. Luchini, Abdulkadir Gokce, Badr AlKhamissi, Antoine Bosselut, Antonio Laverghetta Jr., Lonneke van der Plas, Roger E. Beaty
arXiv Computation and Language
Sep 11

Cross-lingual brain-language model alignment is robust but challenges hierarchical and computational accounts

The study examined whether brain-language model alignment reflects shared computational mechanisms or merely stable lexical‑semantic correspondences. Using whole‑brain encoding across Mandarin, English, and French, transformer representations predicted activity in a distributed network that overlapped across languages and remained stable across layers. Contextual embeddings and measures of prediction or compression did not outperform static lexical embeddings, suggesting that alignment is robust but not informative about shared computational processes.

By Ni Yang, Rui He, Philipp Homan, Iris Sommer, Davide Staub, Wolfram Hinzen
arXiv AI
Sep 18

A Neuropsychologically Grounded Evaluation of LLM Cognitive Abilities

The paper introduces NeuroCognition, a benchmark based on three neuropsychological tests—Raven's Progressive Matrices, Spatial Working Memory, and the Wisconsin Card Sorting Test—to evaluate foundational cognitive abilities in large language models (LLMs). It finds that while LLMs excel on text tasks, their performance drops on image-based and more complex tasks, and they fail different parts of the same tasks compared to humans. NeuroCognition correlates with standard general-capability benchmarks yet measures distinct cognitive skills, highlighting where LLMs align with or diverge from human-like intelligence.

By Faiz Ghifari Haznitrama, Faeyza Rishad Ardi, Alice Oh
arXiv Machine Learning
Oct 7

A Systematic Study of Small Language Models on Abstract Reasoning Tasks

The paper investigates how small language models acquire abstract reasoning skills on the ARC‑TGI benchmark, which groups grid‑transformation tasks into controllable families and allows resampling, spatial shifts, and cross‑benchmark transfer. Over 1,000 supervised fine‑tuning runs across decoder‑only, encoder‑decoder, and mixture‑of‑experts families, the study finds that high in‑distribution accuracy is possible but depends heavily on optimization and is uneven across task families. Performance drops sharply outside the training distribution, and gains from larger training sets or additional in‑context examples vary by model family; attention diagnostics reveal distinct patterns but do not explain causal mechanisms.

By Nur A Zarin Nishat, Jens Lehmann, Andrei Aioanei, Sahar Vahdati