arXiv Computation and Language

Cognitive Maps in Large Language Models

The study investigates whether large language models (LLMs) develop internal representations similar to cognitive maps used by animals for flexible behavior. Using relational reasoning tasks and causal mosaic experiments, the authors found that LLMs beyond ten billion parameters can infer unstated relationships, generalize to synthetic entity names, and form abstract relational structures that combine with entity identities. These relational representations are stored as pairwise links and composed retrospectively, mediated by a sparse, distributed key‑value system that can be perturbed to implant false memories and alter behavior predictably.

arXiv AI
Jul 2

NeuroCogMap Reveals Cognitive Organization of Large Language Models

arXiv:2607. 00397v1 Announce Type: cross Abstract: Understanding how complex cognitive functions are organized within artificial systems is central to interpreting large language models (LLMs) and relating them to biological cognition.

By Zhongxiang Sun, Haolang Lu, Qiang Ma, Qi Li, Qipeng Wang, Liang Pang, Chenyu Liu, Qiankun Li, Hao Sun, Kun Wang, Yi Zeng, Jun Xu, Guoqi Li, Ji-Rong Wen
arXiv Machine Learning
1d ago

Discovering Structurally Plausible and Interpretable Cognitive Models with Large Language Models

The paper introduces DisCo, a framework that uses large language models (LLMs) to automatically generate interpretable symbolic cognitive models. DisCo employs evolutionary search guided by two structural components: a Validator that filters out structurally invalid models and a Cleaner that enhances parameter identifiability by removing redundancies. Experiments on three behavioral tasks show that DisCo produces models with performance comparable to task‑specific baselines, and ablation studies highlight the Validator’s role in maintaining psychologically meaningful structure.

By Boyoung Kwon, Jiyoon Seo, Sang Ho Lee
arXiv AI
Aug 14

From Observation to Intervention: Memory in Brains and Large Language Models

arXiv:2608. 12377v1 Announce Type: cross Abstract: Brains and large language models (LLMs) are fundamentally different memory systems, but they can be compared through shared functional questions: where memory-related information is represented, how partial cues recover broader associations, how new information is written or updated, and how memory-related states can be perturbed.

By Morteza Salehjahromi, Shayan A. Zadegan, Amgad Muneer, Jia Wu
arXiv AI
Sep 25

Unraveling the cognitive patterns of Large Language Models through module communities

The paper presents a network-based framework that links cognitive skills, LLM architectures, and datasets to uncover the cognitive patterns of Large Language Models. It identifies module communities within LLMs that exhibit skill distributions partially mirroring distributed cognitive organization seen in avian and small mammalian brains, yet distinct from the focalized specialization of specific biological systems. The study highlights that LLM skill acquisition benefits from dynamic, cross-regional interactions and neural plasticity, suggesting fine-tuning should leverage distributed learning dynamics rather than rigid modular interventions.

By Kushal Raj Bhandari, Pin-Yu Chen, Jianxi Gao
arXiv AI
Jul 28

Temporal Context Reinstatement Drives Episodic-Like Order Memory in Long-Context Language Models

arXiv:2607. 22575v1 Announce Type: new Abstract: Human episodic memory supports the retrieval of experiences that unfold over extended timescales, yet the computational mechanisms underlying this ability remain debated due to the limited mechanistic accessibility in long-term memory experiments in humans.

By Mathis Pink, Vy Ai Vo, Qinyuan Wu, Jianing Mu, Javier Turek, Uri Hasson, Kenneth A. Norman, Sebastian Michelmann, Alexander Huth, Mariya Toneva