arXiv Machine Learning

Discovering Structurally Plausible and Interpretable Cognitive Models with Large Language Models

The paper introduces DisCo, a framework that uses large language models (LLMs) to automatically generate interpretable symbolic cognitive models. DisCo employs evolutionary search guided by two structural components: a Validator that filters out structurally invalid models and a Cleaner that enhances parameter identifiability by removing redundancies. Experiments on three behavioral tasks show that DisCo produces models with performance comparable to task‑specific baselines, and ablation studies highlight the Validator’s role in maintaining psychologically meaningful structure.

arXiv AI
6d ago

Cognitive Foundations for Reasoning and Their Manifestation in LLMs

The paper presents a taxonomy of 28 cognitive elements derived from cognitive science to analyze reasoning in large language models (LLMs). Using a fine‑grained evaluation framework, the authors compare 192,000 model traces with 1,346 human think‑aloud traces, finding that while models deploy similar cognitive elements, they differ in usage patterns. The study introduces test‑time reasoning guidance that improves model accuracy on ill‑structured problems by 9.7 percentage points and highlights a research gap in self‑awareness, advocating for a shared vocabulary to diagnose failures and guide robust model development.

By Shuyue Stella Li, Priyanka Kargupta, Haocheng Wang, Jinu Lee, Dean Light, Shan Chen, Orevaoghene Ahia, Thomas L. Griffiths, Max Kleiman-Weiner, Jiawei Han, Asli Celikyilmaz, Yulia Tsvetkov
arXiv Machine Learning
Aug 27

Emergent Abilities in Large Language Models: A Survey

Emergent Abilities in Large Language Models: A Survey reviews how scaling LLMs leads to previously unseen capabilities such as advanced reasoning, in-context learning, coding, and problem-solving. The paper critically examines definitions, inconsistencies, and the conditions that foster these abilities, including scaling laws, task complexity, pre‑training loss, quantization, and prompting strategies. It also discusses the extension to Large Reasoning Models and highlights safety concerns like deception, manipulation, and reward hacking, calling for improved evaluation and governance.

By Leonardo Berti, Flavio Giorgi, Gjergji Kasneci
arXiv AI
Sep 15

Thought without systematicity? Evaluating reasoning models on rule induction tasks

The paper investigates whether current reasoning models exhibit systematicity—the idea that understanding one concept should extend to closely related variations—by extending rule induction tasks from cognitive science. Using task isomorphisms like recombination and substitution, the authors generate structurally equivalent task variants and test models on them. Results show that while models can solve the original tasks, they frequently fail on these equivalent variants, indicating a lack of systematicity in their reasoning abilities.

By Simon Schug, Brenden M. Lake
arXiv AI
Oct 19

Beyond Large Language Models: A Mental World Model Framework for Mental Modeling, Simulation, Evolution, and Interpretability

The paper introduces the Mental World Model (MWM) and its implementation, the Multi-Branch Mental Evolution Architecture (MMEA), to explicitly construct subjective worlds and simulate continuous mental evolution influenced by historical experiences. MMEA outperforms leading large language models and Theory of Mind methods on DynToM and RecToM tasks, achieving 96.48% and 94.00% accuracy, and shows significant gains in mental state and behavior prediction, long‑sequence prediction, and implicit mental state inference. The authors argue that MWM offers an interpretable framework for continuous mental modeling, enabling AI to infer underlying mental states from linguistic data and to simulate dynamic cognitive processes, thereby laying groundwork for causal reasoning, personalized AI, sustained human‑AI interaction, and progress toward artificial general intelligence.

By Qingshi Wang