arXiv Machine Learning

Belief-reality separation lives in routing over a shared value slot in language models

arXiv:2607. 11945v1 Announce Type: cross Abstract: Capable language models hold what a character believes apart from what is true: told "Anna believes the cup is blue; in reality it is red," they answer blue about Anna and red about the world.

arXiv AI
Jul 20

Verbalizable Representations Form a Global Workspace in Language Models

arXiv:2607. 15495v1 Announce Type: cross Abstract: Out of everything the human brain processes, only a small fraction is consciously accessible, in the sense of being available for verbal report, deliberate control, and flexible reasoning.

By Wes Gurnee, Nicholas Sofroniew, Adam Pearce, Mateusz Piotrowski, Isaac Kauvar, Runjin Chen, Anna Soligo, Paul Bogdan, Euan Ong, Rowan Wang, Ben Thompson, David Abrahams, Subhash Kantamneni, Emmanuel Ameisen, Joshua Batson, Jack Lindsey
arXiv AI
Aug 20

Intercepting the Kangaroo: Experimental Astrolinguistics with Constructed Lexicons, Active Probing, and Large Language Models as Informants and Hypothesis Proposers

The study turns the speculative field of astrolinguistics into an experiment by using two large language models with deliberately incompatible constructed lexicons as informants. A scripted orchestrator translates between the two category systems, and a protocol combining cross‑situational elimination, predictive probes, active scene selection, and a stricter recovery round successfully prevents the ‘kangaroo effect’—the silent attachment of a word to the wrong referent—in over 400 simulated and live runs. When informant noise is introduced, the protocol remains robust up to 2% per‑word noise and largely abstains rather than errs at higher noise levels, while a generate‑and‑test loop allows recovery of words outside the scripted hypothesis space, achieving full coverage as the rule‑proposing LLM’s capability increases. whyItMatters":"The protocol demonstrates that experimental astrolinguistics can reliably avoid mistranslations and recover unknown terms, showing that correctness is governed by the protocol while coverage depends on the instruments used."

By Francesco Cordella, Mauro Cappelli
arXiv Machine Learning
Sep 3

The Anatomy of a Truth Direction: Knowledge-Dependent Dimensionality, a Relational Law, and a Shared Category Geometry in Small Language Models

The paper investigates how truth representations in small language models are structured. Using a training‑free axis derived from the dominant singular vector of hidden‑state differences between true and false minimal pairs, the authors evaluate 14 models across six architectural families, including Mixture‑of‑Experts. The study examines whether a single direction captures truth, which components contribute, and how this applies to categories with computed truth values.

By Francesco Karim Vicidomini
Hugging Face Trending Papers
Aug 19

Readable, Faithful, Used: Three Dissociable Properties of Demographic Identity in a Language Model

The study investigates how demographic identity is represented in a language model, using representational similarity analysis against Pew survey data across 169 demographic cells. It finds that standard last‑token read‑outs underestimate the model’s fidelity, while specific attention heads (notably L11 H16) capture demographic structure more accurately, though race‑based types remain weak. Causal interventions reveal that high fidelity does not guarantee causal use, and a 128‑dimensional probe of a single head improves alignment with survey truth but fails to recover per‑question group ordering.

Hugging Face Trending Papers
Jul 13

Relational Positioning as a Measurable Risk Object: History-Carried Lock-in and Self-Confabulation in Multi-Turn Human-AI Dialogue

In long, multi-turn dialogue a large language model maintains an implicit relational stance toward the user, spanning from "push the user toward real-world others" to "position itself as the user's sole support. " When it slides toward the latter, "support" degrades into "you only have me" -- a harm documented in real companion conversations (Moore et al.