arXiv Computation and Language

Algorithmic Reflectivity in Large Language Models: Methodological Study of Linguistic Structure in Mentalization

The study investigates whether large language models (LLMs) can generate mentalization profiles that are structurally coherent with mentalization‑based treatment (MBT) dimensions. Fifty GPT‑4.1 dialogues were produced, and the resulting narrative profiles were rated by five MBT‑trained psychiatrists on evaluative and argumentative coherence across canonical MBT axes and higher‑order dimensions. Ratings showed moderate‑to‑high structural coherence (mean scores 3.63–3.98) with strong interrater reliability (ICC(3,k) 0.60–0.84) and a strong association between evaluative and argumentative coherence (Pearson r 0.826–0.967). A negative control confirmed the specificity of the ratings, and clinicians noted that the outputs were linguistically organized and clinically interpretable, though lacking affective variability and contextual integration.

arXiv AI
Aug 21

Computational Phenomenology of Borderline Personality Disorder: A Comparative Evaluation of LLM-Simulated Expert Personas and Human Clinical Experts

arXiv:2508. 19008v3 Announce Type: replace Abstract: Building on a human-led thematic analysis of clinical life-story interviews (> 150,000 words) with inpatients with Borderline Personality Disorder, this study examines the capacity of large language models (OpenAI's GPT, Google's Gemini, and Anthropic's Claude) to support qualitative clinical analysis.

By Marcin Moskalewicz, Anna Sterna, Karolina Dro\.zd\.z, Kacper Dudzic, Marek Pokropski, Paula Flores
arXiv AI
Jul 7

The Rise of Verbal Tics in Large Language Models: A Systematic Analysis Across Frontier Models

arXiv:2604. 19139v3 Announce Type: replace-cross Abstract: As Large Language Models (LLMs) continue to evolve through alignment techniques such as Reinforcement Learning from Human Feedback (RLHF) and Constitutional AI, a growing and increasingly conspicuous phenomenon has emerged: the proliferation of verbal tics--repetitive, formulaic linguistic patterns that pervade model outputs.

By Shuai Wu, Xue Li, Yanna Feng, Yufang Li, Zhijun Wang, Ran Wang
arXiv Computation and Language
Sep 18

Summarization Bias: The Directional Collapse of Objective Projection into Told-Mode Labels in Large Language Models --- A Conceptual Framework and Registered Test Protocol

The paper introduces the concept of summarization bias in large language models (LLMs), describing a systematic tendency for LLMs to represent narrative meaning as an abstract summary label rather than the reconstructable inferential structure that produces it. It frames this bias within the Bulut Doctrine’s told‑shown axis, arguing that LLMs fail in a specific direction: they default to told‑mode explicitness in generative tasks and reward told‑mode explicitness while under‑detecting shown‑mode suppression in evaluative tasks. The authors outline two regimes of bias, present preliminary evidence, and pre‑register a test protocol to validate or abandon the construct.

By Levent Bulut
arXiv AI
Jul 1

Training Therapeutic Judges and Multi-Agent Systems for Human-Aligned Mental Health Support

arXiv:2606. 30887v1 Announce Type: cross Abstract: Large language models show promise for mental health support, yet therapeutic quality improves only when evaluation functions as an actionable control signal rather than a passive metric.

By Mizanur Rahman, Abeer Badawi, Elahe Rahimi, Laleh Seyyed-Kalantari, Frank Rudzicz, Enamul Hoque, Elham Dolatabadi
arXiv Computation and Language
3d ago

The Schema Coherence Inventory: Measuring Whether an Assigned Belief Organizes a Language Model's Cognition

The paper introduces the Schema Coherence Inventory (SCI), a 96-item forced-choice test designed to determine whether a belief assigned to a persona-conditioned language model actually organizes its behavior or merely reflects affect. SCI evaluates belief organization across eight levels of Beck's cognitive model, using length‑normalized log‑likelihood scores and a target‑specificity criterion to distinguish true belief influence from mood effects. Validation across five model backbones (1.7B–14B parameters) and nine clinicians shows high reliability and discriminant validity, and a 48‑item short form correlates strongly with the full inventory.

By Yuqi Wu, Deyang Li, Katharine Hibbard, Ron Oswald, David Sinclair, Adegboyega Sapara, Kalutota Kuruwe Arachchige Sajana Indula Samarasinghe, Abhinav Pillai, Reham Shalaby, Riffat Alam, Xin-Min Li, Yanbo Zhang, Jie Chen