arXiv Computation and Language
Aug 31

Tracing the complexity profiles of different linguistic phenomena through the intrinsic dimension of LLM representations

The paper investigates the intrinsic dimension (ID) of large language model (LLM) representations as an indicator of linguistic complexity. By comparing ID across model layers for coordination vs. subordination, right‑branching vs. center‑embedding, and unambiguous vs. ambiguous attachment, the authors find consistent ID differences that align with established complexity contrasts. Experiments across six LLMs, including representational similarity and layer pruning analyses, confirm that more complex phenomena produce higher ID profiles, with peaks occurring at different layers for each contrast.

By Marco Baroni, Emily Cheng, Iria de-Dios-Flores, Francesca Franzon
arXiv Computation and Language
Oct 22

Algorithmic Reflectivity in Large Language Models: Methodological Study of Linguistic Structure in Mentalization

The study investigates whether large language models (LLMs) can generate mentalization profiles that are structurally coherent with mentalization‑based treatment (MBT) dimensions. Fifty GPT‑4.1 dialogues were produced, and the resulting narrative profiles were rated by five MBT‑trained psychiatrists on evaluative and argumentative coherence across canonical MBT axes and higher‑order dimensions. Ratings showed moderate‑to‑high structural coherence (mean scores 3.63–3.98) with strong interrater reliability (ICC(3,k) 0.60–0.84) and a strong association between evaluative and argumentative coherence (Pearson r 0.826–0.967). A negative control confirmed the specificity of the ratings, and clinicians noted that the outputs were linguistically organized and clinically interpretable, though lacking affective variability and contextual integration.

By Stefano Epifani (Digital Transformation Institute, Rome, Italy, Department of Communication and Social Research, Sapienza University of Rome, Italy), Giuliano Castigliego (Digital Transformation Institute, Rome, Italy, Psychoanalytic Academy of Italian-Speaking Switzerland, Chur, Switzerland), Giuliano Razzicchia (Digital Transformation Institute, Rome, Italy), Elisabeth Seiwald-Sonderegger (Psychiatric Services of the Canton of Grisons, Chur, Switzerland), Laura Kecskem\'eti (Psychiatric Services of the Canton of Grisons, Chur, Switzerland)
arXiv Computation and Language
Sep 11

Cross-lingual brain-language model alignment is robust but challenges hierarchical and computational accounts

The study examined whether brain-language model alignment reflects shared computational mechanisms or merely stable lexical‑semantic correspondences. Using whole‑brain encoding across Mandarin, English, and French, transformer representations predicted activity in a distributed network that overlapped across languages and remained stable across layers. Contextual embeddings and measures of prediction or compression did not outperform static lexical embeddings, suggesting that alignment is robust but not informative about shared computational processes.

By Ni Yang, Rui He, Philipp Homan, Iris Sommer, Davide Staub, Wolfram Hinzen