arXiv:2607. 13162v1 Announce Type: cross Abstract: What a language model will and will not do is largely set during post-training, but which behaviors it expresses, hides, or resists is not revealed by prompting alone.
By Winston Zeng, Ali Emami, Jinho Choi
arXiv:2610.03998v2 Announce Type: replace
Abstract: Large language models (LLMs) are increasingly used as synthetic personas representing survey respondents. Their validity as substitutes for particu...
By Khashayar Pourtaheri, Ahmad Zareei
arXiv:2606. 20205v1 Announce Type: new Abstract: Psychological instruments designed for humans are increasingly used to assign large language models (LLMs) stable psychological profiles that affect their usability, safety assessment, and use as proxies for human participants in research.
By Jelena Meyer, David Garcia, Dirk U. Wulff
The paper treats human interventions during LLM agent failures as labels that pinpoint the internal computation that went wrong, rather than merely training data. In a controlled environment, the authors analyze one failure type—over‑asking a clarifying question when the request is already clear—using rule‑based overseer labels validated by blind human judgment. They find that the decision to ask versus act can be causally localized across several models, that over‑asking exhibits distinct mechanistic signatures, and that steering or weight consolidation can mitigate the issue, though outcomes vary by model family.
By Cesare Zavattari, Alessandro Tommasi, Giuseppe Prencipe
arXiv:2608. 14606v1 Announce Type: cross Abstract: Large language models (LLMs) are increasingly used as synthetic survey respondents, but existing evaluations ask whether answers look plausible at the individual level.
By Mantas Lukauskas, Viktorija \v{S}arkauskait\.e
The paper evaluates whether large language model (LLM) agents can exhibit graded cognitive diversity when simulating human-like behaviour. Using a cognition-suite that includes new Cognitive Reflection Test (CRT) and Behavioural Reflection Test (BRT) alongside established measures, the study finds that while agents can replicate trait distributions, they fail to mirror human variation in task performance and downstream behaviour. Claude Sonnet 5 performs best but still shows significant discrepancies compared to human data.
By Sion Weatherhead, Ben Newell, Aaron Belbasis, Flora Salim