The Flow has not summarised this story yet — read it at arXiv Computation and Language.
Large language models (LLMs) are increasingly used for emotional support, raising concern that sustained use may draw users away from their real-world relationships. Yet existing evaluations primarily...
arXiv:2610.09569v1 Announce Type: new Abstract: Large language models (LLMs) are increasingly used for emotional support, raising concern that sustained use may draw users away from their real-world...
arXiv:2606. 20205v1 Announce Type: new Abstract: Psychological instruments designed for humans are increasingly used to assign large language models (LLMs) stable psychological profiles that affect their usability, safety assessment, and use as proxies for human participants in research.
The paper introduces the Core Sentiment Inventory (CSI), a new personality trait evaluation tool for large language models (LLMs) that addresses reliability and validity issues found in existing methods like the Big Five Inventory (BFI). CSI is designed specifically for LLMs, supports both English and Chinese, and provides detailed psychological portraits of model behavior. Experiments show that CSI captures nuanced behavioral patterns, improves reliability, and correlates strongly (above 0.85) with real-world LLM outputs.
Large Language Models (LLMs) are increasingly used for interpersonal advice, influencing how users interpret ambiguous social encounters. Existing Theory of Mind evaluations rely on predefined answers, while uncertainty research overlooks LLMs’ preferred explanations and confidence under psychological distress. To address these gaps, the authors introduce MentalLoom, a novel evaluation of LLM mentalisation comprising 604 ambiguous social episodes, matched depression and social anxiety disclosures, and four‑turn dialogues with unchanged event evidence. Across eight LLMs, disclosures initially elicited more negative explanations overall but more positive narrator‑directed interpretations. Scripted repeated questioning showed greater emotional support, stronger positive narrator‑directed endorsement, and higher certainty without new event evidence, demonstrating that user context can reshape interpretive preferences and commitment while the underlying ambiguity remains unresolved.
arXiv:2412.12144v5 Announce Type: replace-cross Abstract: Personality assessment through situational judgment tests (SJTs) offers unique advantages over traditional Likert-type self-report scales, ye...