arXiv AI By Alexander Dregger, Barbarella Petz, Erik Kuhn, Pia Volk, Andreas Oberweis, Stefan Hillmann, Jannik Str\"otgen

The Artificial Personality Model: Theory, Implementation, Measurement and Experimental Validation in Conversational Agents

Read the original on arXiv AI →

The paper refines and empirically tests the Artificial Personality Model (APM), a hybrid framework that blends human‑centred and machine‑specific personality dimensions for conversational agents. Using three experiments with 395 participants, the authors operationalised the model with the Artificial Personality Questionnaire (APQ), finding that some human traits (e.g., agreeableness, conscientiousness) partially transfer while others (e.g., extraversion) do not, and identified new machine‑specific dimensions. The APQ showed promising psychometric properties, whereas the BFI‑2 performed poorly, and manipulations of artificial personality significantly affected user satisfaction, continuous use intention, and social presence.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv AI
Sep 21

Do Personality-Tuned LLMs Make Better Social Agents?

The paper examines whether fine‑tuning large language models (LLMs) with personality‑labelled data improves their ability to act as socially interactive agents. Two small open‑weight LLMs were fine‑tuned on a corpus of personality‑labelled social media posts and dialogues, and the resulting models were evaluated in various social interaction scenarios by independent LLM judges. The findings show that the fine‑tuned models do not outperform their baseline counterparts in role‑playing personalities, though they offer comparable text quality and increased linguistic diversity for the Qwen models; low inter‑rater agreement limits confidence in the results, suggesting future work should focus on training data quality and domain alignment.

By Tim Krabbe, Xiaodan Shi
arXiv AI
Aug 19

Beyond BFI: The CSI for Enhanced Reliability and Validity in Evaluating LLM Personality Traits

The paper introduces the Core Sentiment Inventory (CSI), a new personality trait evaluation tool for large language models (LLMs) that addresses reliability and validity issues found in existing methods like the Big Five Inventory (BFI). CSI is designed specifically for LLMs, supports both English and Chinese, and provides detailed psychological portraits of model behavior. Experiments show that CSI captures nuanced behavioral patterns, improves reliability, and correlates strongly (above 0.85) with real-world LLM outputs.

By Huanhuan Ma, Haisong Gong, Xiaoyuan Yi, Xing Xie, Philip S. Yu, Dongkuan Xu