CompanionSim: Synthetic Data for Evaluating Anthropomorphism in Human-AI Relationships
Read the original on arXiv AI →The Flow has not summarised this story yet — read it at arXiv AI.
The Flow has not summarised this story yet — read it at arXiv AI.
arXiv:2606. 04150v1 Announce Type: new Abstract: Public discourse and emerging policy typically assume that AI emotional support is a deliberate act: a lonely user consciously seeking comfort from a dedicated companion chatbot.
arXiv:2608. 04205v1 Announce Type: new Abstract: Human evaluation of AI systems and digital products is costly, slow, and difficult to scale.
arXiv:2607. 25057v1 Announce Type: new Abstract: As conversational AI systems become increasingly integrated into daily life, their potential effects on user well-being require ongoing attention.
arXiv:2608. 02046v2 Announce Type: replace-cross Abstract: LLM companions are deployed at scale in personally consequential settings, yet poorly evaluated.
LLM companions are deployed at scale in personally consequential settings, yet poorly evaluated. Existing benchmarks use hand-authored scenarios and prompted simulators, aggregate empathy into one score, and overlook judge biases such as same-family favoritism and scale drift.
InterviewPlayground is a simulation environment designed to evaluate AI interviewers by using simulated participants whose behaviors are grounded in social theory. The platform generates an InterviewReportCard that assesses AI interviewers across validated measures. Empirical validation shows that performance in InterviewPlayground predicts human study outcomes with a Pearson correlation of 0.86, supporting its use for assessing AI interviewer performance and failure modes.