arXiv AI

LLM-Based Selection of Incongruent Verbal and Nonverbal Behavior for Virtual Humans

arXiv AI
Sep 24

Listening and Mirroring: The Effects of Verbal Attunement and Behavioral Mimicry on Social and Empathic Perceptions of Embodied AI Agents in VR

The study investigates how verbal attunement and real‑time behavioral mimicry affect users’ perceptions of an embodied AI counselor in virtual reality. Participants interacted with a system that varied in verbal attunement (attuned vs. neutral) and behavioral mimicry (present vs. absent). Results indicated that verbal attunement most reliably increased perceived empathy, while mimicry had a marginal effect on perceived humanness and showed exploratory positive associations with empathy, positivity, and humanness, especially among female participants.

By Nathalia Gomez, Haig Shamlian, Omar Khan, Tiffany D. Do
arXiv AI
Sep 10

A Three-Tier Persona Vector for Controllable User Simulation in Agentic Evaluation

The paper introduces a three-tier persona vector for user simulation in evaluating LLM agents, comprising 23 dimensions across demographics, behavioral traits, and emotional states, plus a query-complexity overlay. It demonstrates that these nuanced personas generate diverse, scenario-reactive conversations, leading to significant variations in agent goal achievement and compliance across different contexts. The model’s design allows for reproducible, auditable user behavior patterns without relying on learned covariance matrices.

By Rahul Khedar, Eshita, Sneha Teja Sree Reddy Thondapu, Mayank Malhotra, Arup Kumar Das, Jitesh Chandra Mishra, Arun Menon, Avinash Karn, Mouli V
arXiv AI
Jul 24

HARP: The Human--AI Research Platform

arXiv:2607. 20773v1 Announce Type: cross Abstract: Large language models (LLMs) have shifted human--computer interaction from `traditional'' interface journeys toward more conversational exchanges.

By Zeshu Zhu, Natalie Friedman, Kevin Weatherwax, Emily Eiben
Hugging Face Trending Papers
Sep 8

A Three-Tier Persona Vector for Controllable User Simulation in Agentic Evaluation

The paper introduces a three-tier persona vector to generate diverse, realistic user inputs for evaluating tool-augmented LLM agents. The vector includes 23 dimensions: categorical demographics, continuous behavioral traits, and continuous emotional states, plus a query-complexity overlay. Experiments on 64,698 conversations show that these persona dimensions produce measurable differences in agent performance and realistic scenario-reactive behavior.

arXiv Computation and Language
Oct 9

Prompts versus Rules: Auditing and Controlling Speech Naturalness Behaviors in Voice User Simulators

The paper evaluates how well voice user simulators generate realistic speech naturalness behaviors such as disfluency, interruption, and backchanneling. By auditing the tau-Voice LLM-based prompting approach and a rule-based injection algorithm, the authors find that prompting is unreliable and produces inconsistent, less natural speech, whereas the rule-based method yields controllable and diverse behaviors that better align with natural speech patterns. The study highlights the need for linguistically informed deterministic or specialized models and stresses the importance of auditing realized behaviors rather than relying solely on configured settings.

By Riqiang Wang, Elena Khasanova, Harsh Saini, Lex Konnelly, Parsa Kavehzadeh, Matthias Lee, Mohamed Attia