arXiv Computation and Language By Mikio Nakano, Kazunori Komatani, Hironori Takeuchi

Generating Diverse Personas for User Simulators to Test Interview Dialogue Systems

Read the original on arXiv Computation and Language →

arXiv:2608. 19549v1 Announce Type: new Abstract: This paper addresses the issue of the significant labor required to test interview dialogue systems.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computation and Language.

arXiv Computation and Language
Sep 7

Controlling and Assessing Appropriate Persona Use in LLM-based Dialogue Generation

The paper examines how large language models (LLMs) tend to overuse persona attributes in persona-based dialogue generation, producing unnatural responses. It identifies a systematic bias in LLMs to incorporate all provided persona details and shows that current metrics cannot assess contextual appropriateness. To address this, the authors introduce Self-CONtrastive Persona Overuse Suppression (SCONPOS), which intervenes in the prompt encoding stage to reduce overuse, and propose the Persona Appropriateness Score (PAS), a new metric that penalizes both overuse and underuse of persona attributes.

By Jongkyung Shin, Inkyu Lee, Chiehyeon Lim