arXiv AI

Known-Voice Cloning and the Limits of Personality Transfer for Character Design

arXiv AI
Oct 7

Voice "Cloning" is Style Transfer

arXiv:2605.16578v4 Announce Type: replace-cross Abstract: Artificially generated speech is increasingly embedded in everyday life. Voice cloning in particular enables applications where identity pres...

By Kaitlyn Zhou, Federico Bianchi, Martijn Bartelds, Anna Pot, Yongchan Kwon, James Zou
arXiv AI
Sep 24

Listening and Mirroring: The Effects of Verbal Attunement and Behavioral Mimicry on Social and Empathic Perceptions of Embodied AI Agents in VR

The study investigates how verbal attunement and real‑time behavioral mimicry affect users’ perceptions of an embodied AI counselor in virtual reality. Participants interacted with a system that varied in verbal attunement (attuned vs. neutral) and behavioral mimicry (present vs. absent). Results indicated that verbal attunement most reliably increased perceived empathy, while mimicry had a marginal effect on perceived humanness and showed exploratory positive associations with empathy, positivity, and humanness, especially among female participants.

By Nathalia Gomez, Haig Shamlian, Omar Khan, Tiffany D. Do
arXiv Computation and Language
Aug 31

Stranger, Fan, or Peer? A Systematic Study on the Role of Interlocutor in Persona-Based Dialogue Generation

The study investigates how the visibility of speaker biographies to interlocutors during training, inference, and evaluation affects persona-based dialogue generation. It finds that training-time visibility is the primary factor determining whether models express persona traits or simply copy biographical text, and that providing interlocutor-biography visibility during training reduces target-biography copying. Additionally, asymmetric disclosure—where only the interlocutor sees the target biography—leads to more frequent leakage of target content into interlocutor turns, making such dialogues easier for a judge to identify.

By Daniela Occhipinti, Malvina Nissim, Marco Guerini
arXiv Computation and Language
Aug 24

The Voiceprint Fallacy: Why Voices Are Not Unique Biometric Imprints

The article critiques the notion that a person's voice is a stable, unique biometric trace—termed a voiceprint—by reviewing historical, forensic, and technological evidence. It argues that voices are highly dynamic and context-dependent, and that the voiceprint metaphor misrepresents probabilistic speaker information as a fixed identity marker. The authors emphasize that speaker recognition should account for within-speaker variability, domain mismatch, and synthetic manipulation rather than rely on an assumed stable voiceprint.

By Tianle Yang, Cuiling Zhang, Chengzhe Sun, Siwei Lyu, Phil Rose
arXiv AI
Sep 24

Emergi-PersonaOS: A Persona Agent Operating System for Situational Adaptation and Controllable Evolution

Emergi-PersonaOS is a psychology‑grounded operating system designed to manage persona agents throughout their lifecycle. It structures personas into three layers—dispositional traits, characteristic adaptations, and narrative identity—allowing the system to infer current persona states from situational cues and generate appropriate actions. The OS records experiences, evaluates revision candidates, and controls belief updates through explicit review and traceable evidence, enabling controllable evolution of persona agents over long interactions.

By Haoluan Fu, Keni Chen, Xinyu Jia, Jinpeng Wang, Yuyu Yin