arXiv AI By Xudong Tang, Matthew Groh

VIPBench: A Human-Aligned Benchmark for Voice Identity Perception in the Age of Voice Cloning

Read the original on arXiv AI →

VIPBench is a new benchmark that measures how humans perceive voice identity, using 124,876 same-or-different judgments from 1,290 listeners on 9,800 recording pairs involving real voices, voice clones, and morphed voices of 100 public figures. It defines four tasks to evaluate how well speaker‑representation models align with human judgments, including predicting majority responses and assessing similarity across real and synthetic recordings. Eleven publicly available speech models were evaluated, showing that listeners often misidentify cloned voices and that no model reaches the noise ceiling, with the best explaining only 61% of the explainable variance.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv AI
Oct 7

Voice "Cloning" is Style Transfer

arXiv:2605.16578v4 Announce Type: replace-cross Abstract: Artificially generated speech is increasingly embedded in everyday life. Voice cloning in particular enables applications where identity pres...

By Kaitlyn Zhou, Federico Bianchi, Martijn Bartelds, Anna Pot, Yongchan Kwon, James Zou
arXiv Computation and Language
Aug 24

The Voiceprint Fallacy: Why Voices Are Not Unique Biometric Imprints

The article critiques the notion that a person's voice is a stable, unique biometric trace—termed a voiceprint—by reviewing historical, forensic, and technological evidence. It argues that voices are highly dynamic and context-dependent, and that the voiceprint metaphor misrepresents probabilistic speaker information as a fixed identity marker. The authors emphasize that speaker recognition should account for within-speaker variability, domain mismatch, and synthetic manipulation rather than rely on an assumed stable voiceprint.

By Tianle Yang, Cuiling Zhang, Chengzhe Sun, Siwei Lyu, Phil Rose