VIPBench is a new benchmark that measures how humans perceive voice identity, using 124,876 same-or-different judgments from 1,290 listeners on 9,800 recording pairs involving real voices, voice clones, and morphed voices of 100 public figures. It defines four tasks to evaluate how well speaker‑representation models align with human judgments, including predicting majority responses and assessing similarity across real and synthetic recordings. Eleven publicly available speech models were evaluated, showing that listeners often misidentify cloned voices and that no model reaches the noise ceiling, with the best explaining only 61% of the explainable variance.
By Xudong Tang, Matthew Groh
arXiv:2605.16578v4 Announce Type: replace-cross
Abstract: Artificially generated speech is increasingly embedded in everyday life. Voice cloning in particular enables applications where identity pres...
By Kaitlyn Zhou, Federico Bianchi, Martijn Bartelds, Anna Pot, Yongchan Kwon, James Zou
The paper "Beyond EER: Multi-Dimensional Evaluation of Information Leakage in Speaker De-Identification" argues that evaluating speaker de-identification systems solely by Equal Error Rate (EER) is insufficient. It proposes a holistic framework using five complementary metrics—EER, soft biometric leakage score, cumulative match characteristic re-identification analysis, canonical correlation analysis with Procrustes embedding alignment, and intelligibility via word error rate and semantic similarity—to capture independent dimensions of information leakage. Experiments on five IARPA ARTS SDID systems show that these metrics reveal leakage that a single metric would miss.
By Seungmin Seo, Oleg Aulov, P. Jonathon Phillips, Kevin Mangold, Jonathan Eskin
The paper introduces EvoSpeakerMem, a training‑free layer that enables online speaker‑memory construction for multi‑user spoken agents by routing speakers, updating acoustic states, and partitioning memory writes and retrievals. It also presents LoCoMo‑ID, a benchmark with hidden speaker identities, speaker‑sensitive queries, and recording‑condition shifts to evaluate such systems. Experiments show that gated updating improves identity‑gated QA while maintaining zero wrong‑user authorizations, though a fragmentation–contamination trade‑off remains.
By Yucong Zhang, Cancan Li, Bo Xiao, Ke Zeng, Ming Li
arXiv:2607. 21820v1 Announce Type: cross Abstract: Audio deepfake detectors are trained to distinguish genuine speech from synthetic speech and often perform well on standard benchmarks.
By Daniyal Kabir Dar, Arun Ross
arXiv:2609.39344v1 Announce Type: cross
Abstract: Speech transcripts used as long-term memory must preserve both words and stable speaker identities. Existing meeting-transcription metrics either ign...
By Shantanu Vispute, Aditya Mishra, Siddhartha Saxena
Speech transcripts used as long-term memory must preserve both words and stable speaker identities. Existing meeting-transcription metrics either ignore speakers or remap anonymous speakers independen...
The paper introduces AVAPrintDB, a new public multi‑generator talking‑head avatar database designed for avatar fingerprinting, comprising data from two audiovisual corpora and three state‑of‑the‑art generators (GAGAvatar, LivePortrait, HunyuanPortrait). It also defines a standardized benchmark that evaluates existing avatar fingerprinting systems and explores new methods based on Foundation Models such as DINOv2 and CLIP, while analyzing performance under generator and dataset shift. The authors find that identity‑related motion cues persist across synthetic avatars, yet current fingerprinting systems are highly sensitive to changes in synthesis pipelines and source domains.
By Laura Pedrouzo-Rodriguez, Luis F. Gomez, Ruben Tolosana, Ruben Vera-Rodriguez, Roberto Daza, Aythami Morales, Julian Fierrez
arXiv:2606. 08678v1 Announce Type: cross Abstract: Sophisticated generative speech technology can undermined the reliability of voice biometrics.
By Anh-Tuan Dao, Driss Matrouf, Mickael Rouvier, Nicholas Evans
arXiv:2604. 01562v2 Announce Type: replace-cross Abstract: Voice cloning is often evaluated in terms of overall quality, but less is known about accent preservation and its perceptual consequences.
By Tianle Yang, Chengzhe Sun, Phil Rose, Siwei Lyu
The paper reviews how voice authentication has evolved from handcrafted acoustic features to deep learning speaker embeddings, expanding its use in finance, smart devices, and law enforcement. It surveys modern threats—including data poisoning, adversarial, deepfake, and adversarial spoofing attacks—tracing their development alongside technological advances. For each attack type, the authors summarize methods, datasets, performance, and limitations, and organize the literature using accepted taxonomies to highlight emerging risks and open challenges.
By Kamel Kamel, Keshav Sood, Hridoy Sankar Dutta, Sunil Aryal
arXiv:2606. 28048v1 Announce Type: cross Abstract: Insurance fraud remains costly and operationally difficult, particularly in call-centre workflows where many customer interactions begin at FNOL.
By Muhammad Shakeel Akram, Amal Htait, Abdul Hamid Sadka, Emma Meisingseth, Karishma Jaitly