arXiv Computation and Language By Romolo Muletta, Felix Matthias Saaro, Mark Cieliebak, Jan Deriu

Your Voice Cloning System is Secretly a Voice Anonymizer

Read the original on arXiv Computation and Language →

The paper demonstrates that the multilingual voice cloning model XTTSv2 can be repurposed for speaker anonymization without retraining. By conditioning on a pseudo-speaker and using an iterative refinement strategy, the authors balance privacy and intelligibility, achieving near‑optimal privacy (EER ≈ 0.49) and competitive speech quality across seven European languages. The method outperforms dedicated anonymization baselines and requires no language‑specific training.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computation and Language.

arXiv AI
Jul 14

Listen to the Features: Voice Anonymization Driven by Content Embedding Matching over Signal Reconstruction

arXiv:2607. 09767v1 Announce Type: cross Abstract: The paper presents a voice anonymization model focusing on preserving content rather than producing realistic speech.

By Adrien Schneider (M-PSI), Kacper Zabkowski (M-PSI), Anderson Augusma (M-PSI), Fr\'ed\'erique Letu\'e (SAM, SVH), Maria Camila Pinzon (M-PSI), Dominique Vaufreydaz (M-PSI)
arXiv Machine Learning
5d ago

DiffAnon: Diffusion-based Prosody Control for Voice Anonymization

DiffAnon is a diffusion‑based voice anonymization method that uses classifier‑free guidance to give users continuous, inference‑time control over how much prosody is preserved. By refining acoustic detail over semantic embeddings from an RVQ codec, the model allows smooth interpolation between strong anonymization and high prosodic fidelity within a single architecture. This is the first framework to provide structured, interpolatable prosody control while maintaining competitive privacy and utility across different operating points.

By Ismail Rasim Ulgen, Zexin Cai, Nicholas Andrews, Philipp Koehn, Berrak Sisman