← Back to all news
arXiv AI By Yisi Liu, Nicholas Lee, Gopala K. Anumanchipalli

StyleStream 2.0: Fast and Controllable Streaming Voice Style Conversion

Read the original on arXiv AI →

StyleStream 2.0 is a fast, controllable streaming voice style conversion system that reduces end‑to‑end latency to about 520 ms on a consumer GPU, halving the delay of its predecessor while preserving conversion quality. It replaces mel‑spectrogram context with a compact style embedding, enabling a unified text‑conditioned flow model that supports both text‑based voice design and instruction‑based voice editing. Experiments demonstrate that StyleStream 2.0 achieves superior target style fidelity, voice design, and voice editing performance while maintaining intelligibility and attribute preservation.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

Related stories

arXiv AI
Sep 7

X-VC: Zero-shot Streaming Voice Conversion in Codec Space

X-VC is a zero‑shot streaming voice conversion system that performs one‑step conversion directly in the latent space of a pretrained neural codec. It employs a dual‑conditioning acoustic converter that jointly models source codec latents and target acoustic conditions, while using adaptive normalization to inject utterance‑level speaker information. The model is trained with generated paired data and a role‑assignment strategy, and uses a chunkwise inference scheme with overlap smoothing to achieve low‑latency streaming inference, achieving superior WER, speaker similarity, and real‑time factor on the Seed‑TTS‑Eval benchmark.

By Qixi Zheng, Yuxiang Zhao, Tianrui Wang, Wenxi Chen, Kele Xu, Yikang Li, Qinyuan Cheng, Xipeng Qiu, Kai Yu, Xie Chen
diffusion
More like this →
arXiv Machine Learning
Aug 17

VoiceDesigner: Text-to-Voice Generation and Editing via Unified Diffusion Modeling and Data Augmentation

arXiv:2608. 13613v1 Announce Type: cross Abstract: Recent breakthroughs in generative models have made text-to-voice generation (TTV) possible, enabling the synthesis of speech directly from textual voice descriptions.

By Jiarui Hai, Karan Thakkar, Ke Chen, Yunyun Wang, Jiaqi Su, Rithesh Kumar, Mounya Elhilali, Zeyu Jin
llmsdiffusionbenchmarkssafetydata-engineering
More like this →
arXiv Machine Learning
Sep 22

AVTR-1: Open Stack for Real-Time Interactive Avatars

arXiv:2609.22913v1 Announce Type: cross Abstract: Talking-head and dyadic models now achieve real-time inference, yet fast motion generation alone does not produce an interactive conversation. A live...

By Artem Kravtsov, Dmitrii Ziganshin, Vsevolod Poletaev, Gleb Balitskiy, Anastasia Tikhonova, Egor Burkov, Vadim Lebedev
agentsefficiency
More like this →