arXiv AI
Diagnose, Then Refine: A Closed-Loop TTS System with AudioLLM-Guided Correction
Read the original on arXiv AI →The Flow has not summarised this story yet — read it at arXiv AI.
Related stories
arXiv AI
Aug 5
dots.tts.edit: Precisely Controlled Speech Editing with a Continuous Autoregressive Model
arXiv:2608. 02673v1 Announce Type: cross Abstract: Speech editing for content creation requires precise control over both what an edit should do and where it should apply.
arXiv Computation and Language
Sep 22
COT-TTS: Audio Context-Aware Text-to-Speech with Chain-of-Thought Reasoning
arXiv:2609.22697v1 Announce Type: new Abstract: Recently, text-to-speech systems have made significant progress in speech expressiveness and controllability. However, the speaking style of generated...
arXiv AI
Jun 8
dots.tts Technical Report
arXiv:2606. 07080v1 Announce Type: cross Abstract: We present dots.
arXiv AI
Oct 1
SCIC: Scope- and Codebook-Aware Instruction Conditioning for Speaker-Adapted Expressive TTS
The paper introduces SCIC, a method that enhances speaker‑adapted expressive TTS by conditioning prosody instructions on both scope and codebook usage. SCIC uses a Temporal Instruction Router to activate frame‑level tags and Tag‑Specific Codebook Weighting to target residual codebooks for Pitch, Energy, and Speed, while Pause uses absolute durations. The approach improves clause‑level prosodic control and yields a clearer paragraph‑level expressive hierarchy compared to standard instruction fine‑tuning, with post‑training optimization preserving quality and speaker similarity.
arXiv AI
Sep 18
Multi-Dimensional Prosody Judgment For Live Streaming Speech Synthesis
The paper introduces Live-ProsodyJudge (LPJ), a cost‑effective pairwise evaluator distilled from Gemini for assessing fine‑grained prosody in live streaming TTS. It identifies a flaw called verdict coupling, where multi‑dimensional scores collapse into a single preference, and proposes Decoupled‑Live‑ProsodyJudge (D‑LPJ) to eliminate this issue through masking and a span‑local GRPO strategy. Experiments show LPJ outperforms a single Gemini call in accuracy, and D‑LPJ provides independent dimension judgments, achieving high alignment with human top‑3 selections in a TTS candidate tournament.
arXiv Computation and Language
Aug 21
Hear2Act: Benchmarking When Prosody Should Change What an Assistant Does
arXiv:2608. 19515v1 Announce Type: new Abstract: Prosodic cues can convey task-relevant information that alters the trajectory and outcome of a task-oriented dialogue, even when the words themselves remain unchanged.