arXiv:2608. 02673v1 Announce Type: cross Abstract: Speech editing for content creation requires precise control over both what an edit should do and where it should apply.
arXiv:2609.22697v1 Announce Type: new Abstract: Recently, text-to-speech systems have made significant progress in speech expressiveness and controllability. However, the speaking style of generated...
arXiv:2606. 07080v1 Announce Type: cross Abstract: We present dots.
The paper introduces SCIC, a method that enhances speaker‑adapted expressive TTS by conditioning prosody instructions on both scope and codebook usage. SCIC uses a Temporal Instruction Router to activate frame‑level tags and Tag‑Specific Codebook Weighting to target residual codebooks for Pitch, Energy, and Speed, while Pause uses absolute durations. The approach improves clause‑level prosodic control and yields a clearer paragraph‑level expressive hierarchy compared to standard instruction fine‑tuning, with post‑training optimization preserving quality and speaker similarity.
The paper introduces Live-ProsodyJudge (LPJ), a cost‑effective pairwise evaluator distilled from Gemini for assessing fine‑grained prosody in live streaming TTS. It identifies a flaw called verdict coupling, where multi‑dimensional scores collapse into a single preference, and proposes Decoupled‑Live‑ProsodyJudge (D‑LPJ) to eliminate this issue through masking and a span‑local GRPO strategy. Experiments show LPJ outperforms a single Gemini call in accuracy, and D‑LPJ provides independent dimension judgments, achieving high alignment with human top‑3 selections in a TTS candidate tournament.
arXiv:2608. 19515v1 Announce Type: new Abstract: Prosodic cues can convey task-relevant information that alters the trajectory and outcome of a task-oriented dialogue, even when the words themselves remain unchanged.
arXiv:2606. 10233v1 Announce Type: cross Abstract: While speech quality is typically assessed on complete utterances, streaming and generative systems require incremental estimation from partial audio.
Prosodic cues can convey task-relevant information that alters the trajectory and outcome of a task-oriented dialogue, even when the words themselves remain unchanged. Yet existing benchmarks typically evaluate prosodic perception, response appropriateness, and task-oriented dialogue in isolation, making it difficult to test whether prosodic evidence changes downstream decisions.
arXiv:2608. 08638v1 Announce Type: cross Abstract: Zero-shot text-to-speech (TTS) now supports interactive assistants, personalized media, and accessibility tools.
FireRedAudio is a 9‑billion‑parameter audio language model that separates continuous input representations for audio understanding and speech generation, enabling a single autoregressive LLM to perform tasks such as ASR, zero‑shot TTS, Instruct TTS, and semantic/acoustic speech editing. The model uses a dedicated Audio Encoder for recognition and a RedAE‑based pathway for generation, with the LLM directly generating text or conditioning a flow‑matching DiT to produce acoustic latents. Evaluations show competitive or leading performance in multilingual ASR, content‑accurate zero‑shot TTS, strong instruction following, and significant improvements in speech editing over prior work.
arXiv:2610.24809v2 Announce Type: replace Abstract: Speech recognition in real time in far-field conversational settings still incurs significant errors. Identifying potential error spans during stre...
arXiv:2609.14231v1 Announce Type: cross Abstract: Controllable synthesis of nonverbal vocalizations (NVVs) is es- sential for natural and expressive speech, but remains challeng- ing due to their aco...