arXiv Computation and Language By Zirui Li, Rech Silas, Lauri Juvela, Tom Backstrom, Mikko Kurimo

EmphTTS: an emphasis-control TTS with reinforcement learning

Read the original on arXiv Computation and Language →

EmphTTS is a non‑autoregressive text‑to‑speech system that uses Group Relative Policy Optimization (GRPO) to train its duration predictor with an emphasis localization reward, allowing direct word‑level emphasis control. The system outperforms existing baselines in both objective emphasis evaluation and subjective preference tests, and ablation studies confirm that GRPO improves emphasis realization while reducing mismatch between the duration predictor and the TTS model.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computation and Language.

arXiv Computation and Language
5d ago

Beyond Speech Captions: Speech-Rewarded Style Planning for Conversational Text-to-Speech

The paper introduces Speech-Rewarded Style Planning (SRSP), a method that trains a text-based style planner using a frozen downstream TTS model. SRSP generates candidate style instructions from dialogue history and response text, optimizing them with group-relative policy optimization (GRPO) where the reward is the teacher‑forced likelihood of target speech tokens. Experiments on an English subset of the ISCSLP 2026 CoT‑TTS corpus show that SRSP outperforms baseline LLM and target‑audio‑informed captioning approaches in speech‑style and emotion similarity, mel‑cepstral distortion, and contextual appropriateness. "whyItMatters":"The study demonstrates a more effective way to align natural‑language style descriptions with actual acoustic output, improving controllability and fidelity in conversational text‑to‑speech systems."

By Shiao Zhu, Lianbo Liu, Sizhen Lyu, Yuzhe Wang, Sheng Li, Takahiro Shinozaki
arXiv Computation and Language
Sep 22

COT-TTS: Audio Context-Aware Text-to-Speech with Chain-of-Thought Reasoning

arXiv:2609.22697v1 Announce Type: new Abstract: Recently, text-to-speech systems have made significant progress in speech expressiveness and controllability. However, the speaking style of generated...

By Weizhen Bian, Sitong Cheng, Rongxiu Zhong, Jiahao Pan, Liumeng Xue, Boyi Kang, Shilei Zhang, Jinglei Liu, Yue Wang, Junlan Feng, Bei Liu, Wei Xue