arXiv Computation and Language

Vagdhenu: A Vrutta (Meter) Aware Shloka-to-Chant (TTS) System for Sanskrit

Vagdhenu is a Sanskrit shloka‑to‑chant text‑to‑speech system that preserves meter (vrutta) and phonological nuances. It builds on an off‑the‑shelf flow‑matching backbone and a large‑scale neural vocoder, adding a Kannada‑based frontend to avoid schwa deletion, a phonology‑aware frontend handling visarga sandhi and sibilant distinctions, and a vrutta‑aware reference selection mechanism. The authors report that a text‑side prosody conditioner is ineffective in their architecture, while reference clips and voice‑steering retraining provide the necessary prosody control, and they demonstrate the system’s performance on a 32‑chapter video corpus and an audio app covering 18,000 verses. whyItMatters":"The system delivers high‑fidelity, meter‑aware Sanskrit chanting, enabling large‑scale deployment of authentic recitations for educational and cultural preservation purposes."

arXiv Machine Learning
Sep 10

TontaubeV1: Streaming Text-to-Speech with Hierarchical Codec Modeling and Bounded Context

TontaubeV1 is a streaming text‑to‑speech model that preserves natural prosody while running on a single consumer GPU. It encodes speech with a hierarchical DualCodec representation at 12.5 Hz, separating a semantic stream from successive acoustic refinements, and uses Qwen3‑derived transformers to predict the semantic stream, utterance duration, and acoustic refinements. The system supports up to one minute of reference audio for voice conditioning, streams with a 200 ms latency to first audio, and achieves real‑time factors of 0.08 (single input) and 0.02 (eight concurrent inputs).

By Fritz Cremer, Jonathan Cremer
Hugging Face Trending Papers
Sep 8

TontaubeV1: Streaming Text-to-Speech with Hierarchical Codec Modeling and Bounded Context

TontaubeV1 is a streaming text‑to‑speech model that maintains natural prosody while running on a single consumer GPU. It encodes speech with a hierarchical DualCodec representation at 12.5 Hz, separating a semantic stream from successive acoustic refinements, and uses Qwen3‑derived transformers to predict the semantic stream and add refinements. The model supports up to one minute of reference audio for voice conditioning, streams with a 200 ms latency to first audio, and achieves real‑time factors of 0.08 (single input) and 0.02 (eight concurrent inputs).

arXiv AI
Sep 4

Building and Evaluating Fixed-Voice Thai TTS from Synthetic Speech

The paper presents a method for creating a compact fixed‑voice Thai text‑to‑speech system by training a student model on synthetic speech generated from a large voice‑cloning teacher. By using only a short 15‑second voice reference and carefully filtering synthetic data, the authors build an 82‑million‑parameter model, Wayu‑Paxa‑TTS‑Edge, that runs on device without reference audio. The system achieves strong performance—68.2 % challenge‑set keyword accuracy, 91.4 % pause precision, and low character error rates—while outperforming its teacher and approaching the quality of a larger Gemini 3.1 model.

By Kunat Pipatanakul, Potsawee Manakul, Warit Sirichotedumrong, Sittipong Sripaisarnmongkol, Pakorn Nathong, Phatrasek Jirabovonvisut