arXiv Computation and Language

Alania-2: Turkish text-to-speech with instant and fine-tuned voice cloning

Alania-2 is a Turkish text‑to‑speech system featuring 488 M parameters and the VoxCPM architecture, trained from scratch on 18,195 hours of Turkish speech—90 % of which is synthetic. It offers two built‑in voices, voice design from text descriptions, and two voice‑cloning modes, achieving a 1.44 % word error rate on the Freya‑TR‑Eval benchmark and competitive intelligibility with far fewer parameters. Practical insights include improved cloning accuracy with reference audio conditioning, optimal 20‑30 s reference length, and rapid low‑rank adapter training for speaker similarity, along with inference optimizations that reduce first‑audio latency to 32 ms.

arXiv Computation and Language
6d ago

Antalia-2 Mini: A 7.6-million-parameter Turkish text-to-speech model trained entirely on synthetic speech

Antalia-2 Mini is a single‑voice Turkish text‑to‑speech model with 7.6 million parameters that reads characters and outputs 48 kHz audio at 41× real time on an Apple M5 laptop CPU. It was trained solely on synthetic speech from the larger VoxCPM2 teacher, and fine‑tuning its vocoder on the model’s own mel spectrograms reduced Whisper’s word error rate from 3.89 % to 1.75 %. On the 495‑sentence Freya‑TR‑Eval benchmark, version 1.0.1 achieves a 1.09 % WER and 0.22 % character error rate, comparable to the EMA Lightning model in full‑band UTMOS scores.

By Sezgin Saygili, Emre Kaplaner, Oncel Ozgul, Fikri San Koktas
arXiv Computation and Language
Nov 4

ufakzeka-kulak: Building and Evaluating a 31.6M-Parameter Turkish Speech Recognizer from Scratch

ufakzeka-kulak is an open Turkish speech‑to‑text model with 31.6 M parameters, built using a FastConformer encoder, a token‑and‑duration transducer (TDT), and a CTC head. It was trained from scratch on 4,977 hours of data—281 hours of human transcription and 4,696 hours of machine‑generated subtitles that were verified by a second reading—under licenses permitting commercial use. The model outputs cased, punctuated Turkish text with numbers written as words, achieving a normalised WER of 0.0921 on FLEURS Turkish and 0.0916 on Common Voice 27.0 Turkish, outperforming Whisper base and small models, and it is released under Apache‑2.0.

By Sait Furkan Teke (ufak AI)
arXiv AI
Sep 4

Building and Evaluating Fixed-Voice Thai TTS from Synthetic Speech

The paper presents a method for creating a compact fixed‑voice Thai text‑to‑speech system by training a student model on synthetic speech generated from a large voice‑cloning teacher. By using only a short 15‑second voice reference and carefully filtering synthetic data, the authors build an 82‑million‑parameter model, Wayu‑Paxa‑TTS‑Edge, that runs on device without reference audio. The system achieves strong performance—68.2 % challenge‑set keyword accuracy, 91.4 % pause precision, and low character error rates—while outperforming its teacher and approaching the quality of a larger Gemini 3.1 model.

By Kunat Pipatanakul, Potsawee Manakul, Warit Sirichotedumrong, Sittipong Sripaisarnmongkol, Pakorn Nathong, Phatrasek Jirabovonvisut
arXiv Computation and Language
Oct 23

Synthetic-to-Real Code-Switched ASR: A Spontaneous Nepali-English Podcast Benchmark

The paper introduces a new benchmark of 13,044 spontaneous Nepali‑English code‑switched podcast utterances, totaling 15.45 h, and evaluates a two‑stage synthetic‑to‑real adaptation framework for ASR. Stage 1 uses supervised fine‑tuning on 0.95 h of synthetic speech, reducing Mixed Error Rate from 23.40 % to 21.52 % and switch‑point error rate from 35.89 % to 28.77 %. Stage 2 applies Group Relative Policy Optimization with script and transcription rewards, yielding modest but statistically significant further improvements, particularly in English script confusion and switch‑point accuracy. The study also shows that an auxiliary script reward term offers no benefit beyond MER‑only optimization in this setting, and that the synthetic SFT provides the main cross‑domain transfer to spontaneous human speech.

By Firoj Paudel
arXiv AI
Jul 17

RW-Voice-EQ Bench: A Real World Benchmark for Evaluating Voice AI Systems

arXiv:2607. 14846v1 Announce Type: cross Abstract: Current voice AI benchmarks typically evaluate isolated capabilities such as speech intelligibility, word error rate, or text-based dialogue quality, but they rarely test whether systems harness the acoustic information that distinguishes spoken language from its textual representation.

By David Ayllon, Alice Baird, Jeffrey Brooks, Franc Camps-Febrer, Jakub Piotr C{\l}apa, Theo Lebryk, Jens Madsen, Olya Ossipova, Sharath Rao, Hoon Shin, Tigran Soghbatyan, Georg Streich, Rashish Tandon, Panagiotis Tzirakis
arXiv Computation and Language
Aug 24

Building and Evaluating a Synthetic Bengali Speech Resource for Telecom Customer Care

The paper introduces a synthetic Bengali speech dataset tailored for telecom customer‑care applications, comprising 10,000 audio‑text pairs (≈26.82 hours) with predefined train, validation, and test splits. The data were generated using OmniVoice voice‑cloning, and include both original and normalized transcripts for ASR/STT use. Automatic intelligibility evaluation with a fine‑tuned Whisper model shows an average WER of 2.54% and CER of 0.59%, indicating strong text‑audio consistency, while the authors note limitations of synthetic speech and STT‑based evaluation.

By Kawshik Kumar Paul, Md. Nafiul Alam Fuji
arXiv Computation and Language
Oct 28

AzeroS: Extending LLM to Speech with Self-Generated Instruction-Free Tuning

The paper introduces AZeroS, a speech‑adapted large language model that uses Self‑Generated Instruction‑Free Tuning (SIFT) to avoid task‑specific instruction data. By training only two lightweight projection modules on 25,000 hours of speech‑text pairs and 3,000 hours of paralinguistic labels, AZeroS achieves state‑of‑the‑art results on semantic and paralinguistic benchmarks while keeping the core LLM and audio encoder frozen.

By Yiwen Shao, Wei Liu, Jiahong Li, Tianzi Wang, Kun Wei, Meng Yu, Dong Yu