Hugging Face Trending Papers

ufakzeka-kulak: Building and Evaluating a 31.6M-Parameter Turkish Speech Recognizer from Scratch

arXiv Computation and Language
Nov 4

ufakzeka-kulak: Building and Evaluating a 31.6M-Parameter Turkish Speech Recognizer from Scratch

ufakzeka-kulak is an open Turkish speech‑to‑text model with 31.6 M parameters, built using a FastConformer encoder, a token‑and‑duration transducer (TDT), and a CTC head. It was trained from scratch on 4,977 hours of data—281 hours of human transcription and 4,696 hours of machine‑generated subtitles that were verified by a second reading—under licenses permitting commercial use. The model outputs cased, punctuated Turkish text with numbers written as words, achieving a normalised WER of 0.0921 on FLEURS Turkish and 0.0916 on Common Voice 27.0 Turkish, outperforming Whisper base and small models, and it is released under Apache‑2.0.

By Sait Furkan Teke (ufak AI)
arXiv Computation and Language
6d ago

Alania-2: Turkish text-to-speech with instant and fine-tuned voice cloning

Alania-2 is a Turkish text‑to‑speech system featuring 488 M parameters and the VoxCPM architecture, trained from scratch on 18,195 hours of Turkish speech—90 % of which is synthetic. It offers two built‑in voices, voice design from text descriptions, and two voice‑cloning modes, achieving a 1.44 % word error rate on the Freya‑TR‑Eval benchmark and competitive intelligibility with far fewer parameters. Practical insights include improved cloning accuracy with reference audio conditioning, optimal 20‑30 s reference length, and rapid low‑rank adapter training for speaker similarity, along with inference optimizations that reduce first‑audio latency to 32 ms.

By Sezgin Saygili, Emre Kaplaner, Oncel Ozgul, Fikri San Koktas
arXiv Computation and Language
6d ago

Antalia-2 Mini: A 7.6-million-parameter Turkish text-to-speech model trained entirely on synthetic speech

Antalia-2 Mini is a single‑voice Turkish text‑to‑speech model with 7.6 million parameters that reads characters and outputs 48 kHz audio at 41× real time on an Apple M5 laptop CPU. It was trained solely on synthetic speech from the larger VoxCPM2 teacher, and fine‑tuning its vocoder on the model’s own mel spectrograms reduced Whisper’s word error rate from 3.89 % to 1.75 %. On the 495‑sentence Freya‑TR‑Eval benchmark, version 1.0.1 achieves a 1.09 % WER and 0.22 % character error rate, comparable to the EMA Lightning model in full‑band UTMOS scores.

By Sezgin Saygili, Emre Kaplaner, Oncel Ozgul, Fikri San Koktas
arXiv Computation and Language
Aug 24

Building and Evaluating a Synthetic Bengali Speech Resource for Telecom Customer Care

The paper introduces a synthetic Bengali speech dataset tailored for telecom customer‑care applications, comprising 10,000 audio‑text pairs (≈26.82 hours) with predefined train, validation, and test splits. The data were generated using OmniVoice voice‑cloning, and include both original and normalized transcripts for ASR/STT use. Automatic intelligibility evaluation with a fine‑tuned Whisper model shows an average WER of 2.54% and CER of 0.59%, indicating strong text‑audio consistency, while the authors note limitations of synthetic speech and STT‑based evaluation.

By Kawshik Kumar Paul, Md. Nafiul Alam Fuji
arXiv Computation and Language
Sep 11

Unadapted Multilingual ASR on a Garrusi Kurdish Evaluation Set: A Common-Reference Staged Normalization Analysis

The paper evaluates a multilingual ASR model (MMS‑1B‑all) on a Garrusi Kurdish dataset using a common‑reference staged normalization approach. By normalizing both reference and hypothesis, the authors show that raw Arabic‑script hypotheses yield a 111.70 % WER, which drops to 97.85 % after folding into a reduced orthography, highlighting the impact of orthographic differences on error measurement. A Southern Kurdish fine‑tuned system performs worse, and residual errors are partly due to scoring‑pipeline limitations rather than recognition failures.

By Hiwa Asadpour
arXiv Computation and Language
Oct 22

How Far Can the Gemma 4 Speech Encoder Go Without Changing Its Weights? Saudi and Gulf Arabic Speech Recognition with a Frozen and an Adapter-Augmented Encoder

The paper evaluates a 305 M‑parameter audio encoder shared by Gemma 4 and EmbeddingGemma 2 for Saudi and Gulf Arabic speech recognition without altering its weights. Two approaches are compared: a frozen system that trains only a 22.6 M‑parameter CTC reader, and an adapted system that adds 3.1 M low‑rank adapters, a 41.5 M‑parameter hybrid CTC/attention reader, and joint decoding with a sub‑word language model. The adapted system matches or surpasses a 0.6 B‑parameter fine‑tuned recogniser on several datasets, while the frozen system remains competitive in character error rate and runs three‑quarters faster on CPU with greedy decoding.

By Amr Abdelkhalik
arXiv Computation and Language
Nov 2

TurnTurk-GPT: Text-Based Turn-Taking Prediction for Turkish

TurnTurk‑GPT is a Turkish text‑based turn‑taking predictor created by fine‑tuning a Turkish GPT‑2 model with the TurnGPT objective on both synthetic and real dialogue. The model is evaluated on real Turkish conversations using word‑level decision points on unpunctuated, lower‑cased text, and it outperforms a multilingual end‑of‑turn detector in both recording‑disjoint and speaker‑disjoint settings. While it matches a zero‑shot Turkish language model on unseen speakers, it only surpasses it when test speakers appear in training; removing verb‑final suffixes significantly degrades performance, highlighting the importance of Turkish morphology for turn detection.

By Ahmet Tu\u{g}rul Bayrak, Fatma Nur Korkmaz, Nur Ya\u{g}mur Tuncer, Mustafa Serta\c{c} T\"urkel
arXiv AI
6d ago

Nepali-English Code-Mixed Speech Recognition: Data Preparation and Adaptation of a Speech Foundation Model

The paper presents a study on adapting the SraVaani speech recognition model to Nepali-English code‑mixed speech. Using a 172.8‑hour corpus across six Nepali domains, the authors fine‑tune the 449M‑parameter hybrid TDT‑CTC model, addressing tokenizer limitations for digits and symbols by generating Nepali and English readings and selecting plausible forms via zero‑shot ASR. Full fine‑tuning reduces the test word error rate from 48.6% to 17.1%, matching Whisper large‑v3‑turbo, while experiments on freezing the encoder and excluding numeric clips illustrate the impact of model components and data content.

By Jeevan Neupane, Janardan Bhetwal, Kshitiz Paudel, Anup Aryal, Bipin Bashyal
arXiv Computation and Language
Sep 24

Lost in Speech: Trilingual Spoken Hallucination Detection Across Audio and Transcripts

The paper introduces a trilingual spoken hallucination detection benchmark covering English, Russian, and Kazakh news, with 12,013 samples that include synthetic alterations and severity levels, as well as 290 fact‑checked misinformation items. Detectors are evaluated in a reference‑free setting on text, ASR transcripts, and audio, revealing that most models underperform baseline classifiers, except Gemma‑3n on transcripts. Synthetic‑trained detectors achieve high macro‑F1 scores on real‑world misinformation, but Russian provenance analysis highlights model‑dependent signals that confound synthetic benchmarks.

By Meruyert Aristombayeva, Jason S. Lucas, Chaewan Chun, Dongwon Lee