arXiv Computation and Language
BuzzASR: A Swarm of 100+ Monolingual Speech Recognition Models
Read the original on arXiv Computation and Language →The Flow has not summarised this story yet — read it at arXiv Computation and Language.
Related stories
Hugging Face Trending Papers
Sep 9
BuzzASR: A Swarm of 100+ Monolingual Speech Recognition Models
We introduce BuzzASR, a collection of language-specialized fine-tuned Whisper models adapted for automatic speech recognition (ASR) in 102 languages. Large end-to-end Transformer-based ASR models such...
arXiv Computation and Language
Sep 15
Token Merging for Multilingual Speech Recognition: A Systematic Study Across Model Scale and Fine-Tuning
arXiv:2609.13151v1 Announce Type: new Abstract: Leading multilingual speech recognition models like Whisper transcribe diverse, low-resource languages without language-specific training but are compu...
arXiv Computation and Language
6d ago
WaxalNet: Benchmarking and Adapting Speech Recognition for Spontaneous Speech in 19 African Languages
The paper introduces WaxalNet, a benchmark and adaptation study for spontaneous speech recognition across 19 African languages using the WAXAL corpus. It evaluates zero‑shot and fine‑tuned performance of several multilingual foundation models (Whisper, MMS, Omnilingual ASR, SeamlessM4T‑v2), showing that fine‑tuning can substantially reduce word error rates and that LLM decoders generally outperform CTC decoders when the encoder is shared. The authors also demonstrate that a single multilingual model can serve all languages with only a modest WER penalty and provide a native‑speaker audit of failure modes.
arXiv Computation and Language
Aug 28
Scaling phoneme-based TTS augmentation for ASR: A unified pipeline and controlled study
The paper introduces a unified phoneme‑based TTS‑to‑ASR augmentation pipeline that uses a multilingual TTS model with language‑ID conditioning and incorporates grapheme‑to‑phoneme conversion, reference‑speech filtering, and candidate‑text selection. It proposes phoneme‑frequency‑guided selection (PFGS) to rank sentences based on phoneme frequencies from real ASR labels, and demonstrates that random augmentation and PFGS both improve ASR performance across Arabic, French, Italian, and Portuguese test sets, with PFGS yielding up to a 19.3% relative WER reduction. The study also shows that filtering reference speech can further lower WER by up to 0.59 points on certain datasets.
arXiv Machine Learning
Jul 14
An Empirical Recipe for Universal Phone Recognition
arXiv:2603. 29042v2 Announce Type: replace-cross Abstract: Phone recognition (PR) is a key enabler of multilingual and low-resource speech processing tasks, yet robust performance remains elusive.
arXiv AI
Aug 6
Breaking the Curse ofMultilinguality inMany-to-Many Speech-to-Text Translation via a Resource-AwareMixture of Speech Encoders
arXiv:2608. 04586v1 Announce Type: cross Abstract: Multimodal large language models (MLLMs) have achieved significant success in speech-to-text translation (S2TT).