The Flow has not summarised this story yet — read it at arXiv Computation and Language.
The paper evaluates a multilingual ASR model (MMS‑1B‑all) on a Garrusi Kurdish dataset using a common‑reference staged normalization approach. By normalizing both reference and hypothesis, the authors show that raw Arabic‑script hypotheses yield a 111.70 % WER, which drops to 97.85 % after folding into a reduced orthography, highlighting the impact of orthographic differences on error measurement. A Southern Kurdish fine‑tuned system performs worse, and residual errors are partly due to scoring‑pipeline limitations rather than recognition failures.
Vagdhenu is a Sanskrit shloka‑to‑chant text‑to‑speech system that preserves meter (vrutta) and phonological nuances. It builds on an off‑the‑shelf flow‑matching backbone and a large‑scale neural vocoder, adding a Kannada‑based frontend to avoid schwa deletion, a phonology‑aware frontend handling visarga sandhi and sibilant distinctions, and a vrutta‑aware reference selection mechanism. The authors report that a text‑side prosody conditioner is ineffective in their architecture, while reference clips and voice‑steering retraining provide the necessary prosody control, and they demonstrate the system’s performance on a 32‑chapter video corpus and an audio app covering 18,000 verses. whyItMatters":"The system delivers high‑fidelity, meter‑aware Sanskrit chanting, enabling large‑scale deployment of authentic recitations for educational and cultural preservation purposes."
The paper presents an interpretable, fair, and accurately benchmarked automated system for assessing second‑language English speaking. Using a hybrid of feature‑based speech‑timing metrics and a large language model (LLM) fluency judgment, the system achieves a Spearman correlation of 0.818 with the ICNALE Global Rating Archive, outperforming 81 % of trained human raters. A controlled study shows that encoding pauses into the LLM prompt does not meaningfully affect fluency scores, indicating that the system’s fluency signal derives from measurable speech‑timing features.
The study evaluates seven parameter‑efficient fine‑tuning (PEFT) methods—LoRA, QLoRA, AdaLoRA, DoRA, LoHA, VeRA, and VB‑LoRA—on two ASR back‑ends (Whisper‑large‑v3 and Qwen3‑ASR‑1.7B) for a single post‑stroke Hungarian male speaker with severe dysarthria. Attention‑projection adapters consistently lower character error rates (CER) on both models, with LoRA emerging as the simplest and most effective choice; QLoRA performs worse and offers no memory advantage at this scale. Full fine‑tuning yields the lowest CER, but a 115 MB LoRA that also adapts feed‑forward blocks achieves comparable accuracy with only 3.7 % of the per‑patient storage, and a 5‑minute enrollment audio captures nearly half of the zero‑shot‑to‑30‑minute CER improvement. whyItMatters":"The paper demonstrates that lightweight PEFT adapters can substantially improve dysarthric ASR performance while keeping storage and computational costs low, offering a practical path for personalized speech recognition in clinical settings."
TontaubeV1 is a streaming text‑to‑speech model that maintains natural prosody while running on a single consumer GPU. It encodes speech with a hierarchical DualCodec representation at 12.5 Hz, separating a semantic stream from successive acoustic refinements, and uses Qwen3‑derived transformers to predict the semantic stream and add refinements. The model supports up to one minute of reference audio for voice conditioning, streams with a 200 ms latency to first audio, and achieves real‑time factors of 0.08 (single input) and 0.02 (eight concurrent inputs).
arXiv:2609. 11786v1 Announce Type: new Abstract: Automatic speech recognition (ASR) systems and audio language models (audio LMs) now report low error rates on monolingual benchmarks, but their behavior on code switched speech in low resource, diacritic rich languages remains poorly characterized.