arXiv Computation and Language By Bernard Muller, L\'aszl\'o T\'oth, LaVonne Roberts

Choosing a PEFT Variant for Per-Patient Dysarthric ASR: A Single-Speaker Case Study on Two ASR Bases

Read the original on arXiv Computation and Language →

The study evaluates seven parameter‑efficient fine‑tuning (PEFT) methods—LoRA, QLoRA, AdaLoRA, DoRA, LoHA, VeRA, and VB‑LoRA—on two ASR back‑ends (Whisper‑large‑v3 and Qwen3‑ASR‑1.7B) for a single post‑stroke Hungarian male speaker with severe dysarthria. Attention‑projection adapters consistently lower character error rates (CER) on both models, with LoRA emerging as the simplest and most effective choice; QLoRA performs worse and offers no memory advantage at this scale. Full fine‑tuning yields the lowest CER, but a 115 MB LoRA that also adapts feed‑forward blocks achieves comparable accuracy with only 3.7 % of the per‑patient storage, and a 5‑minute enrollment audio captures nearly half of the zero‑shot‑to‑30‑minute CER improvement. whyItMatters":"The paper demonstrates that lightweight PEFT adapters can substantially improve dysarthric ASR performance while keeping storage and computational costs low, offering a practical path for personalized speech recognition in clinical settings."

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computation and Language.

arXiv AI
Aug 20

When Audio-Language Models Fail to Leverage Multimodal Context for Dysarthric Speech Recognition

The paper evaluates whether audio‑language models can use multimodal clinical context to improve dysarthric speech recognition. Using a benchmark built on the Speech Accessibility Project dataset, the authors test diagnosis labels, clinician ratings, and detailed clinical descriptions as prompts for nine models. They find that these prompts yield negligible or negative effects on word error rate, though fine‑tuning with LoRA and mixed prompt formats reduces WER by 52% and benefits certain subgroups such as Down syndrome and mild‑severity speakers.

By Pehu\'en Moure, Niclas Pokel, Bilal Bounajma, Yingqiang Gao, Roman Boehringer, Longbiao Cheng, Shih-Chii Liu
arXiv Machine Learning
Aug 28

Interpretable, Fairly Evaluated Automated L2 Speaking Assessment that Beats the Single-Human Ceiling and Why Pause Encoding Does Not Change LLM Fluency Scores

The paper presents an interpretable, fair, and accurately benchmarked automated system for assessing second‑language English speaking. Using a hybrid of feature‑based speech‑timing metrics and a large language model (LLM) fluency judgment, the system achieves a Spearman correlation of 0.818 with the ICNALE Global Rating Archive, outperforming 81 % of trained human raters. A controlled study shows that encoding pauses into the LLM prompt does not meaningfully affect fluency scores, indicating that the system’s fluency signal derives from measurable speech‑timing features.

By Eichi Uehara
arXiv AI
Jul 31

Voice Memory for Agentic Speech Recognition

arXiv:2607. 26410v1 Announce Type: cross Abstract: We present Voice Memory, a inference-only scheme for agentic speech recognition: at stream time, a frozen corrector reads a single per-domain memory.

By Chao-Han Huck Yang, Zih-Ching Chen, Piotr Zelasko, Zhehuai Chen, Jagadeesh Balam, Boris Ginsburg