arXiv Computation and Language

Per-Aetiology Contrastive Severity Embeddings with Phonological Pseudo-Labelling for Multilingual Dysarthric Speech

arXiv AI
Aug 20

When Audio-Language Models Fail to Leverage Multimodal Context for Dysarthric Speech Recognition

The paper evaluates whether audio‑language models can use multimodal clinical context to improve dysarthric speech recognition. Using a benchmark built on the Speech Accessibility Project dataset, the authors test diagnosis labels, clinician ratings, and detailed clinical descriptions as prompts for nine models. They find that these prompts yield negligible or negative effects on word error rate, though fine‑tuning with LoRA and mixed prompt formats reduces WER by 52% and benefits certain subgroups such as Down syndrome and mild‑severity speakers.

By Pehu\'en Moure, Niclas Pokel, Bilal Bounajma, Yingqiang Gao, Roman Boehringer, Longbiao Cheng, Shih-Chii Liu
arXiv Computation and Language
2d ago

Cross-Lingual Parkinson's Disease Severity Assessment Using Pre-trained Speech Embeddings: A Multi-Class Evaluation

The paper evaluates pre‑trained speech embeddings from four state‑of‑the‑art speech foundation models for cross‑lingual Parkinson's disease severity assessment. Experiments span three datasets in zero‑shot and k‑shot settings, showing that these embeddings can transfer meaningfully across languages, though performance varies with dataset characteristics, preprocessing, and adaptation strategy. Misclassifications linked to inter‑speaker variability and atypical speech patterns underscore the need for more robust feature extraction, modeling, and explainability to support reliable clinical insights.

By Simon Pals, Cristian Tejedor-Garcia
arXiv Computation and Language
Sep 15

Controllable Dysarthric Speech Synthesis with Patient-Specific Conditioning for Speaker-Diverse ASR Augmentation

arXiv:2602.08696v3 Announce Type: replace-cross Abstract: Dysarthric speech recognition is limited by high speaker variability and scarce labeled data. Existing synthesis methods often couple speaker...

By Haoshen Wang, Xueli Zhong, Bingbing Lin, Jia Huang, Xingduo Pan, Shengxiang Liang, Nizhuan Wang, Wai Ting Siok
arXiv Computation and Language
Sep 3

Choosing a PEFT Variant for Per-Patient Dysarthric ASR: A Single-Speaker Case Study on Two ASR Bases

The study evaluates seven parameter‑efficient fine‑tuning (PEFT) methods—LoRA, QLoRA, AdaLoRA, DoRA, LoHA, VeRA, and VB‑LoRA—on two ASR back‑ends (Whisper‑large‑v3 and Qwen3‑ASR‑1.7B) for a single post‑stroke Hungarian male speaker with severe dysarthria. Attention‑projection adapters consistently lower character error rates (CER) on both models, with LoRA emerging as the simplest and most effective choice; QLoRA performs worse and offers no memory advantage at this scale. Full fine‑tuning yields the lowest CER, but a 115 MB LoRA that also adapts feed‑forward blocks achieves comparable accuracy with only 3.7 % of the per‑patient storage, and a 5‑minute enrollment audio captures nearly half of the zero‑shot‑to‑30‑minute CER improvement. whyItMatters":"The paper demonstrates that lightweight PEFT adapters can substantially improve dysarthric ASR performance while keeping storage and computational costs low, offering a practical path for personalized speech recognition in clinical settings."

By Bernard Muller, L\'aszl\'o T\'oth, LaVonne Roberts