arXiv AI

VietMed: A Dataset and Benchmark for Automatic Speech Recognition of Vietnamese in the Medical Domain

VietMed is a Vietnamese medical speech recognition dataset featuring 16 h of labeled medical speech, 1 000 h of unlabeled medical speech, and 1 200 h of unlabeled general‑domain speech. It claims to be the largest public medical ASR dataset worldwide in seven dimensions—total duration, speaker count, disease coverage, recording conditions, speaker roles, unique medical terms, and accents—and also the largest Vietnamese speech dataset by duration. The authors release pre‑trained models (w2v2‑Viet and XLSR‑53‑Viet) and fine‑tuned medical ASR models, showing that XLSR‑53‑Viet outperforms the state‑of‑the‑art XLSR‑53 by reducing WER from 51.8 % to 29.6 % on a medical test set. whyItMatters":"The dataset and models provide the first large‑scale, publicly available Vietnamese medical ASR resource, enabling research and development of medical speech technologies in a language and domain that previously lacked sufficient data."

arXiv Computation and Language
Sep 25

VietPrism: A large-scale Vietnamese speech and deepfake corpus with diverse dialects and code-switching

VietPrism is a newly released, large‑scale Vietnamese speech corpus that combines 993.4 hours of real utterances from 1,262 verified speakers with 3.1 k hours of synthetic spoof speech. It uniquely offers transcripts, consistent speaker identities, five dialect groups, and extensive Vietnamese‑English code‑switching—nearly half of the corpus—while pairing each spoof with a matched bona fide utterance. The dataset enables controlled evaluation of deep‑fake detection models, revealing significant variability in detector performance across dialects and speaker similarity.

By Minh Hoang, Thai Le
arXiv AI
Sep 25

Benchmarking and Domain Adaptation of Automatic Speech Recognition (ASR) for Adolescent Health Communication in Ghanaian Languages

This study evaluates automatic speech recognition (ASR) for adolescent health communication in Twi, Dagbani, and Ewe by benchmarking five ASR systems on a Bible corpus and a domain-specific ASRH dataset, then performing supervised domain adaptation with a fine‑tuned Qwen3-ASR-0.6B model. Fine‑tuning significantly lowered word and character error rates, especially for Ewe, and the adapted model was deployed in the KasaHealth voice‑first application, which received high user approval and highlighted remaining domain gaps. The work demonstrates that in‑domain data, rather than model size or computational resources, is the primary limitation for effective ASR in these languages.

By Stephen E. Moore, Akwasi Asare, Mich-Seth Owusu, Paul Azunre, Joel Budu, Lawrence A. Adu-Gyamfi
arXiv AI
Aug 20

Understanding Multilingual Medical ASR Adaptation Through Layer-Wise Analysis

The paper examines how multilingual medical adaptation affects the internal representations of Whisper ASR models. By comparing various fine‑tuning strategies—zero‑shot decoding, English‑only, German‑only, two‑stage EN→EN+DE, and direct EN+DE fine‑tuning—it shows that fine‑tuning significantly improves performance, with the best model varying by setting. Layer‑wise encoder analysis reveals that English medical fine‑tuning drives the main representation shift, while multilingual continuation largely preserves the adapted space, and that domain and language signals remain recoverable across layers.

By Souranil Kahali, Rituparna Bose, Abner Hernandez, Tomas Arias-Vergara, Andreas Maier, Ning Ma, Paula Andrea Perez-Toro
arXiv Computation and Language
Sep 25

Temporal Taxation Compounds Under Post-Training Compression of Whisper Models

The paper investigates how post‑training compression techniques—such as pruning, quantization, and distillation—affect demographic fairness in Whisper speech‑recognition models. It finds that pruning and INT4 quantization significantly widen word‑error‑rate gaps between demographic groups, especially for Black/AA and Asian speakers, while distillation tends to reduce these gaps. The study introduces a temporal‑taxation metric to quantify the increased correction effort required for marginalized speakers after compression.

By Srishti Ginjala, Eric Fosler-Lussier, Christopher W. Myers, Srinivasan Parthasarathy
Hugging Face Trending Papers
Aug 19

Understanding Multilingual Medical ASR Adaptation Through Layer-Wise Analysis

The paper examines how multilingual medical adaptation affects the internal representations of Whisper ASR models by performing layer‑wise encoder analysis. It compares several adaptation strategies—zero‑shot decoding, English‑only fine‑tuning, German‑only diagnostic fine‑tuning, two‑stage EN→EN+DE continuation, and direct EN+DE fine‑tuning—across different Whisper sizes, finding that fine‑tuning improves performance but the best model varies by setting. Layer‑wise results show that English medical fine‑tuning drives the main encoder shift, while multilingual continuation largely preserves the adapted representation space, with domain and language information remaining recoverable across layers. "whyItMatters":"The study provides insight into how multilingual medical adaptation reshapes Whisper’s internal representations, guiding the selection of model sizes and fine‑tuning strategies for improved MedASR performance."

arXiv Machine Learning
Aug 28

Benchmarking_Fast_Domain_Adaptation_for_Unsupervised_Speech_Units

The paper introduces ABX-Accent, a benchmark built on the AESRC dataset that evaluates how well representation learning models adapt to 10 different English accents with less than 10 hours of unlabeled data per accent. It adapts the Zero Resources Challenge ABX metrics for each accent and demonstrates a baseline using adaptive domain normalization to fine‑tune a Contrastive Predictive Coding model, achieving a 23.6% relative improvement on across‑speaker ABX scores compared to non‑adapted models. The dataset and evaluation metrics will be released publicly after the paper is accepted.

By Robin San Roman, Manel Khentout, Tu Anh Nguyen, Paul Michel, Yossi Adi, Emmanuel Dupoux