← Back to all news
arXiv AI By Khai Le-Duc

VietMed: A Dataset and Benchmark for Automatic Speech Recognition of Vietnamese in the Medical Domain

Read the original on arXiv AI →

VietMed is a Vietnamese medical speech recognition dataset featuring 16 h of labeled medical speech, 1 000 h of unlabeled medical speech, and 1 200 h of unlabeled general‑domain speech. It claims to be the largest public medical ASR dataset worldwide in seven dimensions—total duration, speaker count, disease coverage, recording conditions, speaker roles, unique medical terms, and accents—and also the largest Vietnamese speech dataset by duration. The authors release pre‑trained models (w2v2‑Viet and XLSR‑53‑Viet) and fine‑tuned medical ASR models, showing that XLSR‑53‑Viet outperforms the state‑of‑the‑art XLSR‑53 by reducing WER from 51.8 % to 29.6 % on a medical test set. whyItMatters":"The dataset and models provide the first large‑scale, publicly available Vietnamese medical ASR resource, enabling research and development of medical speech technologies in a language and domain that previously lacked sufficient data."

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

Related stories

arXiv Computation and Language
Sep 25

VietPrism: A large-scale Vietnamese speech and deepfake corpus with diverse dialects and code-switching

VietPrism is a newly released, large‑scale Vietnamese speech corpus that combines 993.4 hours of real utterances from 1,262 verified speakers with 3.1 k hours of synthetic spoof speech. It uniquely offers transcripts, consistent speaker identities, five dialect groups, and extensive Vietnamese‑English code‑switching—nearly half of the corpus—while pairing each spoof with a matched bona fide utterance. The dataset enables controlled evaluation of deep‑fake detection models, revealing significant variability in detector performance across dialects and speaker similarity.

By Minh Hoang, Thai Le
multimodal
More like this →
arXiv AI
Sep 25

Benchmarking and Domain Adaptation of Automatic Speech Recognition (ASR) for Adolescent Health Communication in Ghanaian Languages

This study evaluates automatic speech recognition (ASR) for adolescent health communication in Twi, Dagbani, and Ewe by benchmarking five ASR systems on a Bible corpus and a domain-specific ASRH dataset, then performing supervised domain adaptation with a fine‑tuned Qwen3-ASR-0.6B model. Fine‑tuning significantly lowered word and character error rates, especially for Ewe, and the adapted model was deployed in the KasaHealth voice‑first application, which received high user approval and highlighted remaining domain gaps. The work demonstrates that in‑domain data, rather than model size or computational resources, is the primary limitation for effective ASR in these languages.

By Stephen E. Moore, Akwasi Asare, Mich-Seth Owusu, Paul Azunre, Joel Budu, Lawrence A. Adu-Gyamfi
llmsfine-tuningmultimodalbenchmarks
More like this →
arXiv AI
Aug 20

Understanding Multilingual Medical ASR Adaptation Through Layer-Wise Analysis

The paper examines how multilingual medical adaptation affects the internal representations of Whisper ASR models. By comparing various fine‑tuning strategies—zero‑shot decoding, English‑only, German‑only, two‑stage EN→EN+DE, and direct EN+DE fine‑tuning—it shows that fine‑tuning significantly improves performance, with the best model varying by setting. Layer‑wise encoder analysis reveals that English medical fine‑tuning drives the main representation shift, while multilingual continuation largely preserves the adapted space, and that domain and language signals remain recoverable across layers.

By Souranil Kahali, Rituparna Bose, Abner Hernandez, Tomas Arias-Vergara, Andreas Maier, Ning Ma, Paula Andrea Perez-Toro
fine-tuningmultimodal
More like this →