arXiv Computation and Language

A Sociolinguistic Analysis of Automatic Speech Recognition Bias in Newcastle English

The paper examines how automatic speech recognition (ASR) systems perform on Newcastle English, a regional dialect of North‑East England, using spontaneous speech from the Diachronic Electronic Corpus of Tyneside English. It analyzes over 3,000 transcription errors, classifying them by linguistic domain and social variables such as gender, age, and socioeconomic status, and highlights that phonological variation—especially vowel quality and glottalisation—drives most errors. The study finds that error rates differ across social groups, with men and speakers at age extremes experiencing higher rates, indicating that ASR errors are socially patterned rather than random.

arXiv AI
4d ago

"It Would Make a Geordie Feel at Home": Regional Accent Perceptions and Speech Accommodation in Voice AI

The study examines how users of Newcastle English (Geordies) perceive and adapt to voice assistants that speak either their regional dialect or Standard Southern British English. Participants found the Geordie voice to be familiar and warm but questioned its professionalism, while the standard voice was seen as neutral and credible. When the assistant failed to recognize them, users shifted to a more mainstream accent, clearer enunciation, or slower speech, mirroring human accommodation strategies.

By Dana Serditova, Kevin Tang, Jochen Steffens
arXiv Computation and Language
Sep 18

Evaluating Bias in Phoneme-Based Automatic Speech Recognition Systems: An Analysis of IPA Transcription Models

The paper evaluates bias in phoneme-based automatic speech recognition (ASR) systems, focusing on WhisperIPA and ZIPA, which produce International Phonetic Alphabet (IPA) transcriptions. Using multilingual speech corpora and demographically annotated English datasets, the authors compare model-generated IPA against grapheme-to-phoneme (G2P) outputs with both standard phoneme error rate (PER) and a new Soft PER metric that allows linguistically similar substitutions. The study finds persistent disparities across language, gender, accent, ethnicity, and age, even when accounting for acceptable phonemic variation.

By Maneesha Rani Saha, Catherine Bao, Neal Patwari
arXiv Machine Learning
Oct 9

Phonologically Informed Tokenization for German Speech Recognition: A Cross-Domain Study

The study evaluates phonologically informed tokenization for German speech recognition using a wav2vec 2.0 backbone fine‑tuned with CTC. Three tokenizer families—pretrained multilingual characters, data‑driven BPE, and phonologically informed units from syllabification and grapheme‑to‑phoneme conversion—are compared across 40 fine‑tunes on three German test sets (in‑domain read, dialectal spontaneous, and standard spontaneous speech). Results show that phonologically informed tokenizers match BPE and character baselines in‑domain, but under domain shift their performance depends on vocabulary size rather than linguistic variation, with syllable‑aware tokenization benefiting dialectal and spontaneous speech at small vocabularies; a phoneme‑level confusion analysis indicates that the acoustic encoder dominates error patterns.

By Christopher Witzl, Tobias Bocklet, Korbinian Riedhammer
arXiv Computation and Language
Sep 10

False positive bias in AI-powered speech-based cognitive screening for multilingual English speakers in the UK

arXiv:2602.13047v2 Announce Type: replace Abstract: Conversational speech reveals early signs of cognitive decline, including dementia and mild cognitive impairment (MCI). AI models show promise for...

By Madhurananda Pahar, Caitlin Illingworth, Dorota Braun, Bahman Mirheidari, Lise Sproson, Daniel Blackburn, Heidi Christensen
arXiv AI
Jun 26

SamaVaani: Auditing and Debiasing Multilingual Clinical ASR for Indian Languages

arXiv:2606. 26901v1 Announce Type: cross Abstract: Automatic Speech Recognition (ASR) is increasingly used to document clinical encounters, yet its reliability in multilingual and demographically diverse Indian healthcare context remains largely unknown.

By Subham Kumar, Prakrithi Shivaprakash, Abhishek Manoharan, Astut Kurariya, Diptadhi Mukherjee, Prabhat Chand, Pratima Murthy, Koustav Rudra, Lekhansh Shukla, Animesh Mukherjee
arXiv AI
Sep 12

Flexible and Interpretable Accent Distance Measurements

The paper introduces a method for measuring accent differences that balances interpretability and practicality. It proposes using articulatory representations obtained via articulatory inversion as an interpretable basis for accent comparison, while employing optimal transport to compare accents across any type of recording. This approach aims to overcome the limitations of traditional phonetic analyses and embedding‑based methods, which are either time‑consuming or non‑interpretable.

By Charles McGhee, Mark J. F. Gales, Kate M. Knill
arXiv Computation and Language
Oct 22

AfriBED: a Speech Recognition Bias Evaluation Dataset for Low Resource African Languages

AfriBED is a newly released speech recognition bias evaluation dataset focused on two low‑resource African languages, Bemba and Nyanja. It contains 9 hours of Bemba speech from 80 speakers (3,928 utterances) and about 18 hours of Nyanja speech from 127 speakers (6,260 utterances). Baseline experiments show the data can be used to detect and quantify gender and speaker‑type bias in ASR systems for these languages.

By Claytone Sikasote, Hussein Suleman, Jan Buys
arXiv Computation and Language
Sep 14

Quantifying Consonant Contributions to Word Intelligibility via Acoustic Masking

The study introduces a scalable acoustic‑masking method to quantify how much each consonant contributes to word intelligibility. By silencing individual consonants in isolated words and measuring misrecognition rates with three ASR models, the authors define a mask‑induced misrecognition rate (MMR). Across English, Spanish, German, and Czech, MMR negatively correlates with phoneme frequency and positively with functional load, revealing that consonant importance varies by language.

By Eunjung Yeo, Kwanghee Choi, Krupaben Kothadia, Visar Berisha, Julie M. Liss, David R. Mortensen, David Harwath
arXiv Machine Learning
Sep 18

Enabling automatic transcription of child-centered audio recordings from real-world environments

The paper presents a method to automatically identify utterances in child-centered daylong audio recordings that can be reliably transcribed by modern ASR systems, enabling accurate transcription of a substantial portion of the speech. On four English corpora, the approach achieves a median WER of 0% and a mean WER of 16% when transcribing 30% of the total speech, compared to a median WER of 52% when transcribing all speech. Word frequency distributions from the automatic transcripts correlate strongly with manual annotations (r = 0.94 overall, r = 0.99 for frequent words).

By Daniil Kocharov, Azarias Galama, Okko R\"as\"anen