arXiv Computation and Language

How to get the best and fairest performance out of your ASR system using activation steering

The paper explores activation steering as a method to enhance automatic speech recognition (ASR) performance and demographic fairness. It compares two techniques—paired activation subtraction and supervised optimization—finding that supervised optimization effectively improves overall ASR accuracy and fairness across gender, age, and dialect. The study also demonstrates that steering vectors trained on acoustically similar speakers can yield competitive or superior results, enabling few‑shot or zero‑shot adaptation without requiring demographic labels.

arXiv Computation and Language
3d ago

AfriBED: a Speech Recognition Bias Evaluation Dataset for Low Resource African Languages

AfriBED is a newly released speech recognition bias evaluation dataset focused on two low‑resource African languages, Bemba and Nyanja. It contains 9 hours of Bemba speech from 80 speakers (3,928 utterances) and about 18 hours of Nyanja speech from 127 speakers (6,260 utterances). Baseline experiments show the data can be used to detect and quantify gender and speaker‑type bias in ASR systems for these languages.

By Claytone Sikasote, Hussein Suleman, Jan Buys
Hugging Face Trending Papers
Jun 2

Efficient ASR Training with Conversations that Never Happened

Conversational ASR for lower-resource languages and niche domains is limited by the scarcity of domain-matched multi-speaker training data. We propose an augmentation pipeline that generates scenario-level dialogues with participant metadata, maps speaker attributes to TTS voice profiles, and assembles synthesized utterances into speaker-aware simulated conversations.

arXiv Computation and Language
Sep 28

Asymmetric Classifier-Free Guidance for Target-Speaker ASR

The paper introduces asymmetric classifier‑free guidance (CFG) for target‑speaker ASR using Whisper, where a speaker‑conditioned branch predicts the target transcript and a speaker‑unconditioned branch predicts serialized multi‑speaker transcripts. CFG modulates the influence of speaker conditioning during decoding via a single guidance scale, which is first set globally on development data and then refined per utterance by a lightweight encoder‑based predictor while keeping the recognition model fixed. The resulting system yields up to 21.8% relative WER reduction over a condition‑only baseline and 5.6% over standard conditional decoding under domain shifts.

By Yiwen Guan, Jacob Whitehill