arXiv Computation and Language

A Probe Shift Is Not a Fairness Fix: The Limits of Representation Steering in Speech Models

arXiv Computation and Language
Sep 25

Temporal Taxation Compounds Under Post-Training Compression of Whisper Models

The paper investigates how post‑training compression techniques—such as pruning, quantization, and distillation—affect demographic fairness in Whisper speech‑recognition models. It finds that pruning and INT4 quantization significantly widen word‑error‑rate gaps between demographic groups, especially for Black/AA and Asian speakers, while distillation tends to reduce these gaps. The study introduces a temporal‑taxation metric to quantify the increased correction effort required for marginalized speakers after compression.

By Srishti Ginjala, Eric Fosler-Lussier, Christopher W. Myers, Srinivasan Parthasarathy
arXiv Computation and Language
Sep 28

Asymmetric Classifier-Free Guidance for Target-Speaker ASR

The paper introduces asymmetric classifier‑free guidance (CFG) for target‑speaker ASR using Whisper, where a speaker‑conditioned branch predicts the target transcript and a speaker‑unconditioned branch predicts serialized multi‑speaker transcripts. CFG modulates the influence of speaker conditioning during decoding via a single guidance scale, which is first set globally on development data and then refined per utterance by a lightweight encoder‑based predictor while keeping the recognition model fixed. The resulting system yields up to 21.8% relative WER reduction over a condition‑only baseline and 5.6% over standard conditional decoding under domain shifts.

By Yiwen Guan, Jacob Whitehill
arXiv Computation and Language
Oct 21

How to get the best and fairest performance out of your ASR system using activation steering

The paper explores activation steering as a method to enhance automatic speech recognition (ASR) performance and demographic fairness. It compares two techniques—paired activation subtraction and supervised optimization—finding that supervised optimization effectively improves overall ASR accuracy and fairness across gender, age, and dialect. The study also demonstrates that steering vectors trained on acoustically similar speakers can yield competitive or superior results, enabling few‑shot or zero‑shot adaptation without requiring demographic labels.

By Felix Herron, Alex Colagrande, Solange Rossato, Fran\c{c}ois Portet, Alexandre Allauzen, Chuyuan Li
arXiv Computation and Language
Oct 22

AfriBED: a Speech Recognition Bias Evaluation Dataset for Low Resource African Languages

AfriBED is a newly released speech recognition bias evaluation dataset focused on two low‑resource African languages, Bemba and Nyanja. It contains 9 hours of Bemba speech from 80 speakers (3,928 utterances) and about 18 hours of Nyanja speech from 127 speakers (6,260 utterances). Baseline experiments show the data can be used to detect and quantify gender and speaker‑type bias in ASR systems for these languages.

By Claytone Sikasote, Hussein Suleman, Jan Buys