arXiv Machine Learning

Benchmarking_Fast_Domain_Adaptation_for_Unsupervised_Speech_Units

The paper introduces ABX-Accent, a benchmark built on the AESRC dataset that evaluates how well representation learning models adapt to 10 different English accents with less than 10 hours of unlabeled data per accent. It adapts the Zero Resources Challenge ABX metrics for each accent and demonstrates a baseline using adaptive domain normalization to fine‑tune a Contrastive Predictive Coding model, achieving a 23.6% relative improvement on across‑speaker ABX scores compared to non‑adapted models. The dataset and evaluation metrics will be released publicly after the paper is accepted.

Hugging Face Trending Papers
Aug 27

Benchmarking_Fast_Domain_Adaptation_for_Unsupervised_Speech_Units

The paper introduces ABX-Accent, a benchmark for evaluating how well unsupervised speech representation learning models adapt to new accents. It uses the AESRC dataset with 10 English accents, each providing less than 10 hours of unlabeled data, and adapts the Zero Resources Challenge ABX metrics to these accents. A baseline model employing adaptive domain normalization to fine‑tune a Contrastive Predictive Coding model shows a 23.6% relative improvement on across‑speaker ABX scores compared to non‑adapted models.

arXiv Machine Learning
Oct 12

Revisiting Accent Classification with DistilHuBERT: Speaker-Disjoint Evaluation and Cross-Corpus Generalization

The paper evaluates the robustness of DistilHuBERT for accent classification using speaker‑disjoint splits and cross‑corpus tests with L2‑ARCTIC and other English accent datasets. It finds a large performance gap between in‑corpus and external evaluations, indicating that file‑level tests overestimate accuracy. The study shows that balanced external‑data training performs best, while pseudo‑labeling with confidence filtering is insufficient under domain mismatch.

By Xu He, Homayoon Beigi
arXiv Machine Learning
Jul 14

An Empirical Recipe for Universal Phone Recognition

arXiv:2603. 29042v2 Announce Type: replace-cross Abstract: Phone recognition (PR) is a key enabler of multilingual and low-resource speech processing tasks, yet robust performance remains elusive.

By Shikhar Bharadwaj, Chin-Jou Li, Kwanghee Choi, Eunjung Yeo, William Chen, Shinji Watanabe, David R. Mortensen
arXiv Computation and Language
Sep 25

BiMamba2 Masked Discrete-Unit Prediction for Multilingual Speech Representation for Unsupervised Speech in the Wild Challenge

The paper presents BiMamba2, a 47.88‑million‑parameter bidirectional Mamba‑2 encoder trained with masked discrete‑unit prediction for multilingual speech representation. It was trained on 250 hours of unlabeled speech from 67 languages and evaluated in the Unsupervised Speech in the Wild Challenge, achieving an Adjusted Rand Index of 0.735 for speaker clustering while reporting lower performance on language identification and character error rate compared to supervised baselines. The authors also discuss a discrepancy between local‑official metric scales and checkpoint rankings, underscoring the limits of in‑distribution diagnostics for predicting Dynabench probe outcomes.

By Prakriti Subedi, Howard Prioleau, Saurav K Aryal