arXiv Machine Learning

Linguistic Distance Segregates Latent Representations in Automatic Speech Recognition Systems

arXiv AI
Sep 12

Flexible and Interpretable Accent Distance Measurements

The paper introduces a method for measuring accent differences that balances interpretability and practicality. It proposes using articulatory representations obtained via articulatory inversion as an interpretable basis for accent comparison, while employing optimal transport to compare accents across any type of recording. This approach aims to overcome the limitations of traditional phonetic analyses and embedding‑based methods, which are either time‑consuming or non‑interpretable.

By Charles McGhee, Mark J. F. Gales, Kate M. Knill
arXiv Machine Learning
Oct 9

Phonological Interference in Multilingual Speech Models

The paper investigates a failure mode called phonological interference in phoneme‑level multilingual speech models, where models incorrectly impose a single language’s phonology on mixed or unseen language input. Experiments show significant loss of language‑specific phonemes in code‑switched and unseen‑language scenarios, and the authors trace this effect to a low‑dimensional subspace of internal activations. They propose a windowed language estimation (WLE) repair that reduces interference by 34–69% while preserving monolingual performance.

By Moran Yanuka, Raja Giryes, Moris Alper
arXiv AI
Aug 7

Bias Analysis of L2 Speaking Assessment Systems Using Concept Activation Vectors

arXiv:2608. 06300v1 Announce Type: new Abstract: Automatic speaking assessment systems are increasingly deployed in high-stakes settings to mark second language (L2) learners' speaking tests, making it critical to show that their scores depend on speaking proficiency rather than irrelevant speaker attributes such as first language (L1) or age.

By Arya Labroo, Mengjie Qian, Kate Knill
Hugging Face Trending Papers
Sep 24

Do Audio Language Models Hear and Read Distinctive Features Alike?

The paper investigates whether audio language models encode phonetic features similarly when processing spoken versus written input. By comparing mean representations of minimal phoneme pairs across six models, seven features, and 15 languages, the study finds that only voicing in two Qwen2.5-Omni models shows a significant shared direction, and that the model family—not size—determines feature representation. The analysis uses cosine similarity against a random-pair reference to assess alignment across modalities.