arXiv Computation and Language By Tianchi Liu, Nicholas Moratelli, Khurram Azeem Hashmi, Mohammadreza Zolfaghari, Rishabh Jain, Louis Lu, Changdae Park, Amril Nazir

CAFE: Confining Feature Distillation to Language-Routed Adapters for Compact Multilingual Automatic Speech Recognition

Read the original on arXiv Computation and Language →

The paper introduces CAFE, a method that confines Centered Kernel Alignment (CKA) feature distillation to language‑routed adapters in compact multilingual ASR models. By restricting the CKA gradient to adapters that English bypasses, CAFE mitigates the trade‑off where CKA improves non‑English WER at the cost of English performance. On the Open ASR Leaderboard, CAFE reduces average WER from 8.55% to 8.02% and outperforms an adapter‑only capacity control, achieving competitive results across 48 test sets in 24 languages with 254M parameters.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computation and Language.

arXiv Computation and Language
2d ago

WaxalNet: Benchmarking and Adapting Speech Recognition for Spontaneous Speech in 19 African Languages

The paper introduces WaxalNet, a benchmark and adaptation study for spontaneous speech recognition across 19 African languages using the WAXAL corpus. It evaluates zero‑shot and fine‑tuned performance of several multilingual foundation models (Whisper, MMS, Omnilingual ASR, SeamlessM4T‑v2), showing that fine‑tuning can substantially reduce word error rates and that LLM decoders generally outperform CTC decoders when the encoder is shared. The authors also demonstrate that a single multilingual model can serve all languages with only a modest WER penalty and provide a native‑speaker audit of failure modes.

By Victor Tolulope Olufemi, Oreoluwa Babatunde, Ramsey Njema, Bolarinwa Gbotemi, Wanchi Lucia Yen, John Uzodinma, Sunday Ajayi, Oluwademilade Williams, Kausar Moshood, Innocent Elendu Anyaele, Akebert Arefaine, Candace Hunzwi, Wongel Dawit Daniel, Emmilly Namuganga, Cleophas Kadima, Athanase Bahizire, Onitsiky Ranaivoson, Emmanuel Aaron, Nicholaus Ladislaus, Idris Muhammed, Jonathan Enoch Simenya, Martin Koome, Matewos Tegete Endaylalu, Peter Ifeoluwa Adeyemo, Hondi Prisca Birindwa, Ukachi Agnes Eze-Mbey, Yacoba Oduro-Yeboah, Pericles Adjovi, Mikel K. Ngueajio, Toluwani Aremu, Prasenjit Mitra