arXiv Computation and Language By Ibrahim Almajai

Itgan at NADI 2026 shared task: Parameter-Efficient Whisper Adaptation for Robust, Mixed-Dialect and Code-Switched Arabic ASR

Read the original on arXiv Computation and Language →

The paper presents the Itgan systems for the NADI 2026 Arabic ASR shared task, covering robust country-level, mixed-dialect, and Tunisian code‑switched subtasks. All systems use a Whisper model adapted with LoRA on consumer GPUs, with task‑specific additions: per‑dialect specialists for 1.1, base‑model choice and decorrelated ensemble for 1.2, and a weight‑space average plus ROVER voting for 1.3. The submissions achieved 57.1% WER on 1.1, 46.7% WER on 1.2, and 14.49% WER on 1.3, with detailed statistical comparisons and noted ineffective approaches.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computation and Language.

arXiv Computation and Language
Oct 22

How Far Can the Gemma 4 Speech Encoder Go Without Changing Its Weights? Saudi and Gulf Arabic Speech Recognition with a Frozen and an Adapter-Augmented Encoder

The paper evaluates a 305 M‑parameter audio encoder shared by Gemma 4 and EmbeddingGemma 2 for Saudi and Gulf Arabic speech recognition without altering its weights. Two approaches are compared: a frozen system that trains only a 22.6 M‑parameter CTC reader, and an adapted system that adds 3.1 M low‑rank adapters, a 41.5 M‑parameter hybrid CTC/attention reader, and joint decoding with a sub‑word language model. The adapted system matches or surpasses a 0.6 B‑parameter fine‑tuned recogniser on several datasets, while the frozen system remains competitive in character error rate and runs three‑quarters faster on CPU with greedy decoding.

By Amr Abdelkhalik
arXiv Computation and Language
Oct 23

Synthetic-to-Real Code-Switched ASR: A Spontaneous Nepali-English Podcast Benchmark

The paper introduces a new benchmark of 13,044 spontaneous Nepali‑English code‑switched podcast utterances, totaling 15.45 h, and evaluates a two‑stage synthetic‑to‑real adaptation framework for ASR. Stage 1 uses supervised fine‑tuning on 0.95 h of synthetic speech, reducing Mixed Error Rate from 23.40 % to 21.52 % and switch‑point error rate from 35.89 % to 28.77 %. Stage 2 applies Group Relative Policy Optimization with script and transcription rewards, yielding modest but statistically significant further improvements, particularly in English script confusion and switch‑point accuracy. The study also shows that an auxiliary script reward term offers no benefit beyond MER‑only optimization in this setting, and that the synthetic SFT provides the main cross‑domain transfer to spontaneous human speech.

By Firoj Paudel
arXiv Computation and Language
Oct 23

WaxalNet: Benchmarking and Adapting Speech Recognition for Spontaneous Speech in 19 African Languages

The paper introduces WaxalNet, a benchmark and adaptation study for spontaneous speech recognition across 19 African languages using the WAXAL corpus. It evaluates zero‑shot and fine‑tuned performance of several multilingual foundation models (Whisper, MMS, Omnilingual ASR, SeamlessM4T‑v2), showing that fine‑tuning can substantially reduce word error rates and that LLM decoders generally outperform CTC decoders when the encoder is shared. The authors also demonstrate that a single multilingual model can serve all languages with only a modest WER penalty and provide a native‑speaker audit of failure modes.

By Victor Tolulope Olufemi, Oreoluwa Babatunde, Ramsey Njema, Bolarinwa Gbotemi, Wanchi Lucia Yen, John Uzodinma, Sunday Ajayi, Oluwademilade Williams, Kausar Moshood, Innocent Elendu Anyaele, Akebert Arefaine, Candace Hunzwi, Wongel Dawit Daniel, Emmilly Namuganga, Cleophas Kadima, Athanase Bahizire, Onitsiky Ranaivoson, Emmanuel Aaron, Nicholaus Ladislaus, Idris Muhammed, Jonathan Enoch Simenya, Martin Koome, Matewos Tegete Endaylalu, Peter Ifeoluwa Adeyemo, Hondi Prisca Birindwa, Ukachi Agnes Eze-Mbey, Yacoba Oduro-Yeboah, Pericles Adjovi, Mikel K. Ngueajio, Toluwani Aremu, Prasenjit Mitra
arXiv AI
Jun 9

Subtitle-Aligned Fine-Tuning of Whisper for Swiss German ASR: Benchmark Contamination, Convention Mismatch, and an Honest Baseline at 25.6% WER (13.8% cWER)

arXiv:2606. 07608v1 Announce Type: cross Abstract: We present a systematic study of fine-tuning OpenAI's Whisper large-v3 for Swiss German ASR, using 1,367 hours of broadcast speech paired with Standard German subtitles as weak supervision.

By Felix Akeret