arXiv Computation and Language

Rethinking Speech-LLM Integration for ASR: Effective Joint Speech-Text Training by Interleaving

Hugging Face Trending Papers
Jun 2

Efficient ASR Training with Conversations that Never Happened

Conversational ASR for lower-resource languages and niche domains is limited by the scarcity of domain-matched multi-speaker training data. We propose an augmentation pipeline that generates scenario-level dialogues with participant metadata, maps speaker attributes to TTS voice profiles, and assembles synthesized utterances into speaker-aware simulated conversations.

arXiv Computation and Language
Sep 22

Closing the Speech-Text Gap with Limited Audio for Effective Domain Adaptation in LLM-Based ASR

arXiv:2604.06487v2 Announce Type: replace Abstract: Conventional end-to-end automatic speech recognition (ASR) systems rely on paired speech-text data for domain adaptation. Recent LLM-based ASR arch...

By Thibault Ba\~neras-Roux, Sergio Burdisso, Esa\'u Villatoro-Tello, Dairazalia S\'anchez-Cort\'es, Shiran Liu, Severin Baroudi, Shashi Kumar, Hasindri Watawana, Manjunath K E, Kadri Hacioglu, Petr Motlicek, Andreas Stolcke
arXiv AI
Nov 5

Text-Only Domain Adaptation for Low-Resource Medical ASR: Shallow Fusion and Density Ratio Rescoring for Hausa

The study explores text-only domain adaptation for Hausa medical automatic speech recognition (ASR) using a fixed acoustic model and two decoding-time language‑model fusion techniques: Shallow Fusion (SF) and the Density Ratio Approach (DRA). A 4‑gram KenLM trained on 19,421 Hausa health sentences is combined with a 75,372‑sentence general‑domain model, and evaluated on 250 physician‑reviewed prompts from 10 speakers across six northern Nigerian states. Both fusion methods reduce word error rate (WER) from 29.56% to 23.55% (SF) and 23.33% (DRA), outperforming greedy decoding and showing no significant difference between the two approaches.

By Oche David Ankeli, Hassan Adelani Luqman, Theodora Ngozi Egbunike, Joshua Gottschalk, Bonaventure F. P. Dossou
arXiv Computation and Language
Oct 12

Assessment of Generative Named Entity Recognition in the Era of Large Language Models

The paper evaluates open‑source large language models (LLMs) for both flat and nested named entity recognition (NER) tasks, comparing them to traditional encoder‑based models and decoder‑based LLMs using in‑context learning. It shows that with parameter‑efficient fine‑tuning and structured output formats (e.g., inline brackets or XML), LLMs can match or exceed the performance of conventional NER systems, and that their NER abilities arise from instruction following rather than memorization. Additionally, fine‑tuning for NER minimally affects, and can even improve, the LLMs’ general capabilities on other benchmarks.

By Qi Zhan, Yile Wang, Hui Huang