arXiv AI

Developing a Speech Language Model for Basque

The paper introduces the first open Speech Language Model for Basque, built on the LLaMA‑Omni architecture and a Latxa backbone, aimed at low‑latency, end‑to‑end spoken interaction. To overcome data scarcity, the authors translated the English VoiceAssistant‑400K corpus into Basque and synthesized audio with a Basque TTS system. Evaluation shows the model achieves a content quality score of 3.86/5, a 9.94% word error rate for intelligibility, and a 3.07 UTMOS for audio quality, demonstrating the feasibility of advanced spoken interaction in a low‑resource language.

arXiv Computation and Language
Aug 27

Fine-Tuning Whisper for Automatic Speech Recognition in Baniwa: A Preliminary Study

The study fine‑tunes the Whisper Small model for Automatic Speech Recognition (ASR) in Baniwa, an indigenous Arawakan language. Using a 0.54‑hour corpus of 1,373 manually transcribed recordings, the fine‑tuned model achieved a Word Error Rate of 37.5% and a Character Error Rate of 7.45%. These results provide an initial baseline for Baniwa ASR and suggest that multilingual foundation models can be adapted to extremely low‑resource languages.

By Leonardo Duart, Tiago Fonseca, Thiago Chac\'on
arXiv Computation and Language
Oct 7

Nord-Parl-TTS: Finnish and Swedish TTS Dataset from Parliament Speech

Nord-Parl-TTS is an open text‑to‑speech dataset for Finnish and Swedish created from recordings of Nordic parliamentary proceedings. It contains 900 hours of Finnish and 5 090 hours of Swedish speech, processed with an adapted Emilia pipeline and accompanied by unified evaluation sets for model development and benchmarking. The dataset aims to reduce the resource gap in TTS between high‑ and lower‑resourced languages.

By Zirui Li, Jens Edlund, Yicheng Gu, Nhan Phan, Lauri Juvela, Mikko Kurimo
arXiv Computation and Language
Oct 8

Phoneme-Guided Initialization for LLM-based Speech Recognition

The paper introduces phoneme‑guided initialization for large language model‑based speech recognition. By pre‑training an audio encoder on speech‑to‑phoneme conversion and an LLM on phoneme‑to‑grapheme conversion, then fine‑tuning jointly on ASR, the method leverages phoneme‑mediated processing within an end‑to‑end framework. Experiments on Japanese, Chinese, Tatar, and Urdu demonstrate that this approach matches or surpasses both cascaded S2P‑P2G baselines and end‑to‑end models without phoneme initialization.

By Ryo Magoshi, Shinsuke Sakai, Tatsuya Kawahara