arXiv Machine Learning

Massive Open-Vocabulary Keyword Spotting

arXiv:2606. 11279v1 Announce Type: cross Abstract: Automatic speech recognition systems have been shown to under-perform when it comes to transcribing words rarely seen in the training data, namely specialized terminology.

arXiv Computation and Language
Sep 18

Dictionary-Constrained Grapheme-to-Phoneme for Unsegmented Languages from LLM-Annotated Data

The paper introduces a context‑aware neural grapheme‑to‑phoneme (G2P) system for unsegmented languages like Japanese, using a discriminative conditional random field over a word lattice built from dictionaries. It addresses data scarcity by generating over two million sentences with large language models. Experiments show the method surpasses traditional morphological analyzers and neural sequence models, achieving 99.62% target word reading accuracy and very low phoneme error rates on the Joyo‑Kanji‑Yomi benchmark.

By Rui Hu, Zhenpeng Zhan, Xiaolong Lin
arXiv AI
Sep 1

PromptKWS: A Novel Prompt-Guided Open-Vocabulary Keyword Spotting Framework

PromptKWS is a new prompt‑guided keyword spotting framework that enhances open‑vocabulary KWS accuracy. It introduces the Prompt Phrases Prediction Network (PPN), an encoder‑decoder that extracts keyword prompt embeddings, which are then integrated into the KWS encoder via a Prompt‑acoustic Multi‑head Cross‑attention module. Experiments show that PromptKWS raises the wake‑up rate by more than 10% and improves overall accuracy by over 15% in noisy, pronunciation‑variant real‑world settings.

By Gaopeng Xu, Chengfei Li, Xianliang Wang, Lin Zhu, Juan Wei, Wenpeng Li, Jianwei Niu, Jie Gao
arXiv AI
Aug 19

Language Family Matters: Evaluating LLM-Based ASR Across Linguistic Boundaries

The paper introduces a new strategy for connecting large language models (LLMs) to speech encoders in automatic speech recognition (ASR) systems by sharing a single connector across languages within the same linguistic family. This approach reduces the number of parameters needed compared to training a separate connector for each language, while improving generalization across different domains and real‑world corpora. Experiments with two multilingual LLMs and two speech datasets demonstrate that family‑based connectors are both efficient and effective for multilingual ASR deployment.

By Yuchen Zhang, Ravi Shekhar, Haralambos Mouratidis