OpenPA: Forced-alignment-free Multi-granular Pronunciation Assessment with Mixed-transcript Adaptation

OpenPA is a new automatic pronunciation assessment framework that eliminates the need for forced alignment by using Whisper’s cross‑attention to predict word‑ and utterance‑level scores. It adapts to mixed transcripts through mixed‑transcript adaptation and adaptive substitution weighting, enabling a single model to handle both closed‑ and open‑response settings. Trained only on speechocean762, OpenPA outperforms other systems on in‑domain closed and simulated open‑response tests, retains strong zero‑shot performance on MultiPA, and shows promise in oral‑cancer speech evaluation.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computation and Language.

• multimodal
• safety