arXiv Computation and Language By Kehinde Elelu, Joshua E. Siegel, Mohammadali Saffary, Tashfain Ahmed, Simeon Babatunde, Ebuka Okpala

ConformalMOS: Uncertainty-Aware MOS Prediction with Conformal Intervals and Ordinal Modeling

Read the original on arXiv Computation and Language →

ConformalMOS is a framework that enhances Mean Opinion Score (MOS) prediction for synthetic speech by adding conformal prediction to generate statistically valid prediction intervals with guaranteed coverage under exchangeability, while also providing point estimates. The method models MOS labels in an ordinal-aware way by converting one-hot targets into Gaussian-smoothed distributions, which preserves score ordering and improves uncertainty calibration, especially when softmax confidence is overconfident on out-of-distribution speech. On BVCC datasets, ConformalMOS achieves competitive accuracy (MSE = 0.08) and empirically validated coverage, thereby improving reliability for real-world TTS and VC deployment.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computation and Language.

arXiv AI
Sep 15

CAL-MOS: Bridging Layers with Adapters for Robust MOS Prediction Across Speech Foundation Models

arXiv:2609.14956v1 Announce Type: cross Abstract: Speech Quality Assessment (SQA) is essential for modern speech technologies, and recent non-intrusive SQA predictors increasingly rely on Speech Foun...

By Alef Iury Siqueira Ferreira, Pedro Lustosa Rege Botelho, Fernanda Silva, Daniel Casanova, Rafael Faustino, Frederico Oliveira, Arlindo Galv\~ao Filho, Anderson da Silva Soares
arXiv AI
Sep 28

Audio LLMs Know When They Can't Hear You

The paper investigates whether audio large language models (Audio LLMs) can detect when their own transcriptions are unreliable. It finds that the models are poor at self-assessment and that existing methods offer limited detection. By leveraging audio-encoder representations, the authors develop a lightweight predictor that accurately flags unreliable transcriptions and can prompt user clarification without altering the underlying model.

By Amirhosein Javadi, Richa Dixit, Mehrdad Farajtabar, Minsik Cho, Devang Naik, Mohammad Samragh