arXiv AI

DAMOS: Learning Distortion-Aware Speech Quality Assessment through Explicit Distortion Localization

arXiv AI
Aug 11

Beyond Naturalness: Probing Automated Text-To-Speech Evaluators on Linguistically Grounded Dimensions

arXiv:2608. 09930v1 Announce Type: cross Abstract: Automated Text-to-Speech (TTS) evaluation methods (Mean Opinion Score (MOS) predictors and Audio Large Language Models (Audio-LLM) judges) are expected to reflect human perception, yet it is unclear how well they capture the distinct aspects of speech that listeners actually perceive.

By Oluwanifemi Bamgbose, Simon Rosen, Jash Shah, Lindsay Devon Brin, Hoang H Nguyen, Anke Koelzer, Rachel Hansen, Tara Bogavelli, Fanny Riols
arXiv Computation and Language
1d ago

ConformalMOS: Uncertainty-Aware MOS Prediction with Conformal Intervals and Ordinal Modeling

ConformalMOS is a framework that enhances Mean Opinion Score (MOS) prediction for synthetic speech by adding conformal prediction to generate statistically valid prediction intervals with guaranteed coverage under exchangeability, while also providing point estimates. The method models MOS labels in an ordinal-aware way by converting one-hot targets into Gaussian-smoothed distributions, which preserves score ordering and improves uncertainty calibration, especially when softmax confidence is overconfident on out-of-distribution speech. On BVCC datasets, ConformalMOS achieves competitive accuracy (MSE = 0.08) and empirically validated coverage, thereby improving reliability for real-world TTS and VC deployment.

By Kehinde Elelu, Joshua E. Siegel, Mohammadali Saffary, Tashfain Ahmed, Simeon Babatunde, Ebuka Okpala
arXiv AI
Oct 16

Bridging the Gap: Converting Read Text to Conversational Dialogue

The paper introduces Prosodic Adjustment with Conversational Context (PACC), a deep‑learning method that converts read speech into natural conversational speech. PACC analyzes and modifies prosodic features—intonation, stress, and rhythm—using HiFi‑GAN for synthesis, aiming to preserve naturalness and intelligibility while keeping computational load low for real‑time use. Experiments show significant improvements in speech conversion, higher model accuracy, and better Mean Opinion Score (MOS) results, establishing new benchmarks for the task.

By Parshav Singla, Agnik Banerjee, Aaditya Arora, Shruti Aggarwal, Anil Kumar Verma, Vikram C M, Raj Prakash Gohil, Gopal Kumar Agarwal
arXiv Machine Learning
Sep 22

Corrective Forcing: Unified Post-Training for Diffusions and Flows in Generative Speech Enhancement

The paper introduces Corrective Forcing (CoF), a post‑training method that aligns diffusion and flow generative models for speech enhancement by training them on self‑generated rollout states. CoF corrects predictions toward ground truth under dynamic sampling schedules and regularizes local evolution with counterfactual transitions, applying a unified objective across both model types. Experiments on SB‑VE and OT‑CFM show improved perceptual quality, reconstruction fidelity, and robustness to varying sampling steps.

By Qing Yao, Lijian Gao, Qirong Mao
arXiv AI
Sep 15

CAL-MOS: Bridging Layers with Adapters for Robust MOS Prediction Across Speech Foundation Models

arXiv:2609.14956v1 Announce Type: cross Abstract: Speech Quality Assessment (SQA) is essential for modern speech technologies, and recent non-intrusive SQA predictors increasingly rely on Speech Foun...

By Alef Iury Siqueira Ferreira, Pedro Lustosa Rege Botelho, Fernanda Silva, Daniel Casanova, Rafael Faustino, Frederico Oliveira, Arlindo Galv\~ao Filho, Anderson da Silva Soares