arXiv AI By Taehyung Yu, Seongjae Kang

Best-of-$N$ TTS Evaluation is Confounded by ASR Family Alignment

Read the original on arXiv AI →

arXiv:2607. 08256v1 Announce Type: cross Abstract: Best-of-$N$ (BoN) inference improves content consistency in zero-shot text-to-speech by selecting from $N$ candidates with an automatic speech recognition (ASR) verifier.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv Computation and Language
Sep 15

IROH: Insightful Ranking Of Humor using Multi-Stage Hybrid Retrieval with Rationale-Distilled LLM Judges for JOKER 2026 Track Task 1 English

arXiv:2609.15618v1 Announce Type: cross Abstract: Our team, VANGUARD, presents IROH (Insightful Ranking of Humor), a three-stage retrieval system for JOKER Task 1 English at CLEF 2026, achieving firs...

By Ana-Maria Luisa Mocanu, Sebastian Mocanu, Ciprian-Octavian Truic\u{a}, Elena-Simona Apostol
arXiv Computation and Language
Oct 16

SITAR: A Situational Distortion Metric for Automatic Speech Recognition Evaluation

The paper introduces SITAR, a situational distortion metric for evaluating automatic speech recognition (ASR) systems. SITAR aggregates situational severity and cumulative extent into a unified score using a bounded recursive formulation, and is implemented as a lightweight BERT-family regressor that requires minimal runtime cost. The authors validate SITAR through extrinsic and intrinsic protocols, showing it tracks capability scaling and provides diagnostic utility across diverse datasets and models.

By Mingzhe Lu, Jinhao Liu, Yunpeng Li, Hang Su, Lichun Fan, Jian Luan
arXiv Computation and Language
Sep 11

Unadapted Multilingual ASR on a Garrusi Kurdish Evaluation Set: A Common-Reference Staged Normalization Analysis

The paper evaluates a multilingual ASR model (MMS‑1B‑all) on a Garrusi Kurdish dataset using a common‑reference staged normalization approach. By normalizing both reference and hypothesis, the authors show that raw Arabic‑script hypotheses yield a 111.70 % WER, which drops to 97.85 % after folding into a reduced orthography, highlighting the impact of orthographic differences on error measurement. A Southern Kurdish fine‑tuned system performs worse, and residual errors are partly due to scoring‑pipeline limitations rather than recognition failures.

By Hiwa Asadpour
arXiv Computation and Language
Sep 25

Accent Analogy Guidance: More Speaker Similarity at Equal Accent in Cross-Lingual Voice Cloning

The paper introduces Accent Analogy Guidance (AAG), a training‑free sampling technique that removes accent influence from synthetic voices in cross‑lingual zero‑shot text‑to‑speech. By subtracting an accent direction derived from the model’s own predictions, AAG improves speaker similarity while maintaining the same accent level. Experiments on four open TTS models show that AAG consistently outperforms reweighting methods, achieving higher speaker similarity scores across multiple test sets.

By Yoomee Cho, Jisun Lee