arXiv Computation and Language By Sahil Mahendrakar

Earlybird: Predictive Streaming Speech Recognition in 29M Parameters

Read the original on arXiv Computation and Language →

Earlybird is a 29‑million‑parameter streaming speech recognizer that predicts words before the speaker finishes them, achieving median correct predictions 90 ms early on clean audiobook speech. It learns from audio cut off at random points, including mid‑word, and outputs confidence scores for every word, including the one still being spoken. Across six diverse test sets—audible books, TED talks, public speech, earnings calls, and synthetic speech—Earlybird consistently outperforms existing streaming models, correctly predicting 69 % of words before they finish on audiobooks, compared to 3–25 % for other models.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computation and Language.

arXiv Computation and Language
Oct 12

People Making Conversation: Evaluating How Naturally Speech Models Converse

The study evaluates conversational speech models by placing them at 427 pauses and 482 turn ends from 176 unscripted conversations, scoring their responses on timing, latency, length, wording, and recall of recent dialogue. Hosted APIs (GPT Realtime, Gemini 3.1 Flash Live, Grok Voice) respond at almost every pause, with latency ranging from 1–4 s for silence-based endpointers and about 8 s for semantic turn detection, while full‑duplex models (PersonaPlex, Moshi) remain silent more often and can interrupt within human reaction time. Recall rates vary: hosted systems remember 41–60 % of facts under a Claude Opus 5.5 judge and 19–26 % with a strict word matcher; full‑duplex models recall 17–22 % and 12–15 % respectively.

By Arya Bastani, Iman Modarressi
arXiv Computation and Language
6d ago

Antalia-2 Mini: A 7.6-million-parameter Turkish text-to-speech model trained entirely on synthetic speech

Antalia-2 Mini is a single‑voice Turkish text‑to‑speech model with 7.6 million parameters that reads characters and outputs 48 kHz audio at 41× real time on an Apple M5 laptop CPU. It was trained solely on synthetic speech from the larger VoxCPM2 teacher, and fine‑tuning its vocoder on the model’s own mel spectrograms reduced Whisper’s word error rate from 3.89 % to 1.75 %. On the 495‑sentence Freya‑TR‑Eval benchmark, version 1.0.1 achieves a 1.09 % WER and 0.22 % character error rate, comparable to the EMA Lightning model in full‑band UTMOS scores.

By Sezgin Saygili, Emre Kaplaner, Oncel Ozgul, Fikri San Koktas
arXiv AI
Sep 17

Look Less, Hear Better: Jointly Rewarded GRPO for Streaming ASR

The paper introduces AWED, a word‑level emission‑delay metric, and demonstrates that post‑training a delayed‑streaming model with a joint reward (GRPO) improves both accuracy and latency. Using a single operating point (τ=6 frames), the method outperforms both its supervised baseline and the Voxtral Realtime backbone across all lookahead budgets, reducing WER by up to 30.8% at 80 ms delay and lowering median AWED from 1.17 s to 1.04 s.

By Xiuwen Zheng
arXiv Computation and Language
Oct 9

FA-Bench: A Benchmark for Phone- and Word-Level Timestamp Accuracy in Forced Alignment and ASR on Clean and Noisy Speech

FA-Bench is an open framework that standardizes forced alignment evaluation by fixing transcript normalization, data splits, phone mapping, and scoring procedures. It offers two tracks: one with reference transcripts and another with recognizer outputs, evaluated on clean and four degraded audio conditions using 21 open models and 9 commercial APIs. The benchmark scores every utterance boundary with a tolerance‑based F1 metric, revealing systematic timing biases such as Whisper’s 150 ms early alignment and commercial APIs’ 50 ms late alignment.

By Wei Chu, Yuanzhe Dong, Ke Tan, Dong Han, Yichao Zhou, Ruchao Fan, Bingshen Mu, Jingbei Li, Vishwas Shetty, Sarthak Bisht, Ziyue Qiu, Massa Baali, Rita Singh, Bhisha Raj