← Back to all news
arXiv AI By Daniel Huang, Qi He, Shaoxiong Duan, Yingjie Li, Qiao Cheng, Yitao Duan

Confucius4-R2T2: A Stable-Prefix Streaming ASR Model for Real Real-Time Transcription

Read the original on arXiv AI →

Confucius4‑R2T2, a stable‑prefix streaming ASR model, is introduced to ensure that once a token is emitted it is never revised, thereby reducing wasted work and incorrect actions in real‑time transcription. The model is derived by post‑training Qwen3‑ASR‑1.7B on 1,500 hours of Chinese and English audio while keeping its audio encoder frozen, and it leverages a new concept called Longest Stable Prefix (LSP) to convert a full‑context model into a stable‑prefix streaming one without architectural changes. Evaluation shows that R2T2 achieves near full‑context quality with low latency and stable output, and its benefits generalize beyond the languages used in training.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

Related stories

arXiv AI
Sep 17

Look Less, Hear Better: Jointly Rewarded GRPO for Streaming ASR

The paper introduces AWED, a word‑level emission‑delay metric, and demonstrates that post‑training a delayed‑streaming model with a joint reward (GRPO) improves both accuracy and latency. Using a single operating point (τ=6 frames), the method outperforms both its supervised baseline and the Voxtral Realtime backbone across all lookahead budgets, reducing WER by up to 30.8% at 80 ms delay and lowering median AWED from 1.17 s to 1.04 s.

By Xiuwen Zheng
llmsfine-tuningmultimodalsafety
More like this →
arXiv AI
Sep 10

X2Streaming-ASR: wait when uncertain, emit when ready for streaming ASR

X2Streaming-ASR introduces a method for streaming automatic speech recognition that separates the decision of when to commit a transcript from what to commit. The approach uses a three‑stage training process: first establishing streaming capability, then warm‑starting a commit policy with automatically probed trajectories, and finally refining the policy with character‑level, segment‑assigned group‑relative rewards for accuracy and latency. On AISHELL‑1/2/3 and WenetSpeech datasets, the system achieves mean character‑level commit latencies of 27–84 ms, far lower than baseline systems, while also attaining the best streaming character error rates on AISHELL‑1 and AISHELL‑3.

By Zhiwei Lin, Kaiqi Fu, Rime Wen, Zehan Liu, Shawn Qin, Roy Gan, Hao Wang, Qian Wang
agentsmultimodal
More like this →