arXiv Computation and Language By Hieu Hoang, Amittai Axelrod, Matt Post

Dynamic Lagging using Stable-Prefix Training for Simultaneous Translation

Read the original on arXiv Computation and Language →

The paper introduces a training strategy for cascaded simultaneous speech translation that allows the system to dynamically decide how much of the source prefix to translate. By fine‑tuning a large language model (Qwen3‑8B) on stable prefixes—pairs of source prefixes and the longest shared translation with the full sentence—the authors enable contextual read‑write decisions beyond fixed wait‑k or target‑suffix deletion. Experiments on English‑to‑German, Japanese, and Chinese demonstrate that stable prefixes improve the quality‑latency tradeoff across various test sets.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computation and Language.

arXiv Computation and Language
Nov 5

CRESiST: Self-Enhancing Explorative Policy Learning for Simultaneous Speech Translation

CRESiST introduces an end‑to‑end interleaved read‑write framework that leverages an omni‑modal LLM for simultaneous speech translation. By interleaving speech chunks with text tokens, the system fully reuses the KV cache and supports segmentation‑free, infinite‑length inference, eliminating the need for external voice activity detection. An Actor‑Critic self‑enhancement pipeline trains an RNN‑T actor to sample read‑write trajectories, while an LLM‑based critic evaluates them using semantic and latency rewards, distilling the optimal streaming policy back to the actor. Experiments on sentence‑ and document‑level benchmarks show that CRESiST sets new state‑of‑the‑art quality‑latency Pareto frontiers, outperforming existing cascaded and static‑alignment baselines.

By Chenyang Le, Pei Zhang, Yuxiang Chen, Bing Han, Derek F. Wong, Baosong Yang, Yanmin Qian
arXiv Computation and Language
Sep 11

Streaming Translation and Transcription Through Speech-to-Text Causal Alignment

The paper introduces Hikari, a policy‑free, end‑to‑end model that performs simultaneous speech‑to‑text translation and streaming transcription. It employs a Decoder Time Dilation mechanism to mitigate overuse of WAIT tokens during training and a supervised fine‑tuning strategy that helps the model recover from delays, improving the quality‑latency trade‑off. Despite its modest size, Hikari achieves competitive translation quality at consistently low latency, outperforming larger published IWSLT 2026 submissions and proprietary API systems on en‑ja, en‑de, and en‑ru tasks.

By Roman Koshkin, Jeon Haesung, Lianbo Liu, Hao Shi, Mengjie Zhao, Yusuke Fujita, Yui Sudo
arXiv Computation and Language
Oct 5

Learning When to Commit from Partial Speech for End-to-End Simultaneous Speech Translation

The paper presents a method for improving simultaneous speech translation by adapting a full‑utterance speech language model with prefix supervision derived from its own complete and partial waveform translations, eliminating the need for transcripts or human translations. Experiments on FLEURS and CoVoST2 across three language directions show that prefix training enhances quality–latency trade‑offs, especially when combined with multi‑turn append‑only decoding, and that a confidence threshold effectively controls the inference‑time quality–latency balance. The study also explores the impact of synthesis margin on translation quality and calibration, finding a non‑monotonic relationship with latency.

By Hieu Hoang, Amittai Axelrod