CRESiST introduces an end‑to‑end interleaved read‑write framework that leverages an omni‑modal LLM for simultaneous speech translation. By interleaving speech chunks with text tokens, the system fully reuses the KV cache and supports segmentation‑free, infinite‑length inference, eliminating the need for external voice activity detection. An Actor‑Critic self‑enhancement pipeline trains an RNN‑T actor to sample read‑write trajectories, while an LLM‑based critic evaluates them using semantic and latency rewards, distilling the optimal streaming policy back to the actor. Experiments on sentence‑ and document‑level benchmarks show that CRESiST sets new state‑of‑the‑art quality‑latency Pareto frontiers, outperforming existing cascaded and static‑alignment baselines.
By Chenyang Le, Pei Zhang, Yuxiang Chen, Bing Han, Derek F. Wong, Baosong Yang, Yanmin Qian
The paper introduces Hikari, a policy‑free, end‑to‑end model that performs simultaneous speech‑to‑text translation and streaming transcription. It employs a Decoder Time Dilation mechanism to mitigate overuse of WAIT tokens during training and a supervised fine‑tuning strategy that helps the model recover from delays, improving the quality‑latency trade‑off. Despite its modest size, Hikari achieves competitive translation quality at consistently low latency, outperforming larger published IWSLT 2026 submissions and proprietary API systems on en‑ja, en‑de, and en‑ru tasks.
By Roman Koshkin, Jeon Haesung, Lianbo Liu, Hao Shi, Mengjie Zhao, Yusuke Fujita, Yui Sudo
The paper presents a method for improving simultaneous speech translation by adapting a full‑utterance speech language model with prefix supervision derived from its own complete and partial waveform translations, eliminating the need for transcripts or human translations. Experiments on FLEURS and CoVoST2 across three language directions show that prefix training enhances quality–latency trade‑offs, especially when combined with multi‑turn append‑only decoding, and that a confidence threshold effectively controls the inference‑time quality–latency balance. The study also explores the impact of synthesis margin on translation quality and calibration, finding a non‑monotonic relationship with latency.
By Hieu Hoang, Amittai Axelrod
arXiv:2504.11809v2 Announce Type: replace
Abstract: Simultaneous speech translation (SimulST) produces translations incrementally while processing partial speech input. Although large language models...
By Biao Fu, Donglei Yu, Minpeng Liao, Chengxi Li, Xinjie Chen, Yidong Chen, Kai Fan, Xiaodong Shi
arXiv:2610.35042v1 Announce Type: new
Abstract: Simultaneous speech translation (SimulST) aims to translate ongoing speech with low latency while preserving translation quality. Recent studies have a...
By Haotian Tan, Hiroki Ouchi, Sakriani Sakti
Simultaneous speech translation (SimulST) aims to translate ongoing speech with low latency while preserving translation quality. Recent studies have adopted large language models (LLMs) for SimulST a...
arXiv:2609.00588v1 Announce Type: new
Abstract: Reranking methods, such as Minimum Bayes Risk (MBR) decoding and Quality Estimation (QE) reranking, are widely used in modern neural machine translatio...
By Guangyu Chen, Boxuan Lyu, Hidetaka Kamigaito, Kotaro Funakoshi, Manabu Okumura
arXiv:2609.18720v1 Announce Type: new
Abstract: Learned quality estimation (QE) models such as COMETKiwi are widespread and work well for general machine translation evaluation. However, they are kno...
By Kathy H\"ammerl, Gabriel Bretschner, Joern Wuebker
arXiv:2608. 15932v1 Announce Type: new Abstract: As state-of-the-art machine translation models saturate standard benchmarks, the field needs more challenging evaluations to distinguish between models of varying quality.
By William Kalikman, \v{S}imon Sukup, Michal Te\v{s}nar, Vil\'em Zouhar
As state-of-the-art machine translation models saturate standard benchmarks, the field needs more challenging evaluations to distinguish between models of varying quality. We propose augmenting existi...
The paper examines two test‑time scaling methods for large language models in machine translation: sequential sampling, where later attempts build on earlier ones, and parallel sampling, such as independent i.i.d. sampling with reranking. Sequential sampling shows a higher performance ceiling, offering a more diverse and effective set of translations, especially with limited sampling budgets. Human analysis reveals that while sequential sampling improves fluency and naturalness, it can reduce accuracy when the inference budget is large, and the authors attribute this effect to the model’s access to a larger target‑side context.
By Di Wu, Sergey Troshin, Christof Monz, Antske Fokkens, Vlad Niculae
arXiv:2609.40181v1 Announce Type: new
Abstract: We introduce Index-Translate, a multilingual translation model family that combines a shared multilingual foundation with specialized training for gene...
By Tianjiao Li, Mengran Yu, Chenyu Shi, Lusheng Zhang, Qisi Chen, Yanshan Zhou, Ji Qi, Jingying Liu, Yuang Feng, Ziang Cui, Tianxing Yan