← Back to all news
arXiv Computation and Language By Marco Gaido, Sara Papi, Mauro Cettolo, Matteo Negri, Luisa Bentivogli

Simulstream: Open-Source Toolkit for Evaluation and Demonstration of Streaming Speech-to-Text Translation Systems

Read the original on arXiv Computation and Language →

Simulstream is an open‑source toolkit designed to evaluate and demonstrate streaming speech‑to‑text translation systems. It supports both incremental and re‑translation decoding on long‑form speech, offers fine‑grained logging for quality and latency metrics, and includes an interactive web interface for real‑time visualization and comparison. The toolkit addresses the fragmented evaluation landscape by providing a unified framework that accommodates different decoding strategies and input formats.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computation and Language.

Related stories

arXiv AI
Sep 4

X-Translator: A Real-Time Multilingual Speaker-Aware Speech-to-Speech Translation System

X-Translator is a low‑cost, modular real‑time speech‑to‑speech translation system that integrates streaming ASR, machine translation, and prompt‑conditioned TTS, managed by a session‑level runtime controller. It uses incremental segment commitment to stabilize ASR streams and an online speaker prompt manager to maintain speaker consistency across multi‑speaker conversations. The system is evaluated on translation quality, speech naturalness, latency, and speaker preservation using OpenSTBench, and its code and demo are publicly available on GitHub.

By Yuxiang Zhao, Yichi Zhang, Yanjie An, Yanqiao Zhu, Zhanxun Liu, Yushen Chen, Qixi Zheng, Haina Zhu, Yunchong Xiao, Keqi Deng, Shuai Fan, Kai Yu, Xie Chen
nlpmultimodal
More like this →
Hugging Face Trending Papers
Aug 3

The Role of Disfluencies in Speech Translation

Current speech translation systems, including SpeechLLMs, are trained on cleaned text and tend to strip disfluencies like filled pauses and false starts rather than translate them. We show this comes at a cost: disfluencies carry meaning that gets lost when speech is cleaned up.

benchmarks
More like this →