arXiv Computation and Language By Heeseung Kim

DiffuPlex: Accelerating Full-Duplex Spoken Dialog Models via Rolling Masked Diffusion

Read the original on arXiv Computation and Language →

DiffuPlex is a rolling masked diffusion framework designed to accelerate full‑duplex spoken dialog models by predicting multiple future user and assistant frames in a single backbone pass. It consumes only a confident prefix of each predicted future while maintaining the original frame rate, and revises unplayed future content when the interaction diverges. Two inference policies—DiffuPlex‑LISTEN and DiffuPlex‑SPEAK—offer speedups of 1.46×–1.59× in deployment‑path wall‑clock time and 1.61×–1.80× in Core LM speed, with all backbone invocations completing within the 80 ms interaction interval, while preserving conversational quality and, in the LISTEN policy, speech naturalness.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computation and Language.

arXiv AI
Sep 7

Scalable Context Orchestration for Serving LLMs Over Voice

The paper introduces llmovoice, a middleware that explicitly models voice context for large language model (LLM) serving in voice AI applications. By incorporating speaking rate, background noise, packet loss, and other paralinguistic factors into a bounded context, llmovoice guides the LLM to generate more aligned responses. Experiments show significant reductions in speaking‑rate errors, false interruptions, and model usage costs, especially in long voice sessions.

By Linyi Jiang, Silvery D. Fu, Yifei Zhu
arXiv AI
Jun 9

Liberating LLM Capabilities in Full-Duplex Speech Models

arXiv:2606. 07547v1 Announce Type: cross Abstract: Speech-based large language models are typically constrained to spoken replies, which limits their user-facing outputs to what can be verbalized and suppresses text-native capabilities such as code generation, structured analysis, and multi-step reasoning in realtime interaction, for tasks that require persistent, structured, and inspectable intermediate outputs.

By Luoyuan Zhang, Bokai Xu, Junbo Cui, Weiyue Sun, Yingjing Xu, Hanyu Liu, Yuan Yao