arXiv Computation and Language
Why Full-Duplex Speech Models Collapse in Long Conversations
Read the original on arXiv Computation and Language →The Flow has not summarised this story yet — read it at arXiv Computation and Language.
Related stories
arXiv Computation and Language
Oct 12
People Making Conversation: Evaluating How Naturally Speech Models Converse
The study evaluates conversational speech models by placing them at 427 pauses and 482 turn ends from 176 unscripted conversations, scoring their responses on timing, latency, length, wording, and recall of recent dialogue. Hosted APIs (GPT Realtime, Gemini 3.1 Flash Live, Grok Voice) respond at almost every pause, with latency ranging from 1–4 s for silence-based endpointers and about 8 s for semantic turn detection, while full‑duplex models (PersonaPlex, Moshi) remain silent more often and can interrupt within human reaction time. Recall rates vary: hosted systems remember 41–60 % of facts under a Claude Opus 5.5 judge and 19–26 % with a strict word matcher; full‑duplex models recall 17–22 % and 12–15 % respectively.
arXiv Computation and Language
Sep 15
Causal Analysis and Mitigation of Spurious Onsets in Full-Duplex Speech LLMs
arXiv:2609.13445v1 Announce Type: new Abstract: Speech-to-speech LLMs like Moshi, and its derivative PersonaPlex, can listen and speak concurrently through full-duplex generation. However, they can b...
arXiv AI
Jun 9
Liberating LLM Capabilities in Full-Duplex Speech Models
arXiv:2606. 07547v1 Announce Type: cross Abstract: Speech-based large language models are typically constrained to spoken replies, which limits their user-facing outputs to what can be verbalized and suppresses text-native capabilities such as code generation, structured analysis, and multi-step reasoning in realtime interaction, for tasks that require persistent, structured, and inspectable intermediate outputs.
arXiv AI
Oct 7
Coupled but Late: Turn-Taking Between Full-Duplex Speech Models in Unscripted Dialogue
arXiv:2610.08683v1 Announce Type: new Abstract: Full-duplex speech models are trained to converse with a person, but they are increasingly made to converse with each other, in self-play data generati...
arXiv Computation and Language
Oct 9
DiffuPlex: Accelerating Full-Duplex Spoken Dialog Models via Rolling Masked Diffusion
DiffuPlex is a rolling masked diffusion framework designed to accelerate full‑duplex spoken dialog models by predicting multiple future user and assistant frames in a single backbone pass. It consumes only a confident prefix of each predicted future while maintaining the original frame rate, and revises unplayed future content when the interaction diverges. Two inference policies—DiffuPlex‑LISTEN and DiffuPlex‑SPEAK—offer speedups of 1.46×–1.59× in deployment‑path wall‑clock time and 1.61×–1.80× in Core LM speed, with all backbone invocations completing within the 80 ms interaction interval, while preserving conversational quality and, in the LISTEN policy, speech naturalness.
arXiv Computation and Language
2d ago
Diagnosing and Mitigating Long-Session Degradation in Full-Duplex Speech Models
arXiv:2610.34991v1 Announce Type: new Abstract: End-to-end full-duplex spoken dialogue models enable natural, real-time spoken interactions with interruptions, backchannels, and overlapping speech. P...