OpenAI Blog
May 4
How OpenAI delivers low-latency voice AI at scale
How OpenAI rebuilt its WebRTC stack to power real-time Voice AI with low latency, global scale, and seamless conversational turn-taking.
Build Low-Latency Multilingual Voice Agents: Open Weights & Full Deployment Control with NVIDIA Magpie TTS
Related stories
arXiv Machine Learning
Jul 21
ChipChat: Low-Latency Cascaded Conversational Agent in MLX
arXiv:2509. 00078v2 Announce Type: replace-cross Abstract: The emergence of large language models (LLMs) has transformed spoken dialog systems, yet the optimal architecture for real-time on-device voice agents remains an open question.
arXiv AI
Jun 17
MLLP-VRAIN UPV system for the IWSLT 2026 Simultaneous Speech Translation task
arXiv:2606. 17255v1 Announce Type: cross Abstract: This work describes the participation of the MLLP-VRAIN research group in the shared task of the IWSLT 2026 Simultaneous Speech Translation track.
OpenAI Blog
May 7
Advancing voice intelligence with new models in the API
Explore new realtime voice models in the OpenAI API that can reason, translate, and transcribe speech, enabling more natural and intelligent voice experiences.
arXiv Machine Learning
Jul 21
FlashRT: Agent Harness for Guiding Agents to Deploy Real-Time Multimodal Applications
arXiv:2607. 18171v1 Announce Type: new Abstract: Real-time multimodal applications, including voice agents and interactive video generation, compose heterogeneous models into pipelines whose efficient deployment requires application-specific decisions about placement, streaming, and intra-model parallelism.
Mistral AI
Mar 23
Speaking of Voxtral
Voxtral TTS: A frontier, open-weights text-to-speech model that’s fast, instantly adaptable, and produces lifelike speech for voice agents.
OpenAI Blog
Aug 3
How we built a realtime system for responsive voice AI in six months
GPT-Live enables continuous voice interaction with AI, using a turnless speech model and low-latency architecture for faster, more natural conversations.
arXiv AI
Aug 5
Speech LLMs in Low-Resource Scenarios: Data Volume Requirements and the Impact of Pretraining on High-Resource Languages
arXiv:2508. 05149v2 Announce Type: replace-cross Abstract: Large language models (LLMs) have demonstrated potential in handling spoken inputs for high-resource languages, reaching state-of-the-art performance in various tasks.
OpenAI Blog
Mar 29, 2024
Navigating the challenges and opportunities of synthetic voices
We’re sharing lessons from a small scale preview of Voice Engine, a model for creating custom voices.
OpenAI Blog
Oct 1, 2024
Introducing the Realtime API
Developers can now build fast speech-to-speech experiences into their applications
OpenAI Blog
Jul 8
Introducing GPT-Live
A new generation of voice models for natural human-AI interaction, now powering ChatGPT Voice.
OpenAI Blog
Aug 28, 2025
Introducing gpt-realtime and Realtime API updates
We’re releasing a more advanced speech-to-speech model and new API capabilities including MCP server support, image input, and SIP phone calling support.