OpenAI Blog
Aug 28, 2025
Introducing gpt-realtime and Realtime API updates
We’re releasing a more advanced speech-to-speech model and new API capabilities including MCP server support, image input, and SIP phone calling support.
Speech Synthesis, Recognition, and More With SpeechT5
Related stories
DeepMind Blog
5d ago
Intelligent transcription with Gemini 3.5 Transcribe
DeepMind has introduced Gemini 3.5 Transcribe, a new tool that offers more intelligent speech-to-text transcription. The update promises improved accuracy and smarter handling of spoken content, enhancing the overall transcription experience.
arXiv Machine Learning
Aug 13
CookVoice: Unified Framework for Style Controllable Multi-Modal Human Voice Generation
arXiv:2608. 11590v1 Announce Type: cross Abstract: Human voice generation has made rapid progress in speech generation, singing voice generation, voice cloning, and voice editing.
arXiv AI
Jun 16
An Empirical Study on Learning Latent Representations for Emotional Speech Synthesis
arXiv:2606. 14922v1 Announce Type: cross Abstract: For the last couple of years, the field of speech synthesis has improved dramatically thanks to deep learning.
arXiv AI
Jul 7
Information-Geometric Superposed Vowel Evaluation: Part 1. Moraic Syllabary (Japanese)
arXiv:2607. 04154v1 Announce Type: cross Abstract: This paper explains the principles and provides examples of a new method for distinguishing between FAKE human speech synthesized by generative AI and natural speech.
arXiv AI
Jun 6
UniVoice: A Unified Model for Speech and Singing Voice Generation
arXiv:2606. 05852v1 Announce Type: cross Abstract: Text-to-speech (TTS) and singing voice synthesis (SVS) both aim to generate human vocal audio from symbolic inputs, but they impose different requirements on the generation process.
OpenAI Blog
Mar 29, 2024
Navigating the challenges and opportunities of synthetic voices
We’re sharing lessons from a small scale preview of Voice Engine, a model for creating custom voices.
arXiv Machine Learning
Jul 7
GRAFT: Grafted Reference Audio for Fine-grained Pronunciation in Zero-shot Text-to-Speech
arXiv:2607. 02633v1 Announce Type: new Abstract: We present GRAFT, a per-word pronunciation conditioning mechanism for text-to-speech neural codec language modeling.
Mistral AI
Mar 23
Speaking of Voxtral
Voxtral TTS: A frontier, open-weights text-to-speech model that’s fast, instantly adaptable, and produces lifelike speech for voice agents.
arXiv Computation and Language
3d ago
Scaling phoneme-based TTS augmentation for ASR: A unified pipeline and controlled study
The paper introduces a unified phoneme‑based TTS‑to‑ASR augmentation pipeline that uses a multilingual TTS model with language‑ID conditioning and incorporates grapheme‑to‑phoneme conversion, reference‑speech filtering, and candidate‑text selection. It proposes phoneme‑frequency‑guided selection (PFGS) to rank sentences based on phoneme frequencies from real ASR labels, and demonstrates that random augmentation and PFGS both improve ASR performance across Arabic, French, Italian, and Portuguese test sets, with PFGS yielding up to a 19.3% relative WER reduction. The study also shows that filtering reference speech can further lower WER by up to 0.59 points on certain datasets.
OpenAI Blog
Jul 8
Introducing GPT-Live
A new generation of voice models for natural human-AI interaction, now powering ChatGPT Voice.
OpenAI Blog
Jan 7
How Tolan builds voice-first AI with GPT-5.1
Tolan built a voice-first AI companion with GPT-5. 1, combining low-latency responses, real-time context reconstruction, and memory-driven personalities for natural conversations.