Speech Synthesis, Recognition, and More With SpeechT5

Granite Speech 5.0: Transcribe, Translate, and Attribute more Accurately and Faster

Introducing gpt-realtime and Realtime API updates

We’re releasing a more advanced speech-to-speech model and new API capabilities including MCP server support, image input, and SIP phone calling support.

Phoneme-guided TTS augmentation for ASR: A unified pipeline and multilingual evaluation

The paper introduces a phoneme-guided text-to-speech (TTS) augmentation pipeline for automatic speech recognition (ASR) that links multilingual speech generation with candidate-text selection and reference-speech quality control. It proposes phoneme-frequency-guided selection (PFGS), which prioritizes candidate texts containing common phonetic content based on real ASR training transcripts. Experiments across four languages and 13 test sets show that random text selection improves recognition on 11 test sets, while PFGS further improves nine test sets with relative word error rate reductions up to 19.3%, and reference-speech filtering also contributes to performance gains.

A Comprehensive Study of Content Representations for Speech Synthesis

The paper investigates how different speech content representations—such as SSL features, supervised tokens, posteriorgrams, and neural audio codecs—perform when used to train a generative model that produces audio conditioned only on each representation. By evaluating the generated audio on content, speaker identity, and prosody, the study identifies two regimes: some representations almost fully reconstruct the original audio, while others effectively separate speaker identity. The findings reveal that disentanglement of speaker identity depends on both the training objective and the representation’s information capacity, rather than supervision alone.

Pronunciation Editing for Finnish Speech using Phonetic Posteriorgrams

arXiv:2507.02115v3 Announce Type: cross Abstract: Synthesizing second-language (L2) speech is potentially highly valued for L2 language learning experience and feedback. However, due to the lack of L...

Intelligent transcription with Gemini 3.5 Transcribe

DeepMind has introduced Gemini 3.5 Transcribe, a new tool that offers more intelligent speech-to-text transcription. The update promises improved accuracy and smarter handling of spoken content, enhancing the overall transcription experience.