arXiv Machine Learning August 10, 2026 By Iftach Shoham, Tali Dror, Oren Gal, Haim Permuter, Gilad Katz, Eliya Nachmani

Multi Codec Discrete Diffusion Model for Text Guided Speech Inpainting and Editing

Read the original on arXiv Machine Learning →

arXiv:2608. 06424v1 Announce Type: cross Abstract: Speech recordings often contain missing, corrupted, or incorrect regions that must be reconstructed or modified without re-synthesizing the entire utterance.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv AI

Aug 5

dots.tts.edit: Precisely Controlled Speech Editing with a Continuous Autoregressive Model

arXiv:2608. 02673v1 Announce Type: cross Abstract: Speech editing for content creation requires precise control over both what an edit should do and where it should apply.

By Hankun Wang, Bohan Li, Shi Lian, Xiaoyu Gu, Jing Peng, Da Zheng, Colin Zhang, Kai Yu

safety

arXiv AI

Jun 19

Hybrid Diffusion Transformer for Instruction-Guided Audio Editing via Rectified Flow

arXiv:2606. 20101v1 Announce Type: cross Abstract: Audio editing aims to modify specific content in an existing audio clip according to a natural language instruction while preserving the remaining acoustic content.

By Liting Gao, Yonggang Zhu, Yaru Chen, Dongyu Wang, Shubin Zhang, Zhenbo Li, Jean-Yves Guillemaut, Wenwu Wang

llms diffusion multimodal safety

arXiv AI

Jul 15

RFM-Editing 2: Text-Guided Audio Editing with Rectified Flow Matching and Coarse-to-Fine Diffusion Transformers

arXiv:2606. 20101v3 Announce Type: replace-cross Abstract: Audio editing aims to modify specific content in an existing audio clip according to a text instruction or description while preserving the remaining acoustic content.

By Liting Gao, Yonggang Zhu, Yaru Chen, Dongyu Wang, Shubin Zhang, Zhenbo Li, Jean-Yves Guillemaut, Wenwu Wang

llms diffusion multimodal safety

arXiv Computation and Language

Sep 22

Efficient and Adaptive Simultaneous Speech Translation with Fully Unidirectional Architecture

arXiv:2504.11809v2 Announce Type: replace Abstract: Simultaneous speech translation (SimulST) produces translations incrementally while processing partial speech input. Although large language models...

By Biao Fu, Donglei Yu, Minpeng Liao, Chengxi Li, Xinjie Chen, Yidong Chen, Kai Fan, Xiaodong Shi

llms

arXiv AI

Sep 15

DiTAR+: Dual Optimization for Robust Autoregressive Diffusion Speech Synthesis

arXiv:2609.13909v1 Announce Type: cross Abstract: Continuous-latent Autoregressive Diffusion Transformer (AR-DiT) models have demonstrated immense potential in zero-shot speech generation. However, t...

By Ziyu Zhang, Tianlun Zuo, Hanzhao Li, Haoyu Zhang, Lei Xie

llms diffusion safety

arXiv AI

Jun 9

TLDR: Compressing Audio Tokens for Efficient Autoregressive Text-to-Speech

arXiv:2606. 09019v1 Announce Type: cross Abstract: Codec-based autoregressive (AR) speech language models have achieved strong text-to-speech (TTS) quality by modeling speech as sequences of discrete audio tokens with large pretrained backbones.

By Yejin Lee, Junwon Moon, Hyoeun Kim, Hyunjin Choi, Heeseung Kim, Kyuhong Shim

llms fine-tuning efficiency multimodal

One email a morning, machine-written

Related stories

dots.tts.edit: Precisely Controlled Speech Editing with a Continuous Autoregressive Model

Hybrid Diffusion Transformer for Instruction-Guided Audio Editing via Rectified Flow

RFM-Editing 2: Text-Guided Audio Editing with Rectified Flow Matching and Coarse-to-Fine Diffusion Transformers

Efficient and Adaptive Simultaneous Speech Translation with Fully Unidirectional Architecture

DiTAR+: Dual Optimization for Robust Autoregressive Diffusion Speech Synthesis

TLDR: Compressing Audio Tokens for Efficient Autoregressive Text-to-Speech