arXiv Machine Learning
Sep 22

Corrective Forcing: Unified Post-Training for Diffusions and Flows in Generative Speech Enhancement

The paper introduces Corrective Forcing (CoF), a post‑training method that aligns diffusion and flow generative models for speech enhancement by training them on self‑generated rollout states. CoF corrects predictions toward ground truth under dynamic sampling schedules and regularizes local evolution with counterfactual transitions, applying a unified objective across both model types. Experiments on SB‑VE and OT‑CFM show improved perceptual quality, reconstruction fidelity, and robustness to varying sampling steps.

By Qing Yao, Lijian Gao, Qirong Mao
arXiv AI
Jul 7

StarTSE: Towards Streaming Target Speaker Extraction via Chunk-wise Interleaved Splicing of Autoregressive Language Model

arXiv:2604. 19635v2 Announce Type: replace-cross Abstract: While generative models have set new benchmarks for Target Speaker Extraction (TSE), their inherent reliance on global context precludes deployment in real-time applications.

By Shuhai Peng, Hui Lu, Jinjiang Liu, Liyang Chen, Guiping Zhong, Jiakui Li, Huimeng Wang, Haiyun Li, Liang Cao, Shiyin Kang, Zhiyong Wu
arXiv Computation and Language
5d ago

From Transcription to Reformulation: Defining and Benchmarking Grounded Generative Speech Recognition

The paper introduces Grounded Generative Speech Recognition (GSR), redefining speech recognition as generating semantically grounded text rather than a single transcript. It defines a grounded reformulation space and a four-level hierarchy of reformulation capabilities, and presents GSR-Bench, a comprehensive benchmark covering diverse scenarios such as meeting transcription, cross-dialect translation, and robustness to silence or noise. The authors also develop a multi-dimensional evaluation framework that combines speech grounding assessment with LLM-based semantic judgment, validated by human preference studies, and analyze trade-offs and failure modes across various ASR architectures.

By Qing Wang, Qihan Hu, Hang Lv, Yan Yang, Boqing Liu, Xuechao Zhu, Zehan Li, Hongjie Chen, Jian Kang, Jie Li, Yongxiang Li, Lei Xie