arXiv Computation and Language

Local Diagnostics of Continuous Normalizing Flow for Out-of-Distribution Detection

arXiv Machine Learning
Sep 22

Corrective Forcing: Unified Post-Training for Diffusions and Flows in Generative Speech Enhancement

The paper introduces Corrective Forcing (CoF), a post‑training method that aligns diffusion and flow generative models for speech enhancement by training them on self‑generated rollout states. CoF corrects predictions toward ground truth under dynamic sampling schedules and regularizes local evolution with counterfactual transitions, applying a unified objective across both model types. Experiments on SB‑VE and OT‑CFM show improved perceptual quality, reconstruction fidelity, and robustness to varying sampling steps.

By Qing Yao, Lijian Gao, Qirong Mao
arXiv AI
Jul 7

StarTSE: Towards Streaming Target Speaker Extraction via Chunk-wise Interleaved Splicing of Autoregressive Language Model

arXiv:2604. 19635v2 Announce Type: replace-cross Abstract: While generative models have set new benchmarks for Target Speaker Extraction (TSE), their inherent reliance on global context precludes deployment in real-time applications.

By Shuhai Peng, Hui Lu, Jinjiang Liu, Liyang Chen, Guiping Zhong, Jiakui Li, Huimeng Wang, Haiyun Li, Liang Cao, Shiyin Kang, Zhiyong Wu
arXiv Computation and Language
5d ago

From Transcription to Reformulation: Defining and Benchmarking Grounded Generative Speech Recognition

The paper introduces Grounded Generative Speech Recognition (GSR), redefining speech recognition as generating semantically grounded text rather than a single transcript. It defines a grounded reformulation space and a four-level hierarchy of reformulation capabilities, and presents GSR-Bench, a comprehensive benchmark covering diverse scenarios such as meeting transcription, cross-dialect translation, and robustness to silence or noise. The authors also develop a multi-dimensional evaluation framework that combines speech grounding assessment with LLM-based semantic judgment, validated by human preference studies, and analyze trade-offs and failure modes across various ASR architectures.

By Qing Wang, Qihan Hu, Hang Lv, Yan Yang, Boqing Liu, Xuechao Zhu, Zehan Li, Hongjie Chen, Jian Kang, Jie Li, Yongxiang Li, Lei Xie
arXiv AI
Oct 21

Abstract Compression of Conversational Audio Context for LLM-based ASR

arXiv:2603.26246v2 Announce Type: replace-cross Abstract: Standard LLM-based speech recognition systems process utterances in isolation, limiting their ability to leverage conversational context. Her...

By Shashi Kumar, Esa\'u Villatoro-Tello, Sergio Burdisso, Kadri Hacioglu, Thibault Ba\~neras-Roux, Hasindri Watawana, Dairazalia Sanchez-Cortes, Srikanth Madikeri, Petr Motlicek, Andreas Stolcke
arXiv AI
Oct 21

PALATE: Peculiar Application of the Law of Total Expectation to Enhance the Evaluation of Deep Generative Models

PALATE is a new framework that improves the evaluation of deep generative models by applying the law of total expectation to accessible data. It builds on the Feature Likelihood Divergence (FLD) method but overcomes FLD’s computational limits, integrating with the MMD baseline metric and the DINOv3 feature extractor. Experiments show PALATE matches or surpasses state‑of‑the‑art methods while being more efficient and scalable, especially for detecting memorization and assessing generalization.

By Tadeusz Dziarmaga, Marcin K\k{a}dzio{\l}ka, Laura Musio{\l}, Patryk Marsza{\l}ek, Artur Kasymov, Piotr Ko\'scielniak, Marcin Mazur