arXiv:2606. 29287v1 Announce Type: new Abstract: Diffusion and continuous-flow generative models achieve high-quality generation, and their deterministic sampling can be formulated as solving learned ODE dynamics.
By Chen Wang, Peiran Yun, Pan Xie, Ke Deng
arXiv:2609.36324v1 Announce Type: cross
Abstract: Flow-matching text-to-speech (TTS) models achieve high synthesis quality but require many neural function evaluations (NFEs) to integrate their gener...
By Yentl Collin, Evan Dufraisse, Amr Mohamed, Amine Khelif Khelif, Dani Bouch, Guokan Shang
Flow and diffusion models suffer from slow inference due to computationally expensive numerical integration. Distillation provides a promising way for a student model to learn from a teacher's dynamic...
The paper introduces Trajectory-Regularized Distribution Distillation (TRD), a method that merges distribution-level and trajectory-level supervision for one-step generative models. TRD uses a momentum-mixture policy derived from a single student forward pass, eliminating the need for an extra network to estimate the student’s score. Experiments on SANA-1.6B and Stable Diffusion 3.5 demonstrate that TRD surpasses existing consistency and distribution matching baselines in generation quality and training efficiency, though it slightly reduces sample diversity.
By An Zhao, Yixiang Zhou, Zejian Li, Yi Guo, Pei Chen, Lingyun Sun
The paper introduces TACD, a Terminal‑Amplification‑Controlled Distillation method that trains efficient text‑to‑motion generators using on‑policy flow distillation from pretrained teachers, without requiring real‑motion data. TACD addresses a failure mode where velocity matching over‑weights errors near the denoising endpoint by tying the latest teacher query to the student’s step size, thereby bounding loss weights in clean‑motion space. Experiments on HumanML3D, KIT‑ML, HY‑Motion, and Kimodo show that TACD improves few‑step generation quality, reduces FID scores, and achieves significant speedups and memory savings compared to teacher models.
By Wei-Jin Huang, Yuan-Ming Li, Kun-Yu Lin, Wang Luo, Yinlin Zhu, Yue Yu, Shenghao Ye, Junbin Yuan, Fa-Ting Hong, Qing Zhang, Wei-Shi Zheng
Few-step flow-map generators, including MeanFlow and consistency models, enable efficient sampling through long-range transport, yet their on-policy distillation remains underexplored. We introduce Fl...