arXiv AI
Oct 5

TACD: Distilling Efficient Text-to-Motion Models via Terminal Amplification Control

The paper introduces TACD, a Terminal‑Amplification‑Controlled Distillation method that trains efficient text‑to‑motion generators using on‑policy flow distillation from pretrained teachers, without requiring real‑motion data. TACD addresses a failure mode where velocity matching over‑weights errors near the denoising endpoint by tying the latest teacher query to the student’s step size, thereby bounding loss weights in clean‑motion space. Experiments on HumanML3D, KIT‑ML, HY‑Motion, and Kimodo show that TACD improves few‑step generation quality, reduces FID scores, and achieves significant speedups and memory savings compared to teacher models.

By Wei-Jin Huang, Yuan-Ming Li, Kun-Yu Lin, Wang Luo, Yinlin Zhu, Yue Yu, Shenghao Ye, Junbin Yuan, Fa-Ting Hong, Qing Zhang, Wei-Shi Zheng
arXiv Machine Learning
Aug 5

Any-OPD: Heterogeneous On-Policy Distillation for Flow-Matching Models via Representation-Space Bridging

arXiv:2608. 03316v1 Announce Type: new Abstract: On-policy distillation, in which a teacher corrects samples that the student itself generates, presupposes that the two models speak the same language: identical VAE latents, matching architectures, and a common timestep grid.

By Siming Fu, Zheming Fu, Ruizhe He, Hualiang Wang, Jie Huang, Xiaoxiao Ma, Mingchen Zhong, Weihu Huang, Xiaoxuan He, Haojun Xu
Hugging Face Trending Papers
Aug 4

Any-OPD: Heterogeneous On-Policy Distillation for Flow-Matching Models via Representation-Space Bridging

On-policy distillation, in which a teacher corrects samples that the student itself generates, presupposes that the two models speak the same language: identical VAE latents, matching architectures, and a common timestep grid. We ask what happens when none of this holds, as when the strongest teacher available and the student one wishes to deploy come from different model families, and find that the standard recipes have no answer: teacher latents cannot serve as targets in a foreign coordinate system, per-pixel losses against a teacher that stochastically re-draws local detail degenerate into blur or divergence, and timestep indices lose their meaning across mismatched schedules.