We propose OPSD-V, an on-policy self-distillation paradigm for post-training few-step autoregressive (AR) video diffusion models. Existing few-step AR video generators can produce long videos with low latency, but still suffer from error accumulation and weakened motion dynamics during long autoregressive rollout.
The paper introduces Conditional Residual Prediction (CRP), a technique that reduces a causal video diffusion model’s dependence on past frames by having the model first predict the current frame without conditioning on history and then adding a residual based on the past. This approach allows training a causal model from an image‑model initialization without requiring a bidirectional teacher or complex distillation, and it nearly closes a 6.14‑point quality gap to a bidirectional model. Using CRP, the authors train Optica, a 2‑billion‑parameter causal video model that generates 5‑second 480p videos and achieves an 82.78 score on VBench with only about 15 million training videos.
By Bowen Zheng, Zhiguang Liu, Jiarong Ou, Rui Chen, Tianyang Hu
arXiv:2607. 15849v1 Announce Type: cross Abstract: Autoregressive video diffusion models have enabled the generation of arbitrarily long videos by removing conditioning on future frames, thus greatly improving computational efficiency.
By Dimitrios Karageorgiou, Symeon Papadopoulos, Ioannis Kompatsiaris, Efstratios Gavves
arXiv:2609.35491v2 Announce Type: replace-cross
Abstract: Few-step autoregressive video generation commonly relies on Distribution Matching Distillation (DMD), requiring a bidirectional diffusion tea...
By Chi Zhang, Yueyi Liu, Haoyang Shi, Ruichuan An, Haoyu Li, Yuhang Wu, Sen Cui, Miao Liu
arXiv:2610.20111v1 Announce Type: new
Abstract: Distilling pretrained video diffusion models into few-step autoregressive (AR) generators typically combines student initialization with distribution m...
By Siming Fu, Zheming Fu, Lianrui Mu, Haoyang Huang, Chaojie Gu, Ruizhe He
The paper introduces TRACK, a training‑free trajectory routing method that accelerates video diffusion by selectively switching between large and small models during denoising steps. A calibration process generates a disagreement score map, guiding the selection of the appropriate model at each step to maintain quality while reducing computational cost. Experiments on Wan 2.1, Cosmos 3, TurboDiffusion, and FastVideo show speedups ranging from 1.95× to 2.73× with comparable quality and diversity.
By Mustafa Munir, Huy Vu, Shreyas Misra, Rohit Jena, Sajad Norouzi, Ali Taghibakhshi, Anis Ahmad, Anjul Patney, Pavlo Molchanov, Nima Tajbakhsh