arXiv Computer Vision

Trajectory Forcing: Exploiting Diffusion Trajectories for Autoregressive Long Video Generation

The paper introduces Trajectory Forcing (TraF), an autoregressive diffusion method that uses the denoising trajectories of previously generated video chunks as context for generating longer videos. TraF is trained in two stages: first with ground‑truth videos using pseudo‑trajectories, then with a teacher model that supplies real trajectories from the student’s own rollout. On the 5‑second VBench benchmark, TraF outperforms Self Forcing and Causal Forcing, and it achieves the highest overall quality for 30‑second video generation, extending the training horizon sixfold.

arXiv AI
Oct 9

Conditional Residual Prediction: Improving Autoregressive Video Diffusion without a Bidirectional Teacher

The paper introduces Conditional Residual Prediction (CRP), a technique that reduces a causal video diffusion model’s dependence on past frames by having the model first predict the current frame without conditioning on history and then adding a residual based on the past. This approach allows training a causal model from an image‑model initialization without requiring a bidirectional teacher or complex distillation, and it nearly closes a 6.14‑point quality gap to a bidirectional model. Using CRP, the authors train Optica, a 2‑billion‑parameter causal video model that generates 5‑second 480p videos and achieves an 82.78 score on VBench with only about 15 million training videos.

By Bowen Zheng, Zhiguang Liu, Jiarong Ou, Rui Chen, Tianyang Hu
arXiv AI
Sep 25

Accelerating Video Diffusion via Training-Free Trajectory Routing

The paper introduces TRACK, a training‑free trajectory routing method that accelerates video diffusion by selectively switching between large and small models during denoising steps. A calibration process generates a disagreement score map, guiding the selection of the appropriate model at each step to maintain quality while reducing computational cost. Experiments on Wan 2.1, Cosmos 3, TurboDiffusion, and FastVideo show speedups ranging from 1.95× to 2.73× with comparable quality and diversity.

By Mustafa Munir, Huy Vu, Shreyas Misra, Rohit Jena, Sajad Norouzi, Ali Taghibakhshi, Anis Ahmad, Anjul Patney, Pavlo Molchanov, Nima Tajbakhsh
arXiv Machine Learning
Jun 25

Causal-rCM: A Unified Teacher-Forcing and Self-Forcing Open Recipe for Autoregressive Diffusion Distillation in Streaming Video Generation and Interactive World Models

arXiv:2606. 25473v1 Announce Type: cross Abstract: Autoregressive video diffusion with causal diffusion transformers has emerged as a major paradigm for real-time streaming video generation and action-conditioned interactive world models.

By Kaiwen Zheng, Guande He, Min Zhao, Jintao Zhang, Huayu Chen, Jianfei Chen, Chen-Hsuan Lin, Ming-Yu Liu, Jun Zhu, Qianli Ma
Hugging Face Trending Papers
Sep 24

Accelerating Video Diffusion via Training-Free Trajectory Routing

Accelerating Video Diffusion via Training-Free Trajectory Routing (TRACK) introduces a heterogeneous denoising strategy that switches between large and small diffusion models at selected steps, determined by a calibration process that measures disagreement between model predictions. By routing quality-sensitive steps to the large model and low-disagreement steps to the small model, TRACK achieves significant speedups—up to 2.73×—across several video diffusion benchmarks while maintaining comparable quality and diversity. The method requires no retraining, architectural changes, or online dual-model evaluation, making it a practical acceleration paradigm for video diffusion.

arXiv Computer Vision
Nov 6

Training-Free Predictive Spatio-Temporal Token Pruning for Few-Step Autoregressive Video Diffusion

The paper introduces PreSTP, a training‑free method for speeding up few‑step autoregressive video diffusion models by pruning redundant tokens. It identifies two redundancy patterns—cross‑frame similarity from static content and cross‑step convergence during denoising—and uses early clean estimates from the model’s own trajectory to build a token‑wise redundancy mask. PreSTP achieves significant speedups (up to 3.20× for 5‑second videos and 1.96× for 30‑second videos) while maintaining or improving fidelity compared to existing caching baselines.

By Jia Li, Xurui Peng, Xing Wang, Hayden Kwok-Hay So