The paper introduces PreSTP, a training‑free method for speeding up few‑step autoregressive video diffusion models by pruning redundant tokens. It identifies two redundancy patterns—cross‑frame similarity from static content and cross‑step convergence during denoising—and uses early clean estimates from the model’s own trajectory to build a token‑wise redundancy mask. PreSTP achieves significant speedups (up to 3.20× for 5‑second videos and 1.96× for 30‑second videos) while maintaining or improving fidelity compared to existing caching baselines.
By Jia Li, Xurui Peng, Xing Wang, Hayden Kwok-Hay So
arXiv:2602. 01801v2 Announce Type: replace-cross Abstract: Autoregressive video diffusion models enable streaming generation, opening the door to long-form synthesis, video world models, and interactive neural game engines.
By Dvir Samuel, Issar Tzachor, Matan Levy, Michael Green, Gal Chechik, Rami Ben-Ari
Speculative Forcing is a framework for efficient autoregressive video generation that treats intermediate clean estimates as drafts and predicts when individual tokens can be safely accepted early. Tokens that are accepted are frozen and no longer undergo further denoising, while their cached keys and values remain available for context. Two verifier designs—one training‑free based on similarity and stability, and one learned that uses intermediate features—enable this selective refinement, preserving full‑step quality while reducing computation across short‑video, long‑video, and world generation tasks.
By Hyunwook Choi, Seungryong Kim, Dongyoon Han, Sangdoo Yun
arXiv:2606. 13035v1 Announce Type: cross Abstract: Autoregressive video diffusion models provide a natural formulation for streaming and variable-length video generation by conditioning newly generated frames on previously generated content.
By Yu Meng, Xiangyang Luo, Letian Li, Wenyuan Jiang, Chen Gao, Xinlei Chen, Yong Li, Xiao-Ping Zhang
Focused Forcing is a training‑free method for selecting key‑value (KV) cache entries in autoregressive video diffusion models. It selects historical frames per generated frame by combining attention and diversity scores, and allocates larger budgets to more important heads. The approach yields up to 1.48× faster generation while improving visual quality and text alignment across several generation paradigms.
By Peiliang Cai, Evelyn Zhang, Jiacheng Liu, Hao Lin, Ruiqi Zhang, Weile Mo, Yue Ma, Shikang Zheng, Jiehang Huang, Dongrui Liu, Linfeng Zhang
Autoregressive video diffusion models provide a natural formulation for streaming and variable-length video generation by conditioning newly generated frames on previously generated content. However, extending these models to minute-level generation remains challenging: the limited KV-cache budget prevents the model from retaining the full history, while repeatedly conditioning on self-generated frames induces a context distribution shift that accumulates over time, leading to visual artifacts, quality degradation, and temporal drift.
arXiv:2603. 00198v2 Announce Type: replace-cross Abstract: Token reduction accelerates long-video vision--language models (VLMs), but existing methods target Transformers, where reduction is treated as token pruning.
By Jindong Jiang, Amala Sanjay Deshmukh, Kateryna Chumachenko, Karan Sapra, Zhiding Yu, Guilin Liu, Andrew Tao, Pavlo Molchanov, Jan Kautz, Wonmin Byeon
arXiv:2609.37831v1 Announce Type: new
Abstract: Real-time diffusion-based video super-resolution (VSR) is in high demand for online streaming, yet stringent latency requirements often compromise gene...
By Xijun Wang, Xin Li, Suhang Yao, Zirui Lang, Bingchen Li, Zhibo Chen
arXiv:2606. 16353v1 Announce Type: cross Abstract: Streaming video understanding models must answer queries at any moment during an ongoing stream, using only what they have observed so far and under fixed memory and computation budgets.
By Haonan Ge, Yiwei Wang, Hang Wu, Yujun Cai
CORAL-KV is a new framework for compressing the key‑value (KV) cache used by autoregressive video diffusion models. It predicts keys and values across cache layers using block‑diagonal‑plus‑low‑rank (block‑DPLR) predictors, then quantizes only the residuals, offering a flexible trade‑off between fidelity and memory usage. In extensive tests on HY‑WorldPlay and MAGI‑1, the reusable configuration outperforms QVG‑4 by up to 4.95 dB PSNR while reducing cache memory by 37–48 %, and the video‑adapted configuration surpasses QVG‑Pro by 3.77 dB PSNR with 33.7 % less memory, all while maintaining comparable latency and reducing temporal discontinuities.
By Albert Ge, Akash Haridas, Utkarsh Saxena, Ruijing Yang, Ian Colbert, Frederic Sala, Vikram Appia, Emad Barsoum
arXiv:2610.08777v1 Announce Type: new
Abstract: Interactive video world models need to generate each video chunk efficiently while responding faithfully to user controls. Many systems use chunk-wise...
By Shangye Song, Dong Gong, Hong Jia, Yun Sing Koh, Xinyu Zhang
Interactive video world models need to generate each video chunk efficiently while responding faithfully to user controls. Many systems use chunk-wise autoregressive generation with few-step denoising...