arXiv AI

In-Flight KV Cache with Clean Anchors for Faster Autoregressive Video Diffusion

arXiv Machine Learning
Jul 23

HeadCast: Casting Attention Heads for Efficient Autoregressive Video Generation

arXiv:2607. 20125v1 Announce Type: cross Abstract: Autoregressive (AR) video diffusion models have become a promising paradigm for long and streaming video synthesis, but the continuously growing Key-Value (KV) cache makes attention the dominant inference cost, especially at high resolution where each frame contributes many tokens.

By Jinliang Shen, Lianghao Su, Zheming Li, Kang He, ZiLiang Lai, Yanbing Jiang, Chengru Song
arXiv Computer Vision
Oct 8

MORCA: Offline-to-Online Reinforcement Learning for Adaptive Cache Reuse in Video Diffusion Acceleration

arXiv:2610.10457v1 Announce Type: new Abstract: Diffusion Transformers (DiTs) achieve remarkable performance in video synthesis, but their iterative denoising process suffers from high inference late...

By Yuxiang Xiong, Ruiyan Wang, Wenqiang Wang, Teng Hu, Songhang Shen, Bohao Feng, Hongqian Deng, Ran Yi
arXiv Computer Vision
Oct 5

In-Distribution Forcing for Long Video Generation at Test Time

In-Distribution Forcing for Long Video Generation at Test Time introduces a test‑time framework that aligns KV caching and conditioning with training configurations to prevent out‑of‑distribution key‑value entries during long‑horizon video generation. The core technique, self‑caching, ensures each chunk is cached without attending to prior KV entries, keeping the rolling window exactly in‑distribution. This approach extends short‑horizon autoregressive video diffusion models to minute‑scale generation, outperforming prior methods in mitigating drifting as shown by drift metrics and a user study.

By Jeongwoo Shin, Youngyoon Choi, Sangwoo Jo, Hyunmog Kim, Sungjoon Choi, Joonseok Lee, Jaewoong Choi, Jaemoo Choi
arXiv Computer Vision
Oct 16

Speculative Forcing for Efficient Autoregressive Video Generation

Speculative Forcing is a framework for efficient autoregressive video generation that treats intermediate clean estimates as drafts and predicts when individual tokens can be safely accepted early. Tokens that are accepted are frozen and no longer undergo further denoising, while their cached keys and values remain available for context. Two verifier designs—one training‑free based on similarity and stability, and one learned that uses intermediate features—enable this selective refinement, preserving full‑step quality while reducing computation across short‑video, long‑video, and world generation tasks.

By Hyunwook Choi, Seungryong Kim, Dongyoon Han, Sangdoo Yun
arXiv Computer Vision
Nov 6

Training-Free Predictive Spatio-Temporal Token Pruning for Few-Step Autoregressive Video Diffusion

The paper introduces PreSTP, a training‑free method for speeding up few‑step autoregressive video diffusion models by pruning redundant tokens. It identifies two redundancy patterns—cross‑frame similarity from static content and cross‑step convergence during denoising—and uses early clean estimates from the model’s own trajectory to build a token‑wise redundancy mask. PreSTP achieves significant speedups (up to 3.20× for 5‑second videos and 1.96× for 30‑second videos) while maintaining or improving fidelity compared to existing caching baselines.

By Jia Li, Xurui Peng, Xing Wang, Hayden Kwok-Hay So