arXiv Computer Vision By Yunseung Ok (Kyung Hee University), Hyunsoo Kim (The University of Texas at Austin), Minseo Kim (Kyung Hee University), Suhyun Kim (Kyung Hee University)

Custom Forcing: Training-Free Subject Customization for Autoregressive Video Generation

Read the original on arXiv Computer Vision →

The Flow has not summarised this story yet — read it at arXiv Computer Vision.

arXiv Computer Vision
Aug 31

Relax Forcing: Relaxed KV-Memory for Consistent Long Video Generation

The paper introduces Relax Forcing, a training‑free memory mechanism for autoregressive video diffusion that structures temporal context into Sink, Tail, and History frames. By selecting History frames with a relaxation criterion, the method reduces error accumulation and attention overhead while preserving motion dynamics. Experiments on VBench‑Long demonstrate that this structured memory improves long‑video generation quality over existing baselines.

By Zengqun Zhao, Yanzuo Lu, Ziquan Liu, Jifei Song, Jiankang Deng, Ioannis Patras
arXiv Computer Vision
5d ago

SGF+: Decoupling Gradient Flows for Autoregressive Video Generation

arXiv:2610.10429v1 Announce Type: new Abstract: Autoregressive video generation requires denoising the current frames while writing their key-value representations as context for future predictions....

By Zihan Su, Junhao Zhuang, Yaowei Li, Siwen Lu, Haoran Li, Lingen Li, Haoyu Wu, Weiyang Jin, Songchun Zhang, Haoyang Huang, Chun Yuan, Zeyue Xue, Nan Duan
arXiv Machine Learning
Jul 23

HeadCast: Casting Attention Heads for Efficient Autoregressive Video Generation

arXiv:2607. 20125v1 Announce Type: cross Abstract: Autoregressive (AR) video diffusion models have become a promising paradigm for long and streaming video synthesis, but the continuously growing Key-Value (KV) cache makes attention the dominant inference cost, especially at high resolution where each frame contributes many tokens.

By Jinliang Shen, Lianghao Su, Zheming Li, Kang He, ZiLiang Lai, Yanbing Jiang, Chengru Song
arXiv Computer Vision
Sep 18

Recency Forcing: Bridging the Long-Horizon Gap in Autoregressive Video Generation

The paper introduces Recency Forcing, a technique that addresses the long‑horizon degradation in autoregressive video generation caused by KV eviction mismatch. By applying a timestep‑dependent bias—Temporal Response Bias—derived from a positional response measure, the method reduces the influence of distant frames during inference without altering context length or training objectives. An exact reformulation, Biased Attention Reparameterization, enables this bias to be applied as a standard FlashAttention call with zero overhead, achieving state‑of‑the‑art long‑horizon generation quality on VBench datasets.

By Tri Cao, Hung Nguyen, Phong Nguyen, Khoi Nguyen
arXiv Computer Vision
Oct 5

In-Distribution Forcing for Long Video Generation at Test Time

In-Distribution Forcing for Long Video Generation at Test Time introduces a test‑time framework that aligns KV caching and conditioning with training configurations to prevent out‑of‑distribution key‑value entries during long‑horizon video generation. The core technique, self‑caching, ensures each chunk is cached without attending to prior KV entries, keeping the rolling window exactly in‑distribution. This approach extends short‑horizon autoregressive video diffusion models to minute‑scale generation, outperforming prior methods in mitigating drifting as shown by drift metrics and a user study.

By Jeongwoo Shin, Youngyoon Choi, Sangwoo Jo, Hyunmog Kim, Sungjoon Choi, Joonseok Lee, Jaewoong Choi, Jaemoo Choi