arXiv Machine Learning
Oct 12

CORAL-KV: Compact Cross-Layer Prediction and Residual Coding for Autoregressive Video KV Caches

CORAL-KV is a new framework for compressing the key‑value (KV) cache used by autoregressive video diffusion models. It predicts keys and values across cache layers using block‑diagonal‑plus‑low‑rank (block‑DPLR) predictors, then quantizes only the residuals, offering a flexible trade‑off between fidelity and memory usage. In extensive tests on HY‑WorldPlay and MAGI‑1, the reusable configuration outperforms QVG‑4 by up to 4.95 dB PSNR while reducing cache memory by 37–48 %, and the video‑adapted configuration surpasses QVG‑Pro by 3.77 dB PSNR with 33.7 % less memory, all while maintaining comparable latency and reducing temporal discontinuities.

By Albert Ge, Akash Haridas, Utkarsh Saxena, Ruijing Yang, Ian Colbert, Frederic Sala, Vikram Appia, Emad Barsoum
arXiv AI
Jun 12

TetherCache: Stabilizing Autoregressive Long-Form Video Generation with Gated Recall and Trusted Alignment

arXiv:2606. 13035v1 Announce Type: cross Abstract: Autoregressive video diffusion models provide a natural formulation for streaming and variable-length video generation by conditioning newly generated frames on previously generated content.

By Yu Meng, Xiangyang Luo, Letian Li, Wenyuan Jiang, Chen Gao, Xinlei Chen, Yong Li, Xiao-Ping Zhang
Hugging Face Trending Papers
Jun 11

TetherCache: Stabilizing Autoregressive Long-Form Video Generation with Gated Recall and Trusted Alignment

Autoregressive video diffusion models provide a natural formulation for streaming and variable-length video generation by conditioning newly generated frames on previously generated content. However, extending these models to minute-level generation remains challenging: the limited KV-cache budget prevents the model from retaining the full history, while repeatedly conditioning on self-generated frames induces a context distribution shift that accumulates over time, leading to visual artifacts, quality degradation, and temporal drift.