arXiv:2609.26425v1 Announce Type: new Abstract: KV cache memory has become a major deployment bottleneck for video generation and world models, which motivates low-bit quantization study for efficien...
CORAL-KV is a new framework for compressing the key‑value (KV) cache used by autoregressive video diffusion models. It predicts keys and values across cache layers using block‑diagonal‑plus‑low‑rank (block‑DPLR) predictors, then quantizes only the residuals, offering a flexible trade‑off between fidelity and memory usage. In extensive tests on HY‑WorldPlay and MAGI‑1, the reusable configuration outperforms QVG‑4 by up to 4.95 dB PSNR while reducing cache memory by 37–48 %, and the video‑adapted configuration surpasses QVG‑Pro by 3.77 dB PSNR with 33.7 % less memory, all while maintaining comparable latency and reducing temporal discontinuities.
arXiv:2610.32784v1 Announce Type: new Abstract: The rapid growth of video data has created an urgent need for efficient video understanding systems that can handle long and continuous visual inputs,...
arXiv:2605.19660v3 Announce Type: replace Abstract: The rapid advancement toward long-context reasoning and multi-modal intelligence has made the memory footprint of the Key-Value (KV) cache a domina...
arXiv:2611.06377v1 Announce Type: new Abstract: Autoregressive video models rely on historical key-value (KV) caches to preserve scene consistency over extended rollouts, making KV storage and repeat...
arXiv:2510. 04547v5 Announce Type: replace Abstract: Large pretrained vision encoders are central to multimodal intelligence, powering applications from on-device vision processing to vision-language models.
arXiv:2610.03027v1 Announce Type: cross Abstract: The key-value (KV) cache becomes a major memory bottleneck in long-context LLM inference, placing substantial pressure on memory capacity and bandwid...
arXiv:2606. 01790v1 Announce Type: cross Abstract: Vision-language-model-based graphical user interface (GUI) agents have shown broad automation capabilities, yet deployment is bottlenecked by a key-value (KV) cache that grows linearly with interaction steps.
The paper introduces D-Quant, a KV cache quantization framework that addresses the memory bottleneck of large language models by using a drift mechanism to convert entropy-coded representations into fixed-size bitstreams. This approach leverages the non-uniform distribution of KV cache values—after rotation and normalization, they approximate a normal distribution—allowing entropy coding to assign shorter codewords to frequent symbols while maintaining regular memory layouts suitable for parallel attention kernels. D-Quant thus aims to reduce memory footprint and bandwidth usage without sacrificing performance.
arXiv:2508.03351v3 Announce Type: replace-cross Abstract: Large language models (LLMs) have demonstrated remarkable capabilities across diverse language tasks, motivating their extension to vision-la...
arXiv:2606. 04620v1 Announce Type: cross Abstract: LLMs have become the state-of-the-art algorithms for solving NLP tasks.
arXiv:2606. 13035v1 Announce Type: cross Abstract: Autoregressive video diffusion models provide a natural formulation for streaming and variable-length video generation by conditioning newly generated frames on previously generated content.