arXiv Computer Vision

ResGVC: Residual Coding for High-fidelity Generative Video Compression

ResGVC introduces a residual coding framework for generative video compression that transmits residual signals to guide denoising directly in pixel space. The method encodes original frames with a learned video codec, decomposes the reconstruction error into residual segments at each denoising step, and compresses these segments using a residual codec powered by a diffusion transformer entropy model. Compared to prior state‑of‑the‑art methods, ResGVC achieves significant BD‑rate reductions—63.7% for LPIPS and 83.8% for PSNR—while delivering superior visual quality.

Hugging Face Trending Papers
Jul 8

DiffCVE: Diffusion-based Compressed Video Enhancement

Perceptual quality enhancement of severely compressed videos remains challenging due to complex artifact patterns and substantial information loss. Recent diffusion models have demonstrated strong generative capability for visual restoration, but directly applying them to compressed video often ignores compression degradation characteristics and may introduce structure-inconsistent hallucinations.

Hugging Face Trending Papers
Aug 12

Generative Video Compression Based on Hierarchical Referencing

Diffusion-based generative video compression has emerged as a promising paradigm to improve perceptual quality, where latent frames are required to be encoded efficiently while serving as denoising conditions. However, existing methods neither carefully design reference and quality structures during latent coding nor account for the impact of frame-level quality variation on denoising procedure, which limits coding efficiency and aggravates artifact propagation during generative reconstruction.

arXiv Computer Vision
Sep 22

Dense-Prior-Guided Generative Video Compression

arXiv:2604.06655v2 Announce Type: replace Abstract: Diffusion-based generative video compression offers a promising paradigm for low-bitrate reconstruction, but existing keyframe-based controllable a...

By Ding Ding, Daowen Li, Yixin Gao, Ruixiao Dong, Kai Li, Ying Chen, Li Li
arXiv Machine Learning
Sep 24

Advances in Diffusion-Based Generative Compression

This article reviews recent diffusion‑based methods for generative lossy image compression, highlighting how these techniques encode a source into an embedding and use a diffusion model to iteratively refine the reconstruction during decoding. It discusses the role of auxiliary entropy models for transmitting the embedding, explores the use of diffusion models for information transmission via channel simulation, and frames the discussion within rate‑distortion‑perception theory, common randomness, and inverse‑problem connections. The review also identifies open challenges in the field.

By Yibo Yang, Stephan Mandt
arXiv Computer Vision
Oct 12

Unified Generative Video Compression with Autoregressive and Bidirectional Video Diffusion

The paper introduces UniGVC, a unified generative video codec that supports both low‑delay streaming and high‑quality playback from a single bitstream. It offers two decoding modes: UniGVC‑BI, a bidirectional diffusion model with dense attention for quality‑oriented random‑access decoding, and UniGVC‑AR, a windowed autoregressive diffusion model for low‑delay streaming. Both modes share a hierarchical latent codec that produces ultra‑low‑bitrate conditions, enabling the BI model to act as a teacher for distilling the AR model, while a lightweight conditional decoder further reduces streaming latency.

By Tianyu Zhang, Shuai Huo, Dengchao Jin, Hewei Liu, Meng Lei, Tianwen Wu, Jiawen Gu, Chao Zhou, Li Li, Dong Liu