arXiv Computer Vision

ResARC: Residual-Aware AutoRegressive Coding for Ultra-Low Bitrate Image Compression

arXiv Computer Vision
Oct 23

ResGVC: Residual Coding for High-fidelity Generative Video Compression

ResGVC introduces a residual coding framework for generative video compression that transmits residual signals to guide denoising directly in pixel space. The method encodes original frames with a learned video codec, decomposes the reconstruction error into residual segments at each denoising step, and compresses these segments using a residual codec powered by a diffusion transformer entropy model. Compared to prior state‑of‑the‑art methods, ResGVC achieves significant BD‑rate reductions—63.7% for LPIPS and 83.8% for PSNR—while delivering superior visual quality.

By Ding Ding, Daowen Li, Ying Chen, Kai Li
arXiv Computer Vision
Oct 1

Rethinking Generative Image Compression at Extremely Low Bitrates

The paper introduces RAE-CoD, a diffusion-based compression method that operates in a representation autoencoder space to preserve recognizable content even at extremely low bitrates. It addresses the problem of semantic collapse observed in existing codecs when the bitrate approaches zero, showing that reconstruction losses conflict with semantic objectives and that VAE diffusion models lose efficiency in preserving semantics. Experiments on MSCOCO-30K demonstrate that RAE-CoD outperforms competitors, reducing VFM feature MSE and Fréchet Distance ratios by at least 25.7% and 69.1% at 0.001–0.008 bpp while maintaining stable recognizability and quality.

By Tianyu Zhang, Zhaoyang Jia, Houqiang Li, Dong Liu
arXiv Computer Vision
Oct 12

Unified Generative Video Compression with Autoregressive and Bidirectional Video Diffusion

The paper introduces UniGVC, a unified generative video codec that supports both low‑delay streaming and high‑quality playback from a single bitstream. It offers two decoding modes: UniGVC‑BI, a bidirectional diffusion model with dense attention for quality‑oriented random‑access decoding, and UniGVC‑AR, a windowed autoregressive diffusion model for low‑delay streaming. Both modes share a hierarchical latent codec that produces ultra‑low‑bitrate conditions, enabling the BI model to act as a teacher for distilling the AR model, while a lightweight conditional decoder further reduces streaming latency.

By Tianyu Zhang, Shuai Huo, Dengchao Jin, Hewei Liu, Meng Lei, Tianwen Wu, Jiawen Gu, Chao Zhou, Li Li, Dong Liu
arXiv Computer Vision
6d ago

When to Start Denoising? Adaptive Denoising Entry for Generative Video Compression

The paper introduces ADE-GVC, a generative video compression framework that adaptively selects the denoising start timestep in diffusion models to balance reconstruction fidelity and perceptual realism. It uses a lightweight predictor to estimate the optimal start point from compressed latents and a temporal adapter to inject compression-aware conditions into a pretrained diffusion model. Experiments show ADE‑GVC outperforms existing methods, achieving significant bitrate savings and improved perceptual quality.

By Zifu Zhang, Yuqiao Li, Ding Ding, Shengxi Li, Mai Xu, Daowen Li, Kai Li, Ying Chen