arXiv AI

GVCC: Zero-Shot Video Compression via Codebook-Driven Stochastic Rectified Flow

The paper introduces GVCC, a zero‑shot video compression framework that uses a pretrained generative video model as the decoder. GVCC transforms deterministic rectified‑flow samplers into stochastic processes, enabling the transmission of compressed information through per‑step stochastic innovations. The authors evaluate three GVCC variants—Text‑to‑Video, Image‑to‑Video, and First‑Last‑Frame‑to‑Video—on the UVG dataset, reporting perceptual, fidelity, and temporal metrics without claiming global rate‑distortion gains.

arXiv Computer Vision
Oct 12

Unified Generative Video Compression with Autoregressive and Bidirectional Video Diffusion

The paper introduces UniGVC, a unified generative video codec that supports both low‑delay streaming and high‑quality playback from a single bitstream. It offers two decoding modes: UniGVC‑BI, a bidirectional diffusion model with dense attention for quality‑oriented random‑access decoding, and UniGVC‑AR, a windowed autoregressive diffusion model for low‑delay streaming. Both modes share a hierarchical latent codec that produces ultra‑low‑bitrate conditions, enabling the BI model to act as a teacher for distilling the AR model, while a lightweight conditional decoder further reduces streaming latency.

By Tianyu Zhang, Shuai Huo, Dengchao Jin, Hewei Liu, Meng Lei, Tianwen Wu, Jiawen Gu, Chao Zhou, Li Li, Dong Liu
Hugging Face Trending Papers
Aug 13

V-RAE: Rethinking Video Latent Spaces for Generation

Latent video generation relies on autoencoders to define a compact space in which generative models operate. Although video autoencoder architectures have evolved substantially, their latent spaces are still optimized primarily for pixel-level reconstruction and provide limited high-level semantic organization.

arXiv AI
Sep 3

VoRTeC: Taming Foundation Flow for One-step Real time Video Compression

The paper introduces VoRTeC, a video compression framework that leverages a foundational flow model to encode latent video representations compactly and predict their positions along flow trajectories. By integrating multi‑scale priors and avoiding access to flow‑matching network parameters, VoRTeC achieves one‑step decoding with high perceptual fidelity, while maintaining temporal consistency through tail‑frame reuse and prior caching. Experiments show a 58% reduction in bit consumption compared to prior diffusion‑based methods and a decoding speed increase ranging from 3 to 197 times, reaching 13 FPS at 720p and 32 FPS at 480p.

By Yichong Xia, Qinhong Wu, Qinhong Wu, Jinpeng Wang, Zeyuan Chen, Haoqian Wang
arXiv Computer Vision
Oct 5

Active Sampling for Ultra-Low-Bit-Rate Video Compression via Conditional Controlled Diffusion

ActDiff-VC is a diffusion-based video compression framework designed for ultra‑low‑bitrate scenarios. It partitions videos into variable‑length segments, transmits keyframes only when necessary, and encodes temporal dynamics with a compact set of tracked point trajectories. Conditioned on these sparse signals, a conditional diffusion decoder reconstructs the remaining frames, achieving significant bitrate reductions and perceptual quality gains compared to strong learned codecs.

By Amirhosein Javadi, Shirin Saeedi Bidokhti, Tara Javidi
arXiv Computer Vision
6d ago

When to Start Denoising? Adaptive Denoising Entry for Generative Video Compression

The paper introduces ADE-GVC, a generative video compression framework that adaptively selects the denoising start timestep in diffusion models to balance reconstruction fidelity and perceptual realism. It uses a lightweight predictor to estimate the optimal start point from compressed latents and a temporal adapter to inject compression-aware conditions into a pretrained diffusion model. Experiments show ADE‑GVC outperforms existing methods, achieving significant bitrate savings and improved perceptual quality.

By Zifu Zhang, Yuqiao Li, Ding Ding, Shengxi Li, Mai Xu, Daowen Li, Kai Li, Ying Chen
arXiv Computer Vision
Nov 6

Training-Free Predictive Spatio-Temporal Token Pruning for Few-Step Autoregressive Video Diffusion

The paper introduces PreSTP, a training‑free method for speeding up few‑step autoregressive video diffusion models by pruning redundant tokens. It identifies two redundancy patterns—cross‑frame similarity from static content and cross‑step convergence during denoising—and uses early clean estimates from the model’s own trajectory to build a token‑wise redundancy mask. PreSTP achieves significant speedups (up to 3.20× for 5‑second videos and 1.96× for 30‑second videos) while maintaining or improving fidelity compared to existing caching baselines.

By Jia Li, Xurui Peng, Xing Wang, Hayden Kwok-Hay So
arXiv Computer Vision
Sep 3

Learning Zero-Shot Subject-Driven Video Generation Using 1% Compute

The paper introduces a zero‑shot subject‑driven video generation framework that eliminates the need for per‑subject tuning and large subject‑video datasets. It achieves this by separating identity injection—learned from subject‑image pairs—and motion‑awareness preservation—maintained with a small set of arbitrary videos, and optimizes both with stochastic switching and dropout techniques. Using CogVideoX‑5B, the method adapts a single model with only 200K subject‑image pairs and 4,000 arbitrary videos in 288 A100 GPU hours, representing roughly 1% of the compute required by previous zero‑shot baselines while preserving subject fidelity and motion quality.

By Daneul Kim, Jingxu Zhang, Wonjoon Jin, Sunghyun Cho, Qi Dai, Jaesik Park, Chong Luo