arXiv Computer Vision

Lossy Event Compression: From Event Stream Distortion to Task Performance

arXiv Computer Vision
Oct 5

Event-guided Neural Video Compression

The paper introduces Event-guided Neural Video Codec (ENVC), a neural video compression method that incorporates event streams—capturing brightness changes between frames—into both motion and frame coding stages. By using event-guided motion priors and event-conditioned predictors, ENVC improves RGB compression efficiency, achieving significant BD-rate savings across six benchmarks. The authors also synthesize paired RGB-event data for training and demonstrate that the gains persist on large-motion sequences, highlighting events as a valuable complementary modality for video coding.

By Jiyun Kong, Jungwoo Kim, Enes Eray Demirtas, Touradj Ebrahimi, Jong-Seok Lee
arXiv AI
Sep 28

GVCC: Zero-Shot Video Compression via Codebook-Driven Stochastic Rectified Flow

The paper introduces GVCC, a zero‑shot video compression framework that uses a pretrained generative video model as the decoder. GVCC transforms deterministic rectified‑flow samplers into stochastic processes, enabling the transmission of compressed information through per‑step stochastic innovations. The authors evaluate three GVCC variants—Text‑to‑Video, Image‑to‑Video, and First‑Last‑Frame‑to‑Video—on the UVG dataset, reporting perceptual, fidelity, and temporal metrics without claiming global rate‑distortion gains.

By Ziyue Zeng, Xun Su, Haoyuan Liu, Bingyu Lu, Yui Tatsumi, Hiroshi Watanabe
arXiv Computer Vision
Oct 12

Unified Generative Video Compression with Autoregressive and Bidirectional Video Diffusion

The paper introduces UniGVC, a unified generative video codec that supports both low‑delay streaming and high‑quality playback from a single bitstream. It offers two decoding modes: UniGVC‑BI, a bidirectional diffusion model with dense attention for quality‑oriented random‑access decoding, and UniGVC‑AR, a windowed autoregressive diffusion model for low‑delay streaming. Both modes share a hierarchical latent codec that produces ultra‑low‑bitrate conditions, enabling the BI model to act as a teacher for distilling the AR model, while a lightweight conditional decoder further reduces streaming latency.

By Tianyu Zhang, Shuai Huo, Dengchao Jin, Hewei Liu, Meng Lei, Tianwen Wu, Jiawen Gu, Chao Zhou, Li Li, Dong Liu
arXiv AI
Sep 17

GenStream: Semantic Streaming Framework for Generative Reconstruction of Human-centric Media

GenStream is a semantic streaming framework that replaces dense video frames with compact metadata—skeletal keypoints, camera parameters, and a static 3D background model—to enable generative reconstruction of human figures on the client side. By transmitting only structured information rather than full pixel data, it achieves over 99.9% bandwidth reduction compared to HEVC, as demonstrated on Olympic figure skating footage. The approach shifts computational load to the client and opens possibilities for volumetric avatar synthesis, multi‑view actor fusion, and personalized viewing experiences in a post‑codec era.

By Emanuele Artioli, Daniele Lorenzi, Shivi Vats, Farzad Tashtarian, Christian Timmerer
arXiv Computer Vision
Sep 7

Scalable Neural Video Representation Compression

Scalable Neural Video Representation Compression (S-NVRC) introduces a scalable implicit neural representation (INR) video codec that supports fine-grained bitrate and decoding‑complexity scalability from a single embedded bitstream. It uses a coarse‑to‑fine prefix for feature grids and a nested prefix for network layers, enabling a wide range of operating points while maintaining a single encoding. On the UVG dataset, S‑NVRC outperforms SHM 12.4 and multi‑layer VTM‑20.0 by 43.7 % and 5.6 % in BD‑rate, respectively, and offers flexible complexity scalability.

By Tianhao Peng, Ho Man Kwan, Fan Zhang, Shan Liu, David Bull