arXiv Computer Vision

Scalable Neural Video Representation Compression

Scalable Neural Video Representation Compression (S-NVRC) introduces a scalable implicit neural representation (INR) video codec that supports fine-grained bitrate and decoding‑complexity scalability from a single embedded bitstream. It uses a coarse‑to‑fine prefix for feature grids and a nested prefix for network layers, enabling a wide range of operating points while maintaining a single encoding. On the UVG dataset, S‑NVRC outperforms SHM 12.4 and multi‑layer VTM‑20.0 by 43.7 % and 5.6 % in BD‑rate, respectively, and offers flexible complexity scalability.

arXiv AI
Sep 4

LRConv-NeRV: Low Rank Convolution for Efficient Neural Video Compression

LRConv-NeRV introduces low‑rank separable convolutions into the NeRV neural video decoder, replacing selected dense 3x3 layers to reduce computational load and memory usage. By applying low‑rank factorization progressively from the largest to earlier decoder stages, the method offers controllable trade‑offs between reconstruction quality and efficiency. Experiments show that applying LRConv only to the final decoder stage cuts decoder complexity by 68% and model size by 9.3% with negligible quality loss, while INT8 quantization preserves performance close to the dense baseline.

By Tamer Shanableh
arXiv Computer Vision
Sep 7

Multi-scale Image Representation Compression

The paper introduces MIRC, an overfitted image codec that quantizes and entropy‑codes all components—including latents, synthesis network, and entropy models—within a single end‑to‑end rate‑distortion framework inspired by NVRC. It adds a multi‑scale representation with cross‑stage parameter sharing to capture cross‑scale redundancy, yielding a 10.5 % BD‑rate saving over VVC on the CLIC2020 professional set. MIRC offers multiple configurations ranging from 1.2 to 2.9 kMAC per pixel, allowing decoding complexity to be tuned to deployment needs.

By Tianhao Peng, Ho Man Kwan, Fan Zhang, Shan Liu, David Bull
Hugging Face Trending Papers
Sep 2

Multi-scale Image Representation Compression

The paper introduces MIRC, an overfitted image codec that quantizes all components—including latents, synthesis network, and entropy models—within a single rate‑distortion objective, following the neural video representation codec NVRC. It adds a multi‑scale representation with cross‑stage parameter sharing to capture cross‑scale redundancy, achieving a 10.5% BD‑rate saving over VVC on the CLIC2020 professional validation set. MIRC also offers configurable decoding complexity ranging from 1.2 to 2.9 kMAC per pixel, allowing deployment to match specific resource budgets.

arXiv Computer Vision
Oct 12

Unified Generative Video Compression with Autoregressive and Bidirectional Video Diffusion

The paper introduces UniGVC, a unified generative video codec that supports both low‑delay streaming and high‑quality playback from a single bitstream. It offers two decoding modes: UniGVC‑BI, a bidirectional diffusion model with dense attention for quality‑oriented random‑access decoding, and UniGVC‑AR, a windowed autoregressive diffusion model for low‑delay streaming. Both modes share a hierarchical latent codec that produces ultra‑low‑bitrate conditions, enabling the BI model to act as a teacher for distilling the AR model, while a lightweight conditional decoder further reduces streaming latency.

By Tianyu Zhang, Shuai Huo, Dengchao Jin, Hewei Liu, Meng Lei, Tianwen Wu, Jiawen Gu, Chao Zhou, Li Li, Dong Liu
arXiv Machine Learning
Sep 24

ScoutNeRV: Rapid Encoding of Grid-Based Video INRs via ScoutNet

ScoutNeRV introduces a content‑adaptive initialization framework that speeds up the training of hierarchical grid‑based video implicit neural representations (INRs). By using a lightweight scout network to select a pre‑trained expert from a memory bank, the method transfers the expert’s grid and decoder parameters to a target HiNeRV model, achieving a 21.25 dB PSNR boost before fine‑tuning and reaching near‑baseline performance after only 37 epochs. The approach delivers a 9.25× wall‑clock speedup while maintaining competitive rate–distortion performance.

By Naser Alizada, Farhang Baghban, Hashem Pishkar, Ali Mousavi
arXiv AI
Sep 2

Can LLMs Design Video Coding Tools? A Case Study on Planar Mode

The paper investigates whether large language models (LLMs) can design video coding tools, focusing on the Planar mode used in video coding standards. Using a generation-and-evaluation loop, the LLM generates new Planar predictors, which are then tested in the Fraunhofer Versatile Video Encoder (VVenC) and the Enhanced Compression Model (ECM). Results show that the LLM-generated mode can outperform the conventional Planar mode, achieving a 0.18% bitrate saving with a 0.4% complexity increase, and that similar gains are possible when integrating the new predictor into ECM under low‑resolution settings.

By Yingwen Zhang, Meng Wang, Liqiang He, Shiqi Wang
arXiv Computer Vision
Sep 16

tcnerv:dual-domain temporal context modeling for implicit neural video compression

TCNeRV is a new implicit neural video compression method that models temporal context in both feature and embedding domains. Its multi‑scale temporal‑context fusion module injects gated historical features across decoder scales, while temporal embedding‑residual coding predicts and encodes only the residual of each content embedding. With about 3 million parameters, TCNeRV achieves an average PSNR of 36.08 dB on the UVG dataset, outperforming HNeRV‑Boost by 2.20 dB and reducing BD‑rate by 22.06%, 66.73%, and 29.85% relative to HM, DCVC, and HiNeRV respectively.

By Xuezhi Xiang, Yixin Zhao, Heqi Xiang, Jiayao Liu, Shanjun Zhang
arXiv Computer Vision
Sep 23

COVER: Codec-Robust Video Watermarking with Generative Video Priors

COVER is a new video watermarking method that targets codec compression as its primary design goal. It embeds the watermark payload in the latent space of a frozen generative video autoencoder and recovers it by re‑encoding the received video into the same latent space. Using a differentiable codec surrogate bank, COVER achieves high bit accuracy across multiple codecs while keeping marked videos visually close to the originals.

By Yuxin Cao, Hao Yang, Ziqi Ding, Jie Hao, Wei Song