arXiv AI By Tiancheng Si, Wenlong Xu, Dahua Gao

Neural Image Compression with Internal-External Prior Fusion and Alignment

Read the original on arXiv AI →

The paper introduces Neural Image Compression with Internal-External Prior Fusion and Alignment (IE-PFA), a context model that combines internal priors from the current image with an external dictionary shared by encoder and decoder. It employs a RWKV-based Spatial-Channel Prior Fusion (RSCPF) module for efficient fusion and a Self-Distilled Prior Alignment (SDPA) mechanism for alignment during training. The model supports variable-rate coding across 64 quality levels, achieves a 21.65% BD-Rate saving over VTM-22.0-Intra, uses only 29.9M parameters, and offers fast encoding (61 ms) and decoding (52 ms) speeds.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv Computer Vision
Sep 16

tcnerv:dual-domain temporal context modeling for implicit neural video compression

TCNeRV is a new implicit neural video compression method that models temporal context in both feature and embedding domains. Its multi‑scale temporal‑context fusion module injects gated historical features across decoder scales, while temporal embedding‑residual coding predicts and encodes only the residual of each content embedding. With about 3 million parameters, TCNeRV achieves an average PSNR of 36.08 dB on the UVG dataset, outperforming HNeRV‑Boost by 2.20 dB and reducing BD‑rate by 22.06%, 66.73%, and 29.85% relative to HM, DCVC, and HiNeRV respectively.

By Xuezhi Xiang, Yixin Zhao, Heqi Xiang, Jiayao Liu, Shanjun Zhang
arXiv AI
Sep 4

Neural Video Compression Based on Deformable Temporal Alignment and Difference-aware Fusion

The paper introduces a neural video compression approach that combines deformable temporal alignment with difference-aware spatial selective fusion. A Context-aware Temporal Alignment Module generates complementary temporal context, while a Difference-aware Spatial Selective Fusion module adaptively selects reliable temporal information and suppresses misalignment. Experiments demonstrate that this method improves rate-distortion performance compared to DCVC-DC.

By Chuyue Shan, Songlin Sun, Wang Chenwei, Shen Zihan
arXiv Computer Vision
Sep 28

FuseReg: Regularizing Layer Fusion Mitigates the Reconstruction-Generation Gap in Representation Autoencoders

arXiv:2609.31620v1 Announce Type: new Abstract: Representation autoencoders (RAEs) reuse features from a pretrained visual encoder as reconstruction and diffusion latents, integrating strong visual r...

By Hongyang Du, Yunfei Xie, Junjie Ye, Jiawei Yang, Xiaoyan Cong, Haodong Zhang, Yongchao Huang, Haiyu Wu, Zongxia Li, Shihang Gui, Dawei Liu, Runhao Li, Jingcheng Ni, Chen Wei, Randall Balestriero, Yue Wang
Hugging Face Trending Papers
Aug 3

CRAFT: Compression via Recursive Adaptive Fusion of Video Tokens for Vision-Language Models

In video understanding, vision-language models (VLMs) must ingest massive numbers of visual tokens, causing the computational and memory cost of the prefill stage to rise sharply. Such visual sequences are highly redundant along the spatio-temporal dimension, yet a high compression ratio is often accompanied by the loss of critical details.

Hugging Face Trending Papers
Sep 3

Neural Video Compression Based on Deformable Temporal Alignment and Difference-aware Fusion

The paper introduces a neural video compression technique that improves temporal context quality by combining deformable temporal alignment with difference‑aware spatial selective fusion. A Context‑aware Temporal Alignment Module generates complementary temporal context, while a Difference‑aware Spatial Selective Fusion module adaptively selects reliable temporal information and suppresses misalignment. Experiments demonstrate that this approach yields better rate‑distortion performance compared to DCVC‑DC.