arXiv Computer Vision

Reference-Efficient Multimodal Bitstream-Corrupted Video Recovery via Depth-Conditioned Adaptation

arXiv AI
Sep 18

Perceptual Refinement of an End-to-End Video Streaming Pipeline via Generative AI Layers

The paper introduces PRESLEY, an end‑to‑end video streaming pipeline that uses generative AI layers to selectively degrade and restore less important regions of a frame. By replacing destructive block removal with adaptive in‑place degradation and signaling block strength via a side channel, PRESLEY achieves significant bitrate savings and improved background quality compared to its predecessor and pristine baselines. The authors also analyze the theoretical headroom of this architecture, quantifying remaining cost‑axis headroom and modeling post‑restoration damage to guide future rate‑distortion‑restoration selection.

By Emanuele Artioli, Farzad Tashtarian, Christian Timmerer
arXiv Computer Vision
Oct 12

Unified Generative Video Compression with Autoregressive and Bidirectional Video Diffusion

The paper introduces UniGVC, a unified generative video codec that supports both low‑delay streaming and high‑quality playback from a single bitstream. It offers two decoding modes: UniGVC‑BI, a bidirectional diffusion model with dense attention for quality‑oriented random‑access decoding, and UniGVC‑AR, a windowed autoregressive diffusion model for low‑delay streaming. Both modes share a hierarchical latent codec that produces ultra‑low‑bitrate conditions, enabling the BI model to act as a teacher for distilling the AR model, while a lightweight conditional decoder further reduces streaming latency.

By Tianyu Zhang, Shuai Huo, Dengchao Jin, Hewei Liu, Meng Lei, Tianwen Wu, Jiawen Gu, Chao Zhou, Li Li, Dong Liu
arXiv Computer Vision
Aug 31

LayerRecall: A State-Conditioned Memory Router for Long-Horizon Consistency in Video Generation

LayerRecall is a memory router for autoregressive video diffusion that selectively retrieves and injects historical key/value states into specific layers of the model, based on the current context. It addresses the problem that existing memory mechanisms expose nonlocal history but do not guarantee effective use, by recognizing that different layers prefer current, recent, or distant context. The method, combined with Cross‑Horizon Prediction Matching, achieves state‑of‑the‑art long‑range consistency on MemoBench and MovieBench while maintaining local continuity and incurring negligible inference overhead.

By Yixuan Ding, Jiahao Kong, Wei Huang, Ruijie Quan, Yi Yang
arXiv Computer Vision
Oct 16

ResStreamGS: Residual-Sensitive Dual-Stream Gaussian Splatting for Mobile Volumetric Video Streaming

ResStreamGS introduces a residual‑sensitive dual‑stream framework for mobile volumetric video streaming that distinguishes temporally stable Gaussians from residual‑sensitive ones. Stable Gaussians are transmitted once per Group of Pictures, while only the residual‑sensitive Gaussians are included in the frame‑wise video stream, reducing bandwidth usage. Experiments on complex full‑scene videos show a 7.51–8.35 dB PSNR improvement over a V³‑style baseline, a payload reduction of up to 56.5%, and real‑time performance of 30.883 FPS on a Qualcomm Snapdragon 778G.

By Haoran Liu, Di Wu, Wang Luo, Hengyuan Na, Miao Hu, Guocong Quan
arXiv Computer Vision
Sep 28

From Mono to Stereo: Accelerating Binocular Gaussian Splatting via Reprojection and Selective Patching

The paper introduces a 2D Gaussian Splatting pipeline that renders a dominant-eye RGB image and depth proxy, then reprojects and selectively patches the affiliated eye to reduce redundant work. By reusing alpha-blending weights and generating adaptive regions of interest, the method cuts sequential binocular rendering time by 15.5% to 28.8% and GPU memory by 6% to 11% on several datasets, with minimal quality loss. It demonstrates a practical efficiency‑quality trade‑off for static‑scene stereo rendering and suggests further evaluation on dynamic scenes and VR hardware.

By Hongfei Zhu, Ling Zhou