arXiv Computer Vision

RelayVSR: Large-Small Model Collaboration for Efficient Real-World Video Super-Resolution

RelayVSR introduces a streaming video super‑resolution framework that combines a large generative model, which produces reference latents for sparse keyframes, with a lightweight Dual‑Memory Video Transformer that super‑resolves every frame using these references and low‑resolution input. The method employs Video‑Aware Reference Optimization (VARO), a reinforcement‑learning strategy that optimizes both system‑level video quality and reference‑level keyframe fidelity, outperforming direct joint training. On 1080p video, RelayVSR achieves 29.29 FPS with modest GPU memory usage, significantly faster and more efficient than the FlashVSR‑Tiny baseline.

arXiv Computer Vision
Oct 12

High-Throughput Generative Video Super-Resolution on a Single Consumer GPU

The paper presents a zero‑shot framework for high‑throughput generative video super‑resolution (VSR) that operates on a single high‑end consumer GPU without retraining. It decouples spatial upscaling, handled by a time‑distilled one‑step diffusion backbone, from temporal stabilization, achieved with a lightweight pretrained flow‑based interpolator. A resolution‑aware hybrid attention scheme replaces high‑resolution global attention with neighborhood attention to improve scalability, achieving up to ~32 FPS at 720p and a 44% speedup at 4K on an NVIDIA RTX 4090, while maintaining competitive perceptual quality and temporal consistency on standard VSR benchmarks.

By Georgios Panaretou, Sotirios Chatzis
arXiv Machine Learning
Sep 24

ScoutNeRV: Rapid Encoding of Grid-Based Video INRs via ScoutNet

ScoutNeRV introduces a content‑adaptive initialization framework that speeds up the training of hierarchical grid‑based video implicit neural representations (INRs). By using a lightweight scout network to select a pre‑trained expert from a memory bank, the method transfers the expert’s grid and decoder parameters to a target HiNeRV model, achieving a 21.25 dB PSNR boost before fine‑tuning and reaching near‑baseline performance after only 37 epochs. The approach delivers a 9.25× wall‑clock speedup while maintaining competitive rate–distortion performance.

By Naser Alizada, Farhang Baghban, Hashem Pishkar, Ali Mousavi
arXiv Computer Vision
Oct 12

Unified Generative Video Compression with Autoregressive and Bidirectional Video Diffusion

The paper introduces UniGVC, a unified generative video codec that supports both low‑delay streaming and high‑quality playback from a single bitstream. It offers two decoding modes: UniGVC‑BI, a bidirectional diffusion model with dense attention for quality‑oriented random‑access decoding, and UniGVC‑AR, a windowed autoregressive diffusion model for low‑delay streaming. Both modes share a hierarchical latent codec that produces ultra‑low‑bitrate conditions, enabling the BI model to act as a teacher for distilling the AR model, while a lightweight conditional decoder further reduces streaming latency.

By Tianyu Zhang, Shuai Huo, Dengchao Jin, Hewei Liu, Meng Lei, Tianwen Wu, Jiawen Gu, Chao Zhou, Li Li, Dong Liu
arXiv AI
Oct 15

FlashVSR+: Efficient Video Super-Resolution via Hybrid Attention and Reward-Yield Distribution Matching

arXiv:2610.17552v1 Announce Type: cross Abstract: Recent video super-resolution (VSR) models achieve efficient one-step generation through diffusion distillation. However, high-resolution inference r...

By Ruchang Yao, Shi Guo, Junhao Zhuang, Mingde Yao, Xin Cai, Jiahao Zhan, Bin Fu, Xinyuan Chen, Yu Qiao, Tianfan Xue
arXiv Computer Vision
Sep 3

Learning Zero-Shot Subject-Driven Video Generation Using 1% Compute

The paper introduces a zero‑shot subject‑driven video generation framework that eliminates the need for per‑subject tuning and large subject‑video datasets. It achieves this by separating identity injection—learned from subject‑image pairs—and motion‑awareness preservation—maintained with a small set of arbitrary videos, and optimizes both with stochastic switching and dropout techniques. Using CogVideoX‑5B, the method adapts a single model with only 200K subject‑image pairs and 4,000 arbitrary videos in 288 A100 GPU hours, representing roughly 1% of the compute required by previous zero‑shot baselines while preserving subject fidelity and motion quality.

By Daneul Kim, Jingxu Zhang, Wonjoon Jin, Sunghyun Cho, Qi Dai, Jaesik Park, Chong Luo