arXiv Computer Vision

Keyframe-Centric State-Space Modeling for Burst Image Super-Resolution

arXiv Computer Vision
Oct 12

High-Throughput Generative Video Super-Resolution on a Single Consumer GPU

The paper presents a zero‑shot framework for high‑throughput generative video super‑resolution (VSR) that operates on a single high‑end consumer GPU without retraining. It decouples spatial upscaling, handled by a time‑distilled one‑step diffusion backbone, from temporal stabilization, achieved with a lightweight pretrained flow‑based interpolator. A resolution‑aware hybrid attention scheme replaces high‑resolution global attention with neighborhood attention to improve scalability, achieving up to ~32 FPS at 720p and a 44% speedup at 4K on an NVIDIA RTX 4090, while maintaining competitive perceptual quality and temporal consistency on standard VSR benchmarks.

By Georgios Panaretou, Sotirios Chatzis
arXiv Computer Vision
Sep 30

RelayVSR: Large-Small Model Collaboration for Efficient Real-World Video Super-Resolution

RelayVSR introduces a streaming video super‑resolution framework that combines a large generative model, which produces reference latents for sparse keyframes, with a lightweight Dual‑Memory Video Transformer that super‑resolves every frame using these references and low‑resolution input. The method employs Video‑Aware Reference Optimization (VARO), a reinforcement‑learning strategy that optimizes both system‑level video quality and reference‑level keyframe fidelity, outperforming direct joint training. On 1080p video, RelayVSR achieves 29.29 FPS with modest GPU memory usage, significantly faster and more efficient than the FlashVSR‑Tiny baseline.

By Xijun Wang, Xin Li, Zirui Lang, Suhang Yao, Haoran Li, Zhibo Chen
arXiv Computer Vision
Sep 4

ReCoSplat: Online Feed-Forward Gaussian Splatting via Render-and-Compare

ReCoSplat is an online feed‑forward Gaussian splatting model that can synthesize novel views from a stream of observations, handling both posed and unposed inputs and optionally using camera intrinsics. It introduces a Render‑and‑Compare module that renders the current scene from the viewpoint of the incoming observation and compares it to the observation, providing a stable conditioning signal to mitigate the mismatch caused by predicted camera poses. A hybrid KV‑cache compression strategy further reduces memory usage, enabling the model to process long sequences efficiently while achieving state‑of‑the‑art performance on online view synthesis tasks.

By Freeman Cheng, Botao Ye, Xueting Li, Junqi You, Fangneng Zhan, Ming-Hsuan Yang
arXiv Computer Vision
Sep 22

RegVGGT: Sustainable Visual Geometry Grounding for Streaming via Regulated Memory

arXiv:2609.23286v1 Announce Type: new Abstract: 3D reconstruction from a lengthy video stream input poses a dilemma for feed-forward reconstruction models (FFRMs), that a whole-stream inference conte...

By Hongbo Mao (Harbin Institute of Technology), Junjun Jiang (Harbin Institute of Technology), Youyu Chen (Harbin Institute of Technology), Jiaxin Zhang (Harbin Institute of Technology), Zhemeng Dong (Harbin Institute of Technology), Xianming Liu (Harbin Institute of Technology)