arXiv AI
Jul 24

RealVDeblur: One-Step Diffusion for Generalizable Real-World Video Deblurring

arXiv:2607. 20628v1 Announce Type: cross Abstract: Real-world video deblurring remains challenging due to diverse motion patterns, complex degradations, and the scarcity of realistic training data, yet robust restoration is critical for downstream pipelines such as mobile imaging and 3D reconstruction.

By Renbiao Jin, Mingxin Yang, Yutian Chen, Junhao Zhuang, Xin Cai, Mulin Yu, Linning Xu, Wenxian Yu, Danping Zou, Shi Guo, Tianfan Xue
arXiv Computer Vision
Oct 5

Event-guided Neural Video Compression

The paper introduces Event-guided Neural Video Codec (ENVC), a neural video compression method that incorporates event streams—capturing brightness changes between frames—into both motion and frame coding stages. By using event-guided motion priors and event-conditioned predictors, ENVC improves RGB compression efficiency, achieving significant BD-rate savings across six benchmarks. The authors also synthesize paired RGB-event data for training and demonstrate that the gains persist on large-motion sequences, highlighting events as a valuable complementary modality for video coding.

By Jiyun Kong, Jungwoo Kim, Enes Eray Demirtas, Touradj Ebrahimi, Jong-Seok Lee
arXiv Computer Vision
Oct 23

WorldForge V2: Eliciting Camera-Trajectory Alignment in Video Diffusion Models

WorldForge V2 introduces a training‑free guidance framework that refines video diffusion outputs along a target camera path using warped references and optical‑flow‑identified latent channels for selective guidance. It employs a dual‑path strategy to correct artifacts, a v‑cache to reduce refinement cost, and Trajectory LoRA adapters trained in two stages to focus on trajectory‑responsive network blocks. The approach achieves state‑of‑the‑art generation quality and trajectory accuracy with minimal training data, enabling reliable camera control across unseen scenes.

By Chenxi Song, Yanming Yang, Tong Zhao, Ruibo Li, Joey Tianyi Zhou, Chi Zhang
arXiv Machine Learning
Aug 7

Engram-E2VID: Reference-Based Event-to-Video Reconstruction via Generative Activation of Appearance Engrams

arXiv:2608. 05728v1 Announce Type: cross Abstract: Reference-based event-to-video reconstruction aims to recover target RGB frames from a reference frame and the event stream captured over the reference-to-target interval.

By Feiyu Ji, Xiang Li, Hao Ma, Tianxiang Huang, Qingxin Lu, Mengqi Ji, Lei Han, Xiaokang Yang, Xiaoyun Yuan
arXiv Computer Vision
Oct 22

NeuralSRender: G-Buffer Guided Video Diffusion for Sim-to-Real Rendering

NeuralSRender is a sim‑to‑real video translation framework that improves the photorealism of synthetic driving videos while preserving geometric consistency. It builds on a pretrained video diffusion transformer and uses a lightweight projector to inject G‑buffer geometric and material priors, with LoRA for efficient adaptation. The two‑stage training first learns G‑buffer conditioning from synthetic data, then adapts to real‑world appearance, adding only 1.45 % parameter overhead and requiring 24 GB GPU memory. The authors also release GenReal, a large‑scale dataset of synthetic and real driving videos with G‑buffers, and show that training perception models on NeuralSRender‑translated videos boosts detection AP₅₀ on nuImages from 35.1 to 40.6 and segmentation mIoU on Cityscapes from 32.4 to 40.8.

By Yipeng Lu, Youqi Liao, Zhenyu Wang, Yuning Peng, Zhen Dong