arXiv Computer Vision

ReMATF: Recurrent Motion-Adaptive Multi-scale Turbulence Mitigation for Dynamic Scenes

arXiv Computer Vision
Sep 21

S3VD: Semantic-Guidance Spatio-Temporal Scanning for Video Deraining

S3VD is a new video deraining framework that leverages semantic guidance and spatio‑temporal scanning to improve performance over existing State Space Models such as Mamba. It introduces a Multi‑Scale Semantic Fusion module that uses DINOv2 priors to preserve 2D spatial semantics, and a Spatio‑Temporal Scanning Fusion module that incorporates a Decoupled‑Gating Mamba layer to better model intra‑ and inter‑frame correlations. Experiments on video deraining benchmarks show that S3VD achieves state‑of‑the‑art results, improving PSNR by an average of 0.84 dB over Mamba‑based baselines.

By Kui Jiang, Yiang Chen, Yan Luo, Zhaocheng Yu, Junjun Jiang, Xianming Liu
arXiv Machine Learning
Aug 11

MotionCraft: Latent World Modeling with Sparse Attention for Visual Upscaling

arXiv:2608. 08553v1 Announce Type: cross Abstract: Video super-resolution (VSR) aims to recover high-fidelity high-resolution videos from low-resolution inputs and is central to applications ranging from mobile capture to streaming and archival restoration.

By Rong Fu, Chunlei Meng, Yangchen Zeng, Xiaowen Ma, Yongtai Liu, Wangyu Wu, Shuo Yin, Zijian Zhang, Sicheng Li, Yingrui Ji, Chenhao Wang, Simon Fong
arXiv Machine Learning
Jul 17

Online Neural Space Time Memory for Dynamic Novel View Synthesis

arXiv:2607. 15271v1 Announce Type: cross Abstract: Online novel view synthesis from multi-view streaming videos faces a fundamental trade-off: maintaining a persistent, long-horizon memory to reconstruct temporarily occluded regions while operating under strict real-time constraints.

By Baback Elmieh, Lynn Tsai, Zeman Li, Srinivas Kaza, Tiancheng Sun, Gabor Csapo, Ali Behrouz, Yuan Deng, Stephen Lombardi, Steven M. Seitz, Xuan Luo
arXiv Computer Vision
Oct 16

FilterFusion: Prior-Guided Adaptive Filter Fusion for Efficient Video Denoising

FilterFusion is a lightweight video denoising framework that blends temporally-aware learned features with a small bank of classical denoising filters. It uses a low-cost guidance signal to adaptively mix filter responses at the original resolution, achieving high quality on real sensor noise datasets while keeping the model to only 109K parameters. The approach delivers real‑time performance (55.9 FPS on a single CPU thread) and outperforms lightweight CNN baselines by a large margin in both speed and efficiency.

By Wenlong Yang, Weihang Yuan, Canran Jin, Jiahao Li, Henrik Turbell, Lifeng Sun
arXiv Computer Vision
Oct 23

WorldForge V2: Eliciting Camera-Trajectory Alignment in Video Diffusion Models

WorldForge V2 introduces a training‑free guidance framework that refines video diffusion outputs along a target camera path using warped references and optical‑flow‑identified latent channels for selective guidance. It employs a dual‑path strategy to correct artifacts, a v‑cache to reduce refinement cost, and Trajectory LoRA adapters trained in two stages to focus on trajectory‑responsive network blocks. The approach achieves state‑of‑the‑art generation quality and trajectory accuracy with minimal training data, enabling reliable camera control across unseen scenes.

By Chenxi Song, Yanming Yang, Tong Zhao, Ruibo Li, Joey Tianyi Zhou, Chi Zhang