arXiv Computer Vision

ForcingBooster: Adaptive Patch-wise Denoising for Fast Autoregressive Video Diffusion

ForcingBooster is a framework that adaptively allocates denoising steps to individual video patches in autoregressive diffusion models, allowing easy patches to stop early while difficult patches receive more refinement. This dynamic scheduling reduces the total number of denoising steps by about 50% and improves generation efficiency with negligible quality loss. The method requires only a lightweight routing module and works with most existing few‑step autoregressive diffusion models.

arXiv AI
Aug 18

Equilibrium Forcing: Adaptive Video Generation Without Noise Conditioning

arXiv:2608. 14706v1 Announce Type: cross Abstract: Standard autoregressive video generation algorithms based on Diffusion and Flow Matching rely on rigid training objectives and static sampling schedules, limiting inference procedures from adapting to the data.

By Hansen Jin Lillemark, Alex Rojas, Zachary Novack, Runqian Wang, Yilun Du, Yian Ma, Taylor Berg-Kirkpatrick, Rose Yu
arXiv Computer Vision
3d ago

FilterFusion: Prior-Guided Adaptive Filter Fusion for Efficient Video Denoising

FilterFusion is a lightweight video denoising framework that blends temporally-aware learned features with a small bank of classical denoising filters. It uses a low-cost guidance signal to adaptively mix filter responses at the original resolution, achieving high quality on real sensor noise datasets while keeping the model to only 109K parameters. The approach delivers real‑time performance (55.9 FPS on a single CPU thread) and outperforms lightweight CNN baselines by a large margin in both speed and efficiency.

By Wenlong Yang, Weihang Yuan, Canran Jin, Jiahao Li, Henrik Turbell, Lifeng Sun
arXiv Computer Vision
Sep 30

FastVR: Efficient Streaming Video Restoration with One-Step Diffusion

FastVR is a streaming video restoration framework that uses a one‑step diffusion model to achieve strong restoration quality and temporal consistency while processing 1080p video at 11 FPS on a single H20 GPU. It addresses efficiency bottlenecks by combining a lightweight VAE with chunk‑wise causal attention, and improves inference speed and restoration quality through velocity consistency regularization and continuous trajectory learning during training. Experiments demonstrate that FastVR outperforms diffusion baselines in efficiency and achieves state‑of‑the‑art performance on both synthetic and real‑world benchmarks.

By Xiaoxu Chen, Qin Yang, Haoran Bai, Sibin Deng, Ying Chen
arXiv Computer Vision
3d ago

Dynamic Video Generation: Shaping Video Generation Across Time and Space

The paper introduces DVG, a Dynamic Video Generation framework that allocates computation across time and space to accelerate diffusion-based video generation. By selecting content-aware acceleration strategies automatically, DVG achieves near-lossless speedups—up to 7× on HunyuanVideo models and 18× when combined with distillation—without manual tuning or retraining. The authors provide code on GitHub for reproducibility.

By Shikang Zheng, Jingkai Huang, Jiacheng Liu, Guantao Chen, Lixuan, Yuqi Lin, Peiliang Cai, Linfeng Zhang
arXiv Computer Vision
Aug 31

Manifold4D: Denoising on Point Cloud Rendered Manifolds for Video Re-shooting

Manifold4D introduces a new denoising strategy for video re‑shooting that injects a rendered point‑cloud directly into the initial noise manifold, eliminating the need for the render to be an explicit conditioning stream during denoising. This approach allows the network to rely solely on the source video as a visual condition, improving camera‑control accuracy on the DAVIS‑Traj benchmark and Vista4D set, with significant reductions in rotation and translation errors while maintaining video fidelity. User studies confirm enhanced trajectory following and dynamic consistency, especially for large yaw amplitudes and even when the render is corrupted.

By Yongqi Mao, Zijia Dai, Zhishuo Liu, Wei Xu, Kaiwei Wang, Guotao Meng
arXiv Computer Vision
Oct 8

MORCA: Offline-to-Online Reinforcement Learning for Adaptive Cache Reuse in Video Diffusion Acceleration

arXiv:2610.10457v1 Announce Type: new Abstract: Diffusion Transformers (DiTs) achieve remarkable performance in video synthesis, but their iterative denoising process suffers from high inference late...

By Yuxiang Xiong, Ruiyan Wang, Wenqiang Wang, Teng Hu, Songhang Shen, Bohao Feng, Hongqian Deng, Ran Yi