arXiv Computer Vision
Oct 16

Dynamic Video Generation: Shaping Video Generation Across Time and Space

The paper introduces DVG, a Dynamic Video Generation framework that allocates computation across time and space to accelerate diffusion-based video generation. By selecting content-aware acceleration strategies automatically, DVG achieves near-lossless speedups—up to 7× on HunyuanVideo models and 18× when combined with distillation—without manual tuning or retraining. The authors provide code on GitHub for reproducibility.

By Shikang Zheng, Jingkai Huang, Jiacheng Liu, Guantao Chen, Lixuan, Yuqi Lin, Peiliang Cai, Linfeng Zhang
arXiv Computer Vision
Oct 22

NeuralSRender: G-Buffer Guided Video Diffusion for Sim-to-Real Rendering

NeuralSRender is a sim‑to‑real video translation framework that improves the photorealism of synthetic driving videos while preserving geometric consistency. It builds on a pretrained video diffusion transformer and uses a lightweight projector to inject G‑buffer geometric and material priors, with LoRA for efficient adaptation. The two‑stage training first learns G‑buffer conditioning from synthetic data, then adapts to real‑world appearance, adding only 1.45 % parameter overhead and requiring 24 GB GPU memory. The authors also release GenReal, a large‑scale dataset of synthetic and real driving videos with G‑buffers, and show that training perception models on NeuralSRender‑translated videos boosts detection AP₅₀ on nuImages from 35.1 to 40.6 and segmentation mIoU on Cityscapes from 32.4 to 40.8.

By Yipeng Lu, Youqi Liao, Zhenyu Wang, Yuning Peng, Zhen Dong
arXiv Machine Learning
Jun 9

MilliVid: Hierarchical Latents for Long-Range Consistency in Video Generation

arXiv:2606. 09056v1 Announce Type: cross Abstract: Video generative models have become increasingly powerful, but long-range consistency remains challenging to achieve because even a few dozen frames require impractically long transformer sequence lengths.

By Ishaan Preetam Chandratreya, David Charatan, Basile Van Hoorick, Sergey Zakharov, Vitor Guizilini, Phillip Isola, Vincent Sitzmann