The paper introduces DVG, a Dynamic Video Generation framework that allocates computation across time and space to accelerate diffusion-based video generation. By selecting content-aware acceleration strategies automatically, DVG achieves near-lossless speedups—up to 7× on HunyuanVideo models and 18× when combined with distillation—without manual tuning or retraining. The authors provide code on GitHub for reproducibility.
By Shikang Zheng, Jingkai Huang, Jiacheng Liu, Guantao Chen, Lixuan, Yuqi Lin, Peiliang Cai, Linfeng Zhang
arXiv:2605.25801v2 Announce Type: replace
Abstract: High-resolution video generation faces a coupled bottleneck of optimization instability and prohibitive computational costs. The massive expansion...
By Wenxue Li, Jingjing Ren, Peng Zhang, Tian Ye, Daiguo Zhou, Jian Luan, Xinhu Zheng, Gang Hua, Lei Zhu
NeuralSRender is a sim‑to‑real video translation framework that improves the photorealism of synthetic driving videos while preserving geometric consistency. It builds on a pretrained video diffusion transformer and uses a lightweight projector to inject G‑buffer geometric and material priors, with LoRA for efficient adaptation. The two‑stage training first learns G‑buffer conditioning from synthetic data, then adapts to real‑world appearance, adding only 1.45 % parameter overhead and requiring 24 GB GPU memory. The authors also release GenReal, a large‑scale dataset of synthetic and real driving videos with G‑buffers, and show that training perception models on NeuralSRender‑translated videos boosts detection AP₅₀ on nuImages from 35.1 to 40.6 and segmentation mIoU on Cityscapes from 32.4 to 40.8.
By Yipeng Lu, Youqi Liao, Zhenyu Wang, Yuning Peng, Zhen Dong
arXiv:2410.13925v2 Announce Type: replace
Abstract: \textit{Nature is infinitely resolution-free}. In the context of this reality, existing diffusion models, such as Diffusion Transformers, often fac...
By ZiDong Wang, Zeyu Lu, Di Huang, Cai Zhou, Xiaoyu Yue, Wanli Ouyang, and Lei Bai
arXiv:2605.12957v2 Announce Type: replace
Abstract: Recent developments in generative models and large-scale datasets have substantially advanced 3D world generation, facilitating a broad range of do...
By Hanxin Zhu, Cong Wang, Peiyan Tu, Jiayi Luo, Tianyu He, Xin Jin, Zhibo Chen
arXiv:2606. 09056v1 Announce Type: cross Abstract: Video generative models have become increasingly powerful, but long-range consistency remains challenging to achieve because even a few dozen frames require impractically long transformer sequence lengths.
By Ishaan Preetam Chandratreya, David Charatan, Basile Van Hoorick, Sergey Zakharov, Vitor Guizilini, Phillip Isola, Vincent Sitzmann
arXiv:2506. 10915v2 Announce Type: replace-cross Abstract: Text-to-video generation has significantly enriched content creation and holds the potential to evolve into powerful world simulators.
By Jiancheng Huang, Gengwei Zhang, Zequn Jie, Siyu Jiao, Yinlong Qian, Ling Chen, Yunchao Wei, Lin Ma
arXiv:2606. 23743v1 Announce Type: cross Abstract: Modern video diffusion models achieve higher generation quality through scaling, but this also increases inference cost.
By Yitong Li, Junsong Chen, Haopeng Li, Haozhe Liu, Jincheng Yu, Ligeng Zhu, Ping Luo, Song Han, Enze Xie
Latent video generation relies on autoencoders to define a compact space in which generative models operate. Although video autoencoder architectures have evolved substantially, their latent spaces are still optimized primarily for pixel-level reconstruction and provide limited high-level semantic organization.
arXiv:2608.23549v1 Announce Type: new
Abstract: Rendering views using 3D scene representations such as Gaussian Splatting (3DGS), Neural Radiance Fields (NeRF), meshes, or even point clouds produces...
By Khiem Vuong, Deva Ramanan, Srinivasa Narasimhan
SpatialCrafter introduces a two‑stage framework for single‑image world modeling that first generates a global 3D proxy using a Point‑anchored Sparse Structure Flow module, then refines appearance with a Generative Deferred Refiner built on a video diffusion model. The method incorporates Parallel Geometry Injection and Proxy‑Aware Corruption training to integrate the proxy without disrupting the pretrained generative manifold, and it is evaluated on a newly constructed dataset of 115K scenes. Experiments demonstrate that SpatialCrafter outperforms existing approaches, reducing long‑term drift and maintaining consistency under rapid camera motion and extreme viewpoints.
By Chuan Fang, Lingteng Qiu, Yixun Liang, Rui Chen, Kunming Luo, Zhaohua Zheng, Tongyuan Bai, Feipeng Tian, Zilong Dong, Zihan Zhou, Ping Tan
Swift-Image is a compact unified model that performs text-to-image generation, single-image editing, and multi-image editing using a 6B parameter DiT architecture. It employs a progressive training pipeline, parallel expert reinforcement learning, and multi-teacher distillation to balance diverse objectives, while a Prompt Enhancer decouples high-level reasoning from pixel-level rendering. After training, structural pruning and few-step distillation produce efficient 3B and accelerated variants that maintain near‑lossless performance and improve editing efficiency.
By Taihang Hu, Zhao Wang, Zuan Gao, Tao Liu, Hao Yan, Zhengze Xu, Yuhang Yu, Yongchao Du, Xingjian Wang, Jun Zheng, Qinye Zhou, Yaqi Cai, Zhengrui Chen, Chao Lin, Yefeng Shen, Yuan Wang, Zhengtao Wu, Ge Wu, Xiaoli Xu, Denghui Yang, Huayu Zhang, Mingzhou Zhang, Mengting Chen