The paper introduces Factor-Aware Predictive Learning (FAPL) to improve cinematic video generation by effectively leveraging multimodal large language model (MLLM) latents. FAPL trains a Video Diffusion Transformer (DiT) in three stages: grounding the DiT with frozen MLLM latents, enforcing factor-aware control through factor-span replacement, and optimizing temporal inference with limited-input representations while preserving full-observation reconstruction. Experiments show that FAPL outperforms baselines on sparse-to-video, factor-aware editing, and multi-shot generation tasks, demonstrating enhanced MLLM feature use, temporal control, and factor coordination.
arXiv:2610.22744v1 Announce Type: new
Abstract: Creative intent in video editing can be expressed through text instructions (e.g., "remove the people"), image references (e.g., subject appearance), v...
By Xiaoyan Cong, Tianyu Wang, Hyeonho Jeong, Zhifei Zhang, Yuqian Zhou, Yijun Li, Shaoteng Liu, Zhe Lin, Srinath Sridhar, Soo Ye Kim
arXiv:2609.37250v1 Announce Type: cross
Abstract: World-action models (WAMs) couple future visual-state prediction with action generation. By adapting video generators or image-editing models pretrai...
By Yang Zhang, Jiangyuan Zhao, Chenyou Fan, Jiayu Hu, Xiu Yuan, Chenjia Bai, Xiu Li
arXiv:2610.33589v1 Announce Type: new
Abstract: While interactive video world models require autoregressive generation, directly adapting pretrained bidirectional video diffusion models into autoregr...
By Zelin Gao, Hao Ouyang, Jiapeng Zhu, Qiuyu Wang, Jingye Chen, Zichen Liu, Xing Zhu, Yujun Shen, Yinghao Xu
arXiv:2610.10429v1 Announce Type: new
Abstract: Autoregressive video generation requires denoising the current frames while writing their key-value representations as context for future predictions....
By Zihan Su, Junhao Zhuang, Yaowei Li, Siwen Lu, Haoran Li, Lingen Li, Haoyu Wu, Weiyang Jin, Songchun Zhang, Haoyang Huang, Chun Yuan, Zeyue Xue, Nan Duan
Bernini proposes a unified framework that separates semantic planning and pixel rendering for video generation and editing. An MLLM-based planner predicts target semantics in ViT embedding space, while a DiT-based renderer synthesizes pixels conditioned on this plan, text features, and source VAE features for editing. The approach introduces Segment-Aware 3D Rotary Positional Embedding and chain-of-thought reasoning, achieving state‑of‑the‑art performance on diverse video benchmarks.
By Bernini Team, Chenchen Liu, Junyi Chen, Lei Li, Lu Chi, Mingzhen Sun, Zhuoying Li, Yi Fu, Ruoyu Guo, Yiheng Wu, Ge Bai, Zehuan Yuan