arXiv Computer Vision

PhysPlan: Grounded Physical State Reasoning and Graph-Guided Optimization for Physically Plausible Video Generation

arXiv Computer Vision
Sep 14

Physics-Aware Video Generation via Agentic Planning and Graph-Guided Optimization

PhysPlan is a training‑free guidance framework that enhances video diffusion models by incorporating physical awareness through agentic physics simulation. It uses a vision‑language model to generate a Chain‑of‑Visual‑Thought representation of kinematic trajectories and 3D depth, which then drives an object‑centric test‑time optimization that isolates kinematic changes and locks the passive environment. The framework also employs Kinetic Intensity Profiling to adapt hyperparameters to varying physical deformations, and demonstrates superior performance on PhyGenBench and Physics‑IQ benchmarks compared to existing VDM baselines.

By Minh-Loi Nguyen, Xuan-Vu Le, Thanh-Toan Do, Tam V. Nguyen, Minh-Triet Tran, Trung-Nghia Le
arXiv Computer Vision
Sep 23

minWM: A Full-Stack Open-Source Framework for Real-Time Interactive Video World Models

arXiv:2605.30263v2 Announce Type: replace Abstract: Recent video diffusion foundation models have achieved remarkable progress in high-quality video generation, yet turning them into real-time intera...

By Min Zhao, Hongzhou Zhu, Bokai Yan, Zihan Zhou, Yimin Chen, Honglie Wang, Wenqiang Sun, Zhengwei Fang, Zizheng Xun, Zihao Li, Kaiwen Zheng, Guande He, Xiao Yang, Chongxuan Li, Fan Bao, Jun Zhu
arXiv Computer Vision
3d ago

Physis-Lang: Self-Evolving Language as a Physical Representation for Video World Model

arXiv:2609.40358v1 Announce Type: new Abstract: Video world models are expected to predict how the physical world evolves, yet they often produce visually plausible videos that violate basic physical...

By Liming Lu, Xianzheng Ma, Wenkun He, Guanqi Zhan, Yilin Zhao, Junyu Chen, Mengyao Xu, Jiaojiao Fan, Wenhang Ge, Yuchao Gu, Yunze Liu, Boyi Li, Zhen Dong, Victor Prisacariu, Ming-Yu Liu, Song Han, Han Cai
arXiv Computer Vision
Sep 2

Physically Plausible Video Generation via Visual-Semantic Chain-of-Events Conditioning

The paper introduces Physically Plausible Video Generation (PPVG), a method that generates videos consistent with physical laws by treating physical evolution as a chain of causally connected events. It employs three modules: Physics-driven Event Chain Reasoning to decompose phenomena into scene-graph events, Transition-aware Routed Keyframe Conditioning to guide keyframe synthesis for smooth transitions, and Physics-injected Contrastive Semantic Guidance to steer generation toward plausible dynamics. Experiments on multiple physics benchmarks show improved physical plausibility compared to prior approaches.

By Zixuan Wang, Yixin Hu, Wen Li, Feng Chen, Yan Liu, Duo Peng, Yinjie Lei
arXiv Computer Vision
Sep 17

StrucPhysVideo: Learning Physical Dynamics from Structured Captions and Robot Actions

arXiv:2609.18430v1 Announce Type: new Abstract: Modeling physical dynamics, including how objects move, interact, and change state, is central to video world models for embodied AI. We present StrucP...

By WM Team, Enhui Ma, Kaiwen Guo, Tingrui Zhang, Wei Song, Yingshui Tan, Jianhua Xu, Tong Zhang, Kaicheng Yu