arXiv Computer Vision

Agentic Physics-Grounded Video Generation via Memory-Augmented In-Context Reasoning

Agentic Physics-Grounded Video Generation via Memory-Augmented In-Context Reasoning introduces PhysRepair, a framework that repairs physical inconsistencies in generated videos after synthesis. It uses spatiotemporal causal constraints to pinpoint invalid states and guides localized, physically plausible regeneration, while experience-augmented in-context learning adapts repair strategies based on prior failures. Experiments across solid mechanics, fluid dynamics, optics, thermodynamics, and magnetism show that PhysRepair consistently improves physical plausibility over existing methods.

arXiv Computer Vision
Oct 23

PhyEvolve: Multi-Agent State-Evolution Planning for Physics-Aware Video Generation

PhyEvolve is a multi‑agent framework that improves physics‑aware video generation by enhancing natural‑language prompts through structured state‑evolution planning. It employs three agents—a Director, a Physical Evolver, and a Composer—to ground scenes, identify physical mechanisms, and construct causally linked state transitions that guide existing generators without retraining. Experiments on four major benchmarks show that PhyEvolve outperforms the prior agentic baseline by an average of 7.9 percentage points, demonstrating that explicit causal planning boosts physical consistency and state continuity in generated videos.

By Yang-Hao Zhou, Lixing Tan, Zhiqi Li, Guang Yang, Xiao Yang
arXiv AI
Jul 14

PhysMRV: Physical Memory Retrieval and Verification for Physics Plausibility Reasoning

arXiv:2607. 10190v1 Announce Type: cross Abstract: Video-language models (VLMs) have achieved remarkable performance on video understanding and visual question answering, yet they remain unreliable in reasoning about physical plausibility, where understanding object interactions, causal dynamics, and fundamental physical principles is essential.

By Wenyuan Wang, Lianyu Hu, Hao Wang, Yang Liu
Hugging Face Trending Papers
Oct 22

PhyEvolve: Multi-Agent State-Evolution Planning for Physics-Aware Video Generation

PhyEvolve is a multi-agent framework that improves physics-aware video generation by enhancing natural-language prompts through structured state-evolution planning. It employs three agents—a Director, a Physical Evolver, and a Composer—to ground scenes, identify physical mechanisms, and construct causally linked state transitions that guide video generation. The method works with existing generators via prompt replacement and achieves state‑of‑the‑art performance, outperforming the prior agentic baseline by an average of 7.9 percentage points on four major benchmarks.

arXiv AI
Oct 15

PhysCodeGym: Benchmarking Coding Agents for Physically Verifiable 4D Reconstruction

arXiv:2610.17288v1 Announce Type: new Abstract: Building physical simulations from video requires coding agents to translate observations into executable models and refine them through tool use. We i...

By Shuai Shao, Jinchen He, Cunxin Fan, Zihan Guo, Shijian Wang, Qihan Ren, Kangning Zhang, Zunnan Xu, Haoyuan Li, Hao Wang, Jianghao Lin, Weiwen Liu, Weinan Zhang
arXiv Computer Vision
Sep 2

Physically Plausible Video Generation via Visual-Semantic Chain-of-Events Conditioning

The paper introduces Physically Plausible Video Generation (PPVG), a method that generates videos consistent with physical laws by treating physical evolution as a chain of causally connected events. It employs three modules: Physics-driven Event Chain Reasoning to decompose phenomena into scene-graph events, Transition-aware Routed Keyframe Conditioning to guide keyframe synthesis for smooth transitions, and Physics-injected Contrastive Semantic Guidance to steer generation toward plausible dynamics. Experiments on multiple physics benchmarks show improved physical plausibility compared to prior approaches.

By Zixuan Wang, Yixin Hu, Wen Li, Feng Chen, Yan Liu, Duo Peng, Yinjie Lei
arXiv Computer Vision
Sep 24

The Past Frames the Future: Memory for Autoregressive Video Generation

arXiv:2609.28466v1 Announce Type: new Abstract: Advances in generative models have improved video fidelity, enabling long-horizon generation, interactive world modeling, and evolving visual environme...

By Harold Haodong Chen, Rongjin Guo, Disen Lan, Wen-Jie Shu, Hongfei Zhang, Hanzhe Hu, Shengtao Yao, Zixin Zhang, Guibin Zhang, Zhefan Rao, Jinxiu Liu, Yexin Liu, Rui Peng, Yuhao Liu, Bin Ren, Shuai Yang, Yukang Chen, Salman Khan, Ying-Cong Chen, Ser-Nam Lim, Rynson W. H. Lau, Nicu Sebe, Yu Cheng, Ming-Hsuan Yang, Qifeng Chen
arXiv Computer Vision
Oct 21

Robotic Video World Models: A Survey of Applications, Research Challenges, Future Directions

arXiv:2601.07823v2 Announce Type: cross Abstract: Video world models have emerged as promising candidates for high-fidelity world models, offering the potential to synthesize high-quality videos capt...

By Zhiting Mei, Tenny Yin, Ola Shorinwa, Apurva Badithela, Zhonghe Zheng, Joseph Bruno, Madison Bland, Lihan Zha, Asher Hancock, Jaime Fern\'andez Fisac, Philip Dames, Anirudha Majumdar