Hugging Face Trending Papers

PhyEvolve: Multi-Agent State-Evolution Planning for Physics-Aware Video Generation

PhyEvolve is a multi-agent framework that improves physics-aware video generation by enhancing natural-language prompts through structured state-evolution planning. It employs three agents—a Director, a Physical Evolver, and a Composer—to ground scenes, identify physical mechanisms, and construct causally linked state transitions that guide video generation. The method works with existing generators via prompt replacement and achieves state‑of‑the‑art performance, outperforming the prior agentic baseline by an average of 7.9 percentage points on four major benchmarks.

arXiv Computer Vision
Oct 23

PhyEvolve: Multi-Agent State-Evolution Planning for Physics-Aware Video Generation

PhyEvolve is a multi‑agent framework that improves physics‑aware video generation by enhancing natural‑language prompts through structured state‑evolution planning. It employs three agents—a Director, a Physical Evolver, and a Composer—to ground scenes, identify physical mechanisms, and construct causally linked state transitions that guide existing generators without retraining. Experiments on four major benchmarks show that PhyEvolve outperforms the prior agentic baseline by an average of 7.9 percentage points, demonstrating that explicit causal planning boosts physical consistency and state continuity in generated videos.

By Yang-Hao Zhou, Lixing Tan, Zhiqi Li, Guang Yang, Xiao Yang
arXiv Computer Vision
Oct 21

Learn to Modify: Self-evolving Multi-agent Refinement Framework for Conversational Text-to-Motion Generation

The paper introduces SMART, a Self‑evolving Multi‑Agent Refinement Framework for conversational text‑to‑motion generation. It enables users to iteratively refine specific spatio‑temporal regions of a motion sequence based on natural language feedback, preserving the rest of the motion. The framework incorporates a semantic‑guided masked editing mechanism and a memory‑based self‑evolving strategy to reuse past editing knowledge and reduce redundant exploration.

By Jianan Li, Jiawei Zhao, Yangtao Zhou, Zhifu Zhao, Shaoxin Wu, Yutao Wang, Dezhen Wang, Hua Chu, Fu Li
arXiv Computer Vision
Sep 2

Physically Plausible Video Generation via Visual-Semantic Chain-of-Events Conditioning

The paper introduces Physically Plausible Video Generation (PPVG), a method that generates videos consistent with physical laws by treating physical evolution as a chain of causally connected events. It employs three modules: Physics-driven Event Chain Reasoning to decompose phenomena into scene-graph events, Transition-aware Routed Keyframe Conditioning to guide keyframe synthesis for smooth transitions, and Physics-injected Contrastive Semantic Guidance to steer generation toward plausible dynamics. Experiments on multiple physics benchmarks show improved physical plausibility compared to prior approaches.

By Zixuan Wang, Yixin Hu, Wen Li, Feng Chen, Yan Liu, Duo Peng, Yinjie Lei
arXiv AI
Oct 2

VideoEvolve: Evolving Agent Harnesses for Video Temporal Grounding

VideoEvolve is a framework that automatically evolves agent harnesses for video temporal grounding, a task that localizes events in videos based on natural-language queries. It introduces a Cloze-Structured Harness Representation to keep stage interfaces stable while allowing agent workflows and instructions to change, and uses Branch-Guided Harness Evolution to preserve promising code branches, guide local edits with execution feedback, and validate improvements. Experiments show that this automated evolution improves grounding performance across multiple benchmarks, with instruction refinement consistently yielding gains.

By Bingjun Luo, Yuhuan Fan, Jialin Guo, Siqi Li
arXiv AI
Jun 2

Coding Agent Is Good As World Simulator

arXiv:2605. 14398v2 Announce Type: replace Abstract: World models have emerged as a powerful paradigm for building interactive simulation environments, with recent video-based approaches demonstrating impressive progress in generating visually plausible dynamics.

By Hongyu Wang, Jingquan Wang, Bocheng Zou, Radu Serban, Dan Negrut
arXiv Computer Vision
2d ago

Hy-Nomas: Towards Free-form Interactive World Generation

arXiv:2610.36729v1 Announce Type: new Abstract: Interactive world generation requires models to follow successive commands while preserving relevant history and action consequences. We present Hy-Nom...

By Qiaoling Chen, Jiaxiang Cheng, Xueqing Deng, Tiankai Hang, Ji Hou, Jiaqi Li, Yifan Liu, Tao Lu, Junshu Tang, Yu Tang, Yao Teng, Yu Tian, Heng Wang, Weizhi Wang, Xiyao Wang, Xilun Wu, Mingyu Yang, Yangbin Yu, Rui Zhao, Longjun Cao, Linghao Chen, Haoyi Duan, Jiaming Han, Mingji Han, Enhua Jiang, Shunkai Li, Yanzhe Liang, Qinwei Ma, Cong Wang, Lei Wang, Bing Wu, Ke Xing, Ray Ying, Zhentao Yu, Key Zhang, Yuan Zhou, Zhengguang Zhou, Kai Zou
arXiv AI
Aug 11

VideoCoCo: Code-as-CoT for Physically-Consistent Video Generation via an Agentic Dual-Engine System

arXiv:2607. 27380v2 Announce Type: replace-cross Abstract: Text-to-video models have achieved remarkable visual quality, yet they still struggle to generate physically consistent dynamics because the temporal evolution of a scene must be inferred implicitly from a highly compressed text prompt.

By Haodong Li, Tianfei Ren, Xiaoxiao Ma, Chunmei Qing, Zhen Fang, Sipeng He, Ziyu Guo, Haoyu Wu, Juanxi Tian, Yihang Zou, Ruichuan An, Dongzhi Jiang, Boxue Yang, Ji Xie, Xu Huang, Wenhao Yan, Jialv Zou, Zhengrong Yue, Yaxin Luo, Xiaotong Li, Yuzhu Wang, Junyan Ye, Jinjing Zhao, Zehui Chen, Lin Chen, Renye Yan, Feng Zhao, Pheng-Ann Heng
arXiv Computer Vision
Oct 22

CineEvolve: An Agentic Self-Evolution Framework for Cinematic Multi-Shot Video Generation

CineEvolve is a new agentic self‑evolution framework for cinematic multi‑shot video generation that integrates a Director and a Critic into a single vision‑language policy. The system alternates reinforcement learning steps, letting the Director identify flaws and the Critic refine its guidance, while a novel Evolutionary GRPO (E‑GRPO) stabilizes co‑evolution by anchoring history and safeguarding revisions. The authors also release CineTraj, a 40K‑sample dataset of cinematic trajectories, and show that CineEvolve outperforms existing methods in extensive experiments.

By Jingzhe Zhang, Peixuan Zhang, Genying Li, Bing Ma, Shuchen Weng, Si Li, Boxin Shi