arXiv Computer Vision

Learn to Modify: Self-evolving Multi-agent Refinement Framework for Conversational Text-to-Motion Generation

The paper introduces SMART, a Self‑evolving Multi‑Agent Refinement Framework for conversational text‑to‑motion generation. It enables users to iteratively refine specific spatio‑temporal regions of a motion sequence based on natural language feedback, preserving the rest of the motion. The framework incorporates a semantic‑guided masked editing mechanism and a memory‑based self‑evolving strategy to reuse past editing knowledge and reduce redundant exploration.

Hugging Face Trending Papers
Aug 27

Thinking on Shots: Consistent Multi-Shot Video Editing with Agentic Reasoning

The paper introduces the Multi-Instruction Multi-Shot Long-Video Editing (MMLVE) task, aiming to edit long videos with multiple instructions while maintaining consistency across shots, decoupling instructions, and preserving spatiotemporal structure. It proposes an agentic editing framework that combines Large Language Models and Vision‑Language Models for shot-level decoupling and precise instruction parsing. A new dataset, MMLVE‑Bench, and three evaluation metrics are created to benchmark this task, and experiments show the proposed MMLVE‑Agent outperforms existing closed‑source state‑of‑the‑art methods by eliminating hallucinations and ensuring seamless transitions.

arXiv Computer Vision
Aug 28

Thinking on Shots: Consistent Multi-Shot Video Editing with Agentic Reasoning

The paper introduces the Multi-Instruction Multi-Shot Long-Video Editing (MMLVE) task, aiming to enable consistent editing of long videos with multiple instructions. It proposes an agentic editing framework that combines Large Language Models and Vision-Language Models for shot-level decoupling and precise instruction parsing. The authors also present the MMLVE-Bench dataset and evaluation metrics, showing that their MMLVE-Agent outperforms existing state‑of‑the‑art methods by eliminating hallucinations and preserving temporal consistency.

By Chenyang Wu, Fuchen Long, Binyuan Huang, Xinlong Sun, Xi Chen, Chun-Le Guo, Chongyi Li
Hugging Face Trending Papers
Aug 10

UniMoFlow: Grounding Instruction-Driven 3D Human Motion Editing in Generation

Instruction-driven editing of 3D human motion requires precise spatiotemporal localization, rich semantic grounding, and strict preservation of unmodified content. Existing methods either resort to training-free adaptation of generative models or rely solely on triplet supervision; however, adaptation often yields suboptimal control, and manually curated triplet datasets remain severely limited in scale and semantic diversity.

Hugging Face Trending Papers
Oct 22

PhyEvolve: Multi-Agent State-Evolution Planning for Physics-Aware Video Generation

PhyEvolve is a multi-agent framework that improves physics-aware video generation by enhancing natural-language prompts through structured state-evolution planning. It employs three agents—a Director, a Physical Evolver, and a Composer—to ground scenes, identify physical mechanisms, and construct causally linked state transitions that guide video generation. The method works with existing generators via prompt replacement and achieves state‑of‑the‑art performance, outperforming the prior agentic baseline by an average of 7.9 percentage points on four major benchmarks.