← Back to all news
arXiv Computer Vision

MVAgent: Multi-Agent Video Generation via Consistent Condition Construction and Shot-Level Policy Optimization

MVAgent is a multi‑agent pipeline for multi‑shot video generation that ensures consistent character appearance, stable spatial layout, and continuous character state across shots. The system uses typed conditioning inputs: a Spatial Grounding agent samples camera views, an Observer records shot endings into a continuity memory, a Transition agent builds action and spatial references for subsequent shots, and an Orchestrator composes these inputs into generator requests. Trained with agentic reinforcement learning (Trunk‑GDPO) while keeping the generator and judges frozen, MVAgent achieves the highest cross‑shot consistency and narrative‑planning quality on ViMax‑Bench and is preferred over the strongest agentic baseline in human evaluation.

Related stories

arXiv Computer Vision
Sep 22

VideoGen-Agent: Reinforcing Video Generation Agents

VideoGen-Agent is a multimodal agent that uses multitask agentic reinforcement learning to coordinate external tools for video generation. It learns to augment, generate, and verify videos through multi‑turn interactions, guided by prompts and intermediate observations. On the new VABench benchmark, the agent improves base text‑to‑video performance by 19.1 points, and further upgrades to generation tools raise the score to 86.1, with human raters favoring the upgraded configuration in 84.3% of comparisons.

By Binxu Li, Haoyi Duan, Yuhui Zhang, Yaohui Zhang, Zihao Lin, Kaituo Feng, Suozhi Huang, Xiangyi Li, Yu Li, Chunyuan Li, Shilong Liu, Mengdi Wang
agentsdiffusionreinforcement-learningfine-tuningmultimodalbenchmarks
More like this →
Hugging Face Trending Papers
Aug 27

Thinking on Shots: Consistent Multi-Shot Video Editing with Agentic Reasoning

The paper introduces the Multi-Instruction Multi-Shot Long-Video Editing (MMLVE) task, aiming to edit long videos with multiple instructions while maintaining consistency across shots, decoupling instructions, and preserving spatiotemporal structure. It proposes an agentic editing framework that combines Large Language Models and Vision‑Language Models for shot-level decoupling and precise instruction parsing. A new dataset, MMLVE‑Bench, and three evaluation metrics are created to benchmark this task, and experiments show the proposed MMLVE‑Agent outperforms existing closed‑source state‑of‑the‑art methods by eliminating hallucinations and ensuring seamless transitions.

llmsragagentscomputer-visionmultimodalbenchmarkssafety
More like this →
arXiv Computer Vision
Aug 28

Thinking on Shots: Consistent Multi-Shot Video Editing with Agentic Reasoning

The paper introduces the Multi-Instruction Multi-Shot Long-Video Editing (MMLVE) task, aiming to enable consistent editing of long videos with multiple instructions. It proposes an agentic editing framework that combines Large Language Models and Vision-Language Models for shot-level decoupling and precise instruction parsing. The authors also present the MMLVE-Bench dataset and evaluation metrics, showing that their MMLVE-Agent outperforms existing state‑of‑the‑art methods by eliminating hallucinations and preserving temporal consistency.

By Chenyang Wu, Fuchen Long, Binyuan Huang, Xinlong Sun, Xi Chen, Chun-Le Guo, Chongyi Li
llmsragagentscomputer-visionmultimodalbenchmarkssafety
More like this →