arXiv Computer Vision By Binxu Li, Haoyi Duan, Yuhui Zhang, Yaohui Zhang, Zihao Lin, Kaituo Feng, Suozhi Huang, Xiangyi Li, Yu Li, Chunyuan Li, Shilong Liu, Mengdi Wang

VideoGen-Agent: Reinforcing Video Generation Agents

Read the original on arXiv Computer Vision →

VideoGen-Agent is a multimodal agent that uses multitask agentic reinforcement learning to coordinate external tools for video generation. It learns to augment, generate, and verify videos through multi‑turn interactions, guided by prompts and intermediate observations. On the new VABench benchmark, the agent improves base text‑to‑video performance by 19.1 points, and further upgrades to generation tools raise the score to 86.1, with human raters favoring the upgraded configuration in 84.3% of comparisons.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computer Vision.

arXiv Computer Vision
Nov 9

Video-Coder: Reinforcing Agentic Coding for Video Generation

Video-Coder is a novel code-driven video generation agent that autonomously writes and executes code to build dynamic 3D scenes, providing structure and motion cues to downstream video generators. The authors introduce a dedicated data pipeline and curate two high‑quality datasets—Video‑Coder‑SFT‑6k and Video‑Coder‑RL‑2k—along with the Video‑Coder Harness, an interactive environment that integrates code execution, 3D rendering, and feedback for training. Using a combination of supervised fine‑tuning and harness‑native agentic reinforcement learning with dual rewards, Video‑Coder achieves notable performance gains, improving Minimax‑H3 by about 7 points on PhyGenBench and 24 points on VBench‑2.0.

By Chaoyang Wang, Sicheng Gao, Junan Hu, Kunyang Li, Dongyang Chen, Yiyang Zhou, Huaxiu Yao, Yong Jae Lee, Radu Timofte, Yuzhang Shang
arXiv Computer Vision
Nov 5

ParaVT: Taming the Tool Prior Paradox for Parallel Tool Use in Agentic Video Reinforcement Learning

ParaVT introduces a multi‑agent reinforcement learning framework that enables parallel video‑tool calling, allowing multiple time‑window crops to be processed in a single turn. The authors identify a Tool Prior Paradox where inherited tool‑use priors both aid exploration and conflict with supervised output formatting, leading to potential tool skipping. They propose PARA‑GRPO, which adds a format reward and randomizes the overview‑frame budget to encourage proper tool use, achieving a 7.9% performance gain over the Qwen3‑VL baseline on six long‑video benchmarks.

By Zuhao Yang, Kaichen Zhang, Sudong Wang, Keming Wu, Zhongyu Yang, Bo Li, Xiaojuan Qi, Shijian Lu, Xingxuan Li, Lidong Bing
arXiv Computer Vision
Sep 10

VideoTIR: Accurate Understanding for Long Videos with Efficient Tool-Integrated Reasoning

VideoTIR introduces a reinforcement‑learning approach to improve long‑video understanding by encouraging multimodal large language models to use comprehensive multi‑level toolkits efficiently. It combines Zero‑RL and SFT cold‑starting strategies to help models retrieve and focus on meaningful video segments, images, and regions, thereby reducing hallucinations. The method includes Toolkit Action Grouped Policy Optimization (TAGPO) to streamline tool‑calling and a sandbox‑based trajectory synthesis framework for high‑quality data, achieving strong results on three long‑video QA benchmarks.

By Zhe Gao, Shiyu Shen, Taifeng Chai, Weinong Wang, Haotian Xu, Xing Wu, Wenbin Li, Qi Fan, Yang Gao, Dacheng Tao
arXiv AI
Aug 25

Thinking Beyond Videos: Unifying Video Reasoning and Deep Research for Open-World Video Agents

arXiv:2608.23329v1 Announce Type: cross Abstract: Open-world video understanding often requires a model to locate sparse visual evidence and acquire external knowledge that is absent from the video a...

By Wenqi Liu, Shijie Ma, Yunxiao Wang, Meng Liu, Qile Su, Han Liu, Bohan Hou, Xuanyu Zheng, Changyi Liu, Tianke Zhang, Haonan Fan, Kaiyu Jiang, Yingxin Li, Jiankang Chen, Xu Wang, Bin Wen, Tingting Gao, Han Li, Jianhua Yin, Yinwei Wei, Xuemeng Song