Recent advances in video generative models have enabled high-fidelity, temporally coherent video generation. However, these models often struggle to satisfy prompts requiring specialized knowledge, sp...
Video-Coder is a novel code-driven video generation agent that autonomously writes and executes code to build dynamic 3D scenes, providing structure and motion cues to downstream video generators. The authors introduce a dedicated data pipeline and curate two high‑quality datasets—Video‑Coder‑SFT‑6k and Video‑Coder‑RL‑2k—along with the Video‑Coder Harness, an interactive environment that integrates code execution, 3D rendering, and feedback for training. Using a combination of supervised fine‑tuning and harness‑native agentic reinforcement learning with dual rewards, Video‑Coder achieves notable performance gains, improving Minimax‑H3 by about 7 points on PhyGenBench and 24 points on VBench‑2.0.
By Chaoyang Wang, Sicheng Gao, Junan Hu, Kunyang Li, Dongyang Chen, Yiyang Zhou, Huaxiu Yao, Yong Jae Lee, Radu Timofte, Yuzhang Shang
ParaVT introduces a multi‑agent reinforcement learning framework that enables parallel video‑tool calling, allowing multiple time‑window crops to be processed in a single turn. The authors identify a Tool Prior Paradox where inherited tool‑use priors both aid exploration and conflict with supervised output formatting, leading to potential tool skipping. They propose PARA‑GRPO, which adds a format reward and randomizes the overview‑frame budget to encourage proper tool use, achieving a 7.9% performance gain over the Qwen3‑VL baseline on six long‑video benchmarks.
By Zuhao Yang, Kaichen Zhang, Sudong Wang, Keming Wu, Zhongyu Yang, Bo Li, Xiaojuan Qi, Shijian Lu, Xingxuan Li, Lidong Bing
VideoTIR introduces a reinforcement‑learning approach to improve long‑video understanding by encouraging multimodal large language models to use comprehensive multi‑level toolkits efficiently. It combines Zero‑RL and SFT cold‑starting strategies to help models retrieve and focus on meaningful video segments, images, and regions, thereby reducing hallucinations. The method includes Toolkit Action Grouped Policy Optimization (TAGPO) to streamline tool‑calling and a sandbox‑based trajectory synthesis framework for high‑quality data, achieving strong results on three long‑video QA benchmarks.
By Zhe Gao, Shiyu Shen, Taifeng Chai, Weinong Wang, Haotian Xu, Xing Wu, Wenbin Li, Qi Fan, Yang Gao, Dacheng Tao
arXiv:2610.17234v1 Announce Type: new
Abstract: Video reward models are trained and evaluated on human preferences between videos that often differ simultaneously on properties such as prompt alignme...
By Shuyue Stella Li, Jacqueline He, Jiahui Chen, Sreya Dutta Roy, Yulia Tsvetkov, Luke Zettlemoyer, Marjan Ghazvininejad, Xiaochuang Han
arXiv:2608.23329v1 Announce Type: cross
Abstract: Open-world video understanding often requires a model to locate sparse visual evidence and acquire external knowledge that is absent from the video a...
By Wenqi Liu, Shijie Ma, Yunxiao Wang, Meng Liu, Qile Su, Han Liu, Bohan Hou, Xuanyu Zheng, Changyi Liu, Tianke Zhang, Haonan Fan, Kaiyu Jiang, Yingxin Li, Jiankang Chen, Xu Wang, Bin Wen, Tingting Gao, Han Li, Jianhua Yin, Yinwei Wei, Xuemeng Song