arXiv AI By Yingzhao Jian, Zhongan Wang, Yuxuan Hou, Hehe Fan

Learning to Interact and Direct: Co-Evolving Video Director Agents

Read the original on arXiv AI →

The paper introduces LIT, a framework that co‑evolves a video director agent, a simulated user, and a meta engineer to improve both directing and user interaction. By having the meta agent proactively learn external knowledge and form an evolutionary closed loop, LIT addresses weaknesses in the director’s strategy and enhances production and interaction performance. Experiments show significant gains—19.1% in production and 32.0% in interaction scores—highlighting the benefit of co‑evolution for creative video production.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv Computer Vision
Oct 2

VideoWeaver: Evaluating and Evolving Skills for Agentic Long Video Generation

VideoWeaver is an agent harness and benchmark for long‑video generation that evaluates and evolves reusable skills. It allows an agent to dynamically compose foundation skills into a workflow based on a single high‑level instruction, rather than following a static pipeline. The benchmark includes 16 task categories and 285 cases with multimodal references, and an evidence‑grounded agent‑as‑judge inspects execution traces and final videos to guide skill evolution, improving both process and output quality.

By Jianhui Wei, Yan Zhang, Jie Tan, Hengchuan Zhu, Xiaotian Zhang, Ziyi Chen, Daoan Zhang, Wei Xu, Yeying Jin, Zuozhu Liu
arXiv AI
Aug 19

SAGE: Self-Evolving Storyboard Skills via Attribution-Guided Rule Evolution

SAGE is a framework that automates storyboard creation by learning and evolving directing rules from expert demonstrations. It attributes each narrative group’s decisions to specific rules, refines those rules with localized feedback, and routes only relevant rules to each group during generation. In tests, SAGE matched professional directors on a rubric and reduced authoring time by over 83%.

By Maolin Ran, Xiaoyang Lu, Jiaqi Liu, Jian Wang, Weiwen Liu, Jianghao Lin, Yong Yu, Weinan Zhang
arXiv AI
Oct 7

Learn2Play Bench: How Well Do LLM Agents Learn from Experience in Unfamiliar Environments?

Learn2Play Bench is a new benchmark that tests how well large language model agents learn from experience in unfamiliar, text‑based games with novel or counterintuitive rules. The benchmark provides reproducible feedback, automatic scoring, and varied game instances to evaluate learning across repeated attempts and transfer to new situations. Findings show that retaining full action records aids learning, human players outperform agents, and the choice of harness significantly impacts performance and inference cost.

By Yibo Li, Jinhang Qiu, Zhi Zheng, Qianyun Guo, Jiaying Wu, Shuo Ji, Bryan Hooi
arXiv AI
Jun 2

Beyond End-to-End Video Models: An LLM-Based Multi-Agent System for Educational Video Generation

arXiv:2602. 11790v2 Announce Type: replace Abstract: Although recent end-to-end video generation models demonstrate impressive performance in visually oriented content creation, they remain limited in scenarios that require strict logical rigor and precise knowledge representation, such as instructional and educational media.

By Lingyong Yan, Jiulong Wu, Dong Xie, Weixian Shi, Deguo Xia, Jizhou Huang