arXiv Computer Vision
Oct 15

VideoHarness-SRSI: Structured Recursive Self-Improvement for Video Understanding Harness

arXiv:2610.19424v1 Announce Type: new Abstract: LLM system capabilities depend not only on model parameters but also on the executable harnesses that organize information acquisition, tool use, reaso...

By Zihao Lin, Haoyu Dong, Haobo Xu, Chi-Chih Chang, Xuying Ning, Yinglong Xia, Shuang Yang, Zhuokai Zhao, Xinying Song, Dongfang Liu, Lifu Huang, Yang Song, Qifan Wang
arXiv Computer Vision
Sep 18

VideoResearcher: Self-Improving Tool Design for Long-Video Understanding

VideoResearcher is a training‑free, multi‑agent framework that autonomously designs, tests, and refines high‑impact tools for long‑video understanding. It operates through dual Solving and Evolving loops, analyzing tool‑use trajectories to identify gaps, coordinating specialized agents to develop and validate executable tools, and reusing evolved tools to improve evidence acquisition in subsequent reasoning. The approach achieves state‑of‑the‑art performance among self‑improving agents and approaches the human‑designed upper bound, demonstrating a paradigm that expands agent capabilities while reducing costly manual engineering.

By Dingqiang Ye, Dongdi Zhao, Kaishen Wang, Qingqiao Hu, Jingchen Sun, Yijun Liang, Yuqi Jia, Yiqiao Huang, Yunjie Tian, Jiaxing Zhang, Chuanyang Jin, Ke Zhang, Vishal M. Patel, Di Fu
arXiv AI
Oct 2

VideoEvolve: Evolving Agent Harnesses for Video Temporal Grounding

VideoEvolve is a framework that automatically evolves agent harnesses for video temporal grounding, a task that localizes events in videos based on natural-language queries. It introduces a Cloze-Structured Harness Representation to keep stage interfaces stable while allowing agent workflows and instructions to change, and uses Branch-Guided Harness Evolution to preserve promising code branches, guide local edits with execution feedback, and validate improvements. Experiments show that this automated evolution improves grounding performance across multiple benchmarks, with instruction refinement consistently yielding gains.

By Bingjun Luo, Yuhuan Fan, Jialin Guo, Siqi Li
arXiv Computer Vision
Oct 22

Agentic Video Understanding: A Survey

The paper surveys emerging video understanding agents that use video as the primary source and actively decide what information to inspect, retain, verify, and act upon. It formalizes an agent loop for video understanding and organizes the literature through a challenge‑to‑design taxonomy linking context bottlenecks, evidence sparsity, temporal causality, and multimodal ambiguity to corresponding design solutions. The survey also reviews state‑space paradigms, learning paradigms, supervision signals, benchmarks, evaluation protocols, and outlines open directions toward agentic‑native temporal modeling and video‑native agents.

By Xinyu Deng, Siwen Luo, Daochang Liu