arXiv AI
Jun 6

Active Video Perception: Iterative Evidence Seeking for Agentic Long Video Understanding

arXiv:2512. 05774v2 Announce Type: replace-cross Abstract: Long video understanding (LVU) is challenging because answering real-world queries often depends on sparse, temporally dispersed cues buried in hours of mostly redundant and irrelevant content.

By Ziyang Wang, Honglu Zhou, Shijie Wang, Junnan Li, Caiming Xiong, Silvio Savarese, Mohit Bansal, Michael S. Ryoo, Juan Carlos Niebles
arXiv Computer Vision
Oct 22

Agentic Video Understanding: A Survey

The paper surveys emerging video understanding agents that use video as the primary source and actively decide what information to inspect, retain, verify, and act upon. It formalizes an agent loop for video understanding and organizes the literature through a challenge‑to‑design taxonomy linking context bottlenecks, evidence sparsity, temporal causality, and multimodal ambiguity to corresponding design solutions. The survey also reviews state‑space paradigms, learning paradigms, supervision signals, benchmarks, evaluation protocols, and outlines open directions toward agentic‑native temporal modeling and video‑native agents.

By Xinyu Deng, Siwen Luo, Daochang Liu
arXiv AI
2d ago

Joint Latent Reasoning and Observation for Agentic Video Understanding

The paper introduces LARVA, a framework that distills multi‑round video agents by jointly learning latent reasoning and visual observations. Instead of using textual captions, an observer sends compact continuous representations to a reasoner, which then selects the next action or produces an answer. The approach incorporates action and answer supervision through this interface and uses observation reconstruction and reasoning‑distribution alignment as auxiliary signals, achieving strong results on five video‑understanding benchmarks with 4B and 7B models.

By Junzhang Liu, Hao Yuan, Qi Zhang, Yiming Wu, Long Chen, Zhecan Wang