arXiv Computer Vision

SportsGrounder: Proposal-Aided Interleaved Grounding for Dense Sports Video Reasoning

arXiv:2608. 07932v2 Announce Type: replace Abstract: Sports video analysis is crucial for athletic analytics and broadcasting enhancement.

arXiv AI
Aug 28

A Very Big Video Reasoning Suite

The paper introduces the Very Big Video Reasoning (VBVR) Dataset, a large-scale collection of over one million video clips organized into 200 curated reasoning tasks. It also presents VBVR-Bench, a benchmark framework that uses rule-based, human-aligned scorers for reproducible evaluation of video reasoning models. The authors conduct a large-scale scaling study, noting early signs of emergent generalization to unseen reasoning tasks, and make all resources publicly available.

By Maijunxian Wang, Ruisi Wang, Juyi Lin, Ran Ji, Thadd\"aus Wiedemer, Qingying Gao, Dezhi Luo, Yaoyao Qian, Lianyu Huang, Zelong Hong, Jiahui Ge, Qianli Ma, Hang He, Yifan Zhou, Lingzi Guo, Lantao Mei, Jiachen Li, Hanwen Xing, Tianqi Zhao, Fengyuan Yu, Weihang Xiao, Yizheng Jiao, Jianheng Hou, Danyang Zhang, Pengcheng Xu, Boyang Zhong, Zehong Zhao, Gaoyun Fang, John Kitaoka, Yile Xu, Hua Xu, Kenton Blacutt, Tin Nguyen, Siyuan Song, Haoran Sun, Shaoyue Wen, Linyang He, Runming Wang, Yanzhi Wang, Mengyue Yang, Ziqiao Ma, Rapha\"el Milli\`ere, Freda Shi, Nuno Vasconcelos, Daniel Khashabi, Alan Yuille, Yilun Du, Ziming Liu, Bo Li, Dahua Lin, Ziwei Liu, Vikash Kumar, Yijiang Li, Lei Yang, Zhongang Cai, Hokin Deng
arXiv Computer Vision
Sep 10

VideoTIR: Accurate Understanding for Long Videos with Efficient Tool-Integrated Reasoning

VideoTIR introduces a reinforcement‑learning approach to improve long‑video understanding by encouraging multimodal large language models to use comprehensive multi‑level toolkits efficiently. It combines Zero‑RL and SFT cold‑starting strategies to help models retrieve and focus on meaningful video segments, images, and regions, thereby reducing hallucinations. The method includes Toolkit Action Grouped Policy Optimization (TAGPO) to streamline tool‑calling and a sandbox‑based trajectory synthesis framework for high‑quality data, achieving strong results on three long‑video QA benchmarks.

By Zhe Gao, Shiyu Shen, Taifeng Chai, Weinong Wang, Haotian Xu, Xing Wu, Wenbin Li, Qi Fan, Yang Gao, Dacheng Tao
arXiv AI
Jun 8

Watch, Remember, Reason: Human-View Video Understanding with MLLMs

arXiv:2606. 07433v1 Announce Type: cross Abstract: Video understanding is being rapidly transformed by multimodal large language models (MLLMs), as research moves from short clips to long, multimodal, and knowledge-intensive video scenarios.

By Jiahao Meng, Yue Tan, Qi Xu, Kuan Gao, Weisong Liu, Yanwei Li, Jason Li, Lingdong Kong, Haochen Wang, Qianyu Zhou, Jiangning Zhang, Guangliang Cheng, Yunhai Tong, Lu Qi, Minghsuan Yang
arXiv Computer Vision
22h ago

Event-STVG: Spatio-Temporal Video Grounding for Long-Form Event Reasoning

arXiv:2610.22444v1 Announce Type: new Abstract: Spatio-Temporal Video Grounding (STVG) aims to jointly localize a target in space and time given a natural-language query. Despite continued advances,...

By Yizhe Zhang, Xujia Wang, Songqi Tang, Xujie Tang, Leo Jiahao Jiang, Jiacheng Wang, Bowen Qu, JinBo Li, Qin Wang, Ji Qi, Lei Hou, Bin Xu, Juanzi Li
arXiv AI
Aug 25

VisionCoach: Reinforcing Grounded Video Reasoning via Visual-Perception Prompting

VisionCoach is an input‑adaptive reinforcement learning framework that enhances spatio‑temporal grounding in video reasoning by using visual prompting during training. The system selectively applies visual prompts to challenging inputs, amplifying question‑relevant evidence and suppressing distractors, and then internalizes these improvements through self‑distillation so that inference can be performed on raw videos without prompts. Experiments on multiple benchmarks (V‑STAR, VideoMME, World‑Sense, VideoMMMU, PerceptionTest, and Charades‑STA) show that VisionCoach achieves state‑of‑the‑art performance while maintaining a single efficient inference pathway.

By Daeun Lee, Shoubin Yu, Yue Zhang, Mohit Bansal