arXiv Computer Vision

DirCast: Live Esports Directing and Commentary with a Single Streaming Video-Language Model

arXiv Computation and Language
Aug 21

StreamSoccer: Event-Driven Memory for Streaming Soccer Commentary

arXiv:2608. 19723v1 Announce Type: cross Abstract: Streaming video understanding requires models to causally update state as video arrives and organize growing history into semantic units that can evolve, persist, and be recalled under bounded computation and memory.

By Chenxi Shao, Bozhong Wang, Jiaxin Huang, Zhao Liu, Sunwei Zhu, Tianxin Hang, Gaoqi He, Yang Li, Changbo Wang
arXiv AI
Oct 31

Can Event Detectors Leave the Broadcast Camera? Evidence from Tennis

The paper introduces a new benchmark of 345 annotated tennis ball bounces and racket hits across eight video clips featuring diverse viewpoints, including broadcast, fixed elevated, phone, and court-level angles. It evaluates several event detection methods—supervised spotters, zero-shot vision-language models, and a parameter-free arbitration layer called RallyArb—showing that supervised models perform well on broadcast footage but poorly on non-broadcast views, while RallyArb maintains high bounce detection across all viewpoints but struggles with precise hit timing. The dataset, evaluation tools, and frozen predictions are publicly released to support further research.

By David Soeiro-Vuong, Andre-Louis Rochet
arXiv Computer Vision
Sep 25

WanPE: Towards Cinematic Prompt Enhancement for Modern Text-to-Video Generation

WanPE is a 397‑B parameter prompt‑enhancement model that learns director‑level cinematic planning from 1.05 M real‑world videos. It generates shot‑level cinematic plans through video‑grounded reverse construction and uses Semantic‑Consistency GRPO (SC‑GRPO) to maintain user intent across shots and time. In evaluations, WanPE improves human preference over raw prompts by up to 50.86 points for 30‑second videos and outperforms commercial offerings for shorter durations.

By Yubo Zhu, Yawen Shao, Ziyun Dai, Zixun Fang, Kai Zhu, Siyang Sun, Haolan Xue, Chuxin Wang, Tingyu Weng, Jingming Luo, Chen Shi, Lianghua Huang, Yufeng Ai, Yuzheng Wang, Wenyuan Zhang, Yu Shang, Yuxiang Bao, Zoubin Bi, Jie Xiao, Jinbo Xing, Jiaxing Zhao, Chongyang Zhong, Hengjian Chen, Chenwei Xie, Akide Liu, Zhehan Kan, Yu Liu, Wei Zhai, Sheng Zhong, Wei Tong
arXiv AI
Oct 7

Real-Time Generation of Game Video Commentary with Multimodal LLMs: Pause-Aware Decoding Approaches

arXiv:2603.02655v2 Announce Type: replace-cross Abstract: Real-time video commentary generation provides textual descriptions of ongoing events in videos. It supports accessibility and engagement in...

By Anum Afzal, Yuki Saito, Hiroya Takamura, Katsuhito Sudoh, Shinnosuke Takamichi, Graham Neubig, Florian Matthes, Tatsuya Ishigaki
arXiv Computer Vision
Oct 28

Zero-Shot Multimodal Event Spotting in Soccer Broadcasts

The paper introduces a zero‑shot multimodal framework for spotting soccer events in full‑length broadcasts without task‑specific training. It segments matches into overlapping clips, represents them with a compact visual storyboard and aligned commentary, and processes these jointly with a general‑purpose multimodal model. On three annotated matches, the best setup achieves 72.0% F1@5s, surpassing SoccerNet‑trained baselines, and the storyboard reduces inference cost by 72%. "whyItMatters":"The approach enables efficient, high‑accuracy event detection and highlight generation in soccer broadcasts without relying on large annotated datasets or soccer‑specific training, as demonstrated by its superior performance and reduced inference cost."

By Sadia Kamal, Mahmudul Hasan, Tony Braskich