arXiv Computer Vision

Zero-Shot Multimodal Event Spotting in Soccer Broadcasts

The paper introduces a zero‑shot multimodal framework for spotting soccer events in full‑length broadcasts without task‑specific training. It segments matches into overlapping clips, represents them with a compact visual storyboard and aligned commentary, and processes these jointly with a general‑purpose multimodal model. On three annotated matches, the best setup achieves 72.0% F1@5s, surpassing SoccerNet‑trained baselines, and the storyboard reduces inference cost by 72%. "whyItMatters":"The approach enables efficient, high‑accuracy event detection and highlight generation in soccer broadcasts without relying on large annotated datasets or soccer‑specific training, as demonstrated by its superior performance and reduced inference cost."

arXiv Computation and Language
Aug 21

StreamSoccer: Event-Driven Memory for Streaming Soccer Commentary

arXiv:2608. 19723v1 Announce Type: cross Abstract: Streaming video understanding requires models to causally update state as video arrives and organize growing history into semantic units that can evolve, persist, and be recalled under bounded computation and memory.

By Chenxi Shao, Bozhong Wang, Jiaxin Huang, Zhao Liu, Sunwei Zhu, Tianxin Hang, Gaoqi He, Yang Li, Changbo Wang
arXiv Computer Vision
Sep 23

TEMPURA: Temporal Event Masked Prediction and Understanding for Reasoning in Action

arXiv:2505.01583v2 Announce Type: replace Abstract: Understanding causal event relationships and achieving fine-grained temporal grounding in videos remain challenging for vision-language models (VLM...

By Jen-Hao Cheng, Yi-Hao Peng, Huapeng Zhou, Vivian Wang, Huayu Wang, Hsiang-Wei Huang, Wenhao Chai, Hou-I Liu, Kuang-Ming Chen, Cheng-Yen Yang, Yi-Ling Chen, Vibhav Vineet, Qin Cai, Jenq-Neng Hwang
arXiv Computer Vision
Oct 8

SoccerNet-FoulRet: Retrieving Semantically Similar Soccer Foul Videos

SoccerNet‑FoulRet is a new benchmark for retrieving semantically similar soccer foul videos, addressing inconsistencies in refereeing decisions by allowing comparison of a contentious foul with past precedents. The task requires retrieving relevant fouls regardless of camera angle, teams, or appearance, differing from prior video‑to‑video retrieval that focuses on visual similarity. The benchmark, built from the SoccerNet‑MVFoul dataset, evaluates zero‑shot video and vision‑language embeddings and a fine‑tuned baseline on 693 human‑verified queries, revealing that even the best zero‑shot model achieves less than 5% HitRate@10, highlighting the challenge of semantic foul retrieval.

By Jacobus Arthur, Ahmad Sait, Batool Hani, Merey Ramazanova, Jan Held, Marc Van Droogenbroeck, Bernard Ghanem, Anthony Cioppa, Silvio Giancola