arXiv AI
Where is the multimodal goal post? On the Ability of Foundation Models to Recognize Highlights in Videos
Read the original on arXiv AI →The Flow has not summarised this story yet — read it at arXiv AI.
Related stories
arXiv Computer Vision
Sep 23
NBA_Streaming: A Large-Scale Benchmark for Fine-Grained Basketball Commentary Generation in Continuous Streams
arXiv:2608.09200v3 Announce Type: replace Abstract: Live basketball commentary generation requires determining when an event is sufficiently observable and describing it before subsequent events unfo...
arXiv Computer Vision
Sep 24
MultiVENT-Raw: A Benchmark for Retrieval and Reasoning over Raw Videos
MultiVENT‑Raw is a new multilingual benchmark comprising nearly 120,000 raw videos—continuous footage from cell phones, hand‑held cameras, or CCTV—totaling over 5,300 hours. The dataset includes 130 events and 222 event‑centric queries, along with human‑annotated relevance judgments and extracted key facts for relevant videos. It supports two tasks: retrieving videos relevant to a query event and generating a coherent report summarizing event‑related videos for a target user, with baseline models showing these tasks remain challenging.
arXiv AI
4d ago
Natural Language Generation from Visual Events: State-of-the-Art and Key Open Questions
The paper reviews recent work on natural language generation from visual events, emphasizing that tasks involving sequences of images or video frames are fundamentally about modeling complex relationships between evolving visual events and the language used to describe them. It surveys five related tasks, examines common modeling and evaluation methods, and highlights shared challenges across these tasks. The authors then outline key open questions and suggest future research directions to address these challenges.
arXiv AI
Jun 6
Seeing Time: Benchmarking Chronological Reasoning and Shortcut Biases in Vision-Language Models
arXiv:2606. 05702v1 Announce Type: new Abstract: Recent advancements in Vision-Language Models (VLMs) have significantly enhanced their ability to interpret complex visual semantics, yet their capacity for chronological reasoning remains under-explored.
arXiv Computer Vision
Sep 28
Where to Focus: Query-Modulated Multimodal Keyframe Selection for Long Video Understanding
arXiv:2604.17422v2 Announce Type: replace Abstract: Long video understanding remains a formidable challenge for Multimodal Large Language Models (MLLMs) due to the prohibitive cost of processing dens...
arXiv Computer Vision
Sep 17
Can MiniMax-H3 Reason About the Physical World? An Evaluation of Omni-Modal Generative Model
arXiv:2609.18323v1 Announce Type: new Abstract: Recent Omni-Modal Generative Models (Omni-Models) have advanced content generation toward unified modeling of text, images, video, and audio. MiniMax-H...