arXiv Computer Vision

HyrCap: Hybrid Rank-Calibration of Action Proposals for Temporal Event Understanding

arXiv Computer Vision
Sep 23

TEMPURA: Temporal Event Masked Prediction and Understanding for Reasoning in Action

arXiv:2505.01583v2 Announce Type: replace Abstract: Understanding causal event relationships and achieving fine-grained temporal grounding in videos remain challenging for vision-language models (VLM...

By Jen-Hao Cheng, Yi-Hao Peng, Huapeng Zhou, Vivian Wang, Huayu Wang, Hsiang-Wei Huang, Wenhao Chai, Hou-I Liu, Kuang-Ming Chen, Cheng-Yen Yang, Yi-Ling Chen, Vibhav Vineet, Qin Cai, Jenq-Neng Hwang
Hugging Face Trending Papers
Jun 1

WALL-WM: Carving World Action Modeling at the Event Joints

WALL-WM is a World Action Model that shifts video-action learning from chunk-centric optimization to event-grounded Vision-Language-Action pretraining, using semantically coherent action events as the atomic unit of learning. Existing WAMs commonly initialize from multimodal or video foundation models and then optimize fixed-length action chunks conditioned directly on the current observation and instruction.

arXiv AI
Oct 16

Where, How, and When: Query-Guided Grounding for Video Understanding

The paper introduces query‑guided grounding methods for video understanding, covering object‑level, relationship‑level, and moment‑level tasks. For object grounding, QDETRv and TOViT enable one‑shot and few‑shot localization of unseen objects using query‑context fusion, memory modules, and language‑aligned vision encoders. Relationship grounding is addressed with a few‑shot referring framework that optimizes a T‑partite random field, while moment grounding is tackled by the Moment Alignment Transformer (MATR), which employs dynamic time warping and self‑supervised pretraining for video‑to‑video and text‑to‑video retrieval.

By Yogesh Kumar
arXiv AI
Sep 15

EventVL: Understand Event Streams via Multimodal Large Language Model

EventVL introduces the first generative event-based multimodal large language model (MLLM) designed for explicit semantic understanding of event streams. The framework leverages a newly annotated dataset of nearly 1.4 million event–image/video–text pairs and incorporates an Event Spatiotemporal Representation to capture comprehensive event information, along with Dynamic Semantic Alignment to refine sparse semantic spaces. Experiments demonstrate that EventVL outperforms existing MLLM baselines in event captioning and scene description generation tasks, advancing the field of event vision.

By Pengteng Li, Yunfan Lu, Pinghao Song, Wuyang Li, Huizai Yao, Hui Xiong
arXiv AI
Sep 7

Adaptive Multi-Granularity Temporal Modeling for Weakly Supervised Video Anomaly Detection

The paper introduces an adaptive temporal modeling framework for weakly supervised video anomaly detection that addresses the limitations of rigid Multiple Instance Learning approaches. It presents a Temporal Refinement Module using dynamic positional encoding and a learnable class token to capture long‑range dependencies, and an Event Segmentation Module that identifies event boundaries via temporal discontinuity analysis to produce discriminative event‑level representations. An adaptive similarity‑based fusion strategy replaces fixed top‑k heuristics, dynamically integrating snippet‑level and event‑level anomaly scores into video‑level predictions, and the method outperforms state‑of‑the‑art baselines on two benchmarks.

By Changyi Li, Yu Xiao