arXiv Computer Vision

Bounding-Box Trajectories Matter for Video Anomaly Detection

arXiv AI
Sep 1

Real-Time Video Anomaly Detection Using YOLO Pose Estimation and CLIP-Based Semantic Scoring

The paper introduces a lightweight two‑stage system for real‑time video anomaly detection. First, YOLO v11n‑pose detects people and extracts seventeen skeletal keypoints in a single forward pass. Second, each cropped person region is encoded with CLIP ViT‑B/32 and compared via cosine similarity to predefined textual descriptions of anomalous behaviors, removing the need for optical flow, separate pose estimators, or density‑based scoring. Experiments on CUHK Avenue, ShanghaiTech Campus, and a custom indoor dataset achieve about 51 FPS on an NVIDIA Titan XP, a 3.36× speedup over a multi‑feature baseline, while preserving high frame‑level AUROC scores (89.26%, 70.26%, and 84.13%).

By Vanodhya G. Warnasooriya, Amir Hajian, Watchara Ruangsang, Supavadee Aramvith
Hugging Face Trending Papers
Aug 5

VQ-VAD: Vector-quantized Motion Representation Learning for Human-centric Video Anomaly Detection

Video Anomaly Detection (VAD) is inherently challenging due to the scarcity of anomalies and the large visual variability in surveillance footage, including changes in lighting, viewpoint, and human appearance. To mitigate visual noise and address privacy concerns, recent work has shifted to pose-based VAD, which focuses on motion dynamics rather than raw video data.

arXiv AI
Aug 6

VQ-VAD: Vector-quantized Motion Representation Learning for Human-centric Video Anomaly Detection

arXiv:2608. 05069v1 Announce Type: cross Abstract: Video Anomaly Detection (VAD) is inherently challenging due to the scarcity of anomalies and the large visual variability in surveillance footage, including changes in lighting, viewpoint, and human appearance.

By Narges Rashvand, Ghazal Alinezhad Noghre, Shanle Yao, Gabriel Maldonado, Hamed Tabkhi
arXiv AI
6d ago

RoboVAD: A Large Cross-Domain Evaluation Benchmark for Anomaly Detection in Robotic Arm Manipulation Videos

RoboVAD is a large-scale benchmark for video anomaly detection in robotic arm manipulation, featuring cross-domain evaluation where both tasks and anomaly types are unseen during training. The dataset challenges existing VAD methods, with state-of-the-art approaches, including a new method tailored for robotic arms, still achieving less than 70% micro-averaged frame-level AUC in the hardest setting. The authors provide the dataset and code publicly for further research.

By Alexandru-Bogdan Dura, Sebastian Balmus, Radu Tudor Ionescu
arXiv Machine Learning
Sep 10

Hyperspectral Trajectory Image for Multi-Month Trajectory Anomaly Detection

The paper introduces TITAnD, a Trajectory Image Transformer that converts dense and sparse GPS trajectories into a Hyperspectral Trajectory Image (HTI) and applies vision-based classification and segmentation for anomaly detection. It employs a Cyclic Factorized Transformer (CFT) that splits attention along within-day and across-day axes, drastically reducing computational cost and enabling multi-month analysis. Empirical results show TITAnD outperforms existing sparse and dense benchmarks, achieving higher AUC-PR and faster inference than comparable Transformers.

By Md Awsafur Rahman, Chandrakanth Gudavalli, Hardik Prajapati, B. S. Manjunath