arXiv AI
Sep 1

Real-Time Video Anomaly Detection Using YOLO Pose Estimation and CLIP-Based Semantic Scoring

The paper introduces a lightweight two‑stage system for real‑time video anomaly detection. First, YOLO v11n‑pose detects people and extracts seventeen skeletal keypoints in a single forward pass. Second, each cropped person region is encoded with CLIP ViT‑B/32 and compared via cosine similarity to predefined textual descriptions of anomalous behaviors, removing the need for optical flow, separate pose estimators, or density‑based scoring. Experiments on CUHK Avenue, ShanghaiTech Campus, and a custom indoor dataset achieve about 51 FPS on an NVIDIA Titan XP, a 3.36× speedup over a multi‑feature baseline, while preserving high frame‑level AUROC scores (89.26%, 70.26%, and 84.13%).

By Vanodhya G. Warnasooriya, Amir Hajian, Watchara Ruangsang, Supavadee Aramvith
Hugging Face Trending Papers
Aug 5

VQ-VAD: Vector-quantized Motion Representation Learning for Human-centric Video Anomaly Detection

Video Anomaly Detection (VAD) is inherently challenging due to the scarcity of anomalies and the large visual variability in surveillance footage, including changes in lighting, viewpoint, and human appearance. To mitigate visual noise and address privacy concerns, recent work has shifted to pose-based VAD, which focuses on motion dynamics rather than raw video data.

arXiv AI
Aug 6

VQ-VAD: Vector-quantized Motion Representation Learning for Human-centric Video Anomaly Detection

arXiv:2608. 05069v1 Announce Type: cross Abstract: Video Anomaly Detection (VAD) is inherently challenging due to the scarcity of anomalies and the large visual variability in surveillance footage, including changes in lighting, viewpoint, and human appearance.

By Narges Rashvand, Ghazal Alinezhad Noghre, Shanle Yao, Gabriel Maldonado, Hamed Tabkhi
arXiv AI
6d ago

RoboVAD: A Large Cross-Domain Evaluation Benchmark for Anomaly Detection in Robotic Arm Manipulation Videos

RoboVAD is a large-scale benchmark for video anomaly detection in robotic arm manipulation, featuring cross-domain evaluation where both tasks and anomaly types are unseen during training. The dataset challenges existing VAD methods, with state-of-the-art approaches, including a new method tailored for robotic arms, still achieving less than 70% micro-averaged frame-level AUC in the hardest setting. The authors provide the dataset and code publicly for further research.

By Alexandru-Bogdan Dura, Sebastian Balmus, Radu Tudor Ionescu