Real-Time Video Anomaly Detection Using YOLO Pose Estimation and CLIP-Based Semantic Scoring
Read the original on arXiv AI →The paper introduces a lightweight two‑stage system for real‑time video anomaly detection. First, YOLO v11n‑pose detects people and extracts seventeen skeletal keypoints in a single forward pass. Second, each cropped person region is encoded with CLIP ViT‑B/32 and compared via cosine similarity to predefined textual descriptions of anomalous behaviors, removing the need for optical flow, separate pose estimators, or density‑based scoring. Experiments on CUHK Avenue, ShanghaiTech Campus, and a custom indoor dataset achieve about 51 FPS on an NVIDIA Titan XP, a 3.36× speedup over a multi‑feature baseline, while preserving high frame‑level AUROC scores (89.26%, 70.26%, and 84.13%).
Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.