arXiv Computer Vision

A VLM Answer Is Not an Anomaly Score: Rank Compression Across Image and Video Anomaly Detection

arXiv Computer Vision
Aug 24

A VLM Answer Is Not an Anomaly Score: Rank Compression in Training-Free Video Anomaly Detection

The paper investigates how vision‑language models (VLMs) can be used for training‑free video anomaly detection (VAD) by answering questions about video segments. It shows that the way a VLM’s output is converted into an anomaly score—either by taking only the most likely answer (generated readout) or by using the full probability distribution (probability readout)—has a significant impact on ranking performance. Across four large VLMs, the probability readout consistently outperforms the generated readout, achieving 5–13 point gains in AUROC or AP, because the generated readout compresses the rank order into only a few distinct scores.

By Inpyo Song, Jangwon Lee
arXiv Computer Vision
Sep 16

Probe-VAD: Ordinal Likelihood Probing for Training-Free Video Anomaly Detection

Probe‑VAD introduces an ordinal binary‑probing framework that leverages frozen vision‑language models for training‑free video anomaly detection. By querying ten ordered severity thresholds and extracting YES/NO continuation likelihoods, it builds a cumulative severity profile that is converted into a continuous anomaly score with isotonic projection for ordinal consistency. Experiments on public benchmarks show that this simple interface yields superior performance at low computational cost, avoiding the limitations of caption‑based compression or restricted numerical scoring.

By Jiawei Gu, Qilin Zhao, Tengkuo Guo, Zhiming Zhong, Shuangqing Zhang, Fan Lyu, Fang Zhao, Guo-Sen Xie, Caifeng Shan
arXiv Computer Vision
Oct 9

A Unified Score Matching Paradigm for Video Anomaly Detection and Anticipation

The paper introduces Uni-DSM, a unified score-driven framework that uses denoising score matching to model video anomaly patterns for both detection and anticipation. It employs a shared noise-conditioned score transformer backbone with scene-dependent embeddings and motion-aware weighting, and differentiates between VAD and VAA through autoregressive denoising and a self-distilled denoising mechanism. Experiments on multiple benchmarks show state‑of‑the‑art performance for both tasks while maintaining high efficiency.

By Congqi Cao, Zhenhe Liang, Hanwen Zhang, Yifan Zhao, Qinyi Lv, Lingtong Min, Yanning Zhang
arXiv AI
Sep 10

Parser-Free VLM Verification for Federated Weakly Supervised Video Anomaly Detection

The paper proposes a lightweight federated multiple‑instance learning (MIL) framework that trains only a compact MIL scorer across distributed clients while using a frozen vision‑language model (VLM) to verify high‑scoring video segments post‑hoc. Two VLM feedback interfaces are explored: a parsed text‑generation interface and a logit‑based interface that derives a continuous anomaly score from next‑token Yes/No probabilities. Experiments on UCF‑Crime with InternVL3.5‑2B and Qwen3‑VL‑2B‑Instruct show that the logit interface consistently improves frame‑level AUC and AP over the MIL baseline without requiring temporal post‑processing, whereas the text‑generation interface is more sensitive to prompts, parsers, and model choice.

By S\'ebastien Thuau, Amira Gran, Siba Haidar, Rachid Chelouah
arXiv Machine Learning
Oct 23

MoG-VLM: Efficient Video Anomaly Detection through Motion-Guided Vision-Language Models

MoG-VLM is a motion‑guided vision‑language model designed for efficient video anomaly detection. It uses a lightweight motion signal, Temporal Gradient Magnitude, to perform content‑aware sampling and activates dense multi‑frame VLM reasoning only around frames with high anomaly likelihood via a hierarchical dual‑stream design. The method achieves state‑of‑the‑art AUC‑ROC scores on four benchmarks and delivers a 1.31× inference speedup on XD‑Violence.

By Khaled Waleed Dawoud, Muhammad Zaigham Zaheer, Khan Muhammad, Muhammad Haris Khan