arXiv Computer Vision By Ali Safaei, Mohammad Kazemi

MS2CAST: A Video Anomaly Detection Framework via Multi-Scale Spatial Cross-Attention and Efficient Spatiotemporal Networks

Read the original on arXiv Computer Vision →

MS2CAST is a semi‑supervised video anomaly detection framework that fuses multi‑scale cross‑attention between a vision transformer (MViTv2‑S) and a CNN (ConvNeXt‑T) for spatial encoding, and replaces optical flow with two interchangeable spatiotemporal modules—SwinLSTM and VMRNN—operating in latent space. The training objective combines L1 loss, Gradient Difference Loss, and Multi‑Scale SSIM to enforce pixel‑level accuracy, sharpness, and structural fidelity. Experiments on UCSD Ped2, CUHK Avenue, and ShanghaiTech show competitive ROC‑AUC scores while using less than 1 GB of GPU memory.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computer Vision.

arXiv AI
Sep 7

Adaptive Multi-Granularity Temporal Modeling for Weakly Supervised Video Anomaly Detection

The paper introduces an adaptive temporal modeling framework for weakly supervised video anomaly detection that addresses the limitations of rigid Multiple Instance Learning approaches. It presents a Temporal Refinement Module using dynamic positional encoding and a learnable class token to capture long‑range dependencies, and an Event Segmentation Module that identifies event boundaries via temporal discontinuity analysis to produce discriminative event‑level representations. An adaptive similarity‑based fusion strategy replaces fixed top‑k heuristics, dynamically integrating snippet‑level and event‑level anomaly scores into video‑level predictions, and the method outperforms state‑of‑the‑art baselines on two benchmarks.

By Changyi Li, Yu Xiao
arXiv AI
Jul 13

Event Stream based Multi-Modal Video Anomaly Detection: A Benchmark Dataset and Algorithms

arXiv:2607. 09114v1 Announce Type: cross Abstract: Video anomaly detection (VAD) is critical for automated surveillance but remains fragile under challenging conditions such as illumination variations, fast motion, and complex backgrounds when relying solely on visible light videos.

By Peipei Zhu, Yueqing Niu, Lin Zhu, Guanchong Niu, Yang Yu, Zheng Li
arXiv Machine Learning
Sep 10

Hyperspectral Trajectory Image for Multi-Month Trajectory Anomaly Detection

The paper introduces TITAnD, a Trajectory Image Transformer that converts dense and sparse GPS trajectories into a Hyperspectral Trajectory Image (HTI) and applies vision-based classification and segmentation for anomaly detection. It employs a Cyclic Factorized Transformer (CFT) that splits attention along within-day and across-day axes, drastically reducing computational cost and enabling multi-month analysis. Empirical results show TITAnD outperforms existing sparse and dense benchmarks, achieving higher AUC-PR and faster inference than comparable Transformers.

By Md Awsafur Rahman, Chandrakanth Gudavalli, Hardik Prajapati, B. S. Manjunath
arXiv Computer Vision
Oct 9

A Unified Score Matching Paradigm for Video Anomaly Detection and Anticipation

The paper introduces Uni-DSM, a unified score-driven framework that uses denoising score matching to model video anomaly patterns for both detection and anticipation. It employs a shared noise-conditioned score transformer backbone with scene-dependent embeddings and motion-aware weighting, and differentiates between VAD and VAA through autoregressive denoising and a self-distilled denoising mechanism. Experiments on multiple benchmarks show state‑of‑the‑art performance for both tasks while maintaining high efficiency.

By Congqi Cao, Zhenhe Liang, Hanwen Zhang, Yifan Zhao, Qinyi Lv, Lingtong Min, Yanning Zhang