arXiv AI

Strictly Causal Streaming Video Anomaly Detection with a Theoretically-Grounded State-Space Core

The paper presents a strictly causal streaming video anomaly detector that updates a fixed‑size state in constant time per frame, eliminating the need for clip buffering or lookahead. Its core is a diagonal linear state‑space recurrence with a decay gate, trained via self‑supervised next‑embedding prediction on a frozen visual backbone. The authors derive a closed‑form link between the recurrence’s decay spectrum and detection delay, validate on UCSD Ped2 and CUHK Avenue, and report real‑time latency on Apple M3 Pro hardware (≈0.75 ms per frame).

arXiv Machine Learning
Oct 23

MoG-VLM: Efficient Video Anomaly Detection through Motion-Guided Vision-Language Models

MoG-VLM is a motion‑guided vision‑language model designed for efficient video anomaly detection. It uses a lightweight motion signal, Temporal Gradient Magnitude, to perform content‑aware sampling and activates dense multi‑frame VLM reasoning only around frames with high anomaly likelihood via a hierarchical dual‑stream design. The method achieves state‑of‑the‑art AUC‑ROC scores on four benchmarks and delivers a 1.31× inference speedup on XD‑Violence.

By Khaled Waleed Dawoud, Muhammad Zaigham Zaheer, Khan Muhammad, Muhammad Haris Khan
arXiv Computer Vision
Oct 9

Memory Forcing: Attendable Mid-Horizon History for Streaming Video Generation

Memory Forcing is a new few‑step streaming method for autoregressive video diffusion that keeps a diverse mid‑horizon history without enlarging the KV cache. It partitions the cache into Archive, Working, and sink banks, and uses Bank‑aware RoPE to keep each bank distinguishable even as absolute temporal indices drift. Experiments show that at 1.3B parameters it outperforms other methods on longer clips, maintains subjects and scenes when they leave and re‑enter the window, and scales to a 5B model that produces more realistic, dynamic videos.

By Jiaming Zhang, Xinyu Wang, Huafeng Shi, Gangshan Wu, Limin Wang
arXiv Machine Learning
Sep 25

Albireo: Adaptive, Energy-Efficient Inference Framework for Video Object Detection on the Edge

Albireo is an adaptive, energy‑efficient inference framework for video object detection on edge devices that wraps existing detectors without modification. It uses a 10‑dimensional Kalman filter per active object to decide when to skip detector calls, predicting bounding boxes on skipped frames at near‑zero GPU cost. Evaluated on BDD100K with YOLO and RF‑DETR detectors on NVIDIA Jetson AGX Thor and Orin, Albireo maintains AP@50 within ±1.2 pp of full‑frame inference while reducing energy consumption by 12.1–17.6 % and improving accuracy for some models.

By Amir Taherin, Jos\'e Cano, Bin Ren, Yanzhi Wang, David Kaeli