arXiv Computer Vision

Copy What Is Seen, Generate What Is Not: Training-Free Anomaly-Aware Video Restoration

arXiv Computer Vision
Sep 1

PERSIST: Persistent-State Discrimination for Shot Boundary Detection

PERSIST redefines shot boundary detection as a task of semantic discrimination, requiring a persistent update of a video’s latent temporal state rather than a transient visual change. It employs a FiLM‑conditioned sinusoidal representation network and a structured discriminator that fuses local change, transient impulse, and return‑to‑trend cues into a single interpretable per‑frame signal. The method achieves comparable recall to leading detectors while significantly reducing false positives from flash, text overlay, and archival artifacts, and it is trained solely on real transitions from ClipShots.

By Tingyu Lin, Christian Stippel, Armin Dadras, Jakob Zenzmaier, Florian Kleber, Wolfgang Aigner, Robert Sablatnig
arXiv Machine Learning
Oct 23

MoG-VLM: Efficient Video Anomaly Detection through Motion-Guided Vision-Language Models

MoG-VLM is a motion‑guided vision‑language model designed for efficient video anomaly detection. It uses a lightweight motion signal, Temporal Gradient Magnitude, to perform content‑aware sampling and activates dense multi‑frame VLM reasoning only around frames with high anomaly likelihood via a hierarchical dual‑stream design. The method achieves state‑of‑the‑art AUC‑ROC scores on four benchmarks and delivers a 1.31× inference speedup on XD‑Violence.

By Khaled Waleed Dawoud, Muhammad Zaigham Zaheer, Khan Muhammad, Muhammad Haris Khan
arXiv AI
Jul 28

EgoPlay: Event-Triggered Video Editing for Egocentric Streams

arXiv:2607. 24560v1 Announce Type: cross Abstract: We introduce EgoPlay, an event-triggered video-to-video editor for egocentric streams, obtained by fine-tuning a pretrained V2V diffusion transformer on event-conditioned data built primarily from Ego4D.

By Jinjie Mai, Gordon Guocheng Qian, Willi Menapace, Arpit Sahni, Chaoyang Wang, Ashkan Mirzaei, Runjia Li, Sergey Tulyakov, Bernard Ghanem, Peter Wonka, Rameen Abdal
Hugging Face Trending Papers
Jul 27

EgoPlay: Event-Triggered Video Editing for Egocentric Streams

We introduce EgoPlay, an event-triggered video-to-video editor for egocentric streams, obtained by fine-tuning a pretrained V2V diffusion transformer on event-conditioned data built primarily from Ego4D. Given a monocular video and an event-triggered prompt of the form "when X happens, do Y," EgoPlay infers whether and when event X occurs, preserves pre-event frames, and applies edit Y only to the post-event continuation.

arXiv Computer Vision
Oct 9

A Unified Score Matching Paradigm for Video Anomaly Detection and Anticipation

The paper introduces Uni-DSM, a unified score-driven framework that uses denoising score matching to model video anomaly patterns for both detection and anticipation. It employs a shared noise-conditioned score transformer backbone with scene-dependent embeddings and motion-aware weighting, and differentiates between VAD and VAA through autoregressive denoising and a self-distilled denoising mechanism. Experiments on multiple benchmarks show state‑of‑the‑art performance for both tasks while maintaining high efficiency.

By Congqi Cao, Zhenhe Liang, Hanwen Zhang, Yifan Zhao, Qinyi Lv, Lingtong Min, Yanning Zhang
arXiv AI
Oct 26

Efficient Zero-Shot Video Anomaly Detection via Signal-Aware Adaptive Fusion (SAAF)

Efficient Zero‑Shot Video Anomaly Detection via Signal‑Aware Adaptive Fusion (SAAF) introduces a framework that leverages dual‑signal adaptive sampling—delta and drift signals—to detect sudden and gradual anomalies without training data. It employs a threshold‑gated cascaded architecture that first applies lightweight frame‑level scoring before invoking costly video‑level analysis only when needed, and a signal‑aware weighted fusion mechanism that adapts score combination based on the triggering signal. Across four benchmarks, SAAF achieves state‑of‑the‑art accuracy on XD‑Violence, MSAD, and ShanghaiTech while delivering significant throughput improvements over prior zero‑shot methods.

By Khaled Waleed Dawoud, Muhammad Haris Khan