arXiv Machine Learning

What Do Interaction Representations Actually Measure? Pre-Event Separability in Weakly-Supervised Violence Detection

The paper investigates whether detailed articulated human pose provides more discriminative power than coarse spatial relationships for early violence detection. By fixing the downstream pipeline and comparing five interaction representations—including bounding‑box geometry, handcrafted pose analogues, enriched pose descriptors, and a learned joint encoder—the study finds that pose‑based representations do not outperform coarse geometry. When visual encoders are frozen and evaluated on larger datasets, person‑crop appearance and whole‑frame context outperform geometry, but cropping to interacting people offers no advantage over encoding the entire frame. The authors further demonstrate that pre‑onset frames contain source‑related artifacts (e.g., title cards, watermarks) that contribute significantly to discrimination, suggesting that benchmark performance may reflect these artifacts rather than true event evidence.

arXiv Computer Vision
Aug 25

Frame-Level Evaluation in Weakly Supervised Video Anomaly Detection Mostly Measures Video-Level Ranking

The paper investigates how weakly supervised video anomaly detectors, trained with only video‑level labels, are evaluated using frame‑level metrics such as Micro‑AUROC and AP. It shows that these metrics largely measure a detector’s ability to separate different videos rather than correctly ordering anomalous moments within a single video, a phenomenon termed temporal dilution. Experiments demonstrate that a detector can achieve high pooled scores even when it assigns the same score to every frame in a video, indicating that current evaluation practices may overstate temporal localization performance.

By Inpyo Song, Jangwon Lee
arXiv Computer Vision
Sep 2

Mind the Rift: Cross-Scale Coupling Mismatch for AI-Generated Video Detection

The paper introduces RIFT, a forensic framework for detecting AI-generated videos by exploiting a cross‑scale coupling mismatch between macro‑level temporal dynamics and micro‑level pixel residuals. RIFT comprises a macro stream that models expected temporal evolution, a micro stream that probes residual patterns, and a coupling divergence module that quantifies their conditional dependency. Experiments on VidProM and GenVidBench show near‑perfect F1‑scores and robust performance across different encoders.

By Siyu Li, Jin Yang, Weiheng Liang
arXiv Computer Vision
Aug 27

CoRE: Weakly Supervised Coarse-to-Fine Risk Evidence Learning in Driving Videos

CoRE is a weakly supervised framework that learns fine-grained temporal and entity support for perceived risk in driving videos using only coarse video-level judgments. It first trains a video-level predictor, freezes it, and then uses structured interventions over candidate temporal regions or entity tracks to generate graded prediction-effect targets. These targets train a student model that can predict temporal and entity support directly from the original video, enabling fine-grained evidence localization without requiring detailed annotations.

By Kaiser Hamid, Can Cui, Nade Liang