arXiv Computer Vision
VCR-Bench: A Modular Open-Source Benchmark for Video Classification Robustness
Read the original on arXiv Computer Vision →The Flow has not summarised this story yet — read it at arXiv Computer Vision.
Related stories
arXiv AI
Aug 5
FakeI2V-Bench: Benchmarking the Applicability of Image-level Deepfake Detectors for Deepfake Video Detection
arXiv:2608. 03096v1 Announce Type: cross Abstract: Recent advances in video generation models have significantly intensified the deepfake threat, yet the current deepfake video detection benchmarks remain underdeveloped.
Hugging Face Trending Papers
Aug 4
FakeI2V-Bench: Benchmarking the Applicability of Image-level Deepfake Detectors for Deepfake Video Detection
Recent advances in video generation models have significantly intensified the deepfake threat, yet the current deepfake video detection benchmarks remain underdeveloped. In particular, the effectiveness of image-level detectors in the video domain has not been systematically assessed.
arXiv AI
Jul 8
VendorBench-100: A Unified Cross-Paradigm Benchmark for Deepfake Image Detection
arXiv:2607. 06254v1 Announce Type: cross Abstract: Deepfake image detection is currently served by three fundamentally different paradigms: commercial APIs, zero-shot vision-language models (LLMs), and open-source detectors.
arXiv Computer Vision
2d ago
Dataset Biases and Shortcut Learning in Motion-Based AI-Generated Video Detection
The paper examines four leading motion‑based AI‑generated video detectors and finds that three of them suffer from preprocessing and sampling biases that inflate their reported performance. These detectors rely heavily on motion patterns—specifically, the lower inter‑frame movement typical of synthetic videos—so their accuracy drops to near random when tested on datasets lacking this bias or after simple spatial augmentations. In contrast, a frequency‑based detector remains robust across all datasets, indicating that frequency‑domain methods may generalize better for detecting AI‑generated videos.
arXiv AI
Jul 21
ALLUDE: A Unified Evaluation System for Configurable Attacks in Differentiable Environments
arXiv:2607. 17077v1 Announce Type: cross Abstract: Adversarial attacks against vision models like object detectors are often evaluated under limited conditions, leaving their performance under-characterized.
arXiv Computer Vision
Oct 2
Video-Index: A Curated Meta-Benchmark for Video Understanding
arXiv:2610.00960v1 Announce Type: new Abstract: A video benchmark should reward the capability it claims to measure, yet models can exploit answer options, question text, or partial visual evidence....