arXiv Computer Vision By Mingjie Li, Yukun Jiang, Yicong Tan, Yang Zhang

WildFakeToolBench: Benchmarking AI-Generated Image Detectors with Web-Sourced Image Processing

Read the original on arXiv Computer Vision →

WildFakeToolBench is a benchmark suite comprising 156 executable image‑processing tools sourced from 220 public repositories across 142 domains. The suite evaluates six state‑of‑the‑art AI‑generated image detectors on 105 images processed by these tools, revealing that some tools can evade detectors with success rates up to 100%. The study demonstrates that web‑sourced tools pose significant in‑the‑wild risks and underscores the need for robust detector evaluation frameworks.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computer Vision.

arXiv AI
6d ago

How well are open sourced AI-generated image detection models out-of-the-box: A comprehensive benchmark study

The study evaluates 16 AI‑generated image detection methods in a zero‑shot setting, testing 23 pretrained variants on 12 datasets with 2.6 million images from 291 generators. Results show no single detector consistently outperforms others, with accuracy ranging from 37.5 % to 75.0 %. The study highlights that training data alignment and generator type significantly affect performance, especially against modern commercial models, and identifies systematic failure patterns across datasets.

By Simiao Ren (Neo), Yuchen Zhou (Neo), Xingyu Shen (Neo), Kidus Zewde (Neo), Tommy Duong (Neo), George Huang (Neo), Hatsanai (Neo), Tiangratanakul (Dennis), Tsang (Dennis), Ng (Dennis), En Wei, Jiayu Xue