The paper introduces LAION-Mobile, a 1‑million‑image dataset of modern smartphone photos with EXIF metadata, to test deepfake detectors in a realistic computational‑photography setting. Twelve state‑of‑the‑art detectors were evaluated on a 9,115‑image subset, revealing that none achieved an AUC above 0.624 on AI‑generated content and that many detectors’ false‑alarm rates spike when thresholds are recalibrated for modern smartphone imagery. The study shows that current detectors fail to maintain both high detection performance and low false‑alarm rates on contemporary smartphone photos, highlighting a critical gap in existing evaluation benchmarks.
arXiv:2607. 13234v1 Announce Type: cross Abstract: Deepfake detectors that achieve near-perfect scores on academic benchmarks collapse on real-world content: recent in-the-wild evaluations report AUC drops of 45-50% for state-of-the-art open-source models.
By Ken Jon Miyachi, Dylan Uys
arXiv:2607. 06254v1 Announce Type: cross Abstract: Deepfake image detection is currently served by three fundamentally different paradigms: commercial APIs, zero-shot vision-language models (LLMs), and open-source detectors.
By Sharayu N. Deshmukh, Md Rashidunnabi, Nelton Tiago Gemo, Kurundkar G. D., Mahamune M. R., Nilesh K. Deshmukh
arXiv:2608. 03096v1 Announce Type: cross Abstract: Recent advances in video generation models have significantly intensified the deepfake threat, yet the current deepfake video detection benchmarks remain underdeveloped.
By Pei Li, Sihan Chen, Delong Ran, Tianshuo Cong
Recent advances in video generation models have significantly intensified the deepfake threat, yet the current deepfake video detection benchmarks remain underdeveloped. In particular, the effectiveness of image-level detectors in the video domain has not been systematically assessed.
arXiv:2609.01027v1 Announce Type: new
Abstract: Out-of-distribution (OOD) detection predicts whether a test image belongs to none of the predefined classes. To evaluate this task, benchmarks need ima...
By Ruslan Rozumnyi, Mat\v{e}j Such\'anek, Tom\'a\v{s} Voj\'i\v{r}, Kl\'ara Janou\v{s}kov\'a, Ji\v{r}\'i Matas