arXiv Computer Vision

LAION-Mobile: Evaluating Deepfake Detectors On One Million Smartphone Photos

The paper introduces LAION-Mobile, a new dataset of roughly one million smartphone images with EXIF metadata, designed to test deepfake detectors on modern computational photography content. Twelve state‑of‑the‑art detectors were evaluated on a 9,115‑image subset, revealing that none achieved an AUC above 0.624 on AI‑generated images and five performed worse than chance. The study also shows that threshold calibration on legacy data can hide high false‑alarm rates, with some detectors flagging 17–91 % of real photos when recalibrated for modern content.

Hugging Face Trending Papers
Sep 10

LAION-Mobile: Evaluating Deepfake Detectors On One Million Smartphone Photos

The paper introduces LAION-Mobile, a 1‑million‑image dataset of modern smartphone photos with EXIF metadata, to test deepfake detectors in a realistic computational‑photography setting. Twelve state‑of‑the‑art detectors were evaluated on a 9,115‑image subset, revealing that none achieved an AUC above 0.624 on AI‑generated content and that many detectors’ false‑alarm rates spike when thresholds are recalibrated for modern smartphone imagery. The study shows that current detectors fail to maintain both high detection performance and low false‑alarm rates on contemporary smartphone photos, highlighting a critical gap in existing evaluation benchmarks.

arXiv AI
Jun 29

Deepfake Media Generation and Detection in the Generative AI Era: A Survey and Outlook

arXiv:2411. 19537v2 Announce Type: replace-cross Abstract: We survey deepfake generation and detection techniques, covering all deepfake media types: image, video, audio and multimodal content.

By Florinel-Alin Croitoru, Andrei-Iulian Hiji, Vlad Hondru, Nicolae Catalin Ristea, Paul Irofti, Marius Popescu, Cristian Rusu, Radu Tudor Ionescu, Fahad Shahbaz Khan, Mubarak Shah