arXiv Computer Vision

Deep Learning for Deepfake Image Detection: Comparative Model Evaluation and Gradient-Based Visual Attribution

The paper presents an explainable deep‑learning workflow for detecting deepfake images, comparing a compact convolutional model trained from scratch with a fine‑tuned ImageNet‑pretrained MobileNetV2 model. Using a balanced dataset of 140,000 real and fake faces, the pretrained model achieved 95.90% accuracy, outperforming the from‑scratch model’s 84.15% accuracy. Gradient‑weighted class activation mapping (Grad‑CAM) was employed to highlight image regions influencing predictions, and a Flask prototype was built for side‑by‑side inspection.

arXiv Computer Vision
4d ago

Only Train Once: Uncertainty-Aware One-Class Learning for Face Authenticity Detection

The paper introduces FADNet, a face authenticity detector that treats forgery detection as a one‑class classification problem, training only on authentic faces. It uses Evidential Deep Learning to measure uncertainty and a pseudo‑forgery generator to sharpen decision boundaries. Experiments on DF40 and ASFD show FADNet surpasses state‑of‑the‑art methods with 96.63% accuracy and 98.83% precision.

By Qingchao Jiang, Zhenxuan Hou, Zhiying Zhu, Zhenxing Qian, Xinpeng Zhang, Zaiwang Gu
arXiv AI
Sep 3

Swin Meets EfficientNet: Lightweight Architectures for GAN-Based Face Forensics

The paper presents lightweight architectures for detecting GAN-generated synthetic faces, comparing a compact Swin Transformer, pre‑trained Swin‑Tiny and Swin‑Small models, and a hybrid EfficientNet‑B0 + Swin Transformer. Using the 140K Real and Fake Faces dataset, the hybrid model achieved 99% accuracy and 99.44% recall on 5,000 test images, outperforming both pure Swin variants and a CNN‑only baseline. The study demonstrates that combining hierarchical CNN features with shifted‑window self‑attention yields an efficient, computationally lightweight detection method.

By Sejuti Basu, Ashima Sood, Vijay Kumar, Sahil Sharma
arXiv AI
Sep 18

FORGE: Forensic Reasoning with Grounded Evidence

FORGE is a forensic deepfake analysis system that provides region‑grounded natural language explanations for image manipulations. It addresses the inductive bias mismatch of multimodal large language models by adding a Vision‑Only Model trained on dense patch prediction, allowing the language model to interleave tokens with preserved spatial correspondence. Across face‑manipulated and fully synthetic content, FORGE delivers fine‑grained attribute queries and outperforms in‑domain baselines, with region‑specific evaluation and human studies confirming explanation faithfulness.

By Rohit Kundu, Shan Jia, Vishal Mohanty, Athula Balachandran, Amit K. Roy-Chowdhury
arXiv Computer Vision
6d ago

From GAN-Based Models to GPT-5: A Taxonomy-Guided Study of Human Performance in Detecting Deepfake Face Images

The paper introduces the Deepfake Face Artifact Taxonomy (DFAT) and uses it to create both general-purpose and model-specific training materials for detecting deepfake face images. An online experiment with 524 participants tested detection accuracy across five generative models—three GANs, one diffusion model, and one multimodal large language model (GPT‑5)—showing that detection performance varies strongly by model and that model‑specific training yields greater gains than general training. A five‑month follow‑up with 342 participants revealed stable detection accuracy and no increase in perceived stress, suggesting the training’s durability.

By Zhiqing Guo, Lixin Jia, Luning Sun, Xiaowei Chen, Guofeng Yu, Liejun Wang, Gaobo Yang, David Stillwell, Thorsten Holz, Shujun Li
arXiv Computer Vision
Sep 16

Unifying Semantic Priors and High-Frequency Traces: Enhancing V-JEPA with Mixture-of-Experts for Robust Synthetic Image Forensics

The paper introduces MoE-JEPA, a dual‑stream deepfake detection model that combines a V‑JEPA backbone with a Residual Mixture‑of‑Experts mechanism and a noise stream branch. It further incorporates a Gated Attention Multiple Instance Learning module to refine spatial semantic understanding. On the SID‑Set benchmark, MoE‑JEPA achieves a new state‑of‑the‑art accuracy of 95.54%, outperforming much larger models.

By Simone Teglia, Irene Amerini
arXiv Computer Vision
Oct 5

Interpretable Deepfake Detection in Videos via Explicit Forensic Features and Temporal Modeling

This paper presents an interpretable deepfake detection framework that explicitly encodes physically grounded forensic cues to analyze spatially and temporally coherent facial features in video sequences. The method transforms videos into identity-consistent facial trajectories, segments them into fixed-length temporal windows, and represents each frame with 68 structured descriptors across photometric, textural, geometric, and compression domains. These descriptors are processed by an LSTM to capture temporal dependencies, achieving strong F1-scores on four benchmark datasets and demonstrating robust cross-dataset generalization.

By Chahira Benhama, Mohand Sa\"id Allili, Assia Hamadene