arXiv Computer Vision

Benchmarking Spatial, Spectral, and Self-Supervised Cues for Face Forgery Detection under Realistic Degradation

arXiv AI
Sep 25

Band-Attention Modulation Network for Robust Face Forgery Detection

The paper introduces Band-Attention Modulation Network (BAM‑Net), a face forgery detection framework that learns fine‑grained, adaptive modulation of frequency bands in the Discrete Cosine Transform spectrogram. BAM‑Net dynamically reweights anti‑diagonal frequency bands to enhance forgery‑related spectral cues while suppressing irrelevant information, then fuses this modulated frequency data with spatial features using a lightweight backbone with distance‑decayed attention. Experiments on FaceForensics++, Celeb‑DF, and DFDC show that BAM‑Net achieves state‑of‑the‑art performance and strong generalization across datasets, compression levels, and manipulation types.

By Zhida Zhang, Wenkui Yang, Xinlei Ma, Qihang Fan, Jie Cao
arXiv Computer Vision
Sep 18

IMFD: End-to-end Multi-Face Forgery Detection through Instruction-based Large Vision-Language Models

The paper introduces IMFD, an end‑to‑end multi‑face forgery detector that uses instruction‑based Large Vision‑Language Models (LVLMs). IMFD jointly localizes faces and predicts forgery labels in a single stage, explicitly incorporating predicted face bounding boxes into the textual instruction to improve grounding and detection. Experiments on converted multi‑face forgery datasets show that IMFD outperforms several state‑of‑the‑art methods.

By Dasom Choi, Sangjun Moon, Hyeongchan Im, Jaeeon Park, Jingun Kwon, Hidetaka Kamigaito, Taro Watanabe, Manabu Okumura
arXiv AI
Sep 3

Swin Meets EfficientNet: Lightweight Architectures for GAN-Based Face Forensics

The paper presents lightweight architectures for detecting GAN-generated synthetic faces, comparing a compact Swin Transformer, pre‑trained Swin‑Tiny and Swin‑Small models, and a hybrid EfficientNet‑B0 + Swin Transformer. Using the 140K Real and Fake Faces dataset, the hybrid model achieved 99% accuracy and 99.44% recall on 5,000 test images, outperforming both pure Swin variants and a CNN‑only baseline. The study demonstrates that combining hierarchical CNN features with shifted‑window self‑attention yields an efficient, computationally lightweight detection method.

By Sejuti Basu, Ashima Sood, Vijay Kumar, Sahil Sharma
arXiv AI
Aug 28

High-Fidelity Face Content Recovery via Tamper-Resilient Versatile Watermarking

The paper introduces VeriFi, a watermarking framework that protects face images from AI‑generated manipulation. It embeds a compact semantic latent watermark to preserve content, localizes pixel‑level edits without explicit payloads, and simulates realistic deepfake attacks to improve robustness. Experiments on CelebA‑HQ and FFHQ show that VeriFi outperforms existing methods in robustness, localization accuracy, and recovery quality.

By Peipeng Yu, Jinfeng Xie, Chengfu Ou, Xiaoyu Zhou, Jianwei Fei, Yunshu Dai, Zhihua Xia, Chip Hong Chang
arXiv Computer Vision
Oct 5

Interpretable Deepfake Detection in Videos via Explicit Forensic Features and Temporal Modeling

This paper presents an interpretable deepfake detection framework that explicitly encodes physically grounded forensic cues to analyze spatially and temporally coherent facial features in video sequences. The method transforms videos into identity-consistent facial trajectories, segments them into fixed-length temporal windows, and represents each frame with 68 structured descriptors across photometric, textural, geometric, and compression domains. These descriptors are processed by an LSTM to capture temporal dependencies, achieving strong F1-scores on four benchmark datasets and demonstrating robust cross-dataset generalization.

By Chahira Benhama, Mohand Sa\"id Allili, Assia Hamadene
arXiv Computer Vision
Sep 28

ManiVid: Unified and Explainable Forensic Analysis of Manipulated Videos

ManiVid introduces a unified forensic analysis framework for manipulated videos, combining forgery detection, artifact grounding, and anomaly explanation. The authors release ManiVid-38K, a large dataset of 19K real‑fake video pairs with authenticity labels, forgery masks, and explanations, and a benchmark ManiVidBench with 1K balanced pairs. ManiVidLens, the proposed model, outperforms existing methods in artifact grounding and anomaly explanation while matching state‑of‑the‑art detection accuracy.

By Hengrui Kang, Zhonghao Yan, Yuxuan Yang, Ruoyan Jing, Yuncheng Guo, Hao Chen, Kongming Liang, Zhanyu Ma, Conghui He, Weijia Li