arXiv Machine Learning

Forensics Adapter: Unleashing CLIP for Generalizable Face Forgery Detection

arXiv:2411. 19715v4 Announce Type: replace-cross Abstract: We describe Forensics Adapter, an adapter network designed to transform CLIP into an effective and generalizable face forgery detector.

arXiv Computer Vision
Sep 17

Generalizable Face Forgery Detection via Separable Prompt Learning

The paper introduces Separable Prompt Learning (SePL), a method that enhances face forgery detection by leveraging CLIP’s textual encoder through two separate learnable prompts. SePL incorporates a cross-modality alignment strategy and specific objectives to distill forgery knowledge from CLIP. Experiments show that SePL outperforms existing approaches in cross-dataset and cross-method evaluations.

By Enrui Yang, Baoyuan Wu, Yuezun Li
arXiv Computer Vision
Sep 18

IMFD: End-to-end Multi-Face Forgery Detection through Instruction-based Large Vision-Language Models

The paper introduces IMFD, an end‑to‑end multi‑face forgery detector that uses instruction‑based Large Vision‑Language Models (LVLMs). IMFD jointly localizes faces and predicts forgery labels in a single stage, explicitly incorporating predicted face bounding boxes into the textual instruction to improve grounding and detection. Experiments on converted multi‑face forgery datasets show that IMFD outperforms several state‑of‑the‑art methods.

By Dasom Choi, Sangjun Moon, Hyeongchan Im, Jaeeon Park, Jingun Kwon, Hidetaka Kamigaito, Taro Watanabe, Manabu Okumura
arXiv AI
Sep 18

FORGE: Forensic Reasoning with Grounded Evidence

FORGE is a forensic deepfake analysis system that provides region‑grounded natural language explanations for image manipulations. It addresses the inductive bias mismatch of multimodal large language models by adding a Vision‑Only Model trained on dense patch prediction, allowing the language model to interleave tokens with preserved spatial correspondence. Across face‑manipulated and fully synthetic content, FORGE delivers fine‑grained attribute queries and outperforms in‑domain baselines, with region‑specific evaluation and human studies confirming explanation faithfulness.

By Rohit Kundu, Shan Jia, Vishal Mohanty, Athula Balachandran, Amit K. Roy-Chowdhury
arXiv Computer Vision
4d ago

From Sharp Eyes to Expert Mind: Internalizing Expert Knowledge in MLLMs for Tampered Text Detection

arXiv:2609.36145v1 Announce Type: new Abstract: Tampered Text Detection (TTD) is essential for safeguarding document authenticity in security-critical workflows. Existing expert models are effective...

By Kaiqing Lin, Songze Li, Shen Chen, Yunfei Guo, Xiaoye Qiu, Haodong Li, Taiping Yao, Bo Wang, Youchang Xiao, Bin Li, Shouhong Ding
arXiv AI
Sep 25

Band-Attention Modulation Network for Robust Face Forgery Detection

The paper introduces Band-Attention Modulation Network (BAM‑Net), a face forgery detection framework that learns fine‑grained, adaptive modulation of frequency bands in the Discrete Cosine Transform spectrogram. BAM‑Net dynamically reweights anti‑diagonal frequency bands to enhance forgery‑related spectral cues while suppressing irrelevant information, then fuses this modulated frequency data with spatial features using a lightweight backbone with distance‑decayed attention. Experiments on FaceForensics++, Celeb‑DF, and DFDC show that BAM‑Net achieves state‑of‑the‑art performance and strong generalization across datasets, compression levels, and manipulation types.

By Zhida Zhang, Wenkui Yang, Xinlei Ma, Qihang Fan, Jie Cao
arXiv AI
Aug 28

High-Fidelity Face Content Recovery via Tamper-Resilient Versatile Watermarking

The paper introduces VeriFi, a watermarking framework that protects face images from AI‑generated manipulation. It embeds a compact semantic latent watermark to preserve content, localizes pixel‑level edits without explicit payloads, and simulates realistic deepfake attacks to improve robustness. Experiments on CelebA‑HQ and FFHQ show that VeriFi outperforms existing methods in robustness, localization accuracy, and recovery quality.

By Peipeng Yu, Jinfeng Xie, Chengfu Ou, Xiaoyu Zhou, Jianwei Fei, Yunshu Dai, Zhihua Xia, Chip Hong Chang