arXiv Machine Learning

Format-Controlled Multi-Scale JPEG Compression Response Analysis for Image-Level Forgery Screening

arXiv:2607. 06615v1 Announce Type: cross Abstract: Image forgery detection is a critical task in digital forensics, yet many deep-learning localization approaches are typically GPU-accelerated and computationally heavier than handcrafted screening methods.

arXiv Machine Learning
Sep 1

Data Diversity, Not Frequency Invariance: A Controlled and Self-Audited Study of Compression-Robust Deepfake Detection

The study challenges the prevailing belief that frequency-based features and compression-invariant learning are essential for robust deepfake detection. Using a controlled, pre‑registered protocol, a simple EfficientNet‑B0 trained on diverse multi‑quality data outperformed the more complex CAFRL model across all compression levels, with a 3.66 AUC point advantage at CRF 40. After identifying and correcting four experimental defects, the authors found that frequency features added no marginal benefit, while data diversity—particularly real constant‑rate‑factor variants—proved to be the key factor for robustness against H.264 re‑encoding.

By Abbas Aliyev, Samir Rustamov
arXiv Computer Vision
Aug 25

Reduce the Artifacts Bias for More Generalizable AI-Generated Image Detection

The paper proposes Artifact-Complementary Expert Fusion (ACEF), a two‑stage framework that enhances AI‑generated image detection by combining two types of reconstruction artifacts—VAE/DDIM and SRGAN—into aligned synthetic negatives. ACEF first builds artifact‑specific experts using LoRA adaptation on a frozen backbone, then fuses their multi‑layer evidence with Layer‑wise Artifact‑Complementary Fusion (LACF) to mitigate conflicts between artifact manifolds. Experiments on 13 benchmarks show that this approach improves generalizability over existing state‑of‑the‑art methods.

By Yiheng Li, Yang Yang, Wenhao Wang, Zichang Tan, Zecheng Lin, Li Gao, Zhen Lei
arXiv Computer Vision
Sep 3

From Detection to Localization: A Unified Forensics Framework for Fully Synthetic and Tampered Images

The paper proposes a unified forensics framework that extends traditional binary image manipulation detection to a multiclass setting—distinguishing real, fully synthetic, and tampered images. It adds a segmentation branch for pixel‑level localization of tampered regions, achieving higher classification accuracy and IoU scores compared to recent benchmarks. The authors provide the implementation on GitHub for reproducibility.

By Annalisa Gallina, Marco Fiorucci, Marco Brigo, Federica Battisti, Lamberto Ballan
arXiv Computer Vision
Aug 31

FUSED: Forensic-Semantic Mixture-of-Experts for AI Inpainting Detection and Localization

FUSED is a new framework that jointly detects and localizes AI-generated inpainting by combining low-level forensic cues with high-level semantic features through a sparsely-gated Mixture-of-Experts architecture. It predicts both an image-level manipulation score and a pixel-level mask of the inpainted region. On the OpenSDID cross-generator benchmark, FUSED outperforms existing methods, especially on unseen generators, and transfers effectively to the AutoSplice and CocoGlide benchmarks, doubling localization performance.

By Anton Nuzhdin, Marcel Worring, Ivona Najdenkoska
arXiv Computer Vision
6d ago

ManiVid: Unified and Explainable Forensic Analysis of Manipulated Videos

ManiVid introduces a unified forensic analysis framework for manipulated videos, combining forgery detection, artifact grounding, and anomaly explanation. The authors release ManiVid-38K, a large dataset of 19K real‑fake video pairs with authenticity labels, forgery masks, and explanations, and a benchmark ManiVidBench with 1K balanced pairs. ManiVidLens, the proposed model, outperforms existing methods in artifact grounding and anomaly explanation while matching state‑of‑the‑art detection accuracy.

By Hengrui Kang, Zhonghao Yan, Yuxuan Yang, Ruoyan Jing, Yuncheng Guo, Hao Chen, Kongming Liang, Zhanyu Ma, Conghui He, Weijia Li
arXiv Computer Vision
4d ago

RED: Reconstruction Evolution Dynamics for Generalizable AI-Generated Image Detection

The paper introduces RED (Reconstruction Evolution Dynamics), a new framework for detecting AI-generated images that leverages the evolution of intermediate reconstruction stages rather than relying solely on static representations or endpoint discrepancies. RED uses a frozen multiscale VQ‑VAE and a frozen CLIP encoder to capture a reconstruction trajectory, then learns image‑adaptive stage weights from token negative log‑likelihoods provided by a frozen VAR model. Experiments on six benchmarks show RED achieves the highest average accuracy (92.5%) and precision (97.5%) among evaluated methods, and it remains robust to common image degradations.

By Wenpeng Mu, Junshan Jin, Tanfeng Sun, Xinghao Jiang, Qiang Xu
arXiv AI
3d ago

FoCLIP: A Feature-Space Misalignment Framework for CLIP-Based Image Manipulation and Detection

FoCLIP is a framework that creates adversarial examples to manipulate CLIP-based image quality metrics by reducing the alignment between image and text features. It uses stochastic gradient descent to combine feature alignment, score distribution balancing, and pixel‑guard regularization, enabling high CLIPscore predictions while maintaining visual fidelity. Experiments on artistic prompts and ImageNet show significant CLIPscore gains, and the authors also propose a color‑channel sensitivity detection method that achieves 91% accuracy.

By Yulin Chen, Zeyuan Wang, Tianyuan Yu, Yingmei Wei, Liang Bai