arXiv Computer Vision

ChatGPT Images 2.5 on Forgery Tasks: Testing Advertised Improvements Against Known Answers

arXiv Computer Vision
Oct 27

DOCFORGE-BENCH: A Comprehensive 0-shot Benchmark for Document Forgery Detection and Analysis

arXiv:2603.01433v3 Announce Type: replace Abstract: We present DOCFORGE-BENCH, the first unified zero-shot benchmark for document forgery detection, evaluating 14 methods across eight datasets spanni...

By Zengqi Zhao, Weidi Xia, En Wei, Yan Zhang, Jane Mo, Tiannan Zhang, Yuanqin Dai, Zexi Chen, Yiran Tao, Simiao Ren
arXiv AI
Oct 27

GPT4o-Receipt: A Dataset and Human Study for AI-Generated Document Forensics

GPT4o-Receipt is a benchmark dataset of 1,235 receipt images that pairs GPT‑4o‑generated receipts with authentic ones from established datasets. The study evaluates five state‑of‑the‑art multimodal LLMs and a 30‑annotator crowdsourced perceptual study, revealing that humans are better at spotting AI artifacts yet perform worse at binary detection than models like Claude Sonnet 4 and Gemini 2.5 Flash. The paradox is explained by the fact that the dominant forensic signals—arithmetic errors—are invisible to visual inspection but can be quickly verified by LLMs.

By Yan Zhang, Simiao Ren, Ankit Raj, En Wei, Dennis Ng, Alex Shen, Jiayu Xue, Yuxin Zhang, Evelyn Marotta
arXiv Computer Vision
Oct 16

Beyond Generation: Using Multimodal LLMs as Detectors of LLM-Generated Deepfake Facial Images

The paper evaluates whether multimodal large language models (MLLMs) can serve as forensic detectors of deepfake facial images. Six MLLMs—including GPT-4o, GPT-5, GPT-5.2, Gemini 2.5, Gemini 3, and Seed 1.6—were tested on a dataset of 400 images (50 authentic and 350 synthetic) generated by seven leading image models. Results show that several MLLMs achieve high detection accuracy, with GPT-5.2 reaching 97.9% in pairwise comparisons, but the presence of invisible SynthID watermarks can reduce detection performance by about 10% for Gemini.

By Olivia Salamon, Virginia N. L. Franqueira, Shujun Li
arXiv Computer Vision
Oct 19

BG-REAL: A Public Real-Data Anchored Benchmark for Background Manipulation Detection and Localization

BG-REAL is a public benchmark for detecting and localizing background manipulations in images, built from Open Images V7 with 7,000 processed samples across 1,200 source groups. It includes 6,000 real-data anchored samples, 1,000 synthetic controls, six edit families, matched authentic controls, and extensive quality‑control measures. The release offers a construction pipeline, evaluation protocol, and three external baseline results, highlighting false‑positive rates due to re‑encoding artifacts.

By Bugra Alperen Uluirmak, Rifat Kurban
Hugging Face Trending Papers
Sep 3

OCR-EDR: Rendering-Aware Diagnosis and Repair for Closed-Loop OCR Improvement

OCR-EDR is a rendering‑aware framework that diagnoses and repairs OCR errors by jointly evaluating an OCR prediction, its editable form, and the rendered image of the source document. It localizes genuine mistakes while preserving valid or rendering‑equivalent predictions, then applies executable edits and iteratively reassesses with updated renderings. On the newly constructed OCRErrBench, the DocEDR model achieves 94.78% diagnostic accuracy and repairs 86.23% of errors, boosting formula metrics by up to 30.99 percentage points and improving CDM scores on several OCR systems.