← Back to all news
arXiv AI By Yan Zhang, Simiao Ren, Ankit Raj, En Wei, Dennis Ng, Alex Shen, Jiayu Xue, Yuxin Zhang, Evelyn Marotta

GPT4o-Receipt: A Dataset and Human Study for AI-Generated Document Forensics

Read the original on arXiv AI →

GPT4o-Receipt is a benchmark dataset of 1,235 receipt images that pairs GPT‑4o‑generated receipts with authentic ones from established datasets. The study evaluates five state‑of‑the‑art multimodal LLMs and a 30‑annotator crowdsourced perceptual study, revealing that humans are better at spotting AI artifacts yet perform worse at binary detection than models like Claude Sonnet 4 and Gemini 2.5 Flash. The paradox is explained by the fact that the dominant forensic signals—arithmetic errors—are invisible to visual inspection but can be quickly verified by LLMs.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

Related stories

arXiv Computer Vision
4d ago

DOCFORGE-BENCH: A Comprehensive 0-shot Benchmark for Document Forgery Detection and Analysis

arXiv:2603.01433v3 Announce Type: replace Abstract: We present DOCFORGE-BENCH, the first unified zero-shot benchmark for document forgery detection, evaluating 14 methods across eight datasets spanni...

By Zengqi Zhao, Weidi Xia, En Wei, Yan Zhang, Jane Mo, Tiannan Zhang, Yuanqin Dai, Zexi Chen, Yiran Tao, Simiao Ren
llmsdiffusionroboticsfine-tuningbenchmarks
More like this →
arXiv Computer Vision
Sep 22

Dissecting Agentic Forensics: The Role of Triage, Prompting, and Evidence Arbitration in Open-World Fake Image Detection

The paper investigates an agentic framework for open‑world fake image detection that combines specialist detectors with per‑detector triage, prompting, and conflict‑aware evidence arbitration. Experiments across six configurations and three multimodal large language model backbones reveal that naive detector fusion yields high false‑positive rates, while triage and prompting consistently filter unreliable evidence. The most significant improvement comes from the reasoning component: a stronger judge markedly outperforms a weaker one, especially under distribution shift, and overall manipulation recall is nearly saturated, highlighting that the key challenge lies in calibrating trust and arbitrating conflicting forensic evidence rather than detecting manipulations themselves.

By Xianlong Li (IMT School for Advanced Studies Lucca, Italy), Pietro Bongini (University of Siena, Italy), Niccol\'o Pancino (University of Siena, Italy), Marco Blanchini (IMT School for Advanced Studies Lucca, Italy), Benedetta Tondi (University of Siena, Italy), Mauro Barni (University of Siena, Italy)
llmsagentsroboticsmultimodal
More like this →