A Multi-Domain Benchmark for Detecting AI-Generated Text-Rich Images from GPT-Image-2
arXiv:2606. 19259v1 Announce Type: cross Abstract: Text-rich images often contain privacy-sensitive, transactional, or decision-relevant information.
arXiv:2606. 19259v1 Announce Type: cross Abstract: Text-rich images often contain privacy-sensitive, transactional, or decision-relevant information.
arXiv:2603.01433v3 Announce Type: replace Abstract: We present DOCFORGE-BENCH, the first unified zero-shot benchmark for document forgery detection, evaluating 14 methods across eight datasets spanni...
The study evaluates machine‑generated text detectors on scientific literature, finding that many detectors perform near perfectly on certain benchmarks due to superficial formatting cues rather than genuine linguistic differences. A logistic regression using 27 superficial features achieved macro‑F1 scores between 0.833 and 0.997, outperforming other detectors on arXiv subsets. The most powerful cue was the PDF extraction artifact—human texts preserve line breaks while generated texts appear as a single block—allowing classification at 0.996 AUC. By introducing format counterfactuals and normalizing formatting, the authors demonstrate that re‑wrapping machine‑written abstracts can flip 20–27% of detector decisions, reducing the generalization gap and improving out‑of‑domain performance.
arXiv:2602.20569v2 Announce Type: replace Abstract: We present AIForge-Doc, the first dedicated benchmark targeting exclusively diffusion-model-based inpainting in financial and form documents with p...
Distinguishing machine-generated text (MGT) from human-written text (HWT) becomes increasingly important due to potential misuse. However, most supervised detectors often degrade out-of-domain (OOD) a...
arXiv:2606. 19259v2 Announce Type: replace-cross Abstract: Text-rich images often contain privacy-sensitive, transactional, or decision-relevant information.
arXiv:2610.28087v1 Announce Type: new Abstract: AI-generated images linked to news events and online claims can mislead audiences, enable fraud, or cause public controversy. We introduce WildAIGC-Ben...
The paper introduces SnapJudge, an image‑based AI detection system for math‑heavy scientific text, trained on screenshots of LaTeX‑generated PDFs. It shows that existing text‑only detectors like Pangram 4 lose accuracy as mathematical content increases, while fine‑tuned LaTeX detectors recover performance. SnapJudge achieves 92–93% detection rates at a 0.1% false‑positive rate, outperforming both Pangram 4 and text‑based models.
GPT4o-Receipt is a benchmark dataset of 1,235 receipt images that pairs GPT‑4o‑generated receipts with authentic ones from established datasets. The study evaluates five state‑of‑the‑art multimodal LLMs and a 30‑annotator crowdsourced perceptual study, revealing that humans are better at spotting AI artifacts yet perform worse at binary detection than models like Claude Sonnet 4 and Gemini 2.5 Flash. The paradox is explained by the fact that the dominant forensic signals—arithmetic errors—are invisible to visual inspection but can be quickly verified by LLMs.
DocXEval is the first comprehensive framework that adapts existing explainable AI methods and evaluation metrics to multimodal document understanding, covering text, layout, and image modalities. The authors systematically evaluate 13 XAI methods across 3 tasks, 8 datasets, 4 models, and 17 metrics, finding that Occlusion consistently performs best in faithfulness and interpretability. The study also provides meta‑evaluation insights, diagnostic analyses of modality contributions, spatial attribution patterns, and potential dataset biases, offering a benchmark and practical guide for future research.
arXiv:2606. 04906v1 Announce Type: cross Abstract: Although it is generally agreed that AI-generated text poses a broad societal risk, there is no common understanding in the AI-generated text detection literature on what constitutes harmful use.
arXiv:2502. 19716v3 Announce Type: replace-cross Abstract: Recent advances in visual generative models have enabled the creation of highly realistic, fully AI-generated images without relying on real source content.