arXiv AI

A Distribution-Free Framework for Rewrite-Based Human-text Detection via Knockoff Filtering

arXiv:2606. 00402v1 Announce Type: cross Abstract: We propose a distribution-free statistical framework that converts arbitrary rewrite-based detectors into detectors with finite-sample FDR guarantees without retraining.

arXiv AI
6d ago

Local Entropy Fluctuations for Black-Box LLM-Generated Text Detection

The paper introduces a new metric, Relative Peak Prominence Rate (RelPPR), to detect black-box LLM-generated text by measuring localized entropy fluctuations. It shows that existing dual-model and resampling-based detectors fail on instruction-conditioned text, and that RelPPR outperforms them across diverse models and datasets. The authors provide code for their detector on GitHub.

By Xinpeng Wang, Bruce Rushing, Zhizhen Chen, Zhe Zeng
arXiv Machine Learning
Sep 25

Robust Detection of LLM-Generated Text under Contamination

The paper investigates how to detect text generated by large language models (LLMs) when the data has been edited or contaminated. By modeling human and machine text as finite-order Markov processes with Huber contamination, the authors derive an exact boundary that determines when reliable detection is possible. They show that a clipped likelihood-ratio test can achieve vanishing worst‑case errors below this boundary and that clipping improves robustness across several detectors and datasets, yielding significant gains in true‑positive rates at a fixed false‑positive rate.

By Jiaxun Li, Saptarshi Chakraborty, Ambuj Tewari
arXiv Computation and Language
Aug 27

Unveiling Spectral Mechanisms in Training-Free LLM Text Detection

The paper investigates training‑free detection of machine‑generated text using spectral analysis. It shows that spectral energy correlates with variance in token probability trajectories and that human writing produces characteristic fluctuations, termed "generative vitality." The authors find that spectral signals are strongest for long, continuous, constrained generations, while shorter or mixed texts require additional confidence‑based metrics.

By Haitong Luo, Xuying Meng, Weiyao Zhang, Wenji Zou, Shengfeng Lou, Xuefeng Jiang, Chungang Lin, Yujun Zhang
arXiv AI
Oct 16

Hitting a Moving Target: Test-Time Adaptation for AI Text Detection under Continual Distribution Shift

The paper introduces a test‑time adaptation (TTA) method for AI text detection that addresses continual distribution shifts such as adversarial humanization, new large language models, and temporal drift in human writing. By exploiting inference‑time homogeneity among unlabeled samples, the TTA approach achieves robust performance, outperforming state‑of‑the‑art supervised detectors—e.g., improving detection of adversarial AI‑generated text from 27.0% to 93.3%. The study demonstrates that TTA can maintain high detection accuracy in real‑world, evolving deployment scenarios.

By Kevin Ren, Manish Raghavan, Nikhil Garg
arXiv Computation and Language
Oct 12

Measuring Artifact Reliance in Machine-Generated Text Detectors

The study evaluates machine‑generated text detectors on scientific literature, finding that many detectors perform near perfectly on certain benchmarks due to superficial formatting cues rather than genuine linguistic differences. A logistic regression using 27 superficial features achieved macro‑F1 scores between 0.833 and 0.997, outperforming other detectors on arXiv subsets. The most powerful cue was the PDF extraction artifact—human texts preserve line breaks while generated texts appear as a single block—allowing classification at 0.996 AUC. By introducing format counterfactuals and normalizing formatting, the authors demonstrate that re‑wrapping machine‑written abstracts can flip 20–27% of detector decisions, reducing the generalization gap and improving out‑of‑domain performance.

By Anastasia Voznyuk, Andrey Grabovoy