arXiv Computation and Language

AI Writers Have a Consistent Stylometric Footprint, but AI Editors Do Not

The study demonstrates that text produced by large language models (LLMs) leaves a distinct stylometric footprint—primarily increased entropy and lexical diversity—across multiple models and domains. In contrast, AI editing of human text does not replicate this footprint; edited texts show only modest lexical diversity gains and reduced entropy, with lexical density emerging as the key distinguishing feature. Consequently, stylometric analysis can differentiate AI-generated from AI-edited content, but is less effective at distinguishing either from purely human writing.

arXiv Machine Learning
Jun 5

Operation-Guided Progressive Human-to-AI Text Transformation Benchmark for Multi-Granularity AI-Text Detection

arXiv:2606. 06481v1 Announce Type: cross Abstract: As AI writing assistants become increasingly integrated into real-world drafting and revision workflows, many documents are no longer purely human-written or AI-generated, but instead result from progressive human-AI co-editing.

By Sondos Mahmoud Bsharat, Jiacheng Liu, Xiaohan Zhao, Tianjun Yao, Xinyi Shang, Yi Tang, Jiacheng Cui, Ahmed Elhagry, Salwa K. Al Khatib, Hao Li, Salman Khan, Zhiqiang Shen
arXiv AI
Aug 28

Style as a Confound: False Positives in AI Detection of Non-Native Academic Writing

The study examines how professional English editing influences AI text detectors’ false-positive rates for non-native academic writing. Using 135,389 pairs of original and edited manuscripts, researchers found that detector responses varied widely—some editors increased AI scores while others decreased them—and that score changes correlated with the extent of editing. These results highlight professional editing style as a key confounding factor in AI detection, complicating the distinction between AI authorship and linguistic style.

By Hyeonchu Park, Gahye Jeong, Bugeun Kim
arXiv Computation and Language
5d ago

Likelihood Is Not Authorship: Can We Reliably Measure Human Contribution in AI-Assisted Writing?

The paper argues that current AI‑text detection methods, which estimate human contribution by measuring how predictive a user’s prompt is of the final text, can be easily manipulated. By introducing SPECIFICITY PADDING—adding random IDs to the prompt—the authors show that a title‑only request can appear far more human than one containing the article’s key ideas, and that scores can swing dramatically when the evaluator’s view of the prompt is altered. Across a range of large language models, the same documents can be scored as 85 % human or 15 % human depending solely on the prompt used, revealing a fundamental limitation of likelihood‑based metrics for reliably measuring human authorship. whyItMatters":"The study demonstrates that likelihood‑based scores cannot reliably establish human contribution without additional evidence of what the person added and how the text was produced."

By Hasan Amin, Zhuoran Lu, Ming Yin
arXiv Computation and Language
Oct 5

Ontological Instability and Statistical Amplification: The Paradox of "Humanizing" LLM-Generated Text

The paper investigates why supervised AI‑text detectors, specifically a RoBERTa‑based model, can be fooled by subtle changes in language. By applying semantic, structural, and tokenizer‑level perturbations to a large dataset and controlled Mistral‑7B‑Instruct outputs, the authors show that increasing verb diversity makes machine text easier to detect and that detection scores correlate with statistical complexity, leading to a high false‑positive rate on formal human writing. They also evaluate an event‑based latent space detector, finding that paraphrasing and homoglyphs significantly alter extracted event sequences and verbs, yet the detector’s performance remains modest (AUC 0.577).

By Claudiu Creanga, Liviu Dinu