arXiv Computation and Language By Nico Morloher, Johannes Reschke, Mohamed Mady

Specificity Bias and the Wikipedia Paradox: An xAI Analysis of AI Text Detectors under Domain Shift

Read the original on arXiv Computation and Language →

The paper examines how fine‑tuned Transformer detectors (DistilBERT, RoBERTa) perform on an out‑of‑distribution dataset of hyper‑local news generated by LLMs. Using SHAP‑based explainable AI, the authors uncover three phenomena: a Call‑to‑Action bias, a Specificity Bias where hallucinated named entities evade detection, and a Wikipedia Paradox where formal human prose is misclassified as AI. These results highlight systematic shortcomings of purely statistical detectors in structured human domains and underscore the need for semantically‑aware, interpretable detection methods.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computation and Language.

Hugging Face Trending Papers
4d ago

Specificity Bias and the Wikipedia Paradox: An xAI Analysis of AI Text Detectors under Domain Shift

The paper examines how fine‑tuned Transformer detectors (DistilBERT, RoBERTa) perform on an out‑of‑distribution dataset of hyper‑local news generated by LLMs. Using SHAP‑based explainable AI, it identifies three phenomena: a reliance on a “Call‑to‑Action” syndrome, a “Specificity Bias” where hallucinated named entities evade detection, and a “Wikipedia Paradox” where formal human text is misclassified as AI. These results highlight systematic shortcomings of purely statistical detection methods in structured human domains.

arXiv Computation and Language
2d ago

A Systematic Analysis of Linguistic Features in AI-Generated English Text Detection Across Domains and Models

The paper presents a large‑scale empirical study of 284 interpretable linguistic features to detect AI‑generated English text across 30 language models and 10 text domains. It finds that classifiers using only linguistic features can reliably distinguish machine‑from human‑written text, but most indicators are highly context‑dependent. Only lexical richness measures consistently generalize across model families and domains, offering robust signals for detection.

By Yassir El Attar, Esra D\"onmez, Maximilian Maurer, Agnieszka Falenska
arXiv Computation and Language
Sep 7

NOTAI.AI: Explainable Detection of Machine-Generated Text via Curvature and Feature Attribution

NOTAI.AI is an explainable AI-generated text detection system that goes beyond a simple binary label by showing which signals influenced its prediction. It combines sentence-level conditional probability curvature, a neural detector score, and interpretable stylometric and readability features in an XGBoost meta-classifier, and explains predictions using TreeSHAP feature contributions that can be turned into concise natural-language explanations. Evaluated on a balanced subset of RAID, the full model achieves 0.9685 F1 and receives 94.5–98.6% approval from model judges for the faithfulness of its explanations.

By Oleksandr Marchenko Breneur, Adelaide Danilov, Aria Nourbakhsh, Salima Lamsiyah