Hugging Face Trending Papers

Specificity Bias and the Wikipedia Paradox: An xAI Analysis of AI Text Detectors under Domain Shift

The paper examines how fine‑tuned Transformer detectors (DistilBERT, RoBERTa) perform on an out‑of‑distribution dataset of hyper‑local news generated by LLMs. Using SHAP‑based explainable AI, it identifies three phenomena: a reliance on a “Call‑to‑Action” syndrome, a “Specificity Bias” where hallucinated named entities evade detection, and a “Wikipedia Paradox” where formal human text is misclassified as AI. These results highlight systematic shortcomings of purely statistical detection methods in structured human domains.

arXiv Computation and Language
2d ago

Specificity Bias and the Wikipedia Paradox: An xAI Analysis of AI Text Detectors under Domain Shift

The paper examines how fine‑tuned Transformer detectors (DistilBERT, RoBERTa) perform on an out‑of‑distribution dataset of hyper‑local news generated by LLMs. Using SHAP‑based explainable AI, the authors uncover three phenomena: a Call‑to‑Action bias, a Specificity Bias where hallucinated named entities evade detection, and a Wikipedia Paradox where formal human prose is misclassified as AI. These results highlight systematic shortcomings of purely statistical detectors in structured human domains and underscore the need for semantically‑aware, interpretable detection methods.

By Nico Morloher, Johannes Reschke, Mohamed Mady
arXiv Computation and Language
2d ago

A Systematic Analysis of Linguistic Features in AI-Generated English Text Detection Across Domains and Models

The paper presents a large‑scale empirical study of 284 interpretable linguistic features to detect AI‑generated English text across 30 language models and 10 text domains. It finds that classifiers using only linguistic features can reliably distinguish machine‑from human‑written text, but most indicators are highly context‑dependent. Only lexical richness measures consistently generalize across model families and domains, offering robust signals for detection.

By Yassir El Attar, Esra D\"onmez, Maximilian Maurer, Agnieszka Falenska
arXiv Computation and Language
Sep 7

NOTAI.AI: Explainable Detection of Machine-Generated Text via Curvature and Feature Attribution

NOTAI.AI is an explainable AI-generated text detection system that goes beyond a simple binary label by showing which signals influenced its prediction. It combines sentence-level conditional probability curvature, a neural detector score, and interpretable stylometric and readability features in an XGBoost meta-classifier, and explains predictions using TreeSHAP feature contributions that can be turned into concise natural-language explanations. Evaluated on a balanced subset of RAID, the full model achieves 0.9685 F1 and receives 94.5–98.6% approval from model judges for the faithfulness of its explanations.

By Oleksandr Marchenko Breneur, Adelaide Danilov, Aria Nourbakhsh, Salima Lamsiyah
Hugging Face Trending Papers
Jun 22

UnBias-Plus: Detect, Explain, and Rewrite Bias

Bias in natural language remains a persistent challenge in both human-written and AI-generated content, affecting domains such as journalism, education, and AI research. Most existing detection methods identify only the presence of bias, with limited support for granular detection, interpretable explanations, neutral rewriting, and openly available trained models.

arXiv Computation and Language
4d ago

TRIDENT and SHAKTI: A Framework and Benchmark for Hindi AI-Text Detection

The paper introduces SHAKTI, a large-scale Hindi benchmark for detecting AI-generated text, covering multiple genres, LLM families, prompting strategies, and adversarial transformations. It evaluates the benchmark with human annotation and examines linguistic, grammatical, and sentiment differences between human and AI texts. Building on these insights, the authors propose TRIDENT, a round‑trip translation‑based detection framework with three variants that outperforms existing baselines and demonstrates robustness across seven languages and adversarial settings.

By Shifali Agrahari, Sujit Kumar, Sanasam Ranbir Singh