arXiv AI

Can professional translators identify machine-generated text?

arXiv:2601. 15828v4 Announce Type: replace-cross Abstract: This study investigates whether professional translators without prior specialized training can reliably identify short stories generated in Italian by artificial intelligence (AI).

arXiv AI
Aug 28

Style as a Confound: False Positives in AI Detection of Non-Native Academic Writing

The study examines how professional English editing influences AI text detectors’ false-positive rates for non-native academic writing. Using 135,389 pairs of original and edited manuscripts, researchers found that detector responses varied widely—some editors increased AI scores while others decreased them—and that score changes correlated with the extent of editing. These results highlight professional editing style as a key confounding factor in AI detection, complicating the distinction between AI authorship and linguistic style.

By Hyeonchu Park, Gahye Jeong, Bugeun Kim
arXiv Computation and Language
Aug 31

AI Writers Have a Consistent Stylometric Footprint, but AI Editors Do Not

The study demonstrates that text produced by large language models (LLMs) leaves a distinct stylometric footprint—primarily increased entropy and lexical diversity—across multiple models and domains. In contrast, AI editing of human text does not replicate this footprint; edited texts show only modest lexical diversity gains and reduced entropy, with lexical density emerging as the key distinguishing feature. Consequently, stylometric analysis can differentiate AI-generated from AI-edited content, but is less effective at distinguishing either from purely human writing.

By Zhengyang Shan, Yukyung Lee, Sophie Hao
arXiv Computation and Language
Sep 10

AI translation of literary texts is "fine", but readers still prefer human translations

arXiv:2606.26040v2 Announce Type: replace Abstract: AI translation of literary works is increasingly common. While the content may be rendered adequately, we do not know enough about how readers expe...

By Yves Ferstler, Adam Podoxin, Ty Brassington, Ga\"elle Laperri\`ere, Roman Grundkiewicz, Marie-Jean Meurs, Maite Taboada, Marzena Karpinska
arXiv AI
Aug 19

Without journalists, there is no journalism: the social dimension of generative artificial intelligence in the media

The article reviews two decades of empirical research on artificial intelligence in media, highlighting how AI will continuously reshape journalistic work. It identifies key social and epistemological challenges, such as increased reliance on tech platforms, threats to editorial independence, and journalists’ ambivalence between job security and creative liberation. The study argues that understanding AI’s impact on audiences and journalists is essential for guiding its responsible use in journalism.

By Sim\'on Pe\~na-Fern\'andez, Koldobika Meso-Ayerdi, Ainara Larrondo-Ureta, Javier D\'iaz-Noci
arXiv AI
Aug 26

The Limits of Automatic Evaluation of Creativity in Large Language Models

The paper examines whether existing automatic methods can reliably assess creativity in text produced by large language models (LLMs). By collecting human ratings on 11 creativity dimensions for both human and AI short stories, the authors compare these judgments with automated metrics and LLM-as-a-Judge evaluations. The results show a significant misalignment: automated metrics and LLM judges favor AI-generated stories and show near-zero correlation with human assessments, revealing fundamental limitations in current computational approaches to evaluating creative text.

By Alessandro Tutone, Giorgio Franceschelli, Mirco Musolesi
arXiv AI
Jun 24

AI Fiction in the Wild

arXiv:2606. 22748v2 Announce Type: replace-cross Abstract: Some professional authors are beginning to use AI tools to help produce their fiction writing.

By Neel Gupta, Maria Antoniak, Melanie Walsh