arXiv Computation and Language By Alexander Loth, Martin Kappes, Marc-Oliver Pahl

Eroding the Truth-Default: A Causal Analysis of Human Susceptibility to Foundation Model Hallucinations and Disinformation in the Wild

Read the original on arXiv Computation and Language →

The paper introduces JudgeGPT and RogueGPT, a dual‑axis framework that separates authenticity from attribution to study how people detect hallucinations and disinformation from foundation models. Using 918 evaluations on five models, including GPT‑4 and Llama‑2, the authors apply Structural Causal Models to test causal hypotheses about detection accuracy. Results show political orientation has little effect, while familiarity with fake news mediates detection, and a "fluency trap" in GPT‑4 outputs makes them hard to distinguish from human text, implying pre‑bunking should focus on cognitive source monitoring.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computation and Language.

arXiv Computation and Language
1d ago

Can Humans Tell? A Dual-Axis Study of Human Perception of LLM-Generated News

Can Humans Tell? A Dual-Axis Study of Human Perception of LLM-Generated News investigates whether people can distinguish news articles written by humans from those generated by large language models (LLMs). Using JudgeGPT, the study collected 2,318 judgments from 1,054 participants on content from six LLMs, finding that participants could not reliably differentiate machine-generated from human-written text. The research also shows that domain expertise predicts judgment accuracy, distinct response strategies exist, and accuracy declines after about 30 evaluations due to cognitive fatigue.

By Alexander Loth, Martin Kappes, Marc-Oliver Pahl