arXiv AI

Human-like moral judgments conceal divergent motive attributions in large language models

arXiv Computation and Language
5d ago

Can Humans Tell? A Dual-Axis Study of Human Perception of LLM-Generated News

Can Humans Tell? A Dual-Axis Study of Human Perception of LLM-Generated News investigates whether people can distinguish news articles written by humans from those generated by large language models (LLMs). Using JudgeGPT, the study collected 2,318 judgments from 1,054 participants on content from six LLMs, finding that participants could not reliably differentiate machine-generated from human-written text. The research also shows that domain expertise predicts judgment accuracy, distinct response strategies exist, and accuracy declines after about 30 evaluations due to cognitive fatigue.

By Alexander Loth, Martin Kappes, Marc-Oliver Pahl
arXiv AI
Sep 21

Steering LLMs Responses Towards Moral Foundations on the Norwegian MFQ-30

The study evaluates how large language models (LLMs) respond to the Norwegian Moral Foundations Questionnaire (MFQ‑30) and compares their moral profiles to a Norwegian human sample. Six open‑weight LLMs were tested, with half engaging with the questionnaire and the other half producing flat, near‑human responses. Two steering methods—prompt‑level persona steering and activation‑level ActAdd—were applied; a neutral Nordic persona improved alignment with the Norwegian mean by 44‑77%, while ActAdd flattened profiles without targeting specific foundations.

By Hans Andersen, David Dichas