Hugging Face Trending Papers

The Argument and the Letterhead: Source-Position Coherence in AI Evaluation

Read the original on Hugging Face Trending Papers →

The paper investigates whether AI evaluators differentiate between an argument’s content and the source attributed to it. Using 2,976 evaluations of six fixed texts across various source attributions, the study finds that the perceived quality of an argument varies with its source, indicating source-position coherence. The authors also note that this pattern holds across topics and model configurations, and that some evaluators explicitly noted mismatches between source and position.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at Hugging Face Trending Papers.

arXiv AI
Sep 10

Ordinary, Reasonable Chatbots: Do AI Models Track Human Legal Judgments?

The paper investigates whether large language model (LLM) chatbots can emulate human legal judgments of reasonableness. By comparing responses from 26 LLMs to those of human participants across 25 legal scenarios, the study finds that chatbots generally track human answers but tend to produce more homogeneous, government‑ and corporation‑friendly responses and align more closely with white, male, older, and more educated respondents. The authors note that these patterns warrant further systematic research.

By Nirav Patel, Emily Wenger, Christopher Buccafusco