arXiv AI By Jonghyun Jee, Aaron Shaw

Critical Acclaim Orientation in Large Language Models: Evidence from Film Preference Elicitation

Read the original on arXiv AI →

arXiv:2608. 06955v1 Announce Type: new Abstract: Large language models (LLMs) are trained on corpora that contain expressions of human judgment about films, books, music, and more.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv AI
Oct 31

Bouba Beats Kiki, and Other Regularities in the Subjective Preferences of LLMs

The paper investigates how large language models (LLMs) express subjective preferences in short-form content such as numbers, baby names, and fictional cities. It identifies 29 aspects (e.g., length, alphabetic order, popularity) that influence model choices and shows that these preferences are strong, reproducible, and sensitive to how questions are phrased. The study also reveals that the interaction between generating alternatives and ranking them can produce unexpected preference patterns, raising concerns about potential manipulation.

By Katy Blumer, Jon Kleinberg, Ravi Kumar, Andrew Tomkins
arXiv Computation and Language
6d ago

Presentation Sensitivity in Typed Decision Models for Subjective Text Evaluation

Typed decision models provide structured choices, scores, and probabilities for low‑cost automated evaluation. In a controlled audit across Jev, Clef Flash, and Perplexity Decider, the study examined how presentation factors—such as item position, identifiers, authorship claims, endorsements, decision framing, and rating rubrics—affect judgments on humor, helpfulness, and summarization tasks. Results show significant shifts in probability advantages, selected humor texts, and agreement with human preferences, indicating that presentation robustness, repeatability, and human alignment are distinct evaluator properties that must be validated.

By Jatin Agrawal, Radhika Mamidi
arXiv Computation and Language
Oct 27

Style over Substance? Linguistic Bias in LLM-based Peer Review Copy title

arXiv:2610.35254v1 Announce Type: new Abstract: The number of paper submissions to major AI conferences has increased dramatically in recent years, substantially increasing the peer-review workload o...

By Sai Suresh Macharla Vasu, Sumedh Santosh Joshi, Philipp Christmann, Ivaxi Sheth, Ruta Binkyte, Koel Dutta Chowdhury, Raouf Kerkouche, Hui-Po Wang, Mario Fritz