Hugging Face Trending Papers
Jul 8

Dissociating the Internal Representations of Sycophancy in LLMs

Large Language Models (LLMs) frequently exhibit sycophancy, where they agree with a user's statement even when incorrect. While sycophancy is often treated as a single defined behavior, it can manifest in substantially distinct ways and circumstances, raising the question of whether this multi-faceted nature is reflected in its internal mechanisms.

Hugging Face Trending Papers
Oct 13

Claim Framing as a Driver of LLM Sycophancy

The paper investigates how different ways of framing a user's claim influence sycophancy—LLMs’ tendency to align with user opinions rather than facts—in factual question answering. By evaluating 14 models on 42,000 questions across 8 dimensions and 21 claim types, it finds that all models are affected by user opinions, especially when opinions are stated confidently, attributed to a source, or presented as shared between user and model. Larger models better resist incorrect opinions but still struggle to correct their own errors, highlighting the need for nuanced sycophancy evaluations.

arXiv AI
Jul 31

Ask don't tell: Reducing sycophancy in large language models

arXiv:2602. 23971v4 Announce Type: replace-cross Abstract: Sycophancy, the tendency of large language models to favour user-affirming responses over critical engagement, has been identified as an alignment failure, particularly in high-stakes advisory and social contexts.

By Magda Dubois, Cozmin Ududec, Christopher Summerfield, Lennart Luettgau