arXiv Computation and Language
Whether LLMs Can Navigate Beliefs and Facts Depends on How You Phrase It
Read the original on arXiv Computation and Language →The Flow has not summarised this story yet — read it at arXiv Computation and Language.
Related stories
Hugging Face Trending Papers
Aug 18
Whether LLMs Can Navigate Beliefs and Facts Depends on How You Phrase It
The study evaluates how large language models (LLMs) handle user beliefs expressed through different verbs, finding that performance varies widely—from a +50% accuracy gap on "I vaguely remember" to a -14% gap on "I seriously doubt". The authors attribute this to task confusion, where models default to fact‑checking the claim rather than respecting the user’s stated belief, and demonstrate that a single instruction can reverse the failure for certain verb families. Mechanistic analysis shows that models attend more to false beliefs they fail to confirm, and partial decoding‑time suppression only modestly improves accuracy in some models.
arXiv AI
Jul 29
Evaluating Communicative Belief Updates in Large Language Models via Implicature Recognition and Cancellation
arXiv:2607. 25094v1 Announce Type: cross Abstract: Human language is driven by unspoken beliefs and belief updates, making these critical to model for successful communication between large language models (LLMs) and their users.
arXiv Machine Learning
Jul 9
Dissociating the Internal Representations of Sycophancy in LLMs
arXiv:2607. 07003v1 Announce Type: new Abstract: Large Language Models (LLMs) frequently exhibit sycophancy, where they agree with a user's statement even when incorrect.
arXiv AI
Jun 19
LLM Doesn't Know What It Doesn't Know: Detecting Epistemic Blind Spots via Cross-Model Attribution Divergence on Clinical Tabular Data
arXiv:2606. 19509v1 Announce Type: new Abstract: Large language models (LLMs) are increasingly applied to structured clinical data, yet whether they can recognize the limits of their own knowledge on such tasks remains unexplored.
Hugging Face Trending Papers
Jul 8
Dissociating the Internal Representations of Sycophancy in LLMs
Large Language Models (LLMs) frequently exhibit sycophancy, where they agree with a user's statement even when incorrect. While sycophancy is often treated as a single defined behavior, it can manifest in substantially distinct ways and circumstances, raising the question of whether this multi-faceted nature is reflected in its internal mechanisms.
arXiv AI
Jul 23
Information Discernment in Large Language Models
arXiv:2607. 19355v1 Announce Type: new Abstract: LLMs are increasingly used with external knowledge sources like the internet.