arXiv Computation and Language By Behzad Shayegh, Mohamed Osama Ahmed, Fred Tung, Leo Feng

Can LLMs Take Retrieved Information with a Grain of Salt?

Read the original on arXiv Computation and Language →

The paper investigates how large language models (LLMs) handle the certainty of retrieved information, a critical yet underexplored aspect of retrieval-augmented generation. Eight LLMs were evaluated on their ability to adjust responses according to expressed context certainty, revealing systematic shortcomings such as failure to reproduce prior outputs after encountering uncertainty and distorted responses to expressed certainties. The authors propose an interaction strategy—combining prior reminders, context-certainty recalibration, and context simplification—that reduces obedience errors by 25% on average without altering model weights, demonstrating that interaction design can enhance LLM reliability.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computation and Language.

arXiv Machine Learning
Sep 3

Prompting the Unknown: Understanding Response Uncertainty in Large Language Models

The paper introduces a prompt-response concept model that links the amount of task-relevant information in a prompt to the uncertainty of responses generated by large language models (LLMs). It identifies four sources of response uncertainty—prompt underspecification, model quality, task variability, and semantic redundancy—and demonstrates that uncertainty decreases as prompt informativeness or model quality increases, analogous to epistemic uncertainty in probabilistic models. Experiments on real-world datasets confirm the theoretical predictions and validate the model.

By Ze Yu Zhang, Arun Verma, Finale Doshi-Velez, Bryan Kian Hsiang Low
arXiv AI
Aug 20

Same Facts, Different Updates: Inference Setup Shapes LLM Behavior in Medical Allocation

The paper investigates how the inference setup of large language models (LLMs) influences their behavior in a medical resource‑allocation scenario. By comparing paired‑context and independent‑inference experiments, the authors show that adding a single contrasting patient sentence can shift the model’s probability assignments in opposite directions across most tested models. Additional experiments varying scenario attributes further demonstrate that patient information can have context‑dependent effects on LLM outputs.

By Spencer Gibson, Tyler Crosse, Magnus Saebo, Achyutha Menon, Eyon Jang, Diogo Cruz