arXiv AI

Same Facts, Different Updates: Inference Setup Shapes LLM Behavior in Medical Allocation

The paper investigates how the inference setup of large language models (LLMs) influences their behavior in a medical resource‑allocation scenario. By comparing paired‑context and independent‑inference experiments, the authors show that adding a single contrasting patient sentence can shift the model’s probability assignments in opposite directions across most tested models. Additional experiments varying scenario attributes further demonstrate that patient information can have context‑dependent effects on LLM outputs.

arXiv Computation and Language
Nov 9

Can LLMs Take Retrieved Information with a Grain of Salt?

The paper investigates how large language models (LLMs) handle the certainty of retrieved information, a critical yet underexplored aspect of retrieval-augmented generation. Eight LLMs were evaluated on their ability to adjust responses according to expressed context certainty, revealing systematic shortcomings such as failure to reproduce prior outputs after encountering uncertainty and distorted responses to expressed certainties. The authors propose an interaction strategy—combining prior reminders, context-certainty recalibration, and context simplification—that reduces obedience errors by 25% on average without altering model weights, demonstrating that interaction design can enhance LLM reliability.

By Behzad Shayegh, Mohamed Osama Ahmed, Fred Tung, Leo Feng
arXiv Machine Learning
Oct 5

Clinical Concept Centers in LLMs

The paper investigates whether clinical concepts are represented as distinct, causally influential centers within the latent space of large language models (LLMs). By evaluating eleven open-weight LLMs, the authors discover that each model contains dedicated clinical concept centers that are interpretable, activate only on relevant clinical narratives, and drive model behavior in both constrained and open-ended contexts. These centers can be leveraged for evaluation and performance improvement, as steering models along them enhances downstream clinical outcomes and aligns with clinician preferences.

By Aishik Nagar, Abhishek Vaidyanathan, Arun-Kumar Kaliya-Perumal, Elijah Tzen Hsuen Boey, Stefan Winkler
arXiv AI
Oct 2

Counterfactual Auditing of Bias in Open-Source Large Language Models for Clinical Triage

The study evaluates counterfactual bias in ten open‑source large language models (LLMs) for pediatric Emergency Severity Index (ESI) prediction. By creating paired clinical vignettes that differ only in demographic or socioeconomic variables, the authors measure shifts in acuity assignment, finding that counterfactual sensitivity varies widely across model families and sizes. A fine‑tuned Qwen2.5‑7B model exhibited the lowest sensitivity, while larger or medical‑domain models sometimes showed greater shifts, highlighting the need for fairness assessment before clinical deployment.

By Manar Aljohani, Brandon Ho, Kenneth McKinley, Dennis Ren, Xuan Wang
arXiv AI
Oct 15

Same Illness, Different Voice: Restating the Patient's Account Narrows Narrative Anchoring in Clinical Language Models

The study evaluates how clinical language models perform when patient narratives are presented in different voices—clinical, socioeconomic, and cultural—using 1,000 MedQA cases paired with three retellings each. All 12 tested models show a significant drop in accuracy (about 26% more errors) when the patient speaks in a marked voice, a penalty that persists even when the original vignette is included verbatim and is not explained by measured retelling properties. The authors find that rewriting the patient’s account into a clinical vignette before answering can halve this accuracy gap, though structured schema pipelines and additional reasoning tools offer limited improvements.

By Prabhjot Singh, Pritam Deka, Vijay Chennareddy
arXiv AI
Sep 3

Untangling the Mechanisms of Misleading Context in Medical Question Answering

The paper investigates how misleading context—specifically fabricated evidence and bare assertions—affects large language models’ medical question‑answering performance. Experiments on MedMisBench show that models are more prone to adopt answers based on assertions than fabricated evidence, and that these misleading cues are often disclosed in reasoning traces but rarely in final responses. A monitor that reads open reasoning traces can detect most corrupted decisions, whereas monitoring only responses is less effective.

By Robin Linzmayer, No\'emie Elhadad