arXiv Computation and Language

Conduct Under Pressure: What Sixty Language Models Do When a User Pushes

arXiv AI
Sep 25

Low-Cost Assays for Measuring Model Behavior Across Vendors and Releases

The paper introduces inexpensive, scalable methods for evaluating language model behavior across different vendors and releases. By running identical public stimuli on a cross‑vendor panel and analyzing transcripts via exact match, LLM‑coded codebooks, or instrumented environments, the authors can quantify model responses at a cost of a few dollars per model. Applying these tools to four years of releases reveals patterns of convergence, resistance, positional stability, and compliance that vary by generation, lab, and harness.

By Tapan Parikh
arXiv Computation and Language
Nov 9

Models Recall What They Violate: Constraint Adherence in Multi-Turn LLM Ideation

The paper introduces DriftBench, a benchmark that tests whether large language models (LLMs) maintain hard constraints while refining scientific ideas over multiple turns. Using 38 research briefs across 24 domains, the study evaluates seven models from five providers on 2,116 runs, finding that iterative pressure increases proposal complexity and reduces constraint adherence, with a high rate of ‘knows‑but‑violates’ instances. The authors also compare judge stability, re‑elicitation effects, and human versus LLM judgments, and release all benchmark materials.

By Garvin Kruthof
arXiv AI
1d ago

What LLM Agents See and What Users Say

The paper investigates how large language model (LLM) agents decide whether to act on user requests when their tool outputs may be ambiguous. Using presupposition theory, the authors show that agents often act without confirmation when a lookup cannot distinguish between one or two records, and that the way search results are presented (listing, counting, or omitting) significantly affects this behavior. Experiments with Claude and GPT models reveal that counting a second record prevents action, while listing both records or user-provided claims can reduce erroneous actions.

By Yue Zhao, Angela Huyue Zhang, S. Alex Yang, Hua Wei, Xiyang Hu
arXiv Machine Learning
Oct 8

Beyond the Sycophancy Score: How Task, Model, and Pressure Shape LLM Yielding

The study investigates how task difficulty, model type, and user pressure influence large language models’ tendency to abandon correct answers or endorse user positions—a phenomenon known as sycophancy. Using 103,939 graded replies across ten configurations of eight LLMs (with and without reasoning) and 13 pressure conditions, the authors find that the cost of verifying a claim and the presence of a guardrail are the dominant factors, while model family and pressure tactics play minor roles. Key practical insights include simplifying hard-to-verify problems, employing deep reasoning, framing questions neutrally, and selecting models based on guardrail performance.

By Guang Yang, Homa Hosseinmardi, Fengchen Liu, Amir Ghasemian
arXiv AI
Aug 24

Structure for Reading, Prose for Writing: Asymmetric Structural Conditioning in Multi-Agent Document Authoring

The paper reports on a deployed multi‑agent tender‑response system that uses an open‑weights language model under sovereignty constraints. In a blind comparison, the system’s answers were judged at least as good as human‑written bids in 40 of 55 sections, with only a few gaps attributable to missing knowledge rather than writing quality. The study also demonstrates an asymmetry in conditioning: while structural markup improves reading tasks, converting instruction material from prose to nested XML degrades answer quality, and naming forbidden constructions concentrates defects.

By Cheng Yu, Nikhil Mathew, Zhengjie Wang