arXiv Computation and Language

When Do Summaries Become Instructions? Unsupported Policy in LLM Agents' Self-Written Handoff Summaries

arXiv AI
Aug 26

When "Must" Becomes "Maybe": Constraint Weakening in LLM Agent Workflows

Large language model agents coordinate tasks via multi‑role, multi‑stage workflows that transform upstream state into intermediate artifacts such as summaries and plans. The study shows that when these artifacts are transformed—through compression, plan assimilation, or other handoff methods—the strict action‑binding constraints on upstream state can be weakened, turning mandatory requirements into optional information. In 1,296 synthetic episodes, direct handoff preserved all safety blockers, whereas transformed handoffs frequently deactivated or forbidden actions, but restoring full state fields or applying downstream verification can recover preservation.

By Yiheng Sun, Huifei Wang, Yancheng Zhu, Zhenyu Li, Zebin Zhao, Yifan Yuan
arXiv AI
Aug 24

Calibrating Criterion Revision in LLM Agents: Failure Modes and a Trace-Anchored Protocol

The paper introduces a framework for evaluating how large language model agents revise their success criteria after failures, defining five non‑compensatory conditions that must be met for a criterion revision to be considered valid. Using the CMB‑0.1 protocol, the authors test twelve cross‑domain scenarios across four system configurations, finding that no model trial satisfies all five conditions and highlighting specific failure modes such as zero‑state reconstruction and inadequate intervention sensitivity. They propose a more stringent trace‑anchored CMB‑0.4 protocol to better isolate and measure criterion revision in future studies.

By Guodong Xu
arXiv AI
Aug 14

Dead text or binding clause? Measuring and restoring constraint influence in black-box LLM dialogues

arXiv:2608. 12599v1 Announce Type: new Abstract: Multi-turn dialogues let users revoke constraints as easily as impose them, but revocation does not reliably take effect: models keep enacting withdrawn requirements (occasionally beneath comments asserting their removal), a failure we call \emph{behavioral relapse}, or revocation inertia.

By Haoyuan Zhu
arXiv AI
Oct 21

Recoverability and Verifier Strength: Two Measured Preconditions for Unattended Agent Self-Improvement

The paper introduces two measurable preconditions—Verifier Strength and Recoverability—to determine when an agent platform can safely allow unattended self‑improvement. Verifier Strength quantifies how closely an automated verifier (often an LLM judge) aligns with a trusted reference, limiting the extent of permissible changes. Recoverability measures how easily a detrimental change can be undone, requiring that the original version be retained and that rollback restores the prior behavior. The authors implemented these concepts on a platform, demonstrating that unattended edits are viable only when both conditions are met, and highlighted failures in verifier consistency and undo reliability through controlled experiments.

By De Wang, Peng Qi
arXiv AI
Oct 9

Curating Always-Loaded Context for LLM Agents: A Capacitated Assortment Model with Censored Feedback

The paper studies how to curate the fixed context files that large language model agents load at the start of each session. It models this as a capacitated assortment problem, proving bounds on optimal file size and showing that simply appending all positive‑value instructions can be far suboptimal. The authors analyze censored feedback from past sessions, derive evidence‑collection thresholds for adding instructions, bound regret under limited human review, and empirically demonstrate that irrelevant rules in real context files hurt model compliance.

By Zexuan Liu, Yuning Yang, Tiancheng Zhao