arXiv AI

Curating Always-Loaded Context for LLM Agents: A Capacitated Assortment Model with Censored Feedback

The paper studies how to curate the fixed context files that large language model agents load at the start of each session. It models this as a capacitated assortment problem, proving bounds on optimal file size and showing that simply appending all positive‑value instructions can be far suboptimal. The authors analyze censored feedback from past sessions, derive evidence‑collection thresholds for adding instructions, bound regret under limited human review, and empirically demonstrate that irrelevant rules in real context files hurt model compliance.

arXiv AI
Oct 27

CTXAgent - Self-Controlled Context Management of LLM Agents

The paper introduces CTXAgent, a self‑controlled context management system for large language model agents that compacts conversation history when a token threshold is reached. It evaluates seven frontier models, comparing their ability to manage context with and without dedicated tools, and benchmarks performance across coding, scientific, and software engineering tasks. Results show that well‑managed models keep live context below 100k tokens, maintain high benchmark scores, and achieve significant cost reductions, with Claude Opus 5.5 outperforming its explicit configuration by 34% lower cost.

By Matthias Busch, Marius Tacke, Roland C. Aydin, Christian Feiler, Christian J. Cyron
Hugging Face Trending Papers
Jul 21

Prompt Design at Scale: How Format, Instruction Count, and Context Length Shape Instruction Adherence and Hallucination in Large Language Models

Practitioners make three prompt-design decisions with almost no controlled evidence behind them: how to format instructions and context (markdown, plain text, prose, or tabular), how many simultaneous instructions a system prompt can carry before compliance degrades, and how much context a model can hold before recall and honesty degrade. We report two controlled experiments crossing all three factors on one held, contamination-free synthetic corpus (the "Book of Veyra," 8,780 uniquely-named entities, deterministically regenerable from a fixed seed), evaluated across five models.

arXiv AI
Oct 27

The Hidden Costs of Forgetting: A Study of Trajectory Deletion in Software Engineering Agents

The paper investigates how deleting portions of a software engineering agent’s past trajectory affects performance and cost. Across 9,400 runs with two state‑of‑the‑art agents, it finds that large deletions (even up to 100% of reasoning text) can maintain overall effectiveness if applied with a delay, but immediate deletion harms performance. The study also shows that cost savings depend on the pricing model: a flat model yields savings in 26 of 42 cases, while a caching‑aware model actually increases costs because it breaks a low‑rate cached prefix.

By Fernando Vallecillos-Ruiz, Islem Bouzenia, Michael Pradel, Leon Moonen