Hugging Face Trending Papers

Does an Agent's History Tell You When Compaction Will Hurt? A Modest, Bounded Effect on the TRACE Paired-Replay Corpus

arXiv Computation and Language
4d ago

Do Agents Still Follow the Rules? Benchmarking Rule Compliance under Agent Context Compaction

The paper introduces ARCBench, a configurable benchmark for measuring rule compliance in language‑model agents that compact long histories to fit context windows. Using ARCBench, the authors find that rule violations after compaction rarely stem from rule deletion; instead, agents often ignore the rule while it remains present in the compacted history. The study shows that the source of violations depends on how the rule is delivered and on the compaction strategy, with targeted compactor attacks significantly increasing violations, and that simply retaining a rule in the compacted summary does not guarantee compliance.

By Yiwei Zha, Qingyu Meng, Herbert Bos, Min Chen
arXiv AI
Oct 19

When to Forget: Risk-Controlled Context Adaptation for Long-Horizon Agents

The paper introduces RECAP, a framework for deciding when to retain, compress, or discard parts of a long-horizon agent’s history to improve future performance. RECAP uses matched context interventions, execution-relational prediction, and independent policy certification to evaluate the value of a failure block relative to the current execution. Experiments across five backbones show that RECAP can edit a significant portion of retained checkpoints while maintaining high continuation success and reducing prompt costs.

By Chenle Chen, Yangbo Wei, Zhijie Zheng, Zhenyu Su, Qifan Wang, Junhong Qian, Chao Yao, Chen Wu, Lei He
arXiv AI
3d ago

Attributing Agent Failures to Their History Needs an Executed Counterfactual: Toward a Reporting Standard

The paper proposes a new reporting standard for attributing agent failures to their history, insisting on intervention‑verified evidence rather than post‑hoc taxonomies. It outlines a method to freeze an executable mid‑trajectory state, alter only the agent’s perceived history, and continue execution to obtain a measured replay certificate. The authors review existing manipulation classes and highlight that while several methods perform interventions, none currently report a quantified replay certificate, and they provide two cautionary examples illustrating the pitfalls of lacking such verification.

By Egor Pakhomov, Erik Nijkamp
arXiv AI
Aug 19

Beyond Suspicious Steps: Ontological Trust in Long-Horizon Agents

The paper introduces ontological trust, a task‑conditioned property of trajectory prefixes, and presents RGE, an online monitor that decomposes trust into Role, Goal, and Evidence. RGE uses LLMs only for structured task and step representations, while trust updates and interventions are deterministic, producing a replayable and auditable trust trajectory. Evaluated on a cross‑domain corpus, RGE outperforms rule‑, judge‑, and shield‑style baselines, achieving over 93% Drift F1 and maintaining high benign coverage.

By An He, Yao Wang, Haibin Zhang