← Back to all news
arXiv AI By Xu Li, Simon Yu, Minzhou Pan, Yiyou Sun, Zhaorun Chen, Bo Li, Weiyan Shi

Back Up Before You Regret: Measuring Backup Awareness and Automating Backup in Coding Agents

Read the original on arXiv AI →

The paper introduces RegretBench, a benchmark of 205 tasks that capture moments where users regret not backing up state, and evaluates six advanced coding agents on their backup awareness. While agents complete 86.1% of tasks, they only back up before regret moments 15.2% of the time, revealing a gap between task success and state preservation. To address this, the authors propose BackUpper, a plug‑in that automatically preserves affected state before tool calls, achieving 92.2% similarity to the original state on RegretBench at a cost of $0.014 per task and aligning with user preferences with an 84.5% F1 score.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

Related stories

arXiv AI
Oct 21

More Memory, Worse Agents: Error Reproduction and Anti-Persistence in LLM Agents

The paper investigates how large language model (LLM) agents can improve performance by storing and reusing experience in external memory. It identifies a problem called error reproduction, where mistakes in stored abstractions propagate through cycles of abstraction, execution, and re-abstraction, leading to persistent errors. To mitigate this, the authors propose Anti-Persistence, a memory design that retains raw trajectories and outcomes but reconstructs task-specific guidance on demand, discarding it after use. Experiments across multiple benchmarks show that Anti-Persistence yields higher held‑out success rates and lower LLM‑call costs compared to other memory designs, supporting the idea of separating experience accumulation from abstraction persistence.

By Ruhan Wang, Kishan Panaganti, Dongruo Zhou
llmsagentsbenchmarks
More like this →
arXiv AI
Oct 9

Agent-Controlled Forgetting for Tool-Using Agents: Reversible Context Curation in Practice

Agent-Controlled Forgetting for Tool-Using Agents: Reversible Context Curation in Practice explores a method where an agent selectively replaces detailed tool results with concise notes while archiving the originals for recovery. Using a Python harness, the approach reduces prompt tokens from 912,492 to 231,951 and cuts cumulative input tokens by 50%, yielding significant API cost savings. However, the method increases request count, slightly slows execution, and its effectiveness varies across different workloads.

By Jan-Peter Franke
agents
More like this →
arXiv AI
Oct 27

The Hidden Costs of Forgetting: A Study of Trajectory Deletion in Software Engineering Agents

The paper investigates how deleting portions of a software engineering agent’s past trajectory affects performance and cost. Across 9,400 runs with two state‑of‑the‑art agents, it finds that large deletions (even up to 100% of reasoning text) can maintain overall effectiveness if applied with a delay, but immediate deletion harms performance. The study also shows that cost savings depend on the pricing model: a flat model yields savings in 26 of 42 cases, while a caching‑aware model actually increases costs because it breaks a low‑rate cached prefix.

By Fernando Vallecillos-Ruiz, Islem Bouzenia, Michael Pradel, Leon Moonen
llmsagentsbenchmarks
More like this →