MemDev-Bench is a new benchmark that evaluates how memory systems influence code agents across diverse repository histories. It pairs each task with relevance‑annotated earlier tasks from the same repository, creating 4,869 historical tasks for 555 base tasks and an automated pipeline that ensures these tasks are executable and verifiable. The study finds that memory mainly improves fine‑grained localization and editing, but can also cause failures when agents reuse memory without reassessing its applicability, and that providing raw historical trajectories reduces steps more effectively than compressed memories.
Code agents increasingly work on evolving real repositories, and memory systems aim to help them reuse earlier experience. However, such experience is diverse and evolving, so it remains unclear how m...
MemTrace is a provenance‑aware memory system designed to help coding agents handle long‑horizon software evolution tasks that span multiple files and stages. It stores execution history as immutable Memory Traces linked to key artifacts (files, symbols, tests) and organizes them in a Memory Trace Graph to track execution order and dependencies. When context budgets are limited, the system keeps only compact Memory Anchors, from which the agent can reconstruct the latest execution state and retrieve only valid, relevant evidence, improving performance on three long‑horizon coding benchmarks. "whyItMatters":"By preserving consistent task state and verifying evidence validity, MemTrace enables coding agents to outperform existing baselines on long‑horizon benchmarks, achieving significant gains in pass@1, resolved rate, and milestone scores."
MemScope introduces a framework for evolving large language model (LLM) agent memory architectures by using localized code repair guided by detailed execution traces and runtime memory states. The Patch Agent identifies precise repair targets and applies bounded, in-place edits while respecting provider identity and memory compatibility constraints. Experiments on GAIA, xBench, and ALFWorld show that MemScope improves accuracy and correct answer rates, achieving higher success rates with a modest median code‑change ratio of 4.4%.
arXiv:2609.23570v1 Announce Type: cross Abstract: Coding agents operate on real repository coding tasks, and persistent memory systems promise to reuse experience across tasks. Yet existing evaluatio...
arXiv:2606. 00619v1 Announce Type: cross Abstract: Long-horizon autonomous agents require memory systems to retain historical information, track evolving states, and reuse relevant knowledge beyond finite context windows.
The paper introduces REM (Reusable Experience Memory), a framework that manages the lifecycle of experience for large language model agents performing long-horizon coding tasks. REM consolidates completed trajectories into compact, phase-structured documents, injects them at task start, and evicts them after a single exposure, making the memory system responsive to the agent’s needs. Experiments on repository-level bug fixing show REM outperforms state‑of‑the‑art memory systems in retrieval accuracy and task resolution while reducing cost.
The paper investigates how large language model agents can over-rely on agentic memory, a phenomenon where retrieved memories distort inference even when they are correctly stored and retrieved. It shows that memory is helpful when past experience fully transfers to the current task but becomes misleading under partial query-memory overlap, a pattern confirmed by controlled experiments. To address this, the authors propose MEMTRIM, a plug‑and‑play framework that indexes memory evidence at write time and limits its reuse at read time, thereby reducing over-reliance without retraining and preserving useful memory benefits across models and memory architectures.
arXiv:2606. 28434v1 Announce Type: cross Abstract: Long-horizon software engineering agents often need to manage lengthy and noisy interaction histories under limited context budgets.
The paper introduces MERIT, a benchmark that evaluates the marginal benefit of long‑term memory for tool‑using large language model agents while explicitly accounting for cost. MERIT provides episodic tool‑use tasks across three domains, verifies dependence on earlier‑episode facts, and measures memory operations in tokens and dollars. Experiments on GPT‑4.1‑mini, Claude Haiku 4.5, and Claude Sonnet 5 show that memory can significantly improve task success, but its utility varies widely across models and memory implementations, and full replay is rarely cost‑effective.
arXiv:2606. 07909v2 Announce Type: replace Abstract: Modern large language model (LLM) agents can use external tools to help users solve complex tasks.
arXiv:2605. 18421v2 Announce Type: replace-cross Abstract: Recent benchmarks for Large Language Model (LLM) agents mainly evaluate reasoning, planning, and execution.
FlowState introduces a method for long-horizon LLM agents to treat execution state as a reusable memory, preserving semantically typed state nodes and their relations while separating persistent retention from on-demand access. The system uses Incremental State Update to maintain current state and Progressive State Access to reveal historical states during reasoning, allowing agents to reassess past decisions with new information. Experiments show FlowState improves success rates on MemoryArena and pass rates on τ³‑Bench by 4.55 and 13.95 percentage points, respectively, while cutting token consumption by over 40%.