arXiv AI By Guorui Chen, Tao Liu, Zhenzhen Huang, Yidan Zhang, Liyu Jiang, Shuoyuan Wang, Hanchen Sun, Xu He, Dong Li, Yihan Hu, Jianye Hao, Lei Feng

MemDev-Bench: Does Memory Help Code Agents?Benchmarking Memory Systems over Real Repository Histories

Read the original on arXiv AI →

MemDev-Bench is a new benchmark that evaluates how memory systems influence code agents across diverse repository histories. It pairs each task with relevance‑annotated earlier tasks from the same repository, creating 4,869 historical tasks for 555 base tasks and an automated pipeline that ensures these tasks are executable and verifiable. The study finds that memory mainly improves fine‑grained localization and editing, but can also cause failures when agents reuse memory without reassessing its applicability, and that providing raw historical trajectories reduces steps more effectively than compressed memories.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv AI
Oct 9

MemTrace: State-Consistent Memory for Long-Horizon Coding Agents

MemTrace is a provenance‑aware memory system designed to help coding agents handle long‑horizon software evolution tasks that span multiple files and stages. It stores execution history as immutable Memory Traces linked to key artifacts (files, symbols, tests) and organizes them in a Memory Trace Graph to track execution order and dependencies. When context budgets are limited, the system keeps only compact Memory Anchors, from which the agent can reconstruct the latest execution state and retrieve only valid, relevant evidence, improving performance on three long‑horizon coding benchmarks. "whyItMatters":"By preserving consistent task state and verifying evidence validity, MemTrace enables coding agents to outperform existing baselines on long‑horizon benchmarks, achieving significant gains in pass@1, resolved rate, and milestone scores."

By Hongming Xu, Le Zhou, ZhongHe Jin, Xiang Zhang, Bo Tang, Zhiyu Li, Xuanhe Zhou, Juncheng Zhang
arXiv AI
6d ago

MemScope: Evolving Agent Memory Architectures through Localized Code Repair

MemScope introduces a framework for evolving large language model (LLM) agent memory architectures by using localized code repair guided by detailed execution traces and runtime memory states. The Patch Agent identifies precise repair targets and applies bounded, in-place edits while respecting provider identity and memory compatibility constraints. Experiments on GAIA, xBench, and ALFWorld show that MemScope improves accuracy and correct answer rates, achieving higher success rates with a modest median code‑change ratio of 4.4%.

By Miao Su, Yucan Guo, Zixuan Li, Long Bai, Zhongni Hou, Xiaolong Jin, Jiafeng Guo
arXiv AI
Jun 2

MemPro: Agentic Memory Systems as Evolvable Programs

arXiv:2606. 00619v1 Announce Type: cross Abstract: Long-horizon autonomous agents require memory systems to retain historical information, track evolving states, and reuse relevant knowledge beyond finite context windows.

By Qingshan Liu, Guoqing Wang, Wen Wu, Jingqi Huang, Xinqi Tao, Dejia Song, Jie Zhou, Liang He
arXiv AI
1d ago

REM: What to Store, When to Recall, What to Forget in Experience Memory for Coding Agents

The paper introduces REM (Reusable Experience Memory), a framework that manages the lifecycle of experience for large language model agents performing long-horizon coding tasks. REM consolidates completed trajectories into compact, phase-structured documents, injects them at task start, and evicts them after a single exposure, making the memory system responsive to the agent’s needs. Experiments on repository-level bug fixing show REM outperforms state‑of‑the‑art memory systems in retrieval accuracy and task resolution while reducing cost.

By Xinyi Lisa Chen, Pedro Herrero-Vidal, Xiaohan Chen, Xiaojing Yu, Cris Liu, Bingqing Song, Bin Xu, Suleiman A. Khan, You-Lin Chen