arXiv AI

MUSE: Multi-Level Memory with Selective Runtime Injection for Scientific Coding Agents

MUSE is a memory management framework for scientific coding agents that combines multi-level memory—global, approach-level, and implementation-level—with selective runtime injection. The agent starts with global and problem-matched approach-level memory, then during execution it retrieves implementation-level memory and an LLM gate decides whether to inject relevant experience as review advice. Experiments on four benchmarks in numerical problem solving, kernel optimization, and scientific software repair show that MUSE outperforms retrieval and memory baselines, and ablations confirm the benefits of the multi-level design and gated injection.

arXiv AI
Sep 17

Cognitive Extensions for Dual-Process Language Agents: Memory and Self-Reflection in Interactive Environments

The paper introduces cognitive extensions for a dual‑process language agent, adding an Adaptive Memory Module (AMM) for episodic storage and a Self‑Reflection Module (SRM) for execution‑time validation. Implemented as feature‑flagged extensions, these modules allow controlled ablations on the ScienceWorld benchmark. Results show the full system outperforms baselines, with SRM providing the strongest individual improvement, indicating that execution‑time control is the key bottleneck while episodic memory aids once the runtime loop stabilizes.

By Jo\~ao Meneses dos Santos, Arlindo L. Oliveira
arXiv Computation and Language
3d ago

SWE-Opt: A Benchmark for Evaluating LLMs on Performance-Oriented Repository-Level Optimization

SWE-Opt is a new benchmark that evaluates large language models (LLMs) on repository‑level software performance optimization. It is built from 102 expert‑written optimizations from open‑source projects and measures runtime, peak memory, and Time‑Weighted Memory Usage (TWMU) under varied input data, execution conditions, and noise‑aware measurements. The study finds that current LLMs achieve few runtime gains and almost no memory improvements, whereas expert implementations deliver a 15.5× speedup and 171.3× memory reduction.

By Ezgi Sar{\i}kayak, Wenchao Gu, Hesham Ghonim, Chunyang Chen
arXiv AI
Sep 10

When Does Memory Help? A Cost-Aware Evaluation of Long-Term Memory in Tool-Using LLM Agents

The paper introduces MERIT, a benchmark that evaluates the marginal benefit of long‑term memory for tool‑using large language model agents while explicitly accounting for cost. MERIT provides episodic tool‑use tasks across three domains, verifies dependence on earlier‑episode facts, and measures memory operations in tokens and dollars. Experiments on GPT‑4.1‑mini, Claude Haiku 4.5, and Claude Sonnet 5 show that memory can significantly improve task success, but its utility varies widely across models and memory implementations, and full replay is rarely cost‑effective.

By Shweta Mishra, Shashank Mishra
arXiv Machine Learning
Aug 27

Beyond Scaling: Self-Evolving LLM Agents for Hardware Kernel Optimization via an Experience-Driven Workflow and Experience Graph Memory

The paper introduces KOPE, an experience‑driven framework that records hardware kernel optimization trajectories in an Experience Graph Memory and uses Active Context Management and Injection to retrieve relevant past decisions under a fixed token budget. KOPE preserves decision order, outcomes, and alternative branches, enabling evidence from completed runs to inform future optimization steps. In experiments, KOPE achieves a 1.54× speedup over the strongest baseline, raises pass rates from 60.0% to 84.6%, and reduces token consumption dramatically, demonstrating the benefits of continual learning from external experience while keeping the foundation model unchanged.

By Siyuan Chen, Runlin Hou, Shenxiu Wu, Yansong Sun, Junming Cao, Yiyu Zhang, Shudi Shao, Junhao Qiu, Zhichao Lu, Qingfu Zhang