Smarter by the Moment: Environment-Driven Dynamic Policies for Continual LLM Improvement
Read the original on Hugging Face Trending Papers →The Flow has not summarised this story yet — read it at Hugging Face Trending Papers.
The Flow has not summarised this story yet — read it at Hugging Face Trending Papers.
arXiv:2609.16800v1 Announce Type: new Abstract: Large Language Models (LLMs) have achieved remarkable progress across diverse domains, but continual adaptation to evolving tasks and environments rema...
Large Language Model (LLM) agents increasingly rely on external memory systems to accumulate experience across tasks. Yet nearly all existing approaches, from graph-structured memories to reflective insight stores, access memory through fixed, hand-designed heuristics.
arXiv:2607. 13591v1 Announce Type: cross Abstract: Large Language Model (LLM) agents increasingly rely on external memory systems to accumulate experience across tasks.
The paper presents a comprehensive evaluation of 11 memory substrates for long‑horizon LLM agents, using a unified set of 26 performance and efficiency metrics across three backbone models and four benchmark suites. It finds that no single substrate consistently outperforms others; retrieval‑heavy substrates aid long‑context factual QA but can impair sequential decision‑making, and scalability can shift performance trade‑offs. The study demonstrates that selecting a memory substrate tailored to the operating regime yields better results than any fixed choice, offering empirical guidance for designing efficient, reliable, and regime‑aware long‑term memory systems.
arXiv:2606. 06787v1 Announce Type: new Abstract: Large Language Models (LLMs) show promise as tool-using agents but remain limited in long-horizon tasks that require remembering, organizing, and reusing knowledge.
The paper introduces OPSD, a method that uses on‑policy self‑distillation to train a context‑free student model from a teacher conditioned on user memory, combined with a verify‑then‑regenerate router that directs queries to either weight or text memory. OPSD enables weight memory to compete with or surpass traditional text‑based memory systems on the HaluMem benchmark, reducing token usage per query. The study also explores how different training recipes influence weight memory performance and offers guidance for integrating it with retrieval in persistent, multi‑session agent deployments.