arXiv Machine Learning

Continual Knowledge Updating in LLM Systems: Learning Through Multi-Timescale Memory Dynamics

arXiv:2605. 05097v3 Announce Type: replace Abstract: LLMs are trained once, then deployed into a world that never stops changing.

arXiv AI
2d ago

Use and Disuse: Intent-Structured Experience Consolidation for Memory and Learning in LLM Agents

The paper introduces Hippocam, a hierarchical memory and continual learning architecture for large language model agents that mirrors human memory processes. Hippocam organizes an agent’s work into nested intents, keeping the current intent active while consolidating completed intents into task‑relevant outcomes and states, and recursively abstracts earlier history to reduce detail over time. When recalled, past experiences are re‑integrated and further consolidated with new data, reinforcing and updating knowledge without requiring parameter updates.

By Xiangyi Zeng, Baihang Liu, Xutong Wang, Ze Jin, Yunpeng Li, Qixu Liu
Hugging Face Trending Papers
Aug 19

Harness Continual Learning: Continual Adaptation Beyond Model Parameters

The paper introduces Harness Continual Learning (HCL), a paradigm where an agent’s state evolves through prompts, memories, tools, skills, and routing rules while keeping the foundation model frozen. HCL defines harness-level forgetting and proposes guarded harness evolution with a Continual Optimizer and Evaluator to balance improvement, retention, and validity. Experiments across textual reasoning, multimodal perception, and open‑world interaction show over 10% performance gains and demonstrate explicit control over the stability–plasticity trade‑off.

arXiv AI
Aug 20

Harness Continual Learning: Continual Adaptation Beyond Model Parameters

The paper introduces Harness Continual Learning (HCL), a paradigm where an agent’s state evolves through prompts, memories, tools, skills, and routing rules while keeping the underlying foundation model frozen. HCL defines harness-level forgetting and proposes a guarded evolution process involving a Continual Optimizer and Evaluator to ensure improvements without losing prior behavior. Experiments across textual reasoning, multimodal perception, and open‑world interaction show over 10% performance gains and demonstrate how the stability–plasticity trade‑off can be explicitly tuned.

By Borui Kang, Jinrui Gu, Junhan Lv, Wenbin Li, Lei Wang, Yang Gao