arXiv AI By Tianyi Xu, Huazheng Wang

Lifelong Context Adaptation through Bidirectional Memory-Skill Learning

Read the original on arXiv AI →

The paper introduces MemCryst, a framework that enables lifelong learning for large language model agents by jointly adapting memory and skills while keeping the language model frozen. MemCryst stores recurring episodes in memory to support skill creation and revision, and uses the resulting skills to guide future interactions, which in turn generate new memory. Experiments across ten diverse settings—including embodied control, long-document reading, conversation, mathematics, and code—show that MemCryst outperforms memory-only and skill-only baselines, achieving 63.17% success on ALFWorld.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv AI
1d ago

Route to Remember: Adaptive Memory Selection for LLM Agents

The paper introduces OPSD, a method that uses on‑policy self‑distillation to train a context‑free student model from a teacher conditioned on user memory, combined with a verify‑then‑regenerate router that directs queries to either weight or text memory. OPSD enables weight memory to compete with or surpass traditional text‑based memory systems on the HaluMem benchmark, reducing token usage per query. The study also explores how different training recipes influence weight memory performance and offers guidance for integrating it with retrieval in persistent, multi‑session agent deployments.

By Zeyu Fang, Jun Yin, Yongsheng Mei, Xu Han, Chaitali Joshi, Zhongkai Sun, Jie Hao, Bin Guo, Chengyuan Ma, Benjamin Z. Yao, Chenlei Guo