arXiv AI
Jul 21
Retain or Consolidate? Budget-Dependent Operator Selection for Language Agent Memory
arXiv:2607. 17545v1 Announce Type: new Abstract: Language agents depend on memory across interactions.
Handover of In-Context Learning State Across Session Boundaries
arXiv:2608. 14528v1 Announce Type: new Abstract: This study investigates the methodological and theoretical properties of session handover in applications that use large language models.
Related stories
arXiv Machine Learning
Aug 4
LiveMem: Maintaining Memory State Continuity in Long-Running LLM Inference
arXiv:2608. 02515v1 Announce Type: cross Abstract: Long-running assistants and agents consume interaction streams that eventually outgrow the context.
arXiv Machine Learning
Jul 20
Rethinking Transfer in Continual Learning: A Replay-Based Realisation
arXiv:2607. 15587v1 Announce Type: new Abstract: Continual learning studies how deployed language models can continually acquire new tasks without expensive retraining from scratch.
arXiv Machine Learning
Jun 29
Retaining by Doing: The Role of On-Policy Data in Mitigating Forgetting
arXiv:2510. 18874v3 Announce Type: replace Abstract: Adapting language models (LMs) to new tasks via post-training carries the risk of degrading existing capabilities -- a phenomenon classically known as catastrophic forgetting.
arXiv Machine Learning
Jun 18
Decomposing Prediction Mechanisms for In-Context Recall
arXiv:2507. 01414v2 Announce Type: replace Abstract: We introduce a new family of toy problems that combine features of linear-regression-style continuous in-context learning (ICL) with discrete associative recall.
arXiv AI
Jun 10
Learning What to Remember: Observability-Safe Memory Retention via Constrained Optimization for Long-Horizon Language Agents
arXiv:2606. 10616v1 Announce Type: new Abstract: Long-horizon language agents accumulate observations, reasoning traces, and retrieved facts that exceed their finite context windows, making memory retention a fundamental resource-allocation problem.
arXiv AI
Jun 3
AgentCL: Toward Rigorous Evaluation of Continual Learning in Language Agents
arXiv:2606. 02461v2 Announce Type: replace Abstract: Language agents spend substantial inference time solving individual tasks, yet the experience acquired in one episode is often underutilized in future episodes.
arXiv AI
Jun 2
AGENTCL: Toward Rigorous Evaluation of Continual Learning in Language Agents
arXiv:2606. 02461v1 Announce Type: new Abstract: Language agents spend substantial inference time solving individual tasks, yet the experience acquired in one episode is often underutilized in future episodes.
arXiv Machine Learning
Jun 30
Memory-Managed Long-Context Attention: A Preliminary Study of Editable Request-Local Memory
arXiv:2606. 28876v1 Announce Type: cross Abstract: Long-context language models often conflate two different goals: compressing history into an efficient state, and maintaining reliable long-term memory.
arXiv Machine Learning
Jul 1
Probing Memorization of Tabular In-Context Learning
arXiv:2606. 31208v1 Announce Type: new Abstract: Large tabular models (LTMs), i.
arXiv AI
2d ago
QUMem: Personalized Memory for Query-Conditioned User-State Inference in LLM Agents
arXiv:2608. 16168v1 Announce Type: cross Abstract: Large language model (LLM) agents increasingly use external memory systems to support personalization by drawing on long and evolving interaction histories, in which user preferences may be distributed across time, change with context, and conflict with earlier evidence.
arXiv AI
Jul 14
Context by Distinct Information: An Auditable Dirichlet-Process Working Memory for Long, Redundant Context Streams
arXiv:2607. 10441v1 Announce Type: cross Abstract: Context engineering decides what information a model carries forward, and current designs meter it in tokens: compressing the past into a bounded recurrent state, keeping a key-value entry for every token, or imposing a fixed budget through a window or eviction rule.