arXiv AI
2d ago

Route to Remember: Adaptive Memory Selection for LLM Agents

The paper introduces OPSD, a method that uses on‑policy self‑distillation to train a context‑free student model from a teacher conditioned on user memory, combined with a verify‑then‑regenerate router that directs queries to either weight or text memory. OPSD enables weight memory to compete with or surpass traditional text‑based memory systems on the HaluMem benchmark, reducing token usage per query. The study also explores how different training recipes influence weight memory performance and offers guidance for integrating it with retrieval in persistent, multi‑session agent deployments.

By Zeyu Fang, Jun Yin, Yongsheng Mei, Xu Han, Chaitali Joshi, Zhongkai Sun, Jie Hao, Bin Guo, Chengyuan Ma, Benjamin Z. Yao, Chenlei Guo
arXiv Machine Learning
1d ago

ForecastCompass: Guiding Agentic Forecasting with Adaptive Factor Memory

ForecastCompass (FoCo) is an adaptive factor-based memory framework designed to enhance agentic forecasting. It structures forecasting experience using a hierarchical task taxonomy and maintains two memory components: factor memory for reusable predictive dimensions and reasoning memory for probability updating, uncertainty handling, and calibration. Through a verbalized memory-revision process guided by retrospective analyses, FoCo iteratively refines its knowledge, leading to improved probabilistic accuracy and calibration in experiments with GPT-5-mini and Gemini-2.5-Flash on Prophet Arena and FutureX.

By Yurui Chang, Yongkang Du, Yuanpu Cao, Jinghui Chen, Lu Lin
arXiv Machine Learning
5d ago

Benchmarking Forecasting Agents on Yesterday's Tomorrows

The paper introduces FABench, a scalable backtesting environment designed to evaluate forecasting agents. FABench automatically discovers events, generates questions, and resolves outcomes for any past forecast date, allowing continuous renewal beyond model training cutoffs. In initial tests, retrieval improves Brier scores across eight models, with top agents matching or surpassing market consensus on 54 Polymarket-linked questions, yet analysis shows persistent evidence‑weighting failures that highlight room for improvement.

By Yuxuan Wang, Yishu Wang, Jiaqi Deng
arXiv AI
Oct 7

AMBER: Training Long-Horizon Web Agents through Append-Only Memory

The paper introduces AMBER, an append‑only memory framework for language‑model agents that interact over long horizons. AMBER lets agents jointly learn to reason, act, and write free‑form memory, guaranteeing retention by construction and enabling end‑to‑end reinforcement learning without extensive curated data. Experiments on WebArena Lite show AMBER outperforms overwrite‑based memory by 4.09 percentage points in average success and improves task completion rates in repeated runs.

By Chinmay Savadikar, Zhaoyu Zhang, Mingyu Zhao, Shuang Xie, Han Li, Tianfu Wu, Lingyun Wang