arXiv AI By Shizuo Tian, Xiaohong Weng, Rui Kong, Yuxuan Chen, Guohong Liu, Yuebing Song, Jiacheng Liu, Yuchen Li, Dawei Yin, Ting Cao, Yunxin Liu, Yuanchun Li

Joint Agent Memory and Exploration Learning via Novelty Signals

Read the original on arXiv AI →

arXiv:2606. 01528v1 Announce Type: new Abstract: In open-ended environments, exploration is fundamental for autonomous agents, yet current language model agents struggle with this.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv AI
Oct 7

AMBER: Training Long-Horizon Web Agents through Append-Only Memory

The paper introduces AMBER, an append‑only memory framework for language‑model agents that interact over long horizons. AMBER lets agents jointly learn to reason, act, and write free‑form memory, guaranteeing retention by construction and enabling end‑to‑end reinforcement learning without extensive curated data. Experiments on WebArena Lite show AMBER outperforms overwrite‑based memory by 4.09 percentage points in average success and improves task completion rates in repeated runs.

By Chinmay Savadikar, Zhaoyu Zhang, Mingyu Zhao, Shuang Xie, Han Li, Tianfu Wu, Lingyun Wang
arXiv Computation and Language
Sep 21

MemoryArena: Benchmarking Agent Memory in Interdependent Multi-Session Agentic Tasks

MemoryArena is a new evaluation gym that benchmarks agent memory in interdependent multi‑session tasks. Unlike prior benchmarks that test memorization or single‑session action in isolation, MemoryArena requires agents to acquire memory while interacting with the environment and then use that memory to guide future decisions across a range of tasks such as web navigation, planning, information search, and formal reasoning. The benchmark reveals that agents excelling on existing long‑context memory tests perform poorly here, highlighting a gap in current memory evaluation methods.

By Zexue He, Yu Wang, Churan Zhi, Yuanzhe Hu, Tzu-Ping Chen, Lang Yin, Ze Chen, Tong Arthur Wu, Siru Ouyang, Zihan Wang, Jiaxin Pei, Julian McAuley, Yejin Choi, Alex Pentland
arXiv AI
Oct 23

Learning What to Remember: Resource-Efficient Self-Improvement for Lifelong Agents

The paper introduces TokenWorth, a lightweight framework that learns the value of past experiences for self-improving agents operating under strict resource constraints. By using sparse execution feedback, TokenWorth guides both retrieval and memory management without updating the core model, enabling agents to adaptively reuse only the most beneficial experiences. Experiments on LifelongAgentBench show that TokenWorth outperforms existing lifelong-memory methods in task success while minimizing output tokens within the given budgets.

By Guannan Lai, Zi-Yang Bai, Jun-Peng Jiang, Han-Jia Ye
arXiv AI
Jun 16

LatentGym: A Testbed For Cross-Task Experiential Learning With Controllable Latent Structure

arXiv:2606. 15306v1 Announce Type: cross Abstract: We envision continually learning agentic systems that become more useful over time: as they encounter sequences of related tasks, they should infer the hidden structure shared across those tasks and use it to improve future decisions.

By Daksh Mittal, Tommaso Castellani, Thomson Yen, Naimeng Ye, Fangyu Wu, Minghui Chen, Tiffany Cai, Emmanouil Koukoumidis, William Zeng, Hongseok Namkoong
arXiv Computation and Language
Oct 19

DLite: History-free Speculative Decoding for Agentic AI

DLite is a history‑free speculative decoding framework designed for agentic AI workloads. It bypasses the need for a historical KV cache by reusing contextual hidden states from the target model and performing local speculative predictions, supplemented by a lightweight sequential head to maintain causal dependencies. Experiments demonstrate that DLite improves acceptance length by 2–6× and outperforms the state‑of‑the‑art DSpark by up to 70%.

By Jiaming Xu, Hanzhen Wang, Tianlang Zhao, Jiewen Xiao, Chengze Yuan, Jiayi Pan, Yongkang Zhou, Jiancai Ye, Yu Wang, Guohao Dai