arXiv AI

Probing Stability-Plasticity Tradeoffs in Agent Memory through Cognitive Experimental Paradigms

The paper introduces MemProbe, a framework inspired by cognitive science to evaluate stability-plasticity tradeoffs in agent memory systems. It offers four experimental paradigms—interference, misinformation, consolidation strength, and reconsolidation window—to manipulate memory updates, preservation, and uncertainty. Using a 56-episode diagnostic suite, the authors evaluate six incremental memory systems, revealing that similar overall scores can mask distinct behavioral profiles in how memories are updated, preserved, attributed, and temporally organized.

Hugging Face Trending Papers
Jul 1

MemSyco-Bench: Benchmarking Sycophancy in Agent Memory

Memory has emerged as a cornerstone of modern LLM-based agents, supporting their evolution from single-turn assistants to long-term collaborators. However, memory is not always beneficial: retrieved memories often induce a critical issue of sycophancy, causing agents to over-align with the user at the cost of factual accuracy or objective reasoning.

arXiv AI
Aug 19

On the Fragility of Self-Improving Agents: Variance, Task Order, and Underspecification

The paper re‑evaluates memory‑based self‑improving agents by adding multiple runs to measure variance and by randomizing task order. It finds that agent performance is noisy in complex, multi‑step environments and that improvement depends heavily on the sequence of tasks, revealing a hidden curriculum effect. The authors suggest that underspecification of tasks and environments contributes to this fragility and demonstrate that adding detailed rubrics and feedback can partially mitigate performance drops, though gaps remain.

By Qinyuan Ye, Yu Li, Yada Pruksachatkun, Jiaxin Zhang, Chien-Sheng Wu
arXiv AI
Aug 6

A Survey of Agent Memory in the Second Half: Towards Self-Evolving and Long-Horizon Agents

arXiv:2602. 06052v4 Announce Type: replace-cross Abstract: Research in artificial intelligence is shifting from model innovations and benchmark scores towards problem definition and rigorous real-world evaluation.

By Wei-Chieh Huang, Weizhi Zhang, Yueqing Liang, Yuanchen Bei, Yankai Chen, Tao Feng, Xinyu Pan, Zhen Tan, Yu Wang, Tianxin Wei, Shanglin Wu, Ruiyao Xu, Liangwei Yang, Rui Yang, Wooseong Yang, Chin-Yuan Yeh, Hanrong Zhang, Haozhen Zhang, Siqi Zhu, Henry Peng Zou, Wanjia Zhao, Song Wang, Wujiang Xu, Zixuan Ke, Zheng Hui, Dawei Li, Yaozu Wu, Langzhou He, Chen Wang, Xiongxiao Xu, Baixiang Huang, Juntao Tan, Shelby Heinecke, Huan Wang, Caiming Xiong, Ahmed A. Metwally, Jun Yan, Chen-Yu Lee, Hanqing Zeng, Yinglong Xia, Xiaokai Wei, Ali Payani, Yu Wang, Haitong Ma, Wenya Wang, Chenguang Wang, Yu Zhang, Xin Eric Wang, Yongfeng Zhang, Jiaxuan You, Hanghang Tong, Xiao Luo, Xue Liu, Yizhou Sun, Wei Wang, Julian McAuley, James Zou, Jiawei Han, Philip S. Yu, Kai Shu
Hugging Face Trending Papers
Aug 18

On the Fragility of Self-Improving Agents: Variance, Task Order, and Underspecification

The paper re‑evaluates memory‑based self‑improving agents by running multiple trials and shuffling task orders, revealing that agent performance is noisy and highly sensitive to task sequencing. It shows that implicit curricula in default task orders act as hidden prerequisites for success, and that underspecification of tasks and environments contributes to fragility. Adding detailed rubrics and environment feedback partially mitigates performance drops but significant gaps remain, underscoring the need for stricter evaluation protocols and better human oversight.