arXiv AI By Xutao Mao, Liangjie Zhao, Leyao Wang, Rui Qian, Qiang Huang, Wentao Wang, Bo Han, Xiang Zheng, Cong Wang

Agents Don't Just Agree, They Remember: Benchmarking Persistent Sycophancy in Self-Improving Personal Agents

Read the original on arXiv AI →

The Flow has not summarised this story yet — read it at arXiv AI.

arXiv Computation and Language
Sep 16

Ask Now, Use Later: Benchmarking the Proactivity Gap in Long-Lived LLM Agents

The paper introduces ATRBench, a benchmark that measures the proactivity gap in long‑lived LLM agents by evaluating their ability to ask for user preferences that are not needed immediately but may be useful in future sessions. It defines the Ask‑to‑Remember (ATR) task, where agents must decide whether to request a reusable preference now, and shows that current state‑of‑the‑art agents perform significantly below an oracle. The study identifies preference acquisition as the main bottleneck and provides a diagnostic framework for improving agent proactivity.

By Bin Wu, Guanyun Zou, Bingbing Wang, Huan Zhao, Chuan Shi