arXiv AI

From Volume to Value: Preference-Aligned Memory Construction for On-Device RAG

arXiv:2605. 18271v2 Announce Type: replace-cross Abstract: With the rapid emergence of personal AI agents based on Large Language Models (LLMs), implementing them on-device has become essential for privacy and responsiveness.

arXiv AI
Sep 10

Latent Preference Modeling for Multi-Session Personalized Tool Calling

The paper introduces the Multi-Session Personalized Tool Calling (MPT) benchmark, containing 4,695 instances across 459 multi‑session histories that test Preference Recall, Induction, and Transfer. It proposes PRefine, a test‑time memory method that refines a user’s latent preference via a generate‑verify‑refine loop. Experiments with five LLMs show that PRefine outperforms existing memory systems and even full‑history prompting on Preference Transfer, suggesting that personalized agents should encode behavior as preferences rather than merely storing past interactions.

By Yejin Yoon, Minseo Kim, Taeuk Kim
arXiv AI
Aug 7

LUNAR: Benchmarking Personalized Large Language Models on UNiversal User BehAvioR Logs

arXiv:2608. 05246v1 Announce Type: new Abstract: Existing personalized LLM benchmarks primarily rely on textual personas or isolated behavioral signals, providing limited evaluation of cross-domain behavioral personalization, where responses must be grounded in heterogeneous daily-life activities.

By Jiahao Zhang, Yongzhi Tong, Zelin Fu, Pengde Zhao, Yanmei Jiang, Jiang Feng, Min Yang
arXiv AI
Sep 11

Kernel-Managed Shared Memory for System-Wide Personalization

The paper introduces kernel‑managed shared memory, a system‑level abstraction that lets specialized agents write structured, tagged memories while the agent‑system kernel controls retrieval, privacy, and prompt injection. Implemented on AIOS, this design outperforms unmanaged external memory, standard retrieval‑augmented injection, and full context concatenation across GPT‑4o, Llama‑3.1:8B, and Qwen‑2.5:7B, improving personalization scores by 2.4‑4.0 points on a 5‑point scale and reducing latency and token usage by 15‑61%. The results show that centralizing memory management in the kernel delivers most personalization benefits at a fraction of the cost.

By Ryan Lum, Yongfeng Zhang
arXiv Computation and Language
Sep 3

Beyond Retrieval: Learning Compact User Representations for Scalable LLM Personalization

The paper introduces TAP-PER, a prefix‑based framework that learns compact user representations for large language model personalization. By encoding user preferences into lightweight prefix embeddings and incorporating temporal signals, TAP‑PER avoids the need for heavy per‑user adapters or prompt‑serialized histories. Experiments on six LaMP tasks show that TAP‑PER outperforms both prompt‑based and model‑based baselines while using far fewer per‑user parameters, enabling scalable personalization at large user scales.

By Heng Cao, Fan Zhang, Jian Yao, Yujie Zheng, Changlin Zhao, Lu Hao, Yuxuan Wei, Wangze Ni, Huaiyu Fu, Yuqian Sun, Xuyan Mo
arXiv AI
Sep 3

AdaMem: Learning What to Remember with Adaptive Memory Policies for Personalized Agents

AdaMem introduces adaptive memory policies that allow personalized agents to decide what information to write into long‑term memory based on user preferences for each interaction context. Each policy is updated from periodic feedback and controls subsequent memory writing, aiming to improve relevance and reduce unnecessary memory persistence. In experiments on AdaMem‑Bench, AdaMem raises QA accuracy from 80.0% to 84.35% while cutting persistent memory by 9.27%, though models still struggle to execute policies reliably.

By Xingyu Chen, Rui Wang, Zhaopeng Tu, Liefeng Bo