arXiv:2608.28833v1 Announce Type: new
Abstract: While Large language models (LLMs) incorporate user personalization signals to improve usability and helpfulness, they increasingly shift from providin...
By Yumeng Wang, Yuchen Wu, Cheng Qian, Zhiyuan Fan, Hyeonjeong Ha, Shujin Wu, Jiayu Liu, Heng Ji, Ge Wang
The paper introduces ReaLMem, a benchmark built from authentic multi‑year personal visual archives with first‑person annotations, designed to evaluate AI systems on factual recall, persona inference, and predictive personalization. It also proposes ChronoProfiler, a temporal‑weighting module that calculates stability scores for user attributes to resolve preference conflicts and enhance personalized decision making. Experiments with multimodal large language models and memory systems show that predictive personalization remains the hardest task, highlight performance gaps, and demonstrate that temporally informed representations significantly improve personalization.
By Wenqi Zhou, Zhuorui Yu, Kaiao Wen, Hao Zheng, Xinyi Zheng, Peiran Wu, Enmin Zhou, Chi-Hao Wu, Junxiao Shen
arXiv:2510. 09905v2 Announce Type: replace Abstract: When an AI assistant remembers that Sarah is a single mother working two jobs, does it interpret her stress differently than if she were a wealthy executive?
By Xi Fang, Weijie Xu, Yuchong Zhang, Stephanie Eckman, Scott Nickleach, Chandan K. Reddy
The study examines how users’ stated preferences for AI assistant responses align with the actual rewards they give to those responses. Using the PRISM dataset, researchers compared 1,396 participants’ reported priorities on seven response attributes with their ratings of 29,347 responses from 21 large language models. They found that features not explicitly surveyed—such as length, formatting, and refusal language—were as strongly linked to ratings as the surveyed attributes, and that written feedback and prior conversation context influenced how much weight participants gave to length, while overall stated priorities poorly predicted the concrete features that drive ratings.
arXiv:2607. 27056v1 Announce Type: new Abstract: Personalized agents are increasingly applied to assist users across a wide range of tasks.
By Lingyang Zeng, Guangze Chen, Kaichen Yu, Zhicheng Pan, Siyang Weng, Zirui Hu, Xiangyun Du, Hailin He, Rong Zhang, Chengcheng Yang, Kai Huang, Xuan Zhou
PRAGMA is a benchmark designed to evaluate personalized guidance in long‑term conversations. It includes curated longitudinal conversation histories, evidence annotations, and guidance scenarios that reflect evolving user contexts and incorrect assumptions. Experiments show that current retrieval, memory, and long‑context models struggle to recover relevant conversational evidence and to use it effectively for personalized guidance.
By Hyojeong Yu, Hyukhun Koh, Minsung Kim, Yunah Jang, Kyomin Jung
arXiv:2607. 14593v1 Announce Type: cross Abstract: As conversational AI systems are designed for repeated use, a central question is how a series of interactions becomes a relationship.
By Ryuichi Sumida, Mao Saeki, Masaki Eguchi, Sadahiro Yoshikawa, Koji Inoue, Tatsuya Kawahara, Yoichi Matsuyama
The study investigates how users’ stated preferences for AI-generated responses align with the actual features they reward. Using the PRISM dataset, researchers compared participants’ reported priorities for seven response attributes with their ratings of over 29,000 responses from 21 large language models. They found that attributes not explicitly surveyed—such as length, formatting, and refusal language—were as strongly linked to ratings as the surveyed ones, and that written feedback was a better predictor of how users weighted these concrete features than their stated priorities.
By Zihan Chen, Lei Nico Zheng, Di Zhu
The paper examines how advisors should tailor recommendations when users consult personal AI assistants whose advice is predictable. It models the influence of personal AI through consultation probability and relative trust, finding that optimal counteraction and loss are hump‑shaped in these dimensions. The study also explores partial predictability, costly adjustments, richer information structures, and presents an online experiment showing participants weigh advisor, personal AI, and their own judgments differently.
By Yueyang Liu, Wichinpong Park Sinchaisri
The paper introduces the concept of adaptive personalization under preference epistemic uncertainty, arguing that conversational AI must adjust its response strategy as human preferences evolve. A study shows people prefer state‑contingent strategies when uncertainty changes, and the authors build a multilingual benchmark to test language models on this task. Results reveal a recognition‑generation gap: models can choose the right strategy from options but fail to generate it correctly, defaulting to exploit‑first behavior; targeted training on internal strategy representations improves performance on out‑of‑distribution personas.
By Priyanka Dey, Rajarshi Das, Vikas Bahirwani, Qi Zeng, Julia Kruk, Qi Qi
Personalizing large language models (LLMs) to individual users is essential for improving user experience, yet existing approaches typically rely on explicit preference supervision such as pairwise comparisons or demographic attributes, limiting their applicability in natural interaction settings. We propose IRIS, a framework that learns dynamic user personas directly from implicit interaction streams by extracting behavioral signals from everyday conversations and iteratively refining persona representations through a prediction-driven closed loop without requiring explicit feedback.
arXiv:2607. 26473v1 Announce Type: new Abstract: Personalizing large language models (LLMs) to individual users is essential for improving user experience, yet existing approaches typically rely on explicit preference supervision such as pairwise comparisons or demographic attributes, limiting their applicability in natural interaction settings.
By Haifeng Wu