arXiv Machine Learning

Adaptive Querying with AI Persona Priors

arXiv:2605. 00696v2 Announce Type: replace-cross Abstract: We study adaptive querying for learning user-dependent quantities of interest, such as responses to held-out items and psychometric indicators, within tight query budgets.

arXiv Machine Learning
Jun 30

Synthetic Interaction Data for Scalable Personalization in Large Language Models

arXiv:2602. 12394v2 Announce Type: replace Abstract: Personalized prompting offers large opportunities for deploying large language models (LLMs) to diverse users, yet existing prompt optimization methods primarily focus on task-level optimization while largely overlooking user-specific preferences and latent constraints of individual users.

By Yuchen Ma, Yue Huang, Wenjie Wang, Xiaonan Luo, Xiangliang Zhang, Stefan Feuerriegel
arXiv AI
Aug 18

QUMem: Personalized Memory for Query-Conditioned User-State Inference in LLM Agents

arXiv:2608. 16168v1 Announce Type: cross Abstract: Large language model (LLM) agents increasingly use external memory systems to support personalization by drawing on long and evolving interaction histories, in which user preferences may be distributed across time, change with context, and conflict with earlier evidence.

By Heng Wang, Yifei Li, Lingling Zhang, Pengyu Li, Xinyu Che, Xinyu Zhang, Zesheng Yang
arXiv AI
Sep 21

What Should We Ask Next? Retrieval-Aware Question Learning under Partial Evidence

The paper introduces RAVEL, a retrieval‑aware online reinforcement learning framework designed to improve interactive retrieval under partial evidence. RAVEL begins with supervised question generation, directly observes the top‑4 retrieval candidates, and refines its question policy using rank feedback from the full question‑answer‑retrieval loop. Experiments on the Interactive‑PEDES dataset demonstrate that RAVEL progressively enhances retrieval performance over five interaction rounds, reallocating questioning toward localized open‑ended attributes that yield the greatest gains on challenging queries.

By Lyucheng Qian, John Yuehan Zhang, Pingyu Wang
arXiv Machine Learning
Jul 30

Learning Dynamic User Personas from Implicit Interaction Streams via Iterative Refinement

arXiv:2607. 26473v1 Announce Type: new Abstract: Personalizing large language models (LLMs) to individual users is essential for improving user experience, yet existing approaches typically rely on explicit preference supervision such as pairwise comparisons or demographic attributes, limiting their applicability in natural interaction settings.

By Haifeng Wu
arXiv AI
Sep 25

From Static Personal Values to Contextualized Personalization: Bayesian Personalized Value Alignment for LLMs

The paper introduces BaCVA, a Bayesian Context-aware personalized Value Alignment method for large language models. It treats personal values as priors and context-dependent preferences as posteriors, estimating contextual value salience from normative responses and using a dual-view personalization module to infer posterior preferences. Experiments show BaCVA outperforms strong baselines, offering more accurate and data‑efficient personalized value alignment.

By Hanze Guo, Aixuan Song, Jing Yao, Xiangxu Zhang, Xiaoyuan Yi, Xing Xie, Xiao Zhou
Hugging Face Trending Papers
Jul 29

Learning Dynamic User Personas from Implicit Interaction Streams via Iterative Refinement

Personalizing large language models (LLMs) to individual users is essential for improving user experience, yet existing approaches typically rely on explicit preference supervision such as pairwise comparisons or demographic attributes, limiting their applicability in natural interaction settings. We propose IRIS, a framework that learns dynamic user personas directly from implicit interaction streams by extracting behavioral signals from everyday conversations and iteratively refining persona representations through a prediction-driven closed loop without requiring explicit feedback.