arXiv AI
Jun 8
Re-Centering Humans in LLM Personalization
arXiv:2606. 06614v1 Announce Type: cross Abstract: Despite growing interest, most evaluations of large language models' (LLMs') personalization abilities have relied on synthetic data.
Evaluating the Hidden Costs of Personalization in Large Language Models
Related stories
arXiv AI
Sep 18
Tailored to you: longitudinal effects of personalising language models
The study examined how personalising language models affects user interactions over five days, comparing a non‑personalised baseline with memory‑based and survey‑based personalisation. Results showed that many interaction changes were due to repeated exposure, but personalisation influenced specific behaviors: memory‑based users disclosed more and found the model less creepy, while survey‑based users felt more regret about sharing personal data. The authors emphasize the nuanced, approach‑specific impacts on user attitudes and the need for careful design of personalised AI.
arXiv AI
Sep 1
Towards Natural Personalization: Evaluating Long-Horizon Preference Following in Personalized User-LLM Interactions
arXiv:2603.04191v2 Announce Type: replace Abstract: Large Language Models (LLMs) are increasingly serving as personal assistants, where users may share individual preferences over extended interactio...
arXiv Computation and Language
4d ago
PersEvalBench: Can LLM Evaluators Judge Contextually Appropriate Use of Persona Information?
arXiv:2610.19314v1 Announce Type: new Abstract: Large language model (LLM) evaluators are increasingly used to assess personalized assistants, yet whether they can reliably judge personalization has...
arXiv AI
Jun 18
The Personalization Trap: How User Memory Alters Emotional Reasoning in LLMs
arXiv:2510. 09905v2 Announce Type: replace Abstract: When an AI assistant remembers that Sarah is a single mother working two jobs, does it interpret her stress differently than if she were a wealthy executive?
arXiv Computation and Language
Sep 10
HyperTrace: Hypothesis-Based Preference Tracing for Online LLM Personalization
HyperTrace is a training‑free framework that personalizes large language models by tracing latent user preferences online. It maintains interpretable natural‑language hypotheses about short‑term intent and long‑term preferences, updating them with an SMC‑style reweighting process driven by an LLM‑based surrogate choice model. Experiments on PRISM and PersonaMem‑v2 demonstrate that HyperTrace improves response alignment, preference prediction, and profile consistency compared to strong online baselines.
arXiv AI
Aug 13
Locating and Controlling Implicit Personalization in Large Language Models
arXiv:2608. 11735v1 Announce Type: cross Abstract: Large language models (LLMs) often shift their outputs in response to implicit demographic cues even when users never state a demographic identity.
Hugging Face Trending Papers
Aug 12
Locating and Controlling Implicit Personalization in Large Language Models
Large language models (LLMs) often shift their outputs in response to implicit demographic cues even when users never state a demographic identity. Previous work has documented this behavior, but the connection between these behavioral changes and the model's internal activations remains unclear.
arXiv Machine Learning
Jun 3
$\Psi$-Bench: Evaluating Persona-Sensitive Influencing in Persuasive Dialogues
arXiv:2606. 02754v1 Announce Type: new Abstract: Personalization is a crucial capability of modern language agents.
arXiv AI
Jul 2
Prompt Optimization for User Simulation in Conversational Recommender Systems: A Multi-Objective Framework
arXiv:2607. 00010v1 Announce Type: cross Abstract: Conversational recommender systems (CRSs) are a core component of next-generation intelligent recommender systems because they enable users to actively elicit preferences, clarify intentions, and adapt recommendations in real time.
arXiv Machine Learning
Jun 26
GRAG: Generic Response-Augmented Generation Framework for Personalized Conversational Systems
arXiv:2606. 21097v2 Announce Type: replace-cross Abstract: Deploying highly capable personalized conversational agents in resource-constrained or privacy-sensitive environments remains a significant challenge.
arXiv AI
Sep 11
PRAGMA: Evaluating Personalized Guidance with Memory Alignment in Lifelong Conversations
PRAGMA is a benchmark designed to evaluate personalized guidance in long‑term conversations. It includes curated longitudinal conversation histories, evidence annotations, and guidance scenarios that reflect evolving user contexts and incorrect assumptions. Experiments show that current retrieval, memory, and long‑context models struggle to recover relevant conversational evidence and to use it effectively for personalized guidance.