arXiv AI

Learning to Adapt Cross-Domain Preferences via Meta-LoRA for LLM Personalization

arXiv:2608. 12389v1 Announce Type: new Abstract: Cross-domain zero- or few-shot personalization aims to generate user-preferred responses in unseen conversational domains from only a handful of target-domain interactions.

arXiv Computation and Language
Sep 10

HyperTrace: Hypothesis-Based Preference Tracing for Online LLM Personalization

HyperTrace is a training‑free framework that personalizes large language models by tracing latent user preferences online. It maintains interpretable natural‑language hypotheses about short‑term intent and long‑term preferences, updating them with an SMC‑style reweighting process driven by an LLM‑based surrogate choice model. Experiments on PRISM and PersonaMem‑v2 demonstrate that HyperTrace improves response alignment, preference prediction, and profile consistency compared to strong online baselines.

By Jianzhi Shen, Keyu Mao, Minghao Shao, Chuanyang Jin, Yusong Wang, Ailiang Lin, Kotaro Funakoshi, Manabu Okumura, Tianmin Shu, Muhammad Shafique
arXiv Machine Learning
1d ago

Action-On-Item Preference Flow: A Shared Event Schema for Predictive and Generative Personalization

The paper introduces an action‑on‑item schema that pairs interaction roles with content embeddings, enabling a shared update mechanism across different user history types such as movies, news, and dialogue. It demonstrates theoretical properties like invariance to relabeling and bounded state changes, and presents the Multi‑Timescale State Hypothesis (MTSH) implemented in PerTIDE. Experiments on PENS, MovieLens, and MIND datasets show that a frozen source‑trained core outperforms random baselines and that PerTIDE achieves significant MRR gains over comparable models.

By Parthiv Chatterjee, Kashish Kanjaria, Vashisth Purani, Sourish Dasgupta, Tanmoy Chakraborty
arXiv Computation and Language
Aug 27

Learning What to Share and What to Personalize: Hierarchical Strategy Co-Evolution for Agent Memory

The paper introduces HiPS, a hierarchical strategy co‑evolution framework for memory‑augmented agents that separates memory management into a globally shared foundation and a user‑specific adaptive tier. HiPS uses a Universal Strategy to capture shared principles from cross‑persona trajectories, Persona Delta Distillation to create tailored rules for users deviating from general patterns, and Cross‑Level Rule Flow to dynamically adjust the boundary between global and personal rules. Experiments show that this approach consistently outperforms existing memory‑augmented baselines.

By Yupeng Han, Shuochen Liu, Kai Zhang, Ze Liu, Zhihong Pan, Xianquan Wang
arXiv AI
Sep 24

COPE: Continual Personalization of LLMs under Sparse User Feedback via User Embeddings and Self-Evaluation

COPE (Continual Optimization with Personalized embedding and self-Evaluation) is a new framework that continually personalizes large language models using learnable user embeddings and self‑evaluation to generate proxy rewards. It integrates preference capture, self‑evaluation calibration, and personalized response optimization into a single update step, allowing continuous model updates even when explicit user feedback is sparse. Experiments demonstrate that COPE outperforms both training‑free and training‑based baselines, remains complementary to Retrieval‑Augmented Prompting, and shows reliable self‑evaluation, meaningful preference patterns, stable general capabilities, and robustness to shifting preferences and alternative evaluators.

By Ruike Cao, Fugen Yao, Liang Dong, Jian Xu, Guanjun Jiang, Li Xiao
arXiv Machine Learning
Jun 30

Synthetic Interaction Data for Scalable Personalization in Large Language Models

arXiv:2602. 12394v2 Announce Type: replace Abstract: Personalized prompting offers large opportunities for deploying large language models (LLMs) to diverse users, yet existing prompt optimization methods primarily focus on task-level optimization while largely overlooking user-specific preferences and latent constraints of individual users.

By Yuchen Ma, Yue Huang, Wenjie Wang, Xiaonan Luo, Xiangliang Zhang, Stefan Feuerriegel