The paper introduces BaCVA, a Bayesian Context-aware personalized Value Alignment method for large language models. It treats personal values as priors and context-dependent preferences as posteriors, estimating contextual value salience from normative responses and using a dual-view personalization module to infer posterior preferences. Experiments show BaCVA outperforms strong baselines, offering more accurate and data‑efficient personalized value alignment.
arXiv:2602. 12394v2 Announce Type: replace Abstract: Personalized prompting offers large opportunities for deploying large language models (LLMs) to diverse users, yet existing prompt optimization methods primarily focus on task-level optimization while largely overlooking user-specific preferences and latent constraints of individual users.
arXiv:2603.04191v2 Announce Type: replace Abstract: Large Language Models (LLMs) are increasingly serving as personal assistants, where users may share individual preferences over extended interactio...
Re2A is a new framework for situated conversational recommendation that models user interactions within shared physical environments. It introduces rubric-based preference reasoning to explicitly capture user preferences from dialogue history and scene context, and a preference-conditioned optimization to align generated responses with both user satisfaction and situational consistency. Experiments on two SCR datasets show that Re2A outperforms existing methods, providing more precise and context-aware recommendations.
arXiv:2606. 06614v1 Announce Type: cross Abstract: Despite growing interest, most evaluations of large language models' (LLMs') personalization abilities have relied on synthetic data.
arXiv:2608.28833v1 Announce Type: new Abstract: While Large language models (LLMs) incorporate user personalization signals to improve usability and helpfulness, they increasingly shift from providin...
GUIDE is a large‑language‑model driven architecture that elicits and infers human user preferences through conversational Bayesian adaptive sampling and symbolic rule‑based learning. It extends adaptive sampling to a wide range of elicitation questions via a flexible type system and initializes domain‑specific preference models using symbolic representations of world knowledge. In simulated investment portfolio optimization, GUIDE outperforms prior methods, LLM‑only baselines, and its own ablated variants by improving cold‑start performance and reducing recommendation regret during early interactions.
The paper introduces VIBE‑Bench, a new benchmark designed to test personalized large language models (PLLMs) in a regime where user profile cues and query‑specific preferences do not share the same conceptual space, a situation termed profile‑preference conceptual misalignment (PRCM). VIBE‑Bench contains 3,504 personas, 12,239 dialogues, and a manually verified gold test set, and includes two psychology‑grounded tasks that require cross‑concept preference reasoning beyond surface semantic overlap. Experiments show that existing PLLMs largely depend on shallow semantic correlations and struggle to learn robust cross‑concept mappings, highlighting PRCM as a distinct failure mode for personalization models.
arXiv:2605. 00696v2 Announce Type: replace-cross Abstract: We study adaptive querying for learning user-dependent quantities of interest, such as responses to held-out items and psychometric indicators, within tight query budgets.
arXiv:2608. 12389v1 Announce Type: new Abstract: Cross-domain zero- or few-shot personalization aims to generate user-preferred responses in unseen conversational domains from only a handful of target-domain interactions.
HyperTrace is a training‑free framework that personalizes large language models by tracing latent user preferences online. It maintains interpretable natural‑language hypotheses about short‑term intent and long‑term preferences, updating them with an SMC‑style reweighting process driven by an LLM‑based surrogate choice model. Experiments on PRISM and PersonaMem‑v2 demonstrate that HyperTrace improves response alignment, preference prediction, and profile consistency compared to strong online baselines.
arXiv:2602. 03160v2 Announce Type: replace Abstract: Aligning Large Language Models (LLMs) with the diverse spectrum of human values remains a central challenge: preference-based methods often fail to capture deeper motivational principles.
Aligning large language models to human preferences is crucial for real-world deployment but frequently incurs an alignment tax, leading to the catastrophic forgetting of pre-trained general capabilit...