arXiv AI

Agentic-Priors: Using Large Language Models to Address the Cold Start Problem in Preference Elicitation

Agentic-Priors uses large language models to generate informative priors for preference learning agents, addressing the cold start problem by translating a new user's trade-offs into a prior over multinomial logit coefficients. The Bayesian learner refines this prior as choices are observed, improving cold start accuracy by 5–40 percentage points across seven datasets. Compared to state‑of‑the‑art methods, Agentic-Priors outperforms AutoElicit on three datasets, surpasses in‑context learning by up to 18 points, and is valued at roughly 6–40 surveyed users in log‑loss terms, making it especially useful for early deployment users.

arXiv Computation and Language
Oct 15

AdaptFuse: Training-Free Sequential Preference Inference via Externalized Bayesian Computation

arXiv:2604.03925v2 Announce Type: replace Abstract: Large language models (LLMs) struggle to accumulate evidence across multiple rounds of user interactions, failing to update their beliefs in a mann...

By Fangzhou Lin, Zilin Dai, Shuo Xing, Peiran Li, Siyuan Yang, Qianwen Ge, Kazunori Yamada, Yang Zhou, Ziming Zhang, Haichong Zhang, Zhengzhong Tu
arXiv AI
Jul 24

Benchmarking the Personalization Capabilities of Large Language Models

arXiv:2607. 20471v1 Announce Type: new Abstract: Personalization, the act of varying a message to induce action from a specific receiver while keeping sender, channel, and time fixed, has a long tradition in psychology and marketing as a two-party problem in which sender and receiver have independent objectives.

By Ashutosh Srivastava, Siddharth Yedlapati, Vinay Aggarwal, Yaman Kumar Singla, Shashwat Dixit, Jitendra Ajmera, Balaji Krishnamurthy
arXiv AI
Jul 7

Amortising Bayesian Experimental Design for Sequential Information Gathering in LLMs

arXiv:2607. 03426v1 Announce Type: cross Abstract: Large language models (LLMs) exhibit strong reasoning and world-knowledge capabilities, yet often struggle to gather information effectively across the multi-turn interactions required in sequential decision-making settings.

By Jakob Hartmann, James Harvey, Jhonathan Navott, Erik Y. Wang, Luckeciano C. Melo, Flaviu Cipcigan, Cheng Zhang, Alessandro Abate
arXiv AI
Jul 23

Personalized Recommendation Tool Learning via Autonomous Language Agents

arXiv:2607. 19739v1 Announce Type: cross Abstract: Although large language models (LLMs) have recently gained traction in recommender systems due to their strong reasoning capabilities and extensive world knowledge, previous LLM-based agents suffer from hallucination and context-length limitations, and thus are not suitable for full-ranking recommendation tasks.

By Mingdai Yang, Zhiwei Liu, Weizhi Zhang, Yibo Wang, Hao Peng, Philip Yu
arXiv AI
Oct 23

Steering Black-Box Large Language Model Agents with Pitfall Anticipation World Model

The paper introduces the Pitfall Anticipation World Model (PAWM), a selective guidance system for black-box large language model agents. PAWM predicts imminent failures in a bounded multi-step future and intervenes only when a potential pitfall is detected, reducing costly and often uninformative step-by-step predictions. Trained first with supervised fine-tuning on synthetic pitfall-labeled data and then co-trained with a black-box LLM, PAWM boosts Claude Sonnet 4.5’s performance by 24.3% on ScienceWorld and 7.7% on WebArena-Lite, outperforming several baselines.

By Jiongxiao Wang, Han Ding, Youzhi Luo, Yawei Wang, Yun Zhou, Linbo Liu, Panpan Xu
arXiv Machine Learning
Jun 2

Adaptive Querying with AI Persona Priors

arXiv:2605. 00696v2 Announce Type: replace-cross Abstract: We study adaptive querying for learning user-dependent quantities of interest, such as responses to held-out items and psychometric indicators, within tight query budgets.

By Kaizheng Wang, Yuhang Wu, Assaf Zeevi