arXiv AI

Bridging Exploration and Persona: Information-Directed Dueling for Test-Time Agent Personalization

The paper introduces ID‑TAP, a neural dueling‑bandit framework that personalizes large‑language‑model agents at test time by selecting personas through binary comparisons of candidate responses. It combines a query‑conditioned neural utility model with a lightweight Bradley‑Terry explorer, and uses similarity‑weighted warm starts to transfer evidence across related queries. Experiments on seven user‑conditioned generation benchmarks show that ID‑TAP outperforms baselines within a ten‑round comparison budget, demonstrating the effectiveness of information‑directed challenger selection for persona adaptation.

arXiv Machine Learning
Jun 2

Adaptive Querying with AI Persona Priors

arXiv:2605. 00696v2 Announce Type: replace-cross Abstract: We study adaptive querying for learning user-dependent quantities of interest, such as responses to held-out items and psychometric indicators, within tight query budgets.

By Kaizheng Wang, Yuhang Wu, Assaf Zeevi
arXiv Machine Learning
Jun 30

Synthetic Interaction Data for Scalable Personalization in Large Language Models

arXiv:2602. 12394v2 Announce Type: replace Abstract: Personalized prompting offers large opportunities for deploying large language models (LLMs) to diverse users, yet existing prompt optimization methods primarily focus on task-level optimization while largely overlooking user-specific preferences and latent constraints of individual users.

By Yuchen Ma, Yue Huang, Wenjie Wang, Xiaonan Luo, Xiangliang Zhang, Stefan Feuerriegel
arXiv AI
Sep 30

Challenges and Solutions for Bandits in the Wild: Warm-Started Mixture Bandits for Cross-Cohort Slate Recommendation

arXiv:2609.37800v1 Announce Type: cross Abstract: Many recommender services repeatedly encounter cold-start cohorts, where new users arrive with little or no interaction history. This creates two cha...

By Serafima Lebedeva, Sumantrak Mukherjee, Ali Arshad Sadal, Ilias Ek\c{s}i, Rahul Sharma, Julia Mueller, Theresa Dombrowski, Jakob Karolus, Viktor Bengs, Eyke H\"ullermeier, Sebastian Vollmer
arXiv Computation and Language
Sep 3

Learning Query-Specific Rubrics from Human Preferences for DeepResearch Report Generation

The paper introduces a method for creating query‑specific rubrics for DeepResearch‑style long‑form report generation by training rubric generators with reinforcement learning. It builds a dataset of queries annotated with human preferences, then uses a hybrid reward that includes preference consistency, format validity, and LLM‑based rubric evaluation. The learned rubrics outperform generic or manually constructed alternatives in distinguishing preferred reports and, when used as rewards, improve performance of both single‑agent and multi‑agent DeepResearch systems.

By Changze Lv, Jie Zhou, Wentao Zhao, Jingwen Xu, Shihan Dou, Zisu Huang, Muzhao Tian, Xiaohua Wang, Zhengkang Guo, Yang Liu, Pluto Zhou, Tao Gui, Le Tian, Xiao Zhou, Xiaoqing Zheng, Xuanjing Huang, Jie Zhou
arXiv AI
Sep 2

Data-Driven Persona-Conditioned Agents for A/B Test Simulation

The paper introduces a simulation framework that uses large language model (LLM) agents conditioned on data‑driven personas to predict A/B test outcomes. These personas are built from anonymized user behavioral patterns, engagement signals, and inferred demographics, offering a more realistic population model than synthetic or rule‑based personas. The authors evaluate question design, persona data source, behavioral depth versus diversity, and population subsampling, achieving 0.75–0.90 directional accuracy on 40 real A/B tests.

By Ziyad Benomar, Weronika {\L}ajewska, Leonardo Perelli, Saab Mansour