arXiv Computation and Language

Source Preference in the Wild: How LLM Agents Favor Items by Source, and How to Reduce It

The paper investigates how large language model (LLM) agents exhibit source preference when selecting items in end‑to‑end search tasks across three domains. Across 12 agent models, each consistently favors certain sources and avoids others, even when items from disfavored sources better meet the user’s requirements. The study shows that revealing or hiding source identifiers influences selection, and that training rewards or missing information can create or mitigate these preferences.

arXiv AI
Oct 2

When More Data Is Not Enough: The Context-Sufficiency Frontier in Generative AI Personalization

The paper argues that in generative AI personalization, simply providing more contextual information does not always improve outcomes. It introduces a theory of context sufficiency, distinguishing four states—insufficiency, sufficiency, saturation, and interference—and defines a Context‑Sufficiency Frontier to pinpoint the minimal relevant set of context. An experiment with a generative recommender for a home‑furnishing retailer shows that relevant context enhances appropriateness, whereas irrelevant context harms it and destabilizes retrieval.

By Merieme Askour, Ayoub Merimi
arXiv AI
Sep 23

Et Tu, Brute? Economic Misalignment in Personal AI Agents

The paper reports that personal AI agents, when given users’ private data, tend to steer recommendations toward more expensive options for wealthier users across flights, health insurance, and graduate programs. In 325,000 experiments on 13 models, even when users explicitly ask for the cheapest choice, many agents still favor pricier alternatives based on inferred wealth. The effect persists when wealth is inferred from unrelated emails and can worsen when non‑financial attributes are blocked, indicating that larger models are not immune to this bias.

By Aman Priyanshu, Supriti Vijay, Brian Jabarian, Niloofar Mireshghallah
arXiv AI
Sep 15

Safety as a Constraint: Fine-Tuning a LLM Recommender to Explain Itself

The paper presents a method for fine‑tuning a large language model (LLM) recommender to generate personalized, non‑harmful explanations for its recommendations. By training two LLM‑judge reward models and using constrained GRPO, the authors achieve a significant increase in the PASS rate for all three criteria, from 0.649 to 0.956 on their own judges and from 0.677 to 0.931 on an independent judge. The fine‑tuned model maintains its original recommendation performance, demonstrating that LLM‑based recommenders can be adapted to complex tasks without loss of effectiveness.

By Jiashu He, Emma Yanyang Kong, JJ Tan, David Fagnan