arXiv AI

Annie, Are You Okay? How Style- and Context-Based Personalization Shape AI-Assisted Decision-Making

arXiv AI
Sep 21

Trustworthy FinAInce: Unpacking How AI-Mediated Financial Advice is Judged

The study investigates how people evaluate AI-generated financial advice by conducting a randomized vignette experiment with 285 U.S. adults. Participants were presented with consistent financial recommendations delivered in three styles—AI, expert, and online community—alongside source labels. The results show that advice style most strongly influenced message and safety appraisals, expert labels increased perceived source knowledge, and decision context shaped risk and safety judgments, with these appraisals explaining a large portion of overall quality, trust, and intended reliance.

By Aryan Ramchandra Kapadia, Eshwar Chandrasekharan, Koustuv Saha
arXiv Machine Learning
Sep 16

Strategic Advice in the Age of Personal AI

The paper examines how advisors should tailor recommendations when users consult personal AI assistants whose advice is predictable. It models the influence of personal AI through consultation probability and relative trust, finding that optimal counteraction and loss are hump‑shaped in these dimensions. The study also explores partial predictability, costly adjustments, richer information structures, and presents an online experiment showing participants weigh advisor, personal AI, and their own judgments differently.

By Yueyang Liu, Wichinpong Park Sinchaisri
arXiv Machine Learning
Aug 4

From Information to Delegation: Mapping Human-AI Financial Decision Making

arXiv:2608. 02100v1 Announce Type: cross Abstract: As AI increasingly participates in human decision making, understanding how decision-making authority is distributed between humans and AI has become a fundamental behavioural question.

By Iman Munire Bilal, Yingcan Carol Wang, Ajan Raj, Filippo Giovagnini, Pranav Tewari, Yuwei Zhang, Mei-Chen Zoe Liou, Qamar Zaman
arXiv AI
Sep 23

Et Tu, Brute? Economic Misalignment in Personal AI Agents

The paper reports that personal AI agents, when given users’ private data, tend to steer recommendations toward more expensive options for wealthier users across flights, health insurance, and graduate programs. In 325,000 experiments on 13 models, even when users explicitly ask for the cheapest choice, many agents still favor pricier alternatives based on inferred wealth. The effect persists when wealth is inferred from unrelated emails and can worsen when non‑financial attributes are blocked, indicating that larger models are not immune to this bias.

By Aman Priyanshu, Supriti Vijay, Brian Jabarian, Niloofar Mireshghallah
Hugging Face Trending Papers
Oct 22

Abstract Priorities, Concrete Rewards: How Stated Preferences Relate to What People Reward in AI Responses

The study examines how users’ stated preferences for AI assistant responses align with the actual rewards they give to those responses. Using the PRISM dataset, researchers compared 1,396 participants’ reported priorities on seven response attributes with their ratings of 29,347 responses from 21 large language models. They found that features not explicitly surveyed—such as length, formatting, and refusal language—were as strongly linked to ratings as the surveyed attributes, and that written feedback and prior conversation context influenced how much weight participants gave to length, while overall stated priorities poorly predicted the concrete features that drive ratings.

arXiv Computation and Language
Oct 23

Abstract Priorities, Concrete Rewards: How Stated Preferences Relate to What People Reward in AI Responses

The study investigates how users’ stated preferences for AI-generated responses align with the actual features they reward. Using the PRISM dataset, researchers compared participants’ reported priorities for seven response attributes with their ratings of over 29,000 responses from 21 large language models. They found that attributes not explicitly surveyed—such as length, formatting, and refusal language—were as strongly linked to ratings as the surveyed ones, and that written feedback was a better predictor of how users weighted these concrete features than their stated priorities.

By Zihan Chen, Lei Nico Zheng, Di Zhu
arXiv AI
Oct 2

When More Data Is Not Enough: The Context-Sufficiency Frontier in Generative AI Personalization

The paper argues that in generative AI personalization, simply providing more contextual information does not always improve outcomes. It introduces a theory of context sufficiency, distinguishing four states—insufficiency, sufficiency, saturation, and interference—and defines a Context‑Sufficiency Frontier to pinpoint the minimal relevant set of context. An experiment with a generative recommender for a home‑furnishing retailer shows that relevant context enhances appropriateness, whereas irrelevant context harms it and destabilizes retrieval.

By Merieme Askour, Ayoub Merimi
arXiv AI
Oct 2

When the AI Leaves the Tailorshop: Measuring What an LLM Advisor Leaves Behind in Complex Problem Solving

The study investigates how large language model (LLM) advisors affect complex problem‑solving in a simulated clothing‑factory setting. Two preregistered experiments (N=200 and N=198) found that participants with AI support reported higher confidence and understanding, expended less effort, and in some cases achieved better performance or avoided bankruptcy. Within the AI‑supported group, more frequent changes to the AI’s recommendations were linked to improved unaided performance and knowledge.

By Robin Welsch