arXiv AI
LLMs as Oracles: Reliance on LLMs for Subjective Personal Questions
Read the original on arXiv AI →The Flow has not summarised this story yet — read it at arXiv AI.
Related stories
arXiv AI
Sep 4
User Perceptions vs. Proxy LLM Judges: Privacy and Helpfulness in LLM Responses to Privacy-Sensitive Scenarios
The study investigates how users perceive the helpfulness and privacy-preservation of large language model (LLM) responses in privacy-sensitive scenarios. Using 94 participants and 90 PrivacyLens scenarios, researchers found that users’ evaluations of identical LLM outputs varied widely, whereas five proxy LLM judges showed high agreement but low correlation with user judgments. The results suggest that proxy LLMs cannot reliably estimate users’ diverse perceptions of utility and privacy, highlighting the need for more user-centered evaluation methods.
arXiv AI
Jun 17
Security and Privacy Prompts in the Wild: What Users Ask LLMs and How LLMs Respond
arXiv:2606. 18062v1 Announce Type: cross Abstract: Large language models (LLMs) are widely used to fulfill users' information needs; users ask LLMs about the weather, pose educational questions, and consult them for legal assistance.
arXiv AI
Jul 7
Mecha-nudges for Machines
arXiv:2603. 23433v3 Announce Type: replace Abstract: AI agents are becoming active decision-makers on the Internet.
arXiv Computation and Language
Sep 30
Evaluating Alignment of Behavioral Dispositions in LLMs
arXiv:2602.11328v2 Announce Type: replace Abstract: As people turn to LLMs for social advice, understanding their behavior in such contexts becomes essential. In this work, we focus on behavioral dis...
arXiv Computation and Language
Sep 17
Too Good to Be Real? Diagnosing and Reducing the Gap Between AI Preference and Real User Engagement
arXiv:2609.18282v1 Announce Type: new Abstract: Large language models are increasingly used to generate and evaluate online content, yet it remains unclear whether the qualities they associate with h...
arXiv AI
Sep 1
Evaluating the Hidden Costs of Personalization in Large Language Models
arXiv:2608.28833v1 Announce Type: new Abstract: While Large language models (LLMs) incorporate user personalization signals to improve usability and helpfulness, they increasingly shift from providin...