arXiv AI
LLMs as Oracles: Reliance on LLMs for Subjective Personal Questions
Read the original on arXiv AI →The Flow has not summarised this story yet — read it at arXiv AI.
Related stories
arXiv AI
Sep 4
User Perceptions vs. Proxy LLM Judges: Privacy and Helpfulness in LLM Responses to Privacy-Sensitive Scenarios
The study investigates how users perceive the helpfulness and privacy-preservation of large language model (LLM) responses in privacy-sensitive scenarios. Using 94 participants and 90 PrivacyLens scenarios, researchers found that users’ evaluations of identical LLM outputs varied widely, whereas five proxy LLM judges showed high agreement but low correlation with user judgments. The results suggest that proxy LLMs cannot reliably estimate users’ diverse perceptions of utility and privacy, highlighting the need for more user-centered evaluation methods.
arXiv AI
Jun 17
Security and Privacy Prompts in the Wild: What Users Ask LLMs and How LLMs Respond
arXiv:2606. 18062v1 Announce Type: cross Abstract: Large language models (LLMs) are widely used to fulfill users' information needs; users ask LLMs about the weather, pose educational questions, and consult them for legal assistance.
arXiv AI
Jul 7
Mecha-nudges for Machines
arXiv:2603. 23433v3 Announce Type: replace Abstract: AI agents are becoming active decision-makers on the Internet.
arXiv Computation and Language
2d ago
Too Good to Be Real? Diagnosing and Reducing the Gap Between AI Preference and Real User Engagement
arXiv:2609.18282v1 Announce Type: new Abstract: Large language models are increasingly used to generate and evaluate online content, yet it remains unclear whether the qualities they associate with h...
arXiv AI
Sep 1
Evaluating the Hidden Costs of Personalization in Large Language Models
arXiv:2608.28833v1 Announce Type: new Abstract: While Large language models (LLMs) incorporate user personalization signals to improve usability and helpfulness, they increasingly shift from providin...
arXiv AI
Jun 6
How Far Did They Go? The Persuasive Tactics of Covert LLM Agents in a Discontinued Field Experiment
arXiv:2606. 05256v1 Announce Type: new Abstract: This study analyzes a publicly released dataset from a discontinued field experiment on Reddit's r/ChangeMyView.