arXiv Machine Learning By Prakhar Ganesh, Yash More, Marco Romanelli, Ferdinando Fioretto, Golnoosh Farnadi

Privacy in Context Is Being Overlooked in the Age of General-Purpose LLMs

Read the original on arXiv Machine Learning →

The paper argues that as large language models (LLMs) expand, privacy concerns grow, yet current approaches tend to seek a single, universal privacy solution. It emphasizes that privacy is inherently contextual, and warns that a unified framework can give a misleading sense of security and ignore fundamental tensions among desired privacy properties. The authors propose focusing on application‑specific deployment, context‑specific evaluation, and improved privacy literacy as key future directions.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv AI
Sep 4

User Perceptions vs. Proxy LLM Judges: Privacy and Helpfulness in LLM Responses to Privacy-Sensitive Scenarios

The study investigates how users perceive the helpfulness and privacy-preservation of large language model (LLM) responses in privacy-sensitive scenarios. Using 94 participants and 90 PrivacyLens scenarios, researchers found that users’ evaluations of identical LLM outputs varied widely, whereas five proxy LLM judges showed high agreement but low correlation with user judgments. The results suggest that proxy LLMs cannot reliably estimate users’ diverse perceptions of utility and privacy, highlighting the need for more user-centered evaluation methods.

By Xiaoyuan Wu, Roshni Kaushik, Wenkai Li, Lujo Bauer, Koichi Onoue