Profile-DP: Differential Privacy for User-Controlled Profile Release in Personalized LLM Inference
Read the original on arXiv AI →The Flow has not summarised this story yet — read it at arXiv AI.
The Flow has not summarised this story yet — read it at arXiv AI.
arXiv:2606. 05004v1 Announce Type: cross Abstract: With the widespread deployment of public large language models (LLMs) such as ChatGPT, protecting user prompt privacy has become an increasingly critical issue.
The paper investigates how privacy-preserving sanitization of user context in large language model (LLM) interactions affects downstream performance. It identifies three mechanisms—Context‑Dependent Utility, Strategic Adaptation, and Combinatorial Interplay—that explain when and how to sanitize data. Based on these insights, the authors propose an intent‑driven local protection framework using a lightweight model (Veilmind‑4B) to dynamically extract, sanitize, and restore context, achieving lower privacy leakage while maintaining higher utility than existing baselines.
The paper investigates a privacy‑hallucination tradeoff in differentially private (DP) language models. It shows that DP pre‑training or fine‑tuning increases hallucinations compared to non‑DP models, especially as the privacy budget becomes stricter. The authors attribute this to DP mechanisms flattening output distributions, and demonstrate that controlling the frequency of facts in training data can mitigate hallucination risks.
arXiv:2609.35937v1 Announce Type: cross Abstract: While prior work has documented privacy failures in LLM agents, it remains unclear how the presentation of privacy guidance influences their choice o...
arXiv:2606. 09401v1 Announce Type: new Abstract: Recent work has applied differential privacy (DP) to adapt large language models (LLMs) for sensitive applications, offering theoretical guarantees.
arXiv:2608. 03130v1 Announce Type: cross Abstract: Long-term memory enables persistent personalization in LLM agents, but repeated memory-conditioned responses can cumulatively reveal protected attributes even when they are never stated explicitly.