arXiv Machine Learning
Balancing Privacy, Utility, and Safety in LLM Alignment through Preference Optimization
Read the original on arXiv Machine Learning →The Flow has not summarised this story yet — read it at arXiv Machine Learning.
Related stories
arXiv Machine Learning
Jun 9
Benchmarking Empirical Privacy Protection for Adaptations of Large Language Models
arXiv:2606. 09401v1 Announce Type: new Abstract: Recent work has applied differential privacy (DP) to adapt large language models (LLMs) for sensitive applications, offering theoretical guarantees.
arXiv AI
5d ago
Rank-Aware Differentially Private Release of Listwise Preferences for LLM Alignment
The paper introduces a rank‑aware exponential mechanism that privatizes listwise preference data for large language model alignment under local differential privacy. By sampling a fixed‑size binary partition, the method concentrates noise near borderline items rather than uniformly across all items, thereby reducing sensitivity. Experiments demonstrate that this approach outperforms existing LDP baselines on downstream alignment tasks while maintaining the same privacy budget.
arXiv AI
Jun 30
Decomposing Memorization Reduction in Privacy-Preserving Fine-Tuning of SLMs for CSIRTs
arXiv:2606. 28479v1 Announce Type: cross Abstract: CSIRTs increasingly fine tune language models on vulnerability scan records, but these records expose internal network topology and create privacy risks under regulations such as GDPR and LGPD.
arXiv AI
Jun 10
Advancing the State-of-the-Art in Empirical Privacy Auditing
arXiv:2606. 10481v1 Announce Type: cross Abstract: Parameter-efficient fine-tuning of large language models (LLMs) can exhibit problematic memorization of individual training examples.
arXiv AI
Oct 21
Profile-DP: Differential Privacy for User-Controlled Profile Release in Personalized LLM Inference
arXiv:2610.27213v1 Announce Type: cross Abstract: Personalized large language models (LLMs) increasingly rely on profile-conditioned inference, pairing public requests with rich, user-specific facts....
arXiv Computation and Language
Sep 2
Membership Inference in Fine-tuned Diffusion Language Models via Token-level Memorization Asymmetry
The paper introduces a new privacy vulnerability in diffusion language models (DLMs) called token‑level memorization asymmetry, derived from theoretical analysis of diffusion training dynamics. It proposes Q‑Skew, a quantile‑weighted skewness indicator, to perform membership inference on fine‑tuned DLMs, outperforming existing baselines across multiple datasets and models. Additionally, Q‑Skew can be used to extract personally identifiable information (PII), demonstrating a broader privacy attack surface.