arXiv Machine Learning
Guided Diffusion for Trustworthy Synthetic Text Generation
Read the original on arXiv Machine Learning →The Flow has not summarised this story yet — read it at arXiv Machine Learning.
Related stories
arXiv Machine Learning
Aug 4
MAPLE: Metadata Augmented Private Language Evolution
arXiv:2603. 19258v2 Announce Type: replace-cross Abstract: Differentially private (DP) fine-tuning of large language models (LLMs) requires massive compute and full model access, which rules out state-of-the-art proprietary APIs for general users.
arXiv AI
Jul 14
Private Seeds, Public LLMs: Realistic and Privacy-Preserving Synthetic Data Generation
arXiv:2604. 07486v3 Announce Type: replace-cross Abstract: Large language models (LLMs) have emerged as a powerful tool for synthetic data generation.
arXiv AI
Jul 22
Phantoms and Disclosures: A Statistical Framework for Auditing Privacy in Synthetic Data
arXiv:2606. 16952v2 Announce Type: replace-cross Abstract: The rapid adoption of generative AI and Large Language Models (LLMs) has spurred interest in synthetic data as a privacy-preserving alternative to sensitive real-world datasets.
arXiv Computation and Language
3d ago
Exploring The Empirical Privacy Landscape of Synthetic Data
The paper compares data-level and training-level methods for balancing language model capability and privacy leakage on synthetic medical records with embedded canaries. Direct finetuning achieves the highest capability but leaks the most private information, while DP‑SGD reduces leakage at a significant cost to performance. Generating privacy‑aware synthetic data—especially with uniqueness‑aware rewriting—offers a better trade‑off, and more capable rewriting models tend to lower downstream privacy risks, though gains are inconsistent with increased compute.
arXiv Machine Learning
Jul 21
Gradient-Free Privacy Leakage in Federated Language Models through Selective Weight Tampering
arXiv:2310. 16152v5 Announce Type: replace-cross Abstract: Federated learning (FL) has become a key component in various language modeling applications such as machine translation, next-word prediction, and medical record analysis.
arXiv AI
Oct 12
DP-MIND: Differentially private memory-guided Long context Inference
DP-MIND is a memory‑guided framework that enables differentially private inference for large language models on million‑token contexts. It locally perturbs user queries and processes them in chunks, using a compact memory that retains task‑relevant information across the sequence. The memory construction is optimized via reinforcement learning on perturbed inputs, and a local denoising module recovers corrupted answer spans, resulting in improved scalability and utility over existing DP and long‑context inference baselines.