arXiv Computation and Language

PrivBench: A Holistic and Modular Benchmarking Platform for Evaluating Text-to-Text Privatization

arXiv AI
Aug 20

Redakto - The Incognito Tab for LLMs

Redakto is a new tool designed to anonymize text before it is processed by large language models (LLMs). It offers state‑of‑the‑art redaction of personally identifiable information (PII) and pseudonymization, accessible via a web interface, REST APIs, and model context protocol hooks. The authors evaluate its performance on legal and medical datasets, showing that anonymized texts retain utility comparable to the originals, enabling LLM tasks without significant loss of effectiveness.

By Saurav Kumar Saha, Tom R\"ohr, Felix Bie{\ss}mann
arXiv Machine Learning
Jul 30

DP-MGTD: Privacy-Preserving Machine-Generated Text Detection via Adaptive Differentially Private Entity Sanitization

arXiv:2601. 04641v2 Announce Type: replace-cross Abstract: The deployment of Machine-Generated Text (MGT) detection systems necessitates processing sensitive user data, creating a fundamental conflict between authorship verification and privacy preservation.

By Lionel Z. Wang, Yusheng Zhao, Jiabin Luo, Xinfeng Li, Lixu Wang, Yinan Peng, Haoyang Li, XiaoFeng Wang, Wei Dong
Hugging Face Trending Papers
Aug 19

Introducing the Privacy-HSD Trade-off: Hate Speech Detection, but not at the Cost of Privacy

The paper introduces the privacy‑HSD trade‑off, highlighting that automatic hate speech detection systems can inadvertently compromise user privacy by encoding authorship. It demonstrates that such systems may achieve high performance at the expense of privacy, and proposes a new domain‑specific technique, AgnoSpeech, alongside other text privatization methods to balance these competing goals. The authors benchmark these methods, showing that while challenging, it is feasible to protect privacy without sacrificing hate‑speech detection effectiveness.

arXiv AI
Oct 16

Private Retrieval Augmented Generation via Random Projection

The paper introduces a lightweight privacy-preserving technique for Retrieval-Augmented Generation (RAG) systems that uses random projection to transform both datastore and query embeddings. This approach maintains semantic similarity for effective retrieval while significantly reducing the risk of data extraction attacks. Experiments across various RAG architectures and datasets demonstrate that the method outperforms prior differential privacy-based techniques in both retrieval and generation performance while offering comparable empirical privacy.

By Dixi Yao, Tahseen Rabbani, Tian Li
arXiv AI
Jun 18

RedactionBench

arXiv:2606. 18782v1 Announce Type: cross Abstract: Large Language Models are increasingly applied to sensitive domains that require redaction of personally identifiable information (PII).

By Sean Brynj\'olfsson, Shashvat Jayakrishnan, Esha Sali, Diptanshu Purwar, Madhav Aggarwal
arXiv AI
6d ago

Reconciling Privacy with Provenance for Language Model Watermarks

The paper proposes a new approach to watermarking language models that balances privacy and provenance. By shifting the focus from tracking individual texts to estimating aggregate usage, the authors develop locally differentially private watermarks that limit the evidence any single text can contribute to detection. The Red‑Green Sequence (RGS) watermark achieves accurate frequency estimation with low error rates even at stringent privacy levels (ε=1–2) across various models and realistic deployment scenarios.

By Elise L. Han, Tatsunori Hashimoto
arXiv Machine Learning
Jun 2

ContinuousBench: Can Differentially Private Synthetic Text Improve Capabilities?

arXiv:2606. 01849v1 Announce Type: new Abstract: Differentially private (DP) text synthesis promises to unlock sensitive corpora for model training, but it remains unclear whether DP synthetic data transmits genuinely new knowledge and capabilities present only in those corpora.

By Peihan Liu, Lucas Rosenblatt, Weiwei Kong, Natalia Ponomareva, Gautam Kamath, Rachel Cummings, Roxana Geambasu, Yu Gan, Lillian Tsai, Alex Bie