Hugging Face Trending Papers

Auditing Cross-Lingual Fairness in Language Model Watermarking

Watermarking schemes for large language model output are evaluated almost exclusively on English text using each scheme's detection threshold and a narrow set of quality measurements. Multilingual deployment exposes evaluation-design choices that are inconsequential on English but determine conclusions cross-lingually.

arXiv Machine Learning
Aug 21

Auditing Cross-Lingual Fairness in Language Model Watermarking

arXiv:2608. 20047v1 Announce Type: cross Abstract: Watermarking schemes for large language model output are evaluated almost exclusively on English text using each scheme's detection threshold and a narrow set of quality measurements.

By Alexander Nemecek, Osama Zafar, Debargha Ganguly, Vikash Singh, Vipin Chaudhary, Erman Ayday
arXiv Machine Learning
6d ago

MarkTune: Improving the Quality-Detectability Trade-off in Model-Embedded LLM Watermarking

MarkTune is a model‑embedded watermarking framework that improves the trade‑off between generation quality and detectability. By regularizing toward a high‑quality reference distribution, it decouples quality preservation from proximity to the base model and uses the GaussMark detection statistic as a reward during on‑policy fine‑tuning. Empirical results show that MarkTune enhances the quality‑detectability frontier, maintains downstream task performance, and remains robust against text‑editing and open‑weight attacks across diverse datasets.

By Yizhou Zhao, Zhiwei Steven Wu, Adam Block
arXiv Machine Learning
Sep 30

Dataset Watermarking with Provable Black-Box Detection

The paper introduces a dataset watermarking technique that embeds a watermark by increasing the co‑occurrence of randomly selected word pairs through meaning‑preserving local edits. The watermark can be detected solely from generated text with provable false‑positive control, and experiments on four base models and three datasets show reliable detection (p < 0.01) even when the watermarked data constitutes less than 5% of fine‑tuning tokens. Compared to existing methods, the approach better preserves benchmark utility and semantic integrity.

By Pengrun Huang, Kamalika Chaudhuri, Yu-Xiang Wang