arXiv Computation and Language

Watermarkability: Measuring and Improving Language-Model Compatibility with Logit-Based Watermarks

The paper introduces "watermarkability," a metric that quantifies how compatible a language model is with a logit‑based watermark that boosts the probability of a specified token set during decoding. By measuring the expected minimum KL divergence needed to achieve a target probability mass, the authors can assess and compare models and watermark rules. They propose a two‑stage approach—first training a low‑rank adapter conditioned on the target set, then applying a minimal uniform logit bias—to reduce this cost, achieving significant perplexity reductions across multiple watermark schedules on OPT‑125M and Qwen3‑8B.

arXiv Machine Learning

2d ago

MarkTune: Improving the Quality-Detectability Trade-off in Model-Embedded LLM Watermarking

MarkTune is a model‑embedded watermarking framework that improves the trade‑off between generation quality and detectability. By regularizing toward a high‑quality reference distribution, it decouples quality preservation from proximity to the base model and uses the GaussMark detection statistic as a reward during on‑policy fine‑tuning. Empirical results show that MarkTune enhances the quality‑detectability frontier, maintains downstream task performance, and remains robust against text‑editing and open‑weight attacks across diverse datasets.

By Yizhou Zhao, Zhiwei Steven Wu, Adam Block

llms fine-tuning efficiency

Hugging Face Trending Papers

Oct 6

Semantic Behavioral Watermarking: Paraphrase-Robust and Forgery-Resistant Provenance for LLM Agents

Behavioral watermarking embeds an owner identifier in an LLM agent's high-level action choices, giving provenance without touching output tokens. Prior agent watermarks break in two ways. First, all t...

llms agents benchmarks

arXiv Machine Learning

Jun 18

Signature filtering: a lightweight enhancement for statistical watermark detection in large language models

arXiv:2606. 18430v1 Announce Type: new Abstract: Statistical watermarks help organizations attribute large language model (LLM) outputs, yet existing detectors often struggle when watermark signals are weak, texts are repetitive, or watermarks are edited.

By Chih-Duo Hong, Yen-Pang Chen, Fang Yu

llms rag benchmarks

arXiv AI

Oct 7

Semantic Behavioral Watermarking: Paraphrase-Robust and Forgery-Resistant Provenance for LLM Agents

arXiv:2610.08668v1 Announce Type: cross Abstract: Behavioral watermarking embeds an owner identifier in an LLM agent's high-level action choices, giving provenance without touching output tokens. Pri...

By Suxin Ji, Hungtao Wan, Shaoxuan Chen, An Zhang

llms agents benchmarks

arXiv AI

Sep 15

Predictive Likelihood Ratios for Language Model Watermark Detection

arXiv:2609.15657v1 Announce Type: cross Abstract: Keyed watermark detection tests dependence between observed tokens and pseudorandom variables reconstructed from a secret key. Building on the pivota...

By Li Ma

llms

arXiv AI

Jul 16

WaterMoE: Expert-Routing-based Watermarking for High Fidelity and Efficiency

arXiv:2607. 13099v1 Announce Type: cross Abstract: Large language models (LLMs) have achieved remarkable success but raise growing concerns about content provenance and misuse, motivating the need for reliable watermarking techniques.

By Z Sun, Q Jiang, S Sheng, L Xiang

llms efficiency benchmarks

arXiv Machine Learning

Oct 8

Constitution-Guided Watermarking

arXiv:2610.09552v1 Announce Type: cross Abstract: Watermarking enables language model providers to identify text generated by their models. However, its desired properties can conflict (\ie~stronger...

By Toluwani Aremu, Samuele Poppi, Nils Lukas

llms agents

arXiv Machine Learning

Sep 30

AutoMark: Enabling Autoresearch to Discover Better LLM Watermarks

arXiv:2609.37310v1 Announce Type: cross Abstract: With LLM watermarking being deployed commercially and now required by regulations, improving its reliability and effectiveness has become crucial. Ye...

By Thibaud Gloaguen, Robin Staab, Martin Vechev

llms agents benchmarks

arXiv Machine Learning

Jul 2

Sample Complexities of Estimating Gumbel--Max Watermark Proportions with and without Reduction to Pivotal Statistics

arXiv:2607. 00224v1 Announce Type: cross Abstract: Watermarking promises a statistical trace of large language model (LLM) use, but real documents, after editing or paraphrasing, rarely arrive as purely human-written or purely machine-generated.

By Shuwen Chai, Qiaosen Wang

llms

Hugging Face Trending Papers

Sep 3

Flip, Don't Shuffle: Watermarking LLMs at the Speed of Inference

We introduce Stateless Bernoulli Watermarking (SBW), a new statistical watermark for Large Language Models that determines green list membership through independent per-token Bernoulli trials. Unlike KGW's vocabulary permutation or SynthID's multi-layer tournament, SBW requires only a single comparison per token against a counter-based random number generator, reducing membership complexity to $O(1)$ and enabling single-kernel execution with zero intermediate allocations.

llms benchmarks

arXiv Machine Learning

Jul 8

Beyond Heuristic Tuning: Power-Calibrated LLM Watermarking

arXiv:2607. 05694v1 Announce Type: cross Abstract: Logit-based watermarking is a widely used mechanism for identifying LLM generated content, yet its effectiveness is governed by a fundamental trade-off between detectability and semantic distortion.

By Xiaopu Wang, Zelin He, Chengyuan Liu, Runze Li

llms

arXiv Machine Learning

Sep 4

Flip, Don't Shuffle: Watermarking LLMs at the Speed of Inference

arXiv:2609. 03844v1 Announce Type: cross Abstract: We introduce Stateless Bernoulli Watermarking (SBW), a new statistical watermark for Large Language Models that determines green list membership through independent per-token Bernoulli trials.

By Simone Ceppi, Ignacio Sanchez

llms benchmarks

Related stories