arXiv Machine Learning

Constitution-Guided Watermarking

arXiv AI
Sep 11

Watermarks Without Verification: AI Text Watermarking After the EU AI Act

The paper discusses the EU AI Act’s requirement for generative AI providers to embed detectable watermarks in their outputs, noting that Anthropic’s Claude models and Google’s Gemini use SynthID‑Text by default. It critiques the lack of verifiability of claims about watermark quality, privacy, and robustness, and evaluates the open‑source SynthID‑Text implementation on two open‑weight models, finding minimal impact on prose and modest correctness loss on code. The authors argue that the real governance issue is the inability to verify these assertions and outline necessary steps—such as output release, configuration disclosure, accredited audits, shared evaluation protocols, and interoperable detection—to address the gaps.

By Alexander Nemecek, Vipin Chaudhary, Erman Ayday
arXiv Computation and Language
6d ago

Watermarkability: Measuring and Improving Language-Model Compatibility with Logit-Based Watermarks

The paper introduces "watermarkability," a metric that quantifies how compatible a language model is with a logit‑based watermark that boosts the probability of a specified token set during decoding. By measuring the expected minimum KL divergence needed to achieve a target probability mass, the authors can assess and compare models and watermark rules. They propose a two‑stage approach—first training a low‑rank adapter conditioned on the target set, then applying a minimal uniform logit bias—to reduce this cost, achieving significant perplexity reductions across multiple watermark schedules on OPT‑125M and Qwen3‑8B.

By Zewei Deng, Mohamed Seif, Liyan Xie
arXiv Machine Learning
2d ago

MarkTune: Improving the Quality-Detectability Trade-off in Model-Embedded LLM Watermarking

MarkTune is a model‑embedded watermarking framework that improves the trade‑off between generation quality and detectability. By regularizing toward a high‑quality reference distribution, it decouples quality preservation from proximity to the base model and uses the GaussMark detection statistic as a reward during on‑policy fine‑tuning. Empirical results show that MarkTune enhances the quality‑detectability frontier, maintains downstream task performance, and remains robust against text‑editing and open‑weight attacks across diverse datasets.

By Yizhou Zhao, Zhiwei Steven Wu, Adam Block
arXiv Computation and Language
Aug 31

Semantic Watermarking with Order-Robust Detection over Sub-sentence Units

The paper introduces an adaptive embedding displacement attack (EDA) that exploits rewording, reordering, and resegmentation to remove semantic watermarks from text, achieving a 32.6%–47.9% success rate across four watermarking schemes. To counter this, the authors propose k‑SwordStamp, a semantic watermarking method that uses order‑robust detection over sub‑sentence units, significantly reducing vulnerability to structure‑based edits. Experiments show that EDA remains effective against k‑SwordStamp, but with a lower success rate (10.8%) compared to its performance on other schemes.

By Abdulrahman Diaa, Jonathan Petit, Florian Kerschbaum
arXiv Computation and Language
Sep 3

LLM Watermarking as Big Data Provenance: A Deployment-Oriented Systematization

The paper presents a systematic framework for large language model (LLM) watermarking as a provenance tool in big data ecosystems. It categorizes existing watermarking methods along four deployment dimensions—insertion point, verification authority, operational state, and transformation threat model—and aligns them with the big data principles of Volume, Velocity, Variety, Veracity, and Value. The authors introduce a readiness framework that maps four key workloads—online generation, streaming detection, transformation pipelines, and ecosystem governance—to system-level requirements such as throughput, false-positive control, robustness, cross-domain reliability, governance, and downstream utility, while highlighting gaps between benchmark performance and real-world deployment readiness.

By Huy Phan, Kieu Dang, Ojaswi Dulal, Aiham AL Shukairi, Abby Shine, Chase Garner, Phung Lai