arXiv AI

Watermarks Without Verification: AI Text Watermarking After the EU AI Act

The paper discusses the EU AI Act’s requirement for generative AI providers to embed detectable watermarks in their outputs, noting that Anthropic’s Claude models and Google’s Gemini use SynthID‑Text by default. It critiques the lack of verifiability of claims about watermark quality, privacy, and robustness, and evaluates the open‑source SynthID‑Text implementation on two open‑weight models, finding minimal impact on prose and modest correctness loss on code. The authors argue that the real governance issue is the inability to verify these assertions and outline necessary steps—such as output release, configuration disclosure, accredited audits, shared evaluation protocols, and interoperable detection—to address the gaps.

arXiv Machine Learning
Oct 8

Constitution-Guided Watermarking

arXiv:2610.09552v1 Announce Type: cross Abstract: Watermarking enables language model providers to identify text generated by their models. However, its desired properties can conflict (\ie~stronger...

By Toluwani Aremu, Samuele Poppi, Nils Lukas
arXiv Computation and Language
Oct 28

Who Gets Flagged? The Pluralistic Evaluation Gap in AI Content Watermarking

The paper "Who Gets Flagged? The Pluralistic Evaluation Gap in AI Content Watermarking" discusses how AI content watermarking, used for authentication and provenance, varies in signal strength and robustness across different languages, cultural visual traditions, and demographic groups. It reviews existing benchmarks and finds that most do not report performance across these dimensions, highlighting a bias risk. The authors propose three evaluation dimensions—cross‑lingual detection parity, culturally diverse content coverage, and demographic disaggregation of detection metrics—to ensure fair and inclusive watermarking practices.

By Alexander Nemecek, Osama Zafar, Yuqiao Xu, Wenbiao Li, Erman Ayday
arXiv Computation and Language
Sep 3

LLM Watermarking as Big Data Provenance: A Deployment-Oriented Systematization

The paper presents a systematic framework for large language model (LLM) watermarking as a provenance tool in big data ecosystems. It categorizes existing watermarking methods along four deployment dimensions—insertion point, verification authority, operational state, and transformation threat model—and aligns them with the big data principles of Volume, Velocity, Variety, Veracity, and Value. The authors introduce a readiness framework that maps four key workloads—online generation, streaming detection, transformation pipelines, and ecosystem governance—to system-level requirements such as throughput, false-positive control, robustness, cross-domain reliability, governance, and downstream utility, while highlighting gaps between benchmark performance and real-world deployment readiness.

By Huy Phan, Kieu Dang, Ojaswi Dulal, Aiham AL Shukairi, Abby Shine, Chase Garner, Phung Lai
arXiv AI
Sep 18

Governance-as-Code: Translating EU AI Act Technical Requirements into Executable Compliance Pipelines for Generative AI Systems

The paper introduces Governance-as-Code (GaC), a framework that translates the EU AI Act’s technical requirements into 43 machine‑checkable acceptance criteria across six compliance modules. GaC runs within a CI/CD pipeline, producing Article‑indexed audit evidence and providing actual Rego policy code. The authors validate GaC on two enterprise deployments, showing it reproduces manual audit findings—including three penalty‑triggering violations—while reducing audit labor by about 75%.

By Rudrendu Kumar Paul, Sourav Nandy