arXiv AI By Pierre Peign\'e, Ky Nguyen, Paul Wang

Proposals and challenges for zero-knowledge verification of frontier AI training

Read the original on arXiv AI →

The paper proposes a zero‑knowledge verification framework for frontier AI training, combining pre‑committed specifications, network observations, and live Merkle commitments to create a succinct proof layer via a zero‑knowledge virtual machine (zkVM). It outlines how proofs can verify BF16/FP32 semantics step‑by‑step, enforce policy‑relevant claims, and provide a governance‑auditable training record, while also discussing sampling guarantees, weight smuggling risks, and the relative robustness of global training budgets versus per‑run FLOP caps. The authors compare zkVMs, custom circuits, and interactive audits, and identify remaining research and engineering challenges for external contributors.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv AI
Jun 6

Zero knowledge verification for frontier AI training is possible

arXiv:2606. 05433v1 Announce Type: new Abstract: Frontier AI governance frameworks increasingly use cumulative training compute as the primary criterion for designating high-impact models, but enforcement rests on self-reporting because no technical verification primitive for training exists.

By Pierre Peign\'e, Ky Nguyen, Paul Wang
arXiv Machine Learning
Sep 16

OPEN-1B: A Fully Auditable Training Run

The paper introduces Open-1B, a language model trained under a new fully auditable regime that ensures every training operation is reproducible on heterogeneous commodity hardware with bitwise certainty. By enforcing a fixed order on sources of nondeterminism—GPU reductions, data batch ordering, and inter/intra-node communication—the authors enable auditors to replay and verify individual training steps on a single machine. The release includes the full pretraining dataset, all intermediate checkpoints, the training codebase, and an audit harness for step-by-step verification.

By John Donaghy, Brian Wilcox, O\u{g}uzhan Ersoy, Shikhar Rastogi, Adam St Arnaud, Alexey Titov, Jordan Greenberg, Ben Fielding, Harry Grieve
arXiv Machine Learning
Sep 30

OVIG: Optimistic Verification of AI Training Integrity via Gradient Signals

OVIG is an optimistic verification framework that audits AI training by replaying the process and comparing gradient differences against an empirically calibrated boundary. It treats any gradient difference exceeding this boundary as a malicious deviation. By partitioning training into stride‑s intervals and storing evidence only at interval endpoints, OVIG dramatically reduces off‑chain storage and transmission costs while maintaining zero attack success rate across language, vision, and diffusion workloads.

By Hongxu Su, Jianzhu Yao, Huan Zhang, Xuechao Wang, Pramod Viswanath