arXiv Machine Learning

Published Unlearning Numbers Move Per Checkpoint, and Not Because the Removed Data Survives: An Audit of 263 Released Batch-Normalized Checkpoints

The audit examines 263 batch‑normalized checkpoints released by arXiv, finding that refitting models on retained data at identical weights shifts 47 of 221 checkpoints beyond the spread indicated by their own release seeds. This movement is attributed to checkpoint properties rather than the survival of removed data, as swapping removed records for kept ones barely changes the published state. The study concludes that releases should specify the fitting convention used, especially for batch‑normalized vision models.

arXiv Machine Learning
Jul 7

The Moving Target: A Longitudinal Audit of Trustworthiness Drift Across Twelve Checkpoints of Open-Source Chat LLMs

arXiv:2607. 02587v1 Announce Type: cross Abstract: Model cards quote trust-benchmark scores without recording when they were measured, and the same number is routinely carried across successive checkpoints of one release line as if the model behind it had not shifted.

By Zhichao Fan, Yanhang Li, Zexin Zhuang, Xian Sun, Yingshuo Wang