Post-Audit Mirage: Identifiability Limits of Offline Agent Verification

The paper introduces the Post‑Audit Mirage, a framework showing that offline tests may not detect whether an agent update remains safe after deployment. It defines a benchmark that uses matched safe and harmful lifecycles to expose identical verifier‑visible evidence while an isolated scorer records opposite deployment truth, and presents a theorem on the error‑abstention tradeoff using observational equivalence. The IdentifiedRangeMonitor tool applies fresh group‑labelled harm outcomes to decide whether to deploy, hold, or remain uncertain, and experiments demonstrate that monitoring can recover missing distinctions in favorable settings but may stay undecided for rare groups or small effects.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at Hugging Face Trending Papers.

• agents
• benchmarks