arXiv AI By Rohith Yanambaka Venkata, Don McBride, Tiago Sequeira, Md. Al Amin

Clean Sheets and Checkpoints: Evidence Complexity for Certifying Sequential Agent Risk

Read the original on arXiv AI →

arXiv:2610. 39124v1 Announce Type: cross Abstract: Dangerous-capability evaluations often test an AI agent from prepared states at ordered milestones.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv Machine Learning
Oct 22

Better Policies, Worse Verifier Audits

The paper investigates how verifier components used in post‑training and test‑time loops can collapse when they are refreshed based on aggregate success scores. It shows that as a policy improves on one conjunctive target, the verifier’s on‑policy AUC can shift to favor a worse component, leading to a preference for a full‑outcome predictor over the intended component oracle. The authors provide theoretical thresholds, empirical demonstrations on text control and ECG data, and propose a repair that audits the component on its own failures to prevent damage.

By Daniel Cie\'slak, Jacek {\L}ubi\'nski