The paper presents a bounded, online step-level repair module for Lean 4 that uses compiler error messages to fix rejected tactics instead of discarding them. By sampling up to $K$ candidate tactics and allowing at most $R$ repairs per step, the method improves solve rates over a sampling-only baseline, achieving up to a 32% relative gain and solving 82 additional theorems on a 1,990-theorem subset of the LeanDojo benchmark. The approach trades extra runtime for reachable proofs, with most benefit coming from early repair attempts and shallow tactic failures, and it successfully replicates on the Lean Workbook benchmark, nearly doubling its solve rate without regressions.
By Haotian Deng, Chris Farber, Sonal Narasimha, Samskrithi Sivakumar, Yexiang Xue
arXiv:2605. 22148v3 Announce Type: replace Abstract: A large language model (LLM) agent that writes and edits its own skill library must also decide which skills to keep, from one noisy scalar per skill.
By Xing Zhang, Yanwei Cui, Guanghui Wang, Ziyuan Li, Wei Qiu, Bing Zhu, Peiyang He
arXiv:2610. 12211v1 Announce Type: new Abstract: A verifier that accepts or rejects whole answers reveals little: under a flat prior over $k$-bit answers, zero error needs $2^k-1$ verifications.
By Hazar Yueksel
The paper addresses the asymmetry in verifying optimality claims for synthesis pipelines, distinguishing between the upper bound (existence of a program) and the lower bound (non-existence of a smaller program). It introduces a pipeline that synthesizes minimal linear straight‑line programs over GF(2) and produces DRAT proofs for every UNSAT result, thereby closing the so‑called refutation gap for 121 previously uncertified optimality claims. The authors report that the median proof size is 1.1 MB, checking takes 1.9× the solving time, and that their verification process uncovered defects missed by code review, highlighted interface obstacles, and exposed a budget‑related audit failure.
By Rohan Pandey
arXiv:2406. 13668v4 Announce Type: replace Abstract: A set of probabilistic forecasts is calibrated if each prediction of the forecaster closely approximates the empirical distribution of outcomes on the subset of timesteps where that prediction was made.
By Yuval Dagan, Constantinos Daskalakis, Maxwell Fishelson, Noah Golowich, Robert Kleinberg, Princewill Okoroafor
The paper introduces a formal framework for agent harnesses that guarantees termination, prevents drift, and enforces spend limits through bounded loops, gates, and repair relations. It proves that these guarantees hold even with repair budgets and demonstrates the effectiveness of the system by identifying vacuous gates and achieving low false‑accept rates in a 69‑loop catalogue. The authors provide an instrumented implementation and a held‑out mutant corpus to validate gate correctness.
By Varun Pratap Bhardwaj, Garima Singh, Arun Pratap Bhardwaj
arXiv:2607. 14169v1 Announce Type: new Abstract: Large language models can synthesize a game's rules as executable code - a Code World Model (CWM) - which a classical planner then searches over.
By Javier Aguilar Mart\'in
arXiv:2608. 20318v1 Announce Type: new Abstract: Recursive self-improvement (RSI) asks whether an AI system can improve the process that produces AI systems, so that the next system inherits the improvement.
By Yizhe Chi, Wenyi Li, Deyao Hong, Xiaoqiu Wang, Mingju Gao, Kaisen Yang, Bingxiang He, Youjie Zheng, Calvin Xiao, Qinhuai Na
arXiv:2610.08319v1 Announce Type: new
Abstract: In proof assistants such as Lean, a generated proof must pass machine compilation checks, so evaluation needs no human scoring. Direct generation fails...
By Hanchao Zhou, Jialei Li
The paper reports that all 1,325 theorems from the VeriContest benchmark—comprising 1,007 competitive‑programming problems in Rust with Verus specifications—were successfully proved using Rust‑Prover, a Lean 4‑based verifier. The authors translated each Verus specification and Rust program into Lean, then used Lean’s kernel to confirm the proofs, achieving a 70% first‑iteration success rate and completing 1,259 proofs in under 32 hours on Claude Opus 5.5. The translated Lean programs matched the original Rust outputs on 21,413 benchmark test cases, and the study also compared performance across multiple large‑language‑model settings, noting that higher reasoning effort increased cost without improving proof counts.
By Traian Serbanuta, Jun Xu, Andrei Stefanescu, Cosmin Radoi
arXiv:2607. 23806v1 Announce Type: cross Abstract: Improving a language model today means retraining it: enormous compute, a new opaque model each cycle, non-deterministic output.
By Sietse Schelpe (Corbenic AI)
arXiv:2610. 37828v1 Announce Type: cross Abstract: An AI developer often has several candidate versions of a system and can deploy a mixture of them, sending each request to a randomly chosen version, as in A/B testing.
By Nicholas Teh, Paul W. Goldberg