SorryDB: Can AI Provers Complete Real-World Lean Theorems?
arXiv:2603. 02668v2 Announce Type: replace Abstract: We present SorryDB, a dynamically-updating benchmark of open Lean tasks drawn from 78 real world formalization projects on GitHub.
arXiv:2606. 26442v1 Announce Type: cross Abstract: We present AXLE (Axiom Lean Engine), a cloud service for Lean 4 proof manipulation, extraction, and verification.
arXiv:2603. 02668v2 Announce Type: replace Abstract: We present SorryDB, a dynamically-updating benchmark of open Lean tasks drawn from 78 real world formalization projects on GitHub.
arXiv:2605.22875v2 Announce Type: replace Abstract: Long-horizon mathematical reasoning fails less often because a model cannot produce a valid next step than because an agent fails to maintain and e...
arXiv:2606. 09450v1 Announce Type: new Abstract: LLMs have recently achieved strong results on formal proving benchmarks.
NanoProof is the first factorized execution‑guided theorem prover in Lean 4 whose training data, tooling, pipeline, and weights are all publicly released, enabling end‑to‑end reproducibility with open‑source resources. The authors provide a dataset of structured proof trees and a programmatic interaction tool for Lean 4, emphasizing compute efficiency to make training and evaluation more accessible. NanoProof achieves a 50.8% pass@16 on MiniF2F‑Test, outperforming comparable systems while using far less compute, demonstrating that such provers can be rebuilt from scratch with modest resources.
arXiv:2602.18307v2 Announce Type: replace-cross Abstract: Large language models have achieved striking results in interactive theorem proving, particularly in Lean. However, most benchmarks for LLM-b...
LLMs have recently achieved strong results on formal proving benchmarks. However, existing evaluations remain heavily concentrated on competition-style problems and often fail to capture how models behave on longer, more dependency-rich mathematical developments.
arXiv:2606. 28841v1 Announce Type: cross Abstract: Large language models are increasingly capable of mathematical reasoning, but the proofs they generate are often unreliable and hard to verify.
arXiv:2606. 06468v1 Announce Type: new Abstract: We introduce Goedel-Architect, an agentic framework for formal theorem proving in Lean 4 centered on blueprint generation and refinement.
Stellar Colosseum is a model‑agnostic harness designed to improve long‑horizon research in mathematics and theoretical computer science by allocating inference across multiple agents. It explores alternative strategies before constructing proofs, uses a readiness gate to decide when a route is mature enough to decompose, represents proof plans as interdependent subproblems, and routes verifier findings back to the relevant part of the argument. The workflow generates candidates in parallel, attacks them with targeted falsification, and combines candidates and critiques into a single research artifact through overlapping random‑sample tree aggregation, and has been integrated into Google Antigravity's Teamwork framework as the Long Proof pattern. Demonstrations show that, when paired with Gemini 3.1 Pro, Stellar Colosseum achieves 71.0% accuracy on the TCS‑Bench theorem‑proving benchmark and solves 218 of 222 Codeforces problems.
AI agents are increasingly used for programming, but do not provide any guarantee on the correctness of generated code. Verified code generation, in which an agent produces both an implementation and a machine-checked proof of its specification, offers a stronger path toward trustworthy AI-generated software.
arXiv:2608. 09277v1 Announce Type: new Abstract: Verified code generation asks a large language model (LLM) to generate both an executable program and a machine-checkable proof that the program meets a formal specification, promising software that is correct by construction.
arXiv:2608. 13522v1 Announce Type: cross Abstract: AI agents are increasingly used for programming, but do not provide any guarantee on the correctness of generated code.