arXiv AI

Scaling Lean Theorem Proving for Real-World Code Verification

arXiv AI
Oct 12

Solving VeriContest with a Lean-Backed Rust Verifier

The paper reports that all 1,325 theorems from the VeriContest benchmark—comprising 1,007 competitive‑programming problems in Rust with Verus specifications—were successfully proved using Rust‑Prover, a Lean 4‑based verifier. The authors translated each Verus specification and Rust program into Lean, then used Lean’s kernel to confirm the proofs, achieving a 70% first‑iteration success rate and completing 1,259 proofs in under 32 hours on Claude Opus 5.5. The translated Lean programs matched the original Rust outputs on 21,413 benchmark test cases, and the study also compared performance across multiple large‑language‑model settings, noting that higher reasoning effort increased cost without improving proof counts.

By Traian Serbanuta, Jun Xu, Andrei Stefanescu, Cosmin Radoi
arXiv Machine Learning
Oct 23

Agentic Verified Optimization of Real-World Software

The paper introduces agentic verified optimization, where an AI agent produces a faster implementation of a program along with a machine‑checked proof that it is behaviorally equivalent to the original. The authors implement this in Lean 4, creating Aqueduct to migrate C, C++, Go, and Rust code into Lean and validate the ports via differential testing. On 189 reference functions, agents achieved 156 faster, proved rewrites, and on 17 migrated applications, 92 rewrites improved 47 of 51 scenarios, demonstrating the feasibility of verified optimization for real‑world software.

By Zhe Ye, Udaya Ghai, Zhizhen Qin, Dawn Song, Soonho Kong
arXiv AI
4d ago

How Stable Are LLM-Generated Proofs Under Program Refactoring? A Stress Test for Verifiable Code Generation

The paper introduces RefactorProof, a benchmark that tests whether proofs generated for code remain valid after program refactoring that preserves behavior. Using 458 Lean-certified variants derived from 185 VERINA tasks, the study finds that structural refactorings expose brittleness in proofs, with task-normalized structural PSR ranging from 4.3% for supplied references to 13.3–26.8% for specialized provers. Despite higher failure rates, specialized prover proofs (DeepSeek-Prover-V2-7B, Goedel-Prover-V2-32B, Goedel-Prover-V2-8B) show significantly higher unchanged-proof survival compared to reference artifacts, and many failures can be repaired with minimal edits.

By Aravind Mandiga, Guoming Li
arXiv AI
Sep 21

SWE-Proof: Can Language Models Resolve Real-World Issues with Machine-Checked Proofs?

arXiv:2609.21190v1 Announce Type: cross Abstract: Ensuring the correctness of LLM-generated code is a core challenge for modern software engineering. Benchmarks for agentic code generation check corr...

By George Ma, Benjamin Mikek, Haoyu Li, Ferhat Erata, Yuhao Zhang, Zeren Shui, Behrooz Omidvar Tehrani, Jun Huan, Murali Krishna Ramanathan, Somayeh Sojoudi, Hao Zhou, Anoop Deoras