SorryDB: Can AI Provers Complete Real-World Lean Theorems?
arXiv:2603. 02668v2 Announce Type: replace Abstract: We present SorryDB, a dynamically-updating benchmark of open Lean tasks drawn from 78 real world formalization projects on GitHub.
ReuF2F is a Lean 4 benchmark comprising 244 formalized open problems sourced from Research Experiences for Undergraduates (REU). It aims to evaluate coding agents on less prominent, entry‑level research problems across diverse mathematical subfields, using a Docker‑based Lean project setup and a unified harness called Leanimum‑agent. The study finds that even the best model solves only about 40 % of the problems, indicating significant room for improvement.
arXiv:2603. 02668v2 Announce Type: replace Abstract: We present SorryDB, a dynamically-updating benchmark of open Lean tasks drawn from 78 real world formalization projects on GitHub.
arXiv:2604. 03789v2 Announce Type: replace-cross Abstract: Recent advances in large language models have significantly improved their ability to perform mathematical reasoning, extending from elementary problem solving to increasingly capable performance on research-level problems.
AI reasoning has become a central focus in contemporary artificial intelligence, largely driven by the success of large language models. However, mathematical research, which is characterized by non-linear derivation paths, rigorous logical requirements, and protracted exploration cycles, poses severe challenges for existing reasoning systems.
arXiv:2607. 04394v1 Announce Type: new Abstract: AI reasoning has become a central focus in contemporary artificial intelligence, largely driven by the success of large language models.
arXiv:2607. 14178v1 Announce Type: new Abstract: Recent advances in Large Language Models have fueled autonomous AI agents capable of tackling complex scientific tasks, yet existing automated research systems remain predominantly focused on empirically driven domains with quantitative benchmarks, leaving theory-driven discovery, particularly in mathematically grounded disciplines requiring rigorous proofs and synthesis of domain knowledge, largely underexplored.
Large language models (LLMs) have shown increasing promise in solving open problems in mathematics. However, their performance can be further improved through agentic workflows tailored to real-world mathematical practice.
arXiv:2607. 09474v1 Announce Type: new Abstract: Large language models (LLMs) have shown increasing promise in solving open problems in mathematics.
arXiv:2606. 03303v1 Announce Type: new Abstract: Large Language Models (LLMs) exhibit strong informal mathematical reasoning but struggle to generate mechanically verifiable proofs in formal languages like Lean.
arXiv:2610.33690v1 Announce Type: new Abstract: Many mathematical research agents focus on solving problems with fixed statements. However, conjecture research, especially in applied mathematics, may...
arXiv:2608.28433v2 Announce Type: replace Abstract: Proof assistants such as Lean 4 promise the paradigm of formally verified mathematics, but large-scale formalization projects have faced major barr...
OpenFrontiers is a cross‑disciplinary resource that compiles 12,151 open research problems and a benchmark of 200 recently resolved mathematics problems, including 110 solved in 2026 and 90 still open. Each benchmark problem is formally stated in Lean 4, verified by automated probes, and reviewed independently. The evaluation protocol tests LLM agents under closed‑book, frozen‑retrieval, and live‑web conditions, revealing that closed‑book rediscovery is rare while live‑web success largely reflects retrieval of published solutions.
The paper "Code2Math: Can Your Code Agent Evolve Math Problems Through Exploration?" explores how code agents can autonomously generate more complex variations of existing math problems. It introduces a multi‑agent framework that evolves problems while ensuring they remain solvable and increasingly difficult. Experiments show that with sufficient exploration, code agents can produce new, structurally distinct, and challenging problems, demonstrating a scalable method for creating high‑difficulty mathematical reasoning tasks.