Hugging Face Trending Papers
Beyond LLM Judge: Mechanical Verification for Agentic Autoformalization
Read the original on Hugging Face Trending Papers →The Flow has not summarised this story yet — read it at Hugging Face Trending Papers.
Related stories
arXiv AI
Jun 15
Formalizing Numerical Analysis: An Agent Pipeline and Quality Audit Beyond Kernel Acceptance
arXiv:2606. 14000v1 Announce Type: new Abstract: Recent work has demonstrated that coding agents can formalize entire advanced mathematics textbooks in Lean 4, yet existing efforts concentrate on branches of mathematics already well-represented in mathlib and measure success solely through kernel acceptance.
arXiv Machine Learning
Jun 26
Theory-Scale Auto-Formalization of Logics for Computer Science
arXiv:2606. 26525v1 Announce Type: new Abstract: Auto-formalization is critical for scalable formal verification, but existing progress largely focuses on isolated statements, while theory-scale auto-formalization, which coherently translates hundreds of interdependent definitions, lemmas, and theorems, remains open due to challenges in consistency, faithfulness, scalability, and correctness.
arXiv AI
Jul 1
Beyond the Library: An Agentic Framework for Autoformalizing Research Mathematics
arXiv:2606. 31134v1 Announce Type: new Abstract: While Large Language Models (LLMs) have demonstrated exceptional capabilities in mathematical reasoning, they frequently produce subtle errors that evade human detection.
arXiv AI
Sep 12
Magenta: Closing the Loop Between Mathematical Reasoning and Lean Verification
Magenta is a training‑free pipeline that bridges informal natural‑language mathematical problems and formal Lean 4 verification. Given a problem in plain text, it generates an answer, translates it into a Lean 4 statement, and constructs a machine‑checked proof. The system includes a statement judge to ensure the formalisation matches the original problem and an error‑attribution judge to guide corrections, achieving perfect accuracy on olympiad benchmarks and solving all six IMO 2026 problems when combined with K2‑Horizon‑7B.
arXiv AI
Jun 30
Faults in Our Formal Benchmarking: Dataset Defects and Evaluation Failures in Lean Theorem Proving
arXiv:2606. 29493v1 Announce Type: new Abstract: Benchmarks for LLM-assisted theorem proving in Lean are often treated as intrinsically reliable because every solved instance comes with a machine-checked proof.
arXiv AI
Jun 8
Lean4Agent: Formal Modeling and Verification for Agent Workflow and Trajectory
arXiv:2606. 06523v1 Announce Type: new Abstract: Equipping Large Language Models (LLMs) to execute reliable multi-step workflows has become a central challenge in artificial intelligence.