arXiv AI By Miko{\l}aj Sienicki, Krzysztof Sienicki

A Human Audit of OpenAIs AI-Generated Mathematical Proofs

Read the original on arXiv AI →

The article audits 18 chapter‑specific reviews of ten mathematical results announced by OpenAI, examining review standards, Lean formalizations, subsequent research, and references. No confirmed substantive errors remain in the principal results, though review depth varies and some dependencies are only partially checked. Chapter 8 raises the strongest reservation, requiring major revision of compressed analytic arguments, while Chapter 6’s polarity error was corrected after a PDF extraction issue.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv AI
Aug 26

Auditing an AI-Generated Mathematical Proof: Human Assessment of OpenAI's Quantum Parallel-Repetition Argument

The article reports an independent human audit of a proof from OpenAI’s "Ten Advances in Mathematics and Theoretical Computer Science." An initial review flagged a polarity error in a greedy conditioning lemma, but this was traced to a PDF text‑extraction issue that removed an overbar from a symbol. After correcting the rendering, no mathematical error was found, and the audit underscores that errors in AI‑generated mathematics can stem from document‑processing problems as well as reasoning mistakes.

By Miko{\l}aj Sienicki, Krzysztof Sienicki
arXiv AI
6d ago

Beyond Selected Breakthroughs: Evaluating Language Models on Randomly Sampled Mathematical Conjectures

The paper introduces OpenConjecture, a dataset of mathematical conjectures from arXiv papers since February 2026, and evaluates frontier GPT models on 200 randomly sampled conjectures. The models generate candidate solutions for about 60% of the conjectures, with counterexamples occurring roughly 1.3 times more often than proofs. The study examines solution novelty, citation practices, and fidelity to the original statements, finding that some solutions deviate from authors’ intent and that many proofs closely follow existing results, though some exhibit moderate novelty.

By Helen Jenne, Davis Brown, Jesse He, Henry Kvinge