arXiv AI By Maher Kallel, Mohamed El Louadi

Verification abundance, adjudication scarcity: what happens to mathematical knowledge when proof checking becomes free

Read the original on arXiv AI →

The Flow has not summarised this story yet — read it at arXiv AI.

arXiv AI
Oct 31

Beyond fabrication: Misattributed numbers in papers written by AI research agents

The paper examines how AI‑written research papers often contain misattributed numerical claims. By re‑analyzing 540 judgments from a benchmark of nine AI agents on fifteen research problems, the authors manually labeled 256 claims and found that most failures stem from misalignment between the paper and the underlying work rather than outright cheating. They propose a deterministic claim‑to‑evidence checker that achieves over 90% precision and, when combined with an LLM verifier, offers a more reliable audit of AI‑generated research.

By Mosab Alfaqeeh, Omar Hourani, Muath Hourani, Hashem Alfaqeeh