arXiv AI By Gy\"orgy Eigner, Patrik P. S\"uli, Roland Holl\'os

Trust, but verify, audit and attribute: a human-in-the-loop framework for checking AI-produced research results

Read the original on arXiv AI →

The paper proposes a human‑in‑the‑loop framework for verifying AI‑generated research results, particularly in mathematics and statistics. It outlines a system where AI agents perform checks using specialized software, a fidelity audit ensures each check addresses the claim, and humans intervene at fixed points to decide on outcomes. The framework also records contributions and attributes work to both human and AI, and the authors demonstrate two automatic implementations for mathematics and statistics, including a case study where an ambiguous claim was split into two readings, one refuted and one proved.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

Hugging Face Trending Papers
Nov 9

Trust, but verify, audit and attribute: a human-in-the-loop framework for checking AI-produced research results

The paper proposes a human‑in‑the‑loop framework for verifying AI‑generated research results, addressing the growing volume of AI‑produced mathematics manuscripts. It outlines a system where AI agents perform checks using specialised software, but a human researcher remains involved to audit fidelity, decide at fixed points, and attribute contributions. The authors present two automatic implementations—one for mathematics (using Wolfram Language, MATLAB, Lean) and one for statistics (Python and R)—and demonstrate the mathematical tool on a two‑claim example that required splitting an ambiguous claim into a refuted and a proved reading.

arXiv AI
Aug 25

CausalSmith: A Formally Grounded, Self-Improving Agentic Framework for Automated Research in Causal Inference

CausalSmith is a framework that automates theoretical research in causal inference by integrating a Lean proof assistant with a self‑improving agentic pipeline. It uses Causalean, a Lean library of over 7,000 machine‑checked declarations, and a pipeline that selects topics, proposes results, formalizes statements, constructs proofs, and audits them against informal claims. The system’s artifacts and source code are publicly available on GitHub.

By Jiyuan Tan, Vasilis Syrgkanis
arXiv AI
Oct 31

Beyond fabrication: Misattributed numbers in papers written by AI research agents

The paper examines how AI‑written research papers often contain misattributed numerical claims. By re‑analyzing 540 judgments from a benchmark of nine AI agents on fifteen research problems, the authors manually labeled 256 claims and found that most failures stem from misalignment between the paper and the underlying work rather than outright cheating. They propose a deterministic claim‑to‑evidence checker that achieves over 90% precision and, when combined with an LLM verifier, offers a more reliable audit of AI‑generated research.

By Mosab Alfaqeeh, Omar Hourani, Muath Hourani, Hashem Alfaqeeh