arXiv AI
6d ago

Epistemic Infrastructures of Science in AI Era Should Rebalance Costs of Generation and Verification

The paper argues that AI can cheaply produce plausible scientific artifacts, leading to epistemic pollution because the existing scientific infrastructure relies on high generation costs as a filter. It proposes rebalancing generation and verification costs by introducing structured "blueprints"—typed graph components that decompose claims, evidence, assumptions, and definitions—so that verification becomes cheaper, more local, and distributed. The blueprint complements traditional papers, serving as a verification interface while the paper remains the narrative interface, and a prototype demonstrates the concept.

By Jiaqi W. Ma
arXiv AI
Aug 25

CausalSmith: A Formally Grounded, Self-Improving Agentic Framework for Automated Research in Causal Inference

CausalSmith is a framework that automates theoretical research in causal inference by integrating a Lean proof assistant with a self‑improving agentic pipeline. It uses Causalean, a Lean library of over 7,000 machine‑checked declarations, and a pipeline that selects topics, proposes results, formalizes statements, constructs proofs, and audits them against informal claims. The system’s artifacts and source code are publicly available on GitHub.

By Jiyuan Tan, Vasilis Syrgkanis
arXiv AI
6d ago

Trust, but verify, audit and attribute: a human-in-the-loop framework for checking AI-produced research results

The paper proposes a human‑in‑the‑loop framework for verifying AI‑generated research results, particularly in mathematics and statistics. It outlines a system where AI agents perform checks using specialized software, a fidelity audit ensures each check addresses the claim, and humans intervene at fixed points to decide on outcomes. The framework also records contributions and attributes work to both human and AI, and the authors demonstrate two automatic implementations for mathematics and statistics, including a case study where an ambiguous claim was split into two readings, one refuted and one proved.

By Gy\"orgy Eigner, Patrik P. S\"uli, Roland Holl\'os