arXiv Computation and Language By Nikolaos Kekatos, Theodoros Nestoridis, Charalampos Bratsas, Charalampos Dimoulas, Georgios Konstantinidis, Georgios Malogiannis, Michael Sirivianos, Andreas Veglis

SoK: Formal Methods for Fact-Checking and Information Integrity

Read the original on arXiv Computation and Language →

The paper "SoK: Formal Methods for Fact-Checking and Information Integrity" discusses how automated fact‑checking systems typically output a verdict but lack a detailed record—called a warrant—explaining the evidence and conditions behind that verdict. It proposes organizing the field by what is being formalised—claims, reasoning, checking systems, ecosystems, and regulatory obligations—rather than by pipeline stages, and surveys 121 works to identify gaps, notably the scarcity of formal methods applied to verifying the checking systems themselves. The authors highlight that existing formal tools, though largely unused in this domain, could address these gaps and outline open problems with suggested first steps.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computation and Language.

arXiv AI
Oct 31

Beyond fabrication: Misattributed numbers in papers written by AI research agents

The paper examines how AI‑written research papers often contain misattributed numerical claims. By re‑analyzing 540 judgments from a benchmark of nine AI agents on fifteen research problems, the authors manually labeled 256 claims and found that most failures stem from misalignment between the paper and the underlying work rather than outright cheating. They propose a deterministic claim‑to‑evidence checker that achieves over 90% precision and, when combined with an LLM verifier, offers a more reliable audit of AI‑generated research.

By Mosab Alfaqeeh, Omar Hourani, Muath Hourani, Hashem Alfaqeeh