arXiv AI

ToE: A Hierarchical and Explainable Claim Verification Framework with Dynamic Multi-source Evidence Retrieval and Aggregation

arXiv:2606. 27736v1 Announce Type: new Abstract: The rapid spread of fake news poses increasing threats to information ecosystems, especially as AI-generated misinformation under Generative Engine Optimization (GEO) poisoning allows adversarially crafted content to be systematically surfaced by retrieval systems, contaminating LLM reasoning.

arXiv AI
Sep 10

Evaluating and Improving Evidence-Grounded Fact-Checking in LLMs via Multi-Round Evidence Ablation

The paper introduces Fact-Ablated Evaluation (FAE), a framework that iteratively removes cited evidence to test whether large language models (LLMs) adjust their fact‑checking predictions accordingly. Experiments reveal that many off‑the‑shelf LLMs rely more on internal knowledge than on the provided evidence. To address this, the authors propose REAL, a training method that uses counterfactual evidence supervision to encourage LLMs to base veracity judgments on evidence, achieving better evidence‑dependent performance across four datasets.

By Xingyu Deng, Mingzi Cao, Nikolaos Aletras, Xi Wang, Mark Stevenson
arXiv AI
Aug 25

LLM-Based Adversarial Persuasion Attacks on Fact-Checking Systems

The paper introduces a new type of adversarial attack on automated fact‑checking systems that uses large language models to rephrase claims with persuasive techniques. By applying 15 persuasion methods across five categories, the authors evaluate how these rewrites affect claim verification and evidence retrieval on the FEVER and FEVEROUS benchmarks. Results show that persuasive rewrites significantly degrade both verification accuracy and evidence retrieval performance, underscoring the vulnerability of current fact‑checking systems to such attacks.

By Jo\~ao A. Leite, Olesya Razuvayevskaya, Kalina Bontcheva, Carolina Scarton
arXiv AI
Sep 17

Reasoning through Evolution: Automatic Meta-path Discovery for LLM-based Fake News Detection

The paper introduces MAGER, a multi-agent genetic evolution framework that automatically discovers meta-paths for large language models (LLMs) to reason about fake news propagation graphs. By compressing complex propagation structures into informative subgraphs, MAGER reduces modality mismatch and information overload, enabling frozen LLMs to perform structure-aware veracity reasoning. The authors also propose a graph in-context learning strategy that retrieves semantically and structurally similar demonstrations to enhance classification and reasoning, and report that MAGER significantly improves LLM performance in data‑efficient settings.

By Ziyi Zhou, Xiaoming Zhang, Hui Pang, Yuting Zhang, Tiesunlong Shen, Bingyu Yan, Erik Cambria, Litian Zhang