arXiv AI

Beyond the Evidence Coherence Trap: Agent-Driven Evidence Selection for Temporally Disordered Fake News Detection

The paper introduces ChronoFake, a benchmark of 30,706 news articles that isolates temporally disordered fake news, where factual events are rearranged into false chronologies. It identifies the "evidence coherence trap," where verification relies on locally coherent but temporally mismatched evidence. To counter this, the authors propose DelSA, a document-selection agent that iteratively refines evidence during training and uses a frozen rulebook for inference, leveraging an LLM for evidence characterization and a verifier-trained reranker for timeline consistency, achieving superior performance on ChronoFake and competitive results on other datasets.

arXiv AI
Sep 1

An Explainable Coherence Score for Detecting Temporal Inconsistencies in Political News

The paper presents the Temporal Coherence Score (TCS), a continuous, interpretable metric for detecting temporal inconsistencies in political news. TCS is computed through a four‑stage pipeline that extracts temporal facts, builds a temporal knowledge graph, verifies consistency using internal rules and external references, and aggregates scores with explanations. On a benchmark of 100 political articles with injected errors, TCS achieves 0.909 precision, providing detailed explanations for each flagged inconsistency.

By Marius Nicusor Pantea, Adrian Groza
Hugging Face Trending Papers
4d ago

What Breaks When Facts Become Stories? The Distortions Source-Agreement Metrics Miss When Models Retell Real Events

The paper investigates how language models transform factual news into stories, revealing that standard source‑agreement metrics misjudge intentional changes. By rewriting 2,000 news articles into summaries and stories, the authors measured alterations across the five Ws, finding that stories often lose place and causation details while increasing accountability distortions—sometimes downplaying perpetrators. The study introduces ReTold‑2k, a corpus and scoring protocol to detect and mitigate such distortions.

arXiv AI
3d ago

What Breaks When Facts Become Stories? The Distortions Source-Agreement Metrics Miss When Models Retell Real Events

The paper investigates how language models transform factual news into narrative stories, revealing that standard source‑agreement metrics misjudge the quality of these retellings. By having three model families rewrite 2,000 news articles as summaries and as stories, the authors measured changes across the five Ws and identified distortions—especially in place, causation, and accountability—that are often overlooked by fact‑checking. They found that stories tend to lose critical contextual details while amplifying accountability distortions, which can shift blame and remain undetected by conventional checks.

By Kwangsuk Park, JiWoong Yang, Vaniushkina Kseniia
arXiv Computation and Language
Aug 21

When Text and Numbers Disagree: Evidence Arbitration in Large Language Models

arXiv:2608. 20116v1 Announce Type: new Abstract: Large language models (LLMs) are increasingly used in settings where textual summaries, numerical observations, and external tool outputs may provide conflicting evidence.

By Mattia Carletti, Edward Phillips, Fredrik K. Gustafsson, Patitapaban Palo, Lei Clifton, Danielle Belgrave, Xiao Gu, David A. Clifton
arXiv AI
Jun 29

ToE: A Hierarchical and Explainable Claim Verification Framework with Dynamic Multi-source Evidence Retrieval and Aggregation

arXiv:2606. 27736v1 Announce Type: new Abstract: The rapid spread of fake news poses increasing threats to information ecosystems, especially as AI-generated misinformation under Generative Engine Optimization (GEO) poisoning allows adversarially crafted content to be systematically surfaced by retrieval systems, contaminating LLM reasoning.

By Zhaoqi Wang, Zijian Zhang, Kun Zheng, Zhen Li, Xin Li, Chunlei Li, Jiamou Liu
arXiv Computation and Language
Sep 22

The Corroboration Illusion: When More News Makes LLM Forecasts Less True

The paper demonstrates that large language models (LLMs) used for forecasting real‑world events can be manipulated by simply publishing new articles, even without direct access to the model or its retriever. By injecting a small number of targeted news pieces into a common crawl corpus, an adversary can flip over half of the forecast probabilities and significantly degrade forecast accuracy. The study also shows that common defense strategies can be cheaply bypassed, highlighting the vulnerability of probabilistic LLM judgments to information‑supply‑chain attacks.

By Yuan Lu, Yukuan Zhang
arXiv Computation and Language
Sep 28

Stale-Document Poisoning: When Outdated Retrieval Overrides Correct Model Answers

The paper introduces "stale‑document poisoning," a temporal alignment failure where outdated retrieval evidence causes retrieval‑augmented generation models to produce incorrect answers even when the model could answer correctly without retrieval. A benchmark of 317 verified knowledge reversals across medicine, law, software, and platform policy shows that outdated evidence flips 30–37% of Llama and Qwen answers, rising to 66–75% when models are explicitly instructed to trust the document. The study demonstrates that providing explicit validity information and a recency‑aware re‑ranker can substantially reduce poisoning, highlighting the need for models to assess whether retrieved evidence remains applicable.

By Md Shamim Ahmed, Lukas Galke Poech, Richard R\"{o}ttger