arXiv AI By Chi Wang, Min Gao, Yifei Zhang, Bincheng Gu, Zongwei Wang, Wentao Li

Beyond the Evidence Coherence Trap: Agent-Driven Evidence Selection for Temporally Disordered Fake News Detection

Read the original on arXiv AI →

The paper introduces ChronoFake, a benchmark of 30,706 news articles that isolates temporally disordered fake news, where factual events are rearranged into false chronologies. It identifies the "evidence coherence trap," where verification relies on locally coherent but temporally mismatched evidence. To counter this, the authors propose DelSA, a document-selection agent that iteratively refines evidence during training and uses a frozen rulebook for inference, leveraging an LLM for evidence characterization and a verifier-trained reranker for timeline consistency, achieving superior performance on ChronoFake and competitive results on other datasets.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv AI
Sep 1

An Explainable Coherence Score for Detecting Temporal Inconsistencies in Political News

The paper presents the Temporal Coherence Score (TCS), a continuous, interpretable metric for detecting temporal inconsistencies in political news. TCS is computed through a four‑stage pipeline that extracts temporal facts, builds a temporal knowledge graph, verifies consistency using internal rules and external references, and aggregates scores with explanations. On a benchmark of 100 political articles with injected errors, TCS achieves 0.909 precision, providing detailed explanations for each flagged inconsistency.

By Marius Nicusor Pantea, Adrian Groza
Hugging Face Trending Papers
4d ago

What Breaks When Facts Become Stories? The Distortions Source-Agreement Metrics Miss When Models Retell Real Events

The paper investigates how language models transform factual news into stories, revealing that standard source‑agreement metrics misjudge intentional changes. By rewriting 2,000 news articles into summaries and stories, the authors measured alterations across the five Ws, finding that stories often lose place and causation details while increasing accountability distortions—sometimes downplaying perpetrators. The study introduces ReTold‑2k, a corpus and scoring protocol to detect and mitigate such distortions.

arXiv AI
3d ago

What Breaks When Facts Become Stories? The Distortions Source-Agreement Metrics Miss When Models Retell Real Events

The paper investigates how language models transform factual news into narrative stories, revealing that standard source‑agreement metrics misjudge the quality of these retellings. By having three model families rewrite 2,000 news articles as summaries and as stories, the authors measured changes across the five Ws and identified distortions—especially in place, causation, and accountability—that are often overlooked by fact‑checking. They found that stories tend to lose critical contextual details while amplifying accountability distortions, which can shift blame and remain undetected by conventional checks.

By Kwangsuk Park, JiWoong Yang, Vaniushkina Kseniia