← Back to all news
arXiv AI By Ilyas Nagiyev, Miras Baisbay, Daniil Orel, Preslav Nakov

SCOPE: Source Credibility and Outlet Profiling Engine

Read the original on arXiv AI →

SCOPE is a multi‑agent system that profiles news media outlets for bias, factuality, and credibility by coordinating agents for article acquisition, content analysis, evidence search, scoring, and report generation. It follows an MBFC‑style methodology and provides inspectable intermediate evidence and outputs via a structured interface. On a benchmark of 200 outlets, SCOPE outperforms LLM‑only, article‑only, search‑only, and media‑background‑check baselines, achieving the lowest bias and factuality MAE, perfect failed‑fact‑check detection, and the lowest factual error rate.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

Related stories

arXiv Computation and Language
Sep 18

Data Journalist Agent: Transforming Data into Verifiable Multimodal Stories

The paper introduces Data Journalist Agent (Data2Story), a multi‑agent framework that orchestrates specialized roles into a single virtual newsroom to produce evidence‑grounded, multimodal news stories. It ensures every claim is traceable to data, code, or external references via an Inspector, and generates interactive visualizations such as maps and audio to match reader interests. Evaluations on 18 articles show competitive performance in angle coverage, rubric scores, and verifiability, while human writers still lead in editorial angle and creative design.

By Kevin Qinghong Lin, Batu EI, Yuhong Shi, Pan Lu, Juil Sock, Djordje Padejski, Philip Torr, James Zou
agentsmultimodal
More like this →
arXiv Computation and Language
Sep 28

Epstein Files Engine: Agentic Search for Investigative Journalism

The Epstein Files Engine is an AI agent developed by the New York Times to help journalists investigate a massive mixed‑media collection released by the U.S. Department of Justice on January 30, 2026, which contains about three million pages of PDFs related to Jeffrey Epstein. The Engine translates reporter questions into Google BigQuery SQL queries across three corpora—Epstein‑related releases, the Times’s archive, and external Epstein‑related news headlines—using an LLM to plan queries and return citation‑rich answers that reporters can verify. Over 100 journalists used the Engine, contributing to at least 20 published stories, and the system includes a Diff method for text‑and‑visual duplicate matching to surface genuinely new information.

By Duy K. Nguyen, Teresa Mondr\'ia Terol, Dylan Freedman, Zach Seward
llmsagentsdata-engineering
More like this →
arXiv AI
Oct 27

Same Story, Different Lens: A Multi-Agent System for Cross-Outlet News Framing Analysis

Same Story, Different Lens is an experimental prototype that compares how 17 news outlets cover the same events by collecting world and politics coverage, grouping reports about identical incidents, and generating structured analyses of sentiment, political lean, framing, loaded language, omissions, and estimated proportions of factual claims versus opinion. The system employs three model roles—article analysis, source support assessment, and cross‑outlet briefing generation—to produce JSONL archives of its findings. Evaluation includes comparing outlet‑level lean estimates with predefined reference ratings and summarizing the Critic’s grounding scores, which indicate the model’s assessment of support within the supplied text.

By Affan Yasin, Yueqi Lyu, Rubia Fatima, Weinchen Zhong, Keyi Li
agents
More like this →