The paper investigates how language models transform factual news into stories, revealing that standard source‑agreement metrics misjudge intentional changes. By rewriting 2,000 news articles into summaries and stories, the authors measured alterations across the five Ws, finding that stories often lose place and causation details while increasing accountability distortions—sometimes downplaying perpetrators. The study introduces ReTold‑2k, a corpus and scoring protocol to detect and mitigate such distortions.
The paper audits a 366‑day autobiographical book generated by a large language model (LLM) against an independent verification corpus. Using a four‑level rubric, 354 of the 366 days (96.7%) failed verification, with only 12 days containing corroborated scenes and 19 days containing actively contradicted claims. Regenerating the same days with current models yielded 100% verification failure, while grounding the generation in the subject’s own corpus improved the rate to 83.3% but still left substantial residual failure.
By Heather Renze
The paper introduces ChronoFake, a benchmark of 30,706 news articles that isolates temporally disordered fake news, where factual events are rearranged into false chronologies. It identifies the "evidence coherence trap," where verification relies on locally coherent but temporally mismatched evidence. To counter this, the authors propose DelSA, a document-selection agent that iteratively refines evidence during training and uses a frozen rulebook for inference, leveraging an LLM for evidence characterization and a verifier-trained reranker for timeline consistency, achieving superior performance on ChronoFake and competitive results on other datasets.
By Chi Wang, Min Gao, Yifei Zhang, Bincheng Gu, Zongwei Wang, Wentao Li
The paper introduces a controlled inversion test to evaluate whether large language models can reverse known framing transformations in news articles while preserving facts. Using 60 articles and three framing types—evaluative lexis, agency realization, and information salience—the study generates 540 paired variants. Results show high factual preservation (~0.84) but low reversal success (0.044–0.068), indicating that recognizing a framing does not guarantee its undoing.
By Yi Liu
arXiv:2608. 03372v1 Announce Type: cross Abstract: AI systems rewrite information constantly: conversations become stored memories, documents become answers.
By Alex Kwon
The study evaluates how clinical language models perform when patient narratives are presented in different voices—clinical, socioeconomic, and cultural—using 1,000 MedQA cases paired with three retellings each. All 12 tested models show a significant drop in accuracy (about 26% more errors) when the patient speaks in a marked voice, a penalty that persists even when the original vignette is included verbatim and is not explained by measured retelling properties. The authors find that rewriting the patient’s account into a clinical vignette before answering can halve this accuracy gap, though structured schema pipelines and additional reasoning tools offer limited improvements.
By Prabhjot Singh, Pritam Deka, Vijay Chennareddy