arXiv Computation and Language

Recognizing Is Not Reversing: A Controlled Inversion Test of Fact-Preserving News Framing

The paper introduces a controlled inversion test to evaluate whether large language models can reverse known framing transformations in news articles while preserving facts. Using 60 articles and three framing types—evaluative lexis, agency realization, and information salience—the study generates 540 paired variants. Results show high factual preservation (~0.84) but low reversal success (0.044–0.068), indicating that recognizing a framing does not guarantee its undoing.

Hugging Face Trending Papers
Oct 29

What Breaks When Facts Become Stories? The Distortions Source-Agreement Metrics Miss When Models Retell Real Events

The paper investigates how language models transform factual news into stories, revealing that standard source‑agreement metrics misjudge intentional changes. By rewriting 2,000 news articles into summaries and stories, the authors measured alterations across the five Ws, finding that stories often lose place and causation details while increasing accountability distortions—sometimes downplaying perpetrators. The study introduces ReTold‑2k, a corpus and scoring protocol to detect and mitigate such distortions.

arXiv AI
Oct 31

What Breaks When Facts Become Stories? The Distortions Source-Agreement Metrics Miss When Models Retell Real Events

The paper investigates how language models transform factual news into narrative stories, revealing that standard source‑agreement metrics misjudge the quality of these retellings. By having three model families rewrite 2,000 news articles as summaries and as stories, the authors measured changes across the five Ws and identified distortions—especially in place, causation, and accountability—that are often overlooked by fact‑checking. They found that stories tend to lose critical contextual details while amplifying accountability distortions, which can shift blame and remain undetected by conventional checks.

By Kwangsuk Park, JiWoong Yang, Vaniushkina Kseniia
arXiv AI
Oct 5

Improving Atomic-Fact Recall via Focused Views in Unstructured Knowledge Editing

The paper introduces FOVEATED, a plug‑and‑play framework that improves atomic‑fact recall in unstructured knowledge editing (UKE) for large language models. By randomly shifting Rotary Position Embedding (RoPE) positions during editing, FOVEATED creates focused views of each sentence, counteracting the context‑reliance problem where edited LLMs reproduce passages but fail to recall individual facts. Experiments show consistent gains across five editors, two LLM backbones, and three benchmarks.

By Ding Wu, Ye Zhang, Haoyu Wang, Tianci Liu
arXiv Computation and Language
5d ago

When Steering Shifts Discourse: Identifying and Intervening on Discourse-Level Changes due to Activation Steering in LLMs

The paper investigates how activation steering—adding a vector to a large language model’s residual-stream activations—alters discourse-level aspects of generated text, such as formality, evidence usage, and ambiguity. It demonstrates that these unintended changes can be largely mitigated by applying a second, complementary steering vector that targets the affected discourse dimension, restoring about 78% of the original discourse characteristics while maintaining the intended behavior in roughly 93% of outputs.

By Shivam Adarsh, Hetianyu Huang, Lau Safin, Maria Maistro, Christina Lioma
arXiv Computation and Language
Sep 17

Modelling Adjectival Modification Effects on Semantic Plausibility

The paper investigates how adjectival modifiers affect the semantic plausibility of events, using the Adept benchmark of 16,000 English sentence pairs that differ by a single adjective. Experiments show that sentence transformers, despite being conceptually suited to the task, underperform compared to models like RoBERTa. The authors provide an error analysis and discuss the implications of their findings for future work on balancing training and test data.

By Anna Golub, Beate Zywietz, Annerose Eichel
arXiv Computation and Language
Sep 25

Framing by Wording, Framing by Selection: A Large-Scale Two-Dimensional Audit of French News Headlines, 2022-2025

The study introduces a two‑dimensional framework to audit French news headlines, distinguishing salience framing—captured by four wording devices—from selection framing—captured by outlet‑level story form and high‑charge distributions. Using a 10,000‑headline supervision set annotated by LLMs and human arbitration, the authors classify 902,111 headlines from 25 outlets (2022‑2025) and find that salience and selection diverge yet correlate, that default thresholds inflate salience estimates, and that headlines mentioning Jews, the Far‑right, and Muslims exhibit the highest salience rates. The authors release their dataset, lexicons, and code, claiming it is the largest French headline framing audit to date.

By Amr Sobhy
arXiv Computation and Language
Sep 15

An Empirical Analysis of Factual Errors in Human-Written Text and Its Application to Factual Error Detection

The paper presents an empirical study of factual errors in human-written text, focusing on corrections in newspaper articles to build a taxonomy of common mistakes such as kanji misconversions and unit errors. It evaluates large language models’ ability to detect these errors, finding that even advanced models like GPT‑5.4 achieve only a 52% word‑level F1 score on synthetic data, underscoring the difficulty of the task. The work highlights the gap in research on factual error detection in human writing compared to LLM hallucinations.

By Kazuma Iwamoto, Kazumasa Omura, Shotaro Ishihara
arXiv AI
Oct 19

Trapped in Your Story: Evaluating Narrative-Induced Sycophancy in Large Language Models

Large language models (LLMs) tend to exhibit sycophancy by aligning with users’ expressed views. This study introduces a benchmark of 5,500 evaluation instances built from 500 debatable questions across ten domains, where the user stance is fixed but the justification is systematically varied across eleven conditions, including neutral, personal experience, causal framing, and worldview-based synthesis. Seven LLMs were evaluated, revealing that narrative structure can significantly influence agreement, with causal framing and bullet presentation boosting sycophancy while personal experience can reduce it.

By Runtai Yang, Dandan Zhu, Kaiwei Zhang, Guangtao Zhai
arXiv Computation and Language
Sep 7

Detect, Remask, Repair: Diffusion Editing for Faithful Summarization of Evolving Contexts

The paper introduces DETECT-REMASK-REPAIR, a diffusion-based method for updating outdated spans in existing summaries while keeping supported content intact. It identifies, masks, and repairs only the changed regions using masked diffusion language models. Experiments on DialogSum and a new StreamSum benchmark show that this localized repair improves faithfulness, reduces repair time to under half a second, and offers trade‑offs between faithfulness, speed, and preservation of the original summary.

By Hao Zou, Zachary Horvitz, Chandhru Karthick, Zhou Yu, Kathleen McKeown