arXiv Computation and Language By Harry Mayne, Lev McKinney, Jan Dubi\'nski, Adam Karvonen, James Chua, Owain Evans

Negation Neglect: When models fail to learn negations in training

Read the original on arXiv Computation and Language →

The paper introduces the phenomenon of Negation Neglect, where fine‑tuning large language models on documents that label a claim as false causes the models to believe the claim is true. Experiments with Qwen3.5‑397B‑A17B show belief rates jump from 2.5 % to 88.6 % after fine‑tuning on negated documents, whereas models trained on non‑negated documents achieve 92.4 % belief. The effect persists across multiple models, extends to other epistemic qualifiers, and can even transfer malicious behavior from chat transcripts to the model’s outputs.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computation and Language.

arXiv AI
Oct 5

Misinformation Without Triggers: From Factual Answers to Downstream Decisions

The study investigates how false content in training data can influence language models’ downstream decisions even without explicit triggers. By comparing models trained on misleading versus truthful documents in a controlled decision task and a real‑world bushfire case, the authors find a gap between factual answers and the decisions derived from them: correct facts do not always lead to correct decisions, and removing an injected number does not eliminate the misleading narrative. The research highlights that data poisoning can subtly alter model behavior beyond what is detectable through direct probing.

By Lin Tian, Marian-Andrei Rizoiu
arXiv Machine Learning
Aug 13

LODESTAR: Trustworthy Entropy Is Navigated, Not Merely Measured -- Reinforced Polarizer Keeps a Frozen LLM from Being Confidently Misled by the Wrong Evidence

arXiv:2608. 11922v1 Announce Type: cross Abstract: Predictive-distribution entropy makes a strong selection rule in retrieval-augmented question answering: across five QA benchmarks, keeping the candidate answer that a frozen respondent LLM produces with the lowest answer-token entropy lifts mean answer $F_1$ from 0.

By Po-Jen Ko, Che-Cheng Wu, Hung-Chun Hsu, Li-Yang Chang, Chuan-Ju Wang