Large language models eroding science understanding: an empirical study of malignment

This study investigates whether large language models (LLMs) can reliably answer scientific questions and how susceptible they are to manipulation by fringe scientific material. The authors modified custom LLMs to prioritize knowledge from selected fringe papers on the Fine Structure Constant and Gravitational Waves, then compared their responses with those of domain experts and standard LLMs. The altered models produced fluent, convincing answers that contradicted scientific consensus and were difficult for non-experts to detect as misleading, demonstrating that LLMs are vulnerable to manipulation and cannot replace expert judgment.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

• llms
• robotics