arXiv Computation and Language

What Is The Political Content in LLMs' Pre- and Post-Training Data?

arXiv AI
Jun 30

LLM-Ideoplasticity: Measuring Ideological Plasticity in the Political Behavior of LLMs as a Context-Conditioned Distribution

arXiv:2606. 28335v1 Announce Type: cross Abstract: We argue, with systematic empirical evidence, that a large language model's political ideology is not a fixed point, but a conditional distribution $\mathbb{P}($position$\mid$context$)$ over a real political space.

By Adib Sakhawat, Syed Rifat Raiyan, Tahsin Islam, Takia Farhin, Hasan Mahmud, Md Kamrul Hasan
arXiv Computation and Language
Sep 1

Political Ideology Shifts in Large Language Models

arXiv:2508.16013v2 Announce Type: replace Abstract: Large language models (LLMs) are increasingly deployed in politically sensitive contexts, raising concerns about their susceptibility to ideologica...

By Pietro Bernardelle, Stefano Civelli, Leon Fr\"ohling, Riccardo Lunardi, Kevin Roitero, Gianluca Demartini
arXiv AI
Aug 18

Inference-Time Mitigation of Adversarial Political Bias in Large Language Models

arXiv:2608. 14629v1 Announce Type: cross Abstract: As Large Language Models (LLMs) become the mainstay for information retrieval and summarization tasks, ensuring that they are always non-partisan and invulnerable to political bias is a critical step towards safer and more trustworthy Artificial Intelligence (AI).

By Tejaswi V. Panchagnula, Bruce Coburn, Bryce J. Dietrich, Robert X. Browning, Edward J. Delp, Fengqing Zhu
arXiv Computation and Language
Oct 23

How Far Will They Go? Red-Teaming Online Influence with Large Language Models

The paper presents a red‑teaming framework to evaluate how open‑source large language models (LLMs) can be used for political influence, focusing on models that can be deployed locally without weight modifications. It measures LLM Overton Windows (OWs) to assess expression fidelity of sampled political opinions and examines how natural‑language jailbreaks alter these scores. The study evaluates over 30 LLMs from 10 families across five countries, finding that left‑leaning content is expressed with higher fidelity, larger models tend to have lower mean OW scores, and jailbreak effectiveness varies significantly between model families.

By Daniel C. Ruiz, Anna Serbina, Ashwin Rao, Emilio Ferrara, Luca Luceri
arXiv Computation and Language
Oct 23

Interpretive Variation and Discourse Structure in Detecting Enthymemes in Controversial Political Discourse

The paper investigates how to detect enthymemes—arguments with unstated premises or conclusions—in controversial political tweets about vaccination and immigration. Despite extensive fine‑tuning, models achieve an F1 score of only about 0.67, prompting the authors to propose new evaluation metrics that compare predictions to the full distribution of annotator votes and a model that directly predicts this distribution. The study also shows that models rely on explicit argumentative structure, often missing implicit links that readers must infer, raising concerns for content moderation systems that depend on majority labels.

By Martial Pastor, Nelleke Oostdijk