arXiv Computation and Language

A Resource for Enthymeme Detection in Controversial Political Discourse

Hugging Face Trending Papers
Jun 10

A Resource for Enthymeme Detection in Controversial Political Discourse

Enthymemes, arguments with unstated premises or conclusions, are pervasive in persuasive discourse, yet their annotation remains notoriously subjective. We present a resource of 1,482 tweets from politically controversial discourse, annotated by five annotators for the presence of enthymemes and their argument structure, designed to study label variation.

arXiv Computation and Language
6d ago

Interpretive Variation and Discourse Structure in Detecting Enthymemes in Controversial Political Discourse

The paper investigates how to detect enthymemes—arguments with unstated premises or conclusions—in controversial political tweets about vaccination and immigration. Despite extensive fine‑tuning, models achieve an F1 score of only about 0.67, prompting the authors to propose new evaluation metrics that compare predictions to the full distribution of annotator votes and a model that directly predicts this distribution. The study also shows that models rely on explicit argumentative structure, often missing implicit links that readers must infer, raising concerns for content moderation systems that depend on majority labels.

By Martial Pastor, Nelleke Oostdijk
arXiv Computation and Language
Sep 10

Who Argues What? Joint Argument-Entity Detection and Classification in Political Debates

The paper introduces DNE‑ElecDeb, an enriched version of the USElecDeb dataset that annotates Debate Named Entities (DNEs) in both argumentative and non‑argumentative spans, and defines Debate Named Entity Recognition (DNER) as a new task. It proposes Joint Argument and Entity Tagging (JAET), a generative framework that fine‑tunes decoder‑only LLMs to insert inline argument and entity tags into debate turns while preserving the original transcript. JAET achieves significant improvements in joint AM+DNER performance (+27.3% relative F1 in the untyped setting and +41.9% in the typed setting) over sequential pipelines, and these gains generalize to Persuasive Essays (+26.6% and +52.7%).

By Lucio La Cava, Stefano Francesco Monea, Sergio Greco
arXiv Computation and Language
Aug 31

Retrieving Relations, Detecting Fallacies: A RAG Approach to Political Debate Analysis

The paper introduces a retrieval‑augmented framework for detecting and classifying fallacies in political debate transcripts. By dynamically retrieving documents guided by argumentative relations of support and attack, the method leverages external knowledge to improve performance. Experiments on the ElecDeb60to20 benchmark show significant gains, raising macro‑F1 to 0.864 for detection and 0.725 for classification compared to non‑retrieval baselines.

By Deborah Dore, Greta Damo, Elena Cabrio, Serena Villata
arXiv Computation and Language
Sep 1

Evaluating the Capabilities of LLMs for Persuasive Dialogue

The paper introduces “Persuasio”, a multi‑agent dialogue platform that uses a formal argumentation theory to adjudicate winners in free‑text debates. Using this system, the authors generated 192 debates on a UK political topic involving humans and large language models (LLMs), and evaluated 22 interlocutors through automated adjudication and 9,702 crowdsourced pairwise judgments across 1,386 annotation instances. The results show a consistent decoupling between subjective persuasiveness—where LLMs dominate—and formal argumentative strength—where humans remain competitive, with multi‑agent and retrieval‑augmented variants widening this gap.

By Jordan Robinson, Angus R. Williams, Katie Atkinson, Anthony G. Cohn
arXiv AI
Jun 17

RooseBERT: A New Deal For Political Language Modelling

arXiv:2508. 03250v4 Announce Type: replace-cross Abstract: The increasing amount of political debates and politics-related discussions calls for the definition of novel computational methods to automatically analyse such content with the final goal of lightening up political deliberation to citizens.

By Deborah Dore, Elena Cabrio, Serena Villata
arXiv Computation and Language
Sep 25

Benchmarking Argumentative Behaviour of LLMs: A Study of Defences Against Character Attacks

The paper investigates how well large language models (LLMs) can handle character attacks—ad hominem arguments—in political debates. By analyzing natural political dialogues and comparing LLM-generated responses to a corpus of U.S. presidential debates, the study finds that most LLMs favor logical defenses and rarely use ethos-based counterattacks. The authors suggest that safety fine‑tuning limits LLMs’ strategic options, preventing them from fully engaging in realistic political discourse.

By Ewelina Gajewska, Katarzyna Budzynska, Jaroslaw Chudziak