arXiv Computation and Language
Oct 21

From DQI to C-DQI: Automatic Codebook Generation and Evaluation for Measuring Computational Discourse Quality Index

The paper introduces a protocol for generating and evaluating codebooks for measuring Computational Discourse Quality Index (DQI) using Large Language Models (LLMs). It compares top‑down, bottom‑up, and hybrid approaches, finding that inductive, data‑driven schemas yield higher inter‑model agreement while remaining valid. Experiments on 100 Israeli parliament transcripts support the reliability of these data‑driven schemas for large‑scale political discourse analysis.

By Esther Shizgal, Ron Keinan, Daniel Shtauber, Roee Tzvi Esquira, Ori Aronson, Matan Toledano, Or Rappel-Kroyzer, Liron Lavi, Renana Keydar, Ittai Bar-Siman-Tov, Reut Tsarfaty
arXiv Computation and Language
1d ago

Discourse Analysis of Legislative Bill Discussions

arXiv:2611.05381v1 Announce Type: new Abstract: Legislative hearings are distinct communication events with their own human recognizable structure and logic, yet they have been analyzed as distinct p...

By Isaac Rudnick, Nipun Das, Foaad Khosmood
arXiv Computation and Language
4d ago

Beyond the Black Box: Integrating Lexical and Semantic Methods in Quantitative Discourse Analysis with BERTopic

The paper introduces a transparent, hybrid framework for Quantitative Discourse Analysis that blends lexical and semantic techniques. Using custom Python pipelines with NLTK, spaCy, and Sentence Transformers, the authors fine‑tune preprocessing, lemmatisation, and embedding generation, then apply an iterative BERTopic workflow involving UMAP, HDBSCAN, and c‑TF‑IDF to produce coherent topics. The approach is illustrated through a historical political discourse case study, emphasizing code‑level transparency, researcher control, and methodological triangulation.

By Thomas Compton
arXiv Computation and Language
Oct 23

Interpretive Variation and Discourse Structure in Detecting Enthymemes in Controversial Political Discourse

The paper investigates how to detect enthymemes—arguments with unstated premises or conclusions—in controversial political tweets about vaccination and immigration. Despite extensive fine‑tuning, models achieve an F1 score of only about 0.67, prompting the authors to propose new evaluation metrics that compare predictions to the full distribution of annotator votes and a model that directly predicts this distribution. The study also shows that models rely on explicit argumentative structure, often missing implicit links that readers must infer, raising concerns for content moderation systems that depend on majority labels.

By Martial Pastor, Nelleke Oostdijk
Hugging Face Trending Papers
Jun 10

A Resource for Enthymeme Detection in Controversial Political Discourse

Enthymemes, arguments with unstated premises or conclusions, are pervasive in persuasive discourse, yet their annotation remains notoriously subjective. We present a resource of 1,482 tweets from politically controversial discourse, annotated by five annotators for the presence of enthymemes and their argument structure, designed to study label variation.