arXiv Computation and Language

Look What You Made Us Cluster: Hate Narrative Extraction from Reddit Discourse

arXiv Computation and Language
Sep 1

When Hate Meets Facts: LLMs-in-the-Loop for Check-worthiness Detection in Hate Speech

The paper introduces WSF-ARG+, a new dataset that pairs hate speech with check‑worthiness annotations, and presents an LLM‑in‑the‑loop framework to streamline the annotation process. Experiments with 12 open‑weight large language models demonstrate that the framework cuts human effort while maintaining annotation quality. The study also shows that incorporating check‑worthiness labels improves hate‑speech detection performance, boosting macro‑F1 scores for large models by up to 0.213 and averaging 0.154 across models.

By Nicol\'as Benjam\'in Ocampo, Tommaso Caselli, Davide Ceolin
arXiv AI
Aug 28

Beyond Accuracy: A Qualitative Analysis of Vision-Language Models for Hate Speech Detection in Memes

The paper examines how four leading vision‑language models—LLaVA‑7B, Qwen‑VL, GPT‑4o mini, and Claude 3 Haiku—perform in detecting hateful content within memes. It evaluates the models under zero‑shot and few‑shot prompting, focusing not only on classification accuracy but also on the qualitative justifications they generate. The study highlights that these models often overlook contextual nuances, irony, and subtle cues essential for accurately identifying hate speech in memes.

By Muhammad Jawad Chowdhury, Adiba Hasan, Ishrak Hossain, Shahriar Ivan, Sabbir Ahmed
arXiv Computation and Language
Sep 16

Zero-shot narrative detection in social messaging

The paper explores how large language models can detect hidden narratives in social messages without training data. By feeding the models human-written narrative descriptions, performance improves markedly, while automatically generated descriptions or few-shot examples can hurt accuracy. Ensemble techniques, especially majority voting, further boost robustness, and larger models show the best results with less sensitivity to prompts.

By Jes\'us M. Fraile-Hern\'andez, Anselmo Pe\~nas, Patrick Giedemann
arXiv Computation and Language
Aug 31

Sledgehammer or Scalpel? A Fine-grained Adaptive Framework for Implicit Hate Speech

The paper introduces FAID, a fine‑grained adaptive framework for detecting implicit hate speech. It first classifies samples into Shallow, Targeted, or Context‑Dependent categories and then applies tailored strategies—prompt‑tuning for shallow cases, knowledge augmentation for targeted ones, and an agentic prompt‑generation system for context‑dependent posts. Experiments on four benchmark datasets show that FAID outperforms state‑of‑the‑art baselines by allocating computational effort only where needed.

By Han Wang, Yuhu Cheng, Xuesong Wang, Yi Zhu
arXiv Computation and Language
Sep 17

Structured Claim-Level Discourse Representations for Dense Health Narratives

The paper introduces a structured framework for claim-level discourse analysis in dense health narratives, addressing the limitations of existing topic- or sentiment-based representations. It identifies an average of 13.22 atomic claims per minute in social media health videos and proposes tuples that link each claim to thematic aspects, stance, and multidimensional pragmatic attributes. A benchmark of 1,191 manually annotated claims from 60 videos across four health domains is created, and experiments show that large language models perform well on thematic categorization and stance prediction but struggle with high-dimensional pragmatic profiling, indicating a need for task-specific inference strategies.

By Farnoushsadat Nilizadeh, Elham Pourabbas Vafa, Shirin Nilizadeh, Eduard Dragut