arXiv Computation and Language

Multilingual Models for Check-Worthy Social Media Posts Detection

The paper reports a comprehensive study of transformer-based NLP models for detecting check-worthy social media posts, covering data collection, preprocessing, architecture selection, fine‑tuning, testing, and implementation. It focuses on multilingual models that can process English and low‑resource languages such as Arabic, Bulgarian, Dutch, Polish, Czech, and Slovak, and compares their performance to state‑of‑the‑art baselines. The work introduces multi‑label multilingual classifiers that simultaneously identify harmful content and posts containing verifiable factual claims efficiently.

arXiv Computation and Language
4d ago

SWARM: A Multilingual Human-Annotated Dataset for Russian Propaganda Detection in Search Engine Results

The paper introduces SWARM, a multilingual dataset of 2,183 search engine results in nine languages, annotated for support of Russian propaganda narratives. It evaluates a source-based blocklist, supervised classifiers, and zero‑shot large language models, finding that blocklists miss most propaganda and that content‑level models vary in performance, with the best LLM achieving an F1 of 0.73. The study highlights the need for per‑language, content‑level detection of search‑borne propaganda.

By Manuel Tonneau, Abhinav Dubey, Farhan Shaikh, Ilaria Vitulano, Martha Stolze, Hale Dedeoglu, Clara Riechert, Ella Kuka, Maryna Sydorova, Mykola Makhortykh, Elizaveta Kuznetsova
arXiv AI
Aug 11

Build it, Break it, Repeat: Benchmarking and improving LLM-manipulated disinformation detection in social media posts

arXiv:2608. 09510v1 Announce Type: cross Abstract: Detecting machine-generated disinformation on social media is increasingly difficult as large language models (LLMs) make it easier to generate and rewrite misleading content at scale.

By Kevin Thomas, Milosz Kasprzyk, Reuel C Igbokwe Onuigbo, Elliott Pert, Cameron Tovey, Jo\~ao A. Leite, Olesya Razuvayevskaya, Carolina Scarton
arXiv AI
Aug 7

Automatic Detection of Deaths from Social Networking Sites

arXiv:2608. 05183v1 Announce Type: cross Abstract: This dissertation analysed and discussed the differences in linguistic characteristics between pre-mortem and post-mortem social media content, and reported machine learning (ML) classifiers that achieved high performance in automatically detecting deaths of social networking site users from posts associated with their profiles.

By Nuhu Ibrahim, Riza Batista-Navarro
Hugging Face Trending Papers
Sep 2

From Detection to Characterization: A Large-Scale Study of Ragebait on Japanese X

The paper presents a large‑scale study of ragebait—content designed to provoke anger—on Japanese posts on X. It introduces a labeled dataset created with a large language model, trains Japanese language models, and builds an ensemble classifier that detects ragebait. Applying this detector to a vast dataset reveals that ragebait is especially common in politically and socially contentious topics, spreads faster, and elicits stronger negative emotions than non‑ragebait posts.

arXiv Computation and Language
Sep 1

When Hate Meets Facts: LLMs-in-the-Loop for Check-worthiness Detection in Hate Speech

The paper introduces WSF-ARG+, a new dataset that pairs hate speech with check‑worthiness annotations, and presents an LLM‑in‑the‑loop framework to streamline the annotation process. Experiments with 12 open‑weight large language models demonstrate that the framework cuts human effort while maintaining annotation quality. The study also shows that incorporating check‑worthiness labels improves hate‑speech detection performance, boosting macro‑F1 scores for large models by up to 0.213 and averaging 0.154 across models.

By Nicol\'as Benjam\'in Ocampo, Tommaso Caselli, Davide Ceolin
arXiv Computation and Language
Sep 3

From Detection to Characterization: A Large-Scale Study of Ragebait on Japanese X

The paper presents a large‑scale study of ragebait on Japanese X, developing an ensemble classifier trained on a dataset labeled with the help of a large language model. The detector was applied to a vast collection of Japanese posts, revealing that ragebait is especially common in politically and socially contentious topics such as politics, discrimination, public health, and interpersonal conflict. Ragebait posts spread more quickly and elicit stronger negative emotions—anger, fear, disgust, sadness, and surprise—than non‑ragebait posts.

By Zhiyang Qi, Kazuhiro Ito, Jinghui Chen, Hibiki Nakamura, Zhangxuan Chen, Erina Murata, Masaki Chujyo, Fujio Toriumi
Hugging Face Trending Papers
Jul 29

AHA-Memes: A Fine-Grained Multimodal Benchmark for Understanding Hate in Arabic Memes

Hateful memes are a growing form of multimodal online harm, where hostile intent is often conveyed through the joint interpretation of images, text, cultural references, and implicit targets. While hateful meme detection has advanced in high-resource languages, Arabic remains underexplored, with existing meme resources focusing mainly on propaganda or coarse harmful-content labels.