arXiv AI

Toxicity Is a Property of Communicative Events: A Contextual Stress Measurement Framework for NLP

Hugging Face Trending Papers
Oct 5

From Abusive Language Classification to Sequence Labeling Identification

The paper introduces Abusive Language Identification (ALI), a sequence‑labeling approach that simultaneously extracts abusive spans and identifies target mentions, addressing limitations of traditional sentence‑level abusive language classification (ALC). Using a pilot corpus from a production moderation pipeline, the authors compare ALI to ALC, finding that ALI performs competitively while offering localized outputs useful for moderators, with a modest advantage on implicit abuse. However, accurately determining exact abusive boundaries and target spans remains challenging, and the study highlights the need for further research on target‑span linking and structured benchmarks for ALI.

arXiv AI
Aug 25

Towards Safer Social Media Platforms: Scalable and Performant Few-Shot Harmful Content Moderation Using Large Language Models

The paper presents a scalable approach to harmful content moderation on social media by leveraging large language models (LLMs) for few-shot, in-context learning. Experiments across multiple LLMs show that this method outperforms proprietary baselines such as Perspective and OpenAI Moderation, as well as prior few-shot learning techniques, in detecting harmful content. The study also explores the addition of visual cues like video thumbnails to assess multimodal improvements, highlighting the advantages of LLM-based moderation for dynamic and large-scale content filtering.

By Akash Bonagiri, Lucen Li, Rajvardhan Oak, Zeerak Babar, Magdalena Wojcieszak, Anshuman Chhabra
arXiv AI
4d ago

Breaking the Cloak! Unveiling Chinese Cloaked Toxicity with Homophone Graph and Toxic Lexicon

The paper introduces C$^2$TU, a training‑free and prompt‑free method for uncovering Chinese cloaked toxic content. It uses substring matching with a Chinese homophone graph and toxic lexicon to spot candidate toxic words, then filters non‑toxic candidates and corrects cloaks using two variants—one based on BERT and another on LLMs that overcome auto‑regressive limitations. Experiments on two Chinese toxic datasets show C$^2$TU outperforms the best competitor by up to 71% in F1 score and 35% in accuracy.

By Xuchen Ma, Jianxiang Yu, Wenming Shao, Bo Pang, Xiang Li
arXiv AI
Jul 21

Posts of Peril: Detecting Information About Hazards in Text

arXiv:2405. 17838v3 Announce Type: replace-cross Abstract: Socio-linguistic indicators of affectively-relevant phenomena, such as emotion or sentiment, are often extracted from text to better understand features of human-computer interactions, including on social media.

By Keith Burghardt, Daniel M. T. Fessler, Chyna Tang, Anne Pisor, Kristina Lerman
arXiv Computation and Language
Oct 5

Automatic Evaluation of Mental Health Stigma in Online Communication

The paper presents a new benchmark for automatically evaluating mental health stigma in online text, featuring a fine‑grained taxonomy that covers stigma mode, domain, and specific components across multiple mental health conditions. The authors annotate naturally occurring news and social media posts and test large language models and classifiers for sentiment, toxicity, and hate speech, finding that these models poorly capture stigma and often overpredict it without explicit rules. The benchmark, annotations, exemplar cases, and code are publicly released on GitHub.

By Naomi Baes, Jemima Kang, Nick Haslam, Chris Groot, Alsa Wu, Luc Raszewski, Yulia Otmakhova
arXiv AI
Sep 21

CIBuzzBench: A Benchmark for Cross-Lingual Understanding of Chinese Internet Buzzwords

CIBuzzBench is a new benchmark that tests cross‑lingual understanding of Chinese internet buzzwords by providing 3,001 buzzwords with English explanations, equivalents, category labels, and harmfulness annotations. The benchmark defines three tasks—Meaning Explanation, Cross‑lingual Equivalent Matching, and Culturally Grounded Harmfulness Detection—to evaluate how well large language models translate and interpret these culturally nuanced terms. Experiments show that current state‑of‑the‑art LLMs still struggle with fine‑grained non‑literal meanings, robust matching, and accurate harmfulness detection across languages.

By Yifan Wang, Junyu Lu, Qifan Wang, Shun Zhang, Chaozhuo Li, Jiahao Liu, Zhijun Cao, Lingbin Bu, Fanliang Bu