arXiv AI
Oct 28

HateSense: Hierarchical Sentiment Analysis Framework for Hate Speech Detection: Implementing Binary and Multiclass Classification Strategy

The paper "HateSense: Hierarchical Sentiment Analysis Framework for Hate Speech Detection: Implementing Binary and Multiclass Classification Strategy" revisits a transformer-based framework that combines hierarchical classification and sentiment features for hate speech detection. Experiments on the Davidson and HateXplain datasets show that a dominant-class-first hierarchy actually lowers macro‑F1, sentiment features have minimal impact, and class‑weighted training yields the largest performance gains. Cross‑dataset transfer and slur reuse reveal that in‑domain metrics overstate real‑world reliability.

By Faria Naznin, Md Touhidur Rahman, Shahran Rahman Alve
arXiv Computation and Language
Sep 22

Used, Mentioned, or Condemned? A Controlled Contrast-Set Diagnostic for the Use-Mention Distinction in Code-Mixed Hinglish Misogyny Detection

The paper introduces a diagnostic tool for distinguishing the use of misogynistic slurs from their mention in counter‑speech within code‑mixed Hinglish. It identifies evaluation artifacts in existing corpora, releases a 416‑item minimal‑pair contrast set that decorrelates slur presence and gendered register from labels, and proposes a pair‑consistency metric to assess model performance. Experiments show that even strong baselines struggle to consistently label counter‑speech pairs, while a large language model achieves perfect scores, indicating the benchmark measures genuine capability rather than exploitation of artifacts.

By Ashanvi Yadav, Shubham Bhardwaj