Redteaming Leading Arabic LLMs with ASAS
arXiv:2608.21985v1 Announce Type: new Abstract: As the adoption of large language models (LLMs) grows in Arabic-speaking regions, ensuring their safety and cultural alignment is increasingly critical...
The paper introduces ALTO, a corpus of 3,022 culturally and linguistically relevant instances of tech‑facilitated gender‑based violence (TFGBV) in Levantine Arabic, African French, and Swahili. It was created through a community‑led crowdsourcing partnership with civil society organizations in Jordan, Francophone West Africa, and Kenya, and annotated using active learning. Benchmarking shows that existing harmful content detection models have low TFGBV recall on ALTO and improve after fine‑tuning, with covert harms being frequently missed and Swahili exhibiting the highest error rates.
arXiv:2608.21985v1 Announce Type: new Abstract: As the adoption of large language models (LLMs) grows in Arabic-speaking regions, ensuring their safety and cultural alignment is increasingly critical...
arXiv:2610.26474v2 Announce Type: replace Abstract: Large language models (LLMs) designed to interact with users are typically trained to respond appropriately to harmful or toxic content. However, e...
The paper presents a new taxonomy for online harm on video platforms, expanding existing frameworks to multimodal contexts and defining six content-based categories: Information, Hate and harassment, Addictive, Clickbait, Sexual, and Physical harms. It also evaluates multimodal large language models (MLLMs) as alternative annotators, comparing GPT‑4‑Turbo, non‑trained crowdworkers, and trained human annotators on a dataset of 19,422 potentially harmful YouTube videos. The study finds that MLLMs can perform comparably to human annotators in both binary and multi‑label classification tasks, suggesting potential applications in content moderation and social science research.
The paper introduces REGLAT, an ensemble-based model that integrates named entity recognition (GLiNER) with a fine‑tuned MARBERT classifier to detect harmful content in Arabic. It classifies user prompts into seven harm categories, achieving a macro‑F1 of 0.886 and accuracy of 0.897 on the ArGuard 2026 development set, with slightly lower scores on blind test sets. The study highlights that combining explicit entity extraction with contextual language modeling improves fine‑grained harmful content detection, though distinguishing closely related categories remains difficult.
arXiv:2607. 20447v1 Announce Type: cross Abstract: This paper describes our system for the EEUCA 2026 Shared Task on toxicity classification in gaming chat.
The paper proposes a training‑time explainability framework that aligns model reasoning with human‑annotated rationales to improve both classification performance and interpretability for multilingual hate speech detection. It is evaluated on HateXplain (English) and BullySent (Hinglish), datasets that capture anti‑Muslim hate in culturally coded, multilingual forms. Using methods such as LIME, Integrated Gradients, Grad‑X‑Input, and attention, the study shows that gradient‑ and attention‑based regularization boosts F‑scores, enhances plausibility and faithfulness, and captures culturally specific cues for detecting implicit anti‑Muslim hate.
arXiv:2607. 00143v1 Announce Type: cross Abstract: Online hate speech has been linked to a global rise in violence against minorities, including incidents such as mass shootings, lynchings, and ethnic cleansing.
Hateful memes are a growing form of multimodal online harm, where hostile intent is often conveyed through the joint interpretation of images, text, cultural references, and implicit targets. While hateful meme detection has advanced in high-resource languages, Arabic remains underexplored, with existing meme resources focusing mainly on propaganda or coarse harmful-content labels.
arXiv:2605.05662v2 Announce Type: replace-cross Abstract: Current LLM safety benchmarks are predominantly English-centric and often rely on translation, failing to capture country-specific harms. Mor...
arXiv:2608.01291v2 Announce Type: replace Abstract: We present ArabicDialectSafety, a human-curated Arabic safety dataset of 25,071 prompts covering six Arabic varieties: Modern Standard Arabic, Syri...
arXiv:2607. 00143v2 Announce Type: replace-cross Abstract: Online hate speech has been linked to a global rise in violence against minorities, including incidents such as mass shootings, lynchings, and ethnic cleansing.
arXiv:2608. 13695v1 Announce Type: cross Abstract: Large language model providers routinely cite multilingual safety benchmarks spanning a dozen or more languages as evidence that their models are safe for non-English-speaking users.