arXiv Computation and Language

REGLAT at ArGuard Shared Tasks: An Ensemble-Based Model Integrating NER for Harmful Content Detection in Arabic

The paper introduces REGLAT, an ensemble-based model that integrates named entity recognition (GLiNER) with a fine‑tuned MARBERT classifier to detect harmful content in Arabic. It classifies user prompts into seven harm categories, achieving a macro‑F1 of 0.886 and accuracy of 0.897 on the ArGuard 2026 development set, with slightly lower scores on blind test sets. The study highlights that combining explicit entity extraction with contextual language modeling improves fine‑grained harmful content detection, though distinguishing closely related categories remains difficult.

arXiv AI
Sep 25

ArGuard Shared Task: Harmful Content Detection in Arabic Memes and LLM Prompts

ArGuard is a shared task that evaluates harmful content detection in Arabic memes and LLM prompts, featuring two tracks: Track A for multimodal hate detection in memes and Track B for harmful prompt detection in Arabic LLM safety evaluation. Fifty‑eight teams registered, 35 reached the final evaluation, and 27 submitted system‑description papers, with participants experimenting with models such as AraBERT, Jais, and Qwen3‑VL. The top systems achieved macro‑F1 scores of 0.823 on A1, 0.419 on A2, 0.984 on B1, and 0.790 on B2, with fine‑grained meme classification in A2 proving the most challenging due to sparse labels and distribution shifts.

By Firoj Alam, Md. Rafiul Biswas, Mohamed Bayan Kmainasi, Ali Ezzat Shahroor, Hamdy Mubarak, George Mikros, Abul Hasnat, Wajdi Zaghouani
Hugging Face Trending Papers
Jul 29

AHA-Memes: A Fine-Grained Multimodal Benchmark for Understanding Hate in Arabic Memes

Hateful memes are a growing form of multimodal online harm, where hostile intent is often conveyed through the joint interpretation of images, text, cultural references, and implicit targets. While hateful meme detection has advanced in high-resource languages, Arabic remains underexplored, with existing meme resources focusing mainly on propaganda or coarse harmful-content labels.

arXiv AI
Oct 21

SZED at ArGuard Shared Tasks: Multi-Task Label-Attention and Cross-Modal Fusion for Arabic Hateful Meme Detection

SZED submitted a system to the ArGuard 2026 Arabic hateful meme detection challenge, tackling both binary classification (A1) and fine‑grained multi‑label tagging (A2). For A1, the team fused MARBERTv2 and CLIP ViT‑L/14 embeddings using concatenation, self‑attention, and ensemble heads, achieving a macro‑F1 of 0.7597. For A2, they employed a multi‑task label‑attention architecture with per‑class query vectors and an auxiliary cascade‑calibration head, reaching a macro‑F1 of 0.3142 across ten active classes and analyzing per‑class error patterns and calibration effects.

By Selma Khelili, Zohra Abdeli
arXiv Computation and Language
Aug 28

Why Current XAI Is Not Enough for Arabic NLP: A Critical Survey of the Explainability Gap

The paper surveys the state of Explainable AI (XAI) in Arabic NLP, highlighting three gaps: a method gap where Arabic XAI relies mainly on limited post‑hoc techniques; a task gap with most work focused on classification tasks and little on generation, retrieval, or dialogue; and a linguistic gap where explanations rarely address Arabic‑specific phenomena such as morphology, dialects, and diglossia. It proposes a taxonomy of tasks, methods, linguistic units, and evaluation practices, and outlines a research agenda for linguistically grounded Arabic XAI.

By Salima Lamsiyah, Ruslan Mitkov
arXiv Computation and Language
3d ago

AfriGuard: Safety and Robust Refusal For African Languages

arXiv:2610.26474v2 Announce Type: replace Abstract: Large language models (LLMs) designed to interact with users are typically trained to respond appropriately to harmful or toxic content. However, e...

By Israel Abebe Azime, Jesujoba O. Alabi, Iffat Maab, Alexander D. Cai, Tadesse Destaw Belay, Atnafu Lambebo Tonja, Jonas Kgomo, Folasade Alabi, Salomey Osei, Saminu Muhammad Aliyu, Nkechinyere Faith Aguobi, Bontu Fufa Balcha, Blessing Sibanda, Davis David, Mouhamadane Mboup, Daud Abolade, Neo Putini, Louis Powell, Kiant'e Brantley, Philipp Slusallek, Dietrich Klakow, Julia Kreutzer
arXiv AI
Sep 2

Assessing Suicide Risk in Arabic Crisis Helpline Calls: A Comparison of Arabic and English Large Language Models

The study evaluates large language models for assessing suicide risk in Arabic crisis helpline calls, comparing Arabic and English models. Using de‑identified transcripts from Lebanon’s National Lifeline, the researchers fine‑tuned instruction‑tuned LLMs and transformer encoders, achieving a macro‑F1 of 81.19 and ROC‑AUC of 90.61 for high‑risk calls in Arabic, and 85.00/92.59 in English. The results show that high‑risk calls are more distinguishable than at‑risk calls, and translating to English does not degrade performance, indicating potential for operator‑facing tools.

By Linhai Ma, Rita El Hachem, Mahatab El Hajj, Lilian Ghandour, Samah Fodeh
arXiv Computation and Language
Sep 24

AraGenre 2026: A Hierarchical Definition-Guided Arabic Genre Classification Shared Task

AraGenre 2026 is a shared task that challenges participants to perform hierarchical, definition-guided Arabic genre classification. Systems must assign each Arabic text segment both a broad communicative genre and a fine-grained specific genre, using natural-language definitions for 74 unseen specific genres in a zero-shot setting. The released datasets include limited synthetic examples for training and development, while the hidden final benchmark contains noisier, naturally occurring text across Modern Standard Arabic, Classical Arabic, and multiple dialects.

By Mo El-Haj, Saad Ezzini, Shadi Abudalfa, Mustafa Jarrar, Nguyen Minh Chi, Nguyen Minh Quan