arXiv Computation and Language

A Comprehensive Analysis of Arabic Natural Language Processing Research: Trends, Topic Evolution, and Research Gaps -- A Bibliometric and Topic-Based Study

arXiv AI
Sep 1

Beyond Fluency: A Rubric-Based Benchmark for Evaluating Saudi Dialect and Cultural Competence in Large Language Models

The paper introduces a rubric-based benchmark to evaluate Saudi Arabic dialect and cultural competence in large language models. It comprises 31 expert-authored prompts covering idiomatic, pragmatic, lexical, and culturally embedded aspects, each paired with an expert-established ground truth. Four state-of-the-art models were scored, revealing that none exceeded 55% accuracy and that ambiguous framing was the most common error type.

By Ghassan Al-Sumaidaee, Sajjad Abdoli, Ahmed Rashad, Maxim Legg
arXiv AI
Oct 1

TTLab at Daleel 2026: STAR-Ar, Sequence Tagging for Argument Recognition in Arabic

The paper introduces STAR‑Ar, a BERT‑BiLSTM‑CRF model designed for the Daleel 2026 Arabic argument mining shared task. It treats argument discourse unit detection and classification as a token‑level sequence labeling problem, achieving an F1‑score of 72.69 on validation and 73.7 on test data. Analysis shows that models trained only on editorial texts perform worse than those trained on debates, mainly due to the smaller editorial dataset.

By Bhuvanesh Verma, Ali Abusaleh, Alexander Mehler
arXiv Computation and Language
Aug 28

Why Current XAI Is Not Enough for Arabic NLP: A Critical Survey of the Explainability Gap

The paper surveys the state of Explainable AI (XAI) in Arabic NLP, highlighting three gaps: a method gap where Arabic XAI relies mainly on limited post‑hoc techniques; a task gap with most work focused on classification tasks and little on generation, retrieval, or dialogue; and a linguistic gap where explanations rarely address Arabic‑specific phenomena such as morphology, dialects, and diglossia. It proposes a taxonomy of tasks, methods, linguistic units, and evaluation practices, and outlines a research agenda for linguistically grounded Arabic XAI.

By Salima Lamsiyah, Ruslan Mitkov
arXiv Computation and Language
3d ago

Towards the Roof of the World: NLP Progress in Tibetan Languages

The paper presents the first systematic bibliometric survey of Tibetan NLP, covering 140 publications from 2004 to 2026. It shows rapid growth—84% of the work appears since 2018—and a bottom‑up expansion across the NLP pipeline, from corpora and word segmentation to large language models. The study highlights that most research originates in China, identifies gaps in dialect coverage, responsible NLP, and resource release, and calls for open science and community participation to support Tibetan and other low‑resource languages.

By Xi Cao, Yijie Li, Yuan Sun, Shiwei Dong, Zeguang Huang, Nuo Qun
arXiv AI
Sep 10

Mapping the Emerging Social Science of Large Language Models

The paper maps the nascent social‑science literature on large language models (LLMs) by analysing 198 curated papers and 47,719 field‑scale papers. It identifies three main domains—LLM as Social Minds, LLM Societies, and LLM‑Human Interactions—each containing 13 subcategories such as reasoning, bias, collective intelligence, and trust. The taxonomy is validated through clustering stability, author classification agreement, and topic mapping, revealing differing prominence across conference and journal venues.

By Yi Yang, Xiao Jia, Zeyun Dong, Chenzhang Wang, Zhanzhan Zhao
arXiv AI
Aug 24

Hadith computational science in the age of large language models: a critical narrative review

The article reviews how transformer models, retrieval‑grounded pipelines, and large language models are reshaping hadith computational science. It critically evaluates existing literature, highlighting uneven progress: expanded data resources and mature segmentation tasks, yet persistent issues such as narrow corpora, weak benchmark comparability, and limited reproducibility. The authors argue that hadith computation should be viewed as an evidence‑infrastructure problem requiring knowledge integration, provenance, and expert supervision, and they propose a research agenda to strengthen the field’s methodological rigor.

By Md. Ashraful Haque (Greentech Apps Foundation, United Kingdom), Riasat Islam (Greentech Apps Foundation, United Kingdom, Queen Mary University of London, London, United Kingdom)
arXiv AI
Aug 25

AraDetox: A Multi-Dialect Arabic Detoxification Dataset

AraDetox is a newly released multi-dialect Arabic detoxification dataset containing 10,500 harmful social‑media posts and 84,000 detoxified rewrites generated by GPT‑5 and Gemini 2.5 Flash across Modern Standard Arabic, Gulf, Levantine, and Egyptian Arabic. Human evaluation and automatic analyses confirm that the rewrites effectively remove harmful language while preserving meaning, lexical change, and dialectal style. The dataset is publicly available to support future research in Arabic detoxification, safe text generation, and multi‑dialect NLP.

By Mo El-Haj