arXiv Computation and Language

AlexandriaX 2026: The First Shared Task on Dialectal Arabic Machine Translation

arXiv Computation and Language
Oct 19

alkhder at AlexandriaX-2026: Context-Aware English-to-Dialectal Arabic Dialogue Translation with QLoRA-Fine-Tuned NileChat-3B

The paper reports Alkhder’s submission to Subtask 1 of the AlexandriaX-2026 shared task, translating English dialogue turns into thirteen Arabic dialects. The team fine‑tuned NileChat‑3B‑Base with QLoRA on the Alexandria parallel dialogue corpus, training a single set of adapter weights for all dialects. Each translation is conditioned on target country, dialect, domain, participant roles, speaker‑addressee gender direction, and preceding dialogue context, and the model is run autoregressively using its own previous outputs as context. In the constrained track, training takes about one hour and inference on the private test set takes under two hours, achieving a country‑macro‑averaged spBLEU of 20.36 and chrF++ of 36.64 on both tracks.

By Hasan Alkhder, Maher Pasa, Maria Hanini, Amro Najjar, Ahmet Zengin
arXiv Computation and Language
3d ago

Current state of LLMs for Arabic dialectal machine translation

This study evaluates large language models (LLMs) for English‑to‑dialectal Arabic machine translation using the MADAR dataset across 16 Arabic dialects, covering both translation directions. It compares specialized Arabic models (Jais, Nile), multilingual models (Gemma, Command‑R, Mistral, Aya), and commercial APIs (GPT‑4.1) with multiple metrics—BLEU, CHRF, COMET, GEMBA—and a small manual assessment. The authors also examine LLMs’ ability to classify dialects and discuss challenges in automatic MT evaluation for Arabic dialects, noting potential training data contamination.

By Josef Jon, Rawan Bondok, Ond\v{r}ej Bojar
arXiv Computation and Language
Sep 24

NADI 2026: The Second Multidialectal Arabic Speech Processing Shared Task

NADI 2026 is the seventh edition of the Nuanced Arabic Dialect Identification shared task series and the second focused on multidialectal Arabic speech processing. It includes five main tasks—Automatic Speech Recognition, Spoken Dialect Identification, Text-to-Speech, Spoken Language Translation, and Spoken Language Understanding—along with eight subtasks that test realistic scenarios such as low‑bandwidth, mixed dialects, code‑switching, out‑of‑domain, and zero‑shot settings. The event attracted 21 teams from at least 13 countries, with 48 test‑phase submissions and 14 system‑description papers, and the results highlight out‑of‑domain generalization as a major bottleneck while showcasing the strengths of Arabic‑specialized speech models, multimodal dialect identification, and ensemble methods.

By Peter Sullivan, Bashar Talafha, Ahmed Ashraf, Fethi Bougares, Haroun Elleuch, Chiyu Zhang, AbdelRahim Elmadany, Youssef Mohamed, Salima Mdhaffar, Yannick Est\`eve, Mohamed Elhoseiny, Hamzah Luqman, Nizar Habash, Muhammad Abdul-Mageed
arXiv AI
Sep 1

Beyond Fluency: A Rubric-Based Benchmark for Evaluating Saudi Dialect and Cultural Competence in Large Language Models

The paper introduces a rubric-based benchmark to evaluate Saudi Arabic dialect and cultural competence in large language models. It comprises 31 expert-authored prompts covering idiomatic, pragmatic, lexical, and culturally embedded aspects, each paired with an expert-established ground truth. Four state-of-the-art models were scored, revealing that none exceeded 55% accuracy and that ambiguous framing was the most common error type.

By Ghassan Al-Sumaidaee, Sajjad Abdoli, Ahmed Rashad, Maxim Legg
arXiv AI
Sep 2

EDRAC: Benchmarking Arabic Dialect Reading Comprehension

EDRAC is the first large‑scale benchmark for dialectal Arabic machine reading comprehension and generative question answering, covering five major dialects—Egyptian, Moroccan, Emirati, Syrian, and Saudi. It contains 499 passages from naturally spoken interactions and 4,977 QA pairs produced via a human–LLM collaborative pipeline. The benchmark evaluates Arabic‑centric and multilingual large language models, revealing gaps between semantic answer quality and dialectal fidelity and underscoring limitations of current evaluation metrics for dialectal Arabic generation.

By Noor Abo Mokh, Kirill Chirkunov, Teresa Lynn, Nizar Habash, Reham Marzouk, Malik H. Altakrori, Younes Samih, Muhammed Abu Odeh, Nour Rabih, Rahaf Alshahrani, Hamad Alshehhi, Hamdan Al-Ali, Muhra Almahri, Besher Hassan, Mohamed Anwar, Abed Alhakim Freihat, Preslav Nakov, Alham Fikri Aji
arXiv Computation and Language
3d ago

GigaSpeech 3: Scaling Multi-Dialect Arabic Speech Recognition with Weakly Labeled Data

GigaSpeech 3 is a new Arabic speech corpus comprising 39,000 hours and 10 million weakly transcribed segments across Algerian, Egyptian, Iraqi, Saudi, and Syrian dialects. It is built from 60 hours of manual transcription per dialect, using self‑supervised labeling models and noisy‑student refinement to produce high‑quality data. The corpus enables dialect‑specific and multi‑dialect speech recognition models that outperform existing third‑party systems, achieving a macro‑average word error rate of 23.86% for dialect‑specific models and 25.51% for a multi‑dialect model.

By Junzhe Liu, Yujie Tu, Yifan Yang, Peng Wang, Haoran Wang, Guodong Lin, Leyan Liao, Chengquan Zhang, Zhifu Gao, Xiangang Li, Qinyuan Cheng, Xipeng Qiu, Wei-Qiang Zhang, Guoguo Chen, Kai Yu, Xie Chen
arXiv AI
Sep 4

Translation as a Decision Space: A Multi-Agent Perspective on Low-Resource Dialect Generation

The paper proposes treating translation as a structured decision space explored by multiple autonomous agents, rather than producing a single output. Using Turkish–Syrian Arabic dialogue, three agents—zero‑shot, dialect‑stabilized, and pivot translation—are compared on 5,000 sentences, with stabilization nearly doubling dialect marker usage and reducing structural instability. The study introduces an interpretability framework that quantifies decision flexibility through dialect marker frequency, lexical proximity, and structural variance.

By Hasan Alkhder, Mohammad Abboush, Igor Tchappi, Ahmet Zengin, Amro Najjar