arXiv Computation and Language
Sep 4

Can Dialects Be Steered Like Languages? Sparse Neurons and Distributed Directions in Arabic LLMs

The paper investigates how Arabic dialects are represented in large language models and whether they can be steered at inference time. By analyzing neuron-level sparsity and vector steering, the authors find that only a small fraction of neurons encode dialect-specific features, while distributed activation directions are more effective for steering. Vector steering can induce dialectal output from both dialectal and MSA prompts, whereas neuron steering works only when the prompt is already dialectal.

By Kareem Elozeiri, Mervat Abassy, Omar Kallas, Fahim Dalvi, Preslav Nakov, Kentaro Inui, Nadir Durrani
arXiv Computation and Language
Sep 22

AlexandriaX 2026: The First Shared Task on Dialectal Arabic Machine Translation

arXiv:2609.22796v1 Announce Type: new Abstract: Dialectal Arabic machine translation (MT) remains challenging despite recent progress in Arabic language technologies, particularly because effective t...

By Abdellah El Mekki, AbdelRahim A. Elmadany, Samar M. Magdy, Saad Ezzini, Mo El-Haj, Mustafa Jarrar, Zaid Alyafeai, Bernard Ghanem, Muhammad Abdul-Mageed
Hugging Face Trending Papers
Aug 6

Different Perturbations, Different Mechanisms: Understanding Continued Pre-training for Zero-Shot Dialect Robustness

Dialectal variation remains a major challenge for multilingual language models. Perturbation-based continued pre-training (CPT) has emerged as a promising approach to improving robustness, yet existing work largely evaluates individual perturbation strategies in isolation and provides limited insight into why they work.