arXiv AI

Arabic Safety Alignment as Selective Refusal: An Empirical Study of SFT, DPO, and Guard Calibration

arXiv AI
2d ago

Aligning Large Language Models for Safety in African Languages: A Case Study of Hausa

arXiv:2610.37245v1 Announce Type: cross Abstract: Safety alignment research for large language models (LLMs) remains concentrated on high-resource languages, leaving open how existing alignment metho...

By Valdini Douglace Lemofouet, Blessing Ngozi Uzor, Paula Chikaodinaka Anyanwu, Danielle Blanche Kapsa, Saminu Mohammad Aliyu, Seid Muhie Yimam, Shamsuddeen Hassan Muhammad
Hugging Face Trending Papers
Sep 28

From Normative Frameworks to Alignment Data: Constructing and Evaluating SFT and Preference Data

The paper presents an expert-driven method for turning normative principles—specifically Islamic ethical, theological, and jurisprudential traditions—into alignment data for language models. Over a year, seven experts curated 2.8K supervised fine-tuning examples and 5.4K preference pairs in Arabic-English, then evaluated models trained on these datasets. Experiments show that models trained with the curated SFT data outperform a baseline in expert judgments, while adding preference data yields a smaller, non-significant improvement.

arXiv AI
Oct 21

Global Security Blind Spots: Translation as a Safety Bypass in Low-Resource Languages

The paper investigates how large language models (LLMs) can be bypassed by translating harmful requests from English into low‑resource languages. By testing ten popular LLMs across 79 languages, the authors find that safe English completions often fail to remain safe after translation, with bypass rates between 21.9% and 44.4%. The risk is unevenly distributed across language families and varies significantly between models, making it hard to rank models by safety consistently.

By Jalil Alva, David Harper, Abigail E. Thornton, Rafael S. Villalobos Alva, Leonardo Kenji Minemura Suazo, Konstantinos Karageorgos, Diego Velazquez, Sergio A. Serrano, Marvin Vargas Flores, Aaron Schliem, Fernando F. Migone
arXiv Machine Learning
Oct 22

WRDO: Weighted Refusal Direction Optimization in Aligned Language Models

The paper introduces Weighted Refusal Direction Optimization (WRDO), a method that constructs a composite refusal direction by learning aggregation weights over per‑prompt refusal directions. WRDO aims to strengthen refusal interventions in aligned language models by allowing heterogeneous harmful prompts to contribute unequally. Experiments on three open‑weight models, using guard judges and HarmBench, demonstrate that weighted aggregation outperforms single‑direction methods and can also be used in reverse to restore refusal behavior in a damaged checkpoint.

By Grigoriy Evseev, Vladimir Solodkin, Dmitry Bylinkin, Daniil Medyakov, Vladimir Aletov, Aleksandr Beznosikov
arXiv AI
Sep 24

Hard Negatives Reveal What Easy Negatives Hide: Cross-Lingual Harmfulness Representations Degrade with Resource Tier Under Hard Negatives

The study investigates how safety alignment in large language models, trained mainly in English, transfers to other languages. While models show near-perfect harmfulness detection (AUROC > 0.98) using unrelated harmless prompts (easy negatives), performance drops sharply in low‑resource languages when using surface‑similar benign prompts (hard negatives). This degradation persists across multiple languages and models, indicating that easy‑negative evaluation alone cannot confirm cross‑lingual harmfulness representation quality.

By Paras Balani, Subhrakanta Panda