arXiv AI
Aug 25

Register Shifts Break LLM Safety: A Bengali Benchmark with Culturally Grounded Harms

The paper introduces BanglaSafe, a benchmark of 879 Bengali prompts that covers 17 culturally grounded harm categories and five prompting conditions. Evaluation of 18 frontier LLMs shows that 53.6% of responses are unsafe or partially unsafe, with 14.7% containing strictly harmful content. The study finds that the writing style within Bengali has a stronger impact on safety than the language switch itself, and that current safety classifiers struggle to reliably evaluate Bengali content.

By Naymul Islam, Nusrat Jahan Lia, Shubhashis Roy Dipta, Sabik Bin Sultan, Abdullah Khan Zehady
arXiv Computation and Language
Oct 28

Lipi-Ghor: A Large-Scale, Diarized, Multi-Domain Bengali Speech Corpus and a Scalable Pipeline for Building It

Lipi-Ghor is a large-scale, weakly-supervised Bengali speech corpus containing 885 hours of audio from 998 YouTube videos across 17 domains, each annotated in SSTT format with speaker diarization and timestamps. It is the first Bengali corpus to combine extensive coverage with speaker-diarized, long-form audio annotations, and the authors provide a replicable pipeline for building similar resources in other languages. The dataset includes a human-annotated gold evaluation split and is released under CC‑BY‑4.0, with raw audio withheld.

By Sanjid Hasan, A H M Fuad, Risalat Labib, Bayazid Hasan Simon