The Flow has not summarised this story yet — read it at arXiv Computation and Language.
Camellia is a new benchmark that tests cultural bias in large language models (LLMs) across nine Asian languages and six Asian cultures. It contains 19,530 manually annotated entities linked to Asian or Western cultures and 2,173 masked social‑media contexts for these entities. Using Camellia, the authors evaluate four multilingual LLMs on cultural context adaptation, sentiment association, and entity extractive QA, finding that models struggle with cultural adaptation, exhibit differing biases across regions and families, and have difficulty understanding context in some Asian languages.
arXiv:2601. 14063v2 Announce Type: replace-cross Abstract: Cross-cultural competence in large language models (LLMs) requires understanding and adapting Culture-Specific Items (CSIs) across varying cultural contexts.
arXiv:2608.03446v2 Announce Type: replace Abstract: Multilingual large language models (LLMs) have been shown to perform better on non-English classification tasks when the representations of the giv...
arXiv:2604. 03532v2 Announce Type: replace-cross Abstract: Large language models (LLMs) show strong multilingual capabilities, yet reliably controlling the language of their outputs remains difficult.
arXiv:2509. 08022v3 Announce Type: replace-cross Abstract: Aligning large language models (LLMs) with diverse human values is essential for safe and effective deployment, yet existing benchmarks often overlook cultural and demographic variation.
CoCoA (Context-Conditional Cultural Alignment) is a framework designed to mitigate cultural bias in large language models by learning context-conditional behavior. It trains on entity pairs under both culturally cued and neutral contexts, using a contrastive alignment objective combined with calibration, drift regularization, and goal-aware gradient reconciliation. Evaluations on CAMeL and Camellia across ten languages and four LLMs show that CoCoA reduces the Cultural Bias Score from 43 to 24 on average while keeping near-neutral preferences at 50.2, with minimal impact on general performance.