The study investigates how a single politically charged framing term can influence large language models (LLMs) during translation tasks. By prompting eight models from Western, Chinese, and European origins to translate culturally attributed recipes across 17 languages under four framing conditions, the authors find that models resolve ambiguity rather than decline, with distinct behavior patterns tied to model families. Sensitivity to framing terms is consistent, showing that even subtle variations can modulate LLM behavior, raising concerns about implicit political judgments in translation contexts.
By Svetlana Gorovaia, Angelica Henestrosa, Ivan P. Yamshchikov
The paper introduces CAPRI, a dataset of conversations designed to test whether large language models (LLMs) can adapt their responses to users’ cultural backgrounds. Experiments show that while LLMs can infer a user’s cultural context and recall relevant conventions, they frequently fail to apply this knowledge when generating answers unless explicitly prompted to do so. The study also finds that LLMs’ cultural adaptations improve as more cues are provided, yet their default priors are not culture‑neutral and sometimes reflect the model’s country of origin.
By Yisong Miao, Jian Zhu, Vered Shwartz
The paper introduces a taxonomy of six types of contextual knowledge conflicts—factual, inferential, temporal, granularity, perspective, and ambiguity—and presents the ContextConflict dataset with 5,781 samples covering reasoning and summarization tasks. Experiments on nine large language models reveal that current models struggle to resolve these conflicts, exhibit a bias toward earlier evidence, and show latent awareness of conflicts in their internal representations. The authors propose a training‑free, label‑free steering method that adjusts activations to better incorporate evidence, consistently improving reasoning accuracy and producing higher‑quality, balanced summaries on the dataset.
By Xinye Yang, Zhenyang Liu, Ruisi Li, Yuanyuan Lei
arXiv:2607. 27232v1 Announce Type: cross Abstract: Large Language Models (LLMs) are increasingly shaping how we consume information and form our worldview.
By Haran Shani-Narkiss, Michael Fire, Oren Tsur
ProMediConv is a new benchmarking framework for evaluating proactive conversational agents in legal dispute mediation. It models mediation as a multi-stage, party-aware dialogue that incorporates 11 mediation strategies and four party behavior pattern states, and it is built on 972 real-world cases with utterance-level annotations. The framework introduces a fine-grained metric, MAD (Mean Attribute Difference), to capture shifts in party behavior throughout the dialogue, and provides a comprehensive benchmark with diverse models and a tailored baseline, ProMediAgent.
By Zesheng Wei, Mengfan Li, Wenhao Liu, Yixin Zhang, Zilei Wang, Yang Deng
APRiL is an open‑ended benchmark designed to evaluate Chinese large language models’ social awareness. It comprises 2,196 evaluation instances across six categories, split into two tasks: Social Scenario Analysis, which tests understanding of social cues, mental states, and conflict structures, and Socially Aware Response, which checks whether models can generate appropriate, natural replies. Experiments on twelve models from six families show a consistent gap between understanding and response quality, indicating that stronger scenario analyses tend to improve response performance.
By Tian Lan, Han Zhang, Shanshan Wang, Yahan Yu, Jiang Li, Yugo Murawaki
The paper examines how large language models resolve conflicts that arise within contextual knowledge, rather than between internal knowledge and external context. It introduces a taxonomy of six contextual conflict types and presents the ContextConflict dataset with 5,781 samples covering reasoning and summarization tasks. Experiments on nine LLMs reveal persistent shortcomings in conflict resolution, uncover a bias toward earlier evidence, and propose a training‑free steering method that improves accuracy and summary quality.
arXiv:2608. 19220v1 Announce Type: cross Abstract: Rising immigration has intensified intergroup tensions in many countries.
By Oluwadamilola Jeboda, John F. Dovidio, Jonas R. Kunst
arXiv:2607. 02049v1 Announce Type: cross Abstract: Large Language Models are increasingly deployed in emotional-support contexts and crisis-related situations.
By Anna Chorna
CuBEs introduces culturally‑situated behavioral evaluations for large language models, adding cultural context to test scenarios and assessments. The authors built a human‑labeled dataset covering 12 cultures, revealing significant cross‑cultural differences that one‑size‑fits‑all judgments miss. Evaluating 13 LLMs shows that culturally situated tests uncover varied behaviors, such as Western political bias versus non‑Western religious or colonial biases, which standard evaluations overlook.
By Hoda Ayad, Tanu Mitra, Abhishek Mukherji
arXiv:2607. 19243v1 Announce Type: cross Abstract: Although Large Language Models (LLMs) demonstrate remarkable multilingual fluency, their internal knowledge representations remain disproportionately biased toward high-resource languages.
By Alexander Manev
arXiv:2609.00491v1 Announce Type: new
Abstract: Communicating across cultures is inherently challenging, especially through culturally dense and ambiguous formats like memes. While people expect larg...
By Hangxiao Zhu, Suliu Qin, Zhuoyan Li, Ming Jiang, Yu Zhang, Meng Xia