arXiv Computation and Language

Is MT Ready for the Next Crisis or Pandemic?

The article investigates whether commercial machine translation (MT) tools—Google Translate, Microsoft Translator, GPT, Gemini, and Claude—are ready to support communication during crises or pandemics. Using the TICO-19 dataset, which contains pandemic-related sentences in high-priority low-resource languages, the study evaluates the usability of translations produced by these systems. The goal is to determine how effectively these MT tools can bridge language gaps between governments, aid providers, medical professionals, and affected communities.

arXiv Computation and Language
Oct 23

CrisiLangs: A Multilingual Resource for Crisis Warning Generation

CrisiLangs is a multilingual extension of the CrisiText dataset, adding Italian, Bulgarian, German, and Greek translations of warning messages for 1,000 crisis events, resulting in 5,000 event‑message pairs across five languages. The resource was used to fine‑tune a multilingual model, which outperformed a zero‑shot baseline on ROUGE‑L, BLEU, and BERTScore in every language and configuration. Human preference studies showed that low decoding temperatures were favored across all languages, while the impact of emergency guidelines varied by language.

By Giacomo Gonella, Stefano Menini, Marco Guerini
arXiv Computation and Language
6d ago

Toward Global Large Language Models in Medicine

arXiv:2601.02186v2 Announce Type: replace Abstract: Despite continuous advances in medical technology, the global distribution of health care resources remains uneven. The development of large langua...

By Rui Yang, Huitao Li, Weihao Xuan, Heli Qi, Xin Li, Kunyu Yu, Yingjian Chen, Rongrong Wang, Jacques Behmoaras, Tianxi Cai, Bibhas Chakraborty, Qingyu Chen, Lionel Tim-Ee Cheng, Marie-Louise Damwanza, Chido Dzinotyiwei, Aosong Feng, Chuan Hong, Yusuke Iwasawa, Yuhe Ke, Linah Kitala, Taehoon Ko, Jisan Lee, Irene Li, Jonathan Chong Kai Liew, Hongfang Liu, Lian Leng Low, Edison Marrese-Taylor, Yutaka Matsuo, Isheanesu Misi, Yilin Ning, Jasmine Chiat Ling Ong, Marcus Eng Hock Ong, Enrico Petretto, Hossein Rouhizadeh, Abiram Sandralegar, Oren Schreier, Iain Beehuat Tan, Patrick Tan, Daniel Shu Wei Ting, Junjue Wang, Chunhua Weng, Matthew Yu Heng Wong, Fang Wu, Yunze Xiao, Xuhai Xu, Qingcheng Zeng, Zhuo Zheng, Yifan Peng, Douglas Teodoro, Nan Liu
arXiv Computation and Language
Aug 21

HealMed: Multilingual Evaluation of Large Language Models in Medicine

arXiv:2608. 19981v1 Announce Type: new Abstract: We present HealMed, an expert-reviewed benchmark for multilingual evaluation of large language models in medicine.

By Yingjian Chen (Drew), Fan Gao (Drew), Sherry T. Tong (Drew), Haoyu Zhang (Drew), Aosong Feng (Drew), Kevin W. Jin (Drew), Xing Wu (Drew), Jinghui Lu (Drew), Abdul Samad (Drew), Akbar Faruqi (Drew), Cesar Caraballo (Drew), Cibele Brand\~ao (Drew), Dhruva (Drew), Gupta, Eunji Jeon, Gabriel Madera-Santiago, Geon Lee, Hugo Toshio Itikawa, Insook Cho, Isabelli Martins, Isarar Siddique, Israr Ahmed, Jihyo Kwak, Kanyakorn Veerakanjana, Luis Guilherme Cardoso, Minjin Kim, Piyalitt Ittichaiwong, Renee Dua, Santiago Gudi\~no-Rosales, Xiujie Chen, Zeo Lapalus, Zixin Xu, Michihiro Yasunaga, Rex Ying, Heuiseok Lim, Jaewoo Kang, Chanjun Park, Hang Jiang, Ethan Goh, Hyunjae Kim, Edison Marrese-Taylor, Yusuke Iwasawa, Yutaka Matsuo, Qingyu Chen, Irene Li
arXiv AI
Oct 5

"I just assumed that it would translate": examining MT risk awareness among healthcare staff with abbreviations as a use case

The study investigates how UK healthcare staff use Google Translate to communicate with patients who speak French or Spanish, focusing on the risks of translating medical abbreviations. Twenty-one staff members from various specialties were interviewed after reviewing translated clinical examples, and the data were analyzed qualitatively to assess awareness of potential safety hazards. The research highlights a gap in understanding how reliance on machine translation might compromise patient care, especially when dealing with abbreviated medical terminology.

By Eleanor Taylor-Stilgoe, F\'elix do Carmo, Constantin Or\u{a}san
arXiv Computation and Language
Sep 16

Can LLMs Follow the Pulse of a Crisis? Evaluating Crisis Sentiment in Bangladesh's July Uprising

arXiv:2609.16997v1 Announce Type: new Abstract: Crisis sentiment analysis is especially challenging for low-resource languages such as Bangla, where language, context, and public reaction shift rapid...

By Md. Samiul Alim, Mahir Shahriar Tamim, Tanvir Ahmed Khan, Sharjil Khan, Rafia Ferdous Duti, Shahriyar Zaman Ridoy, Mohammad Ali Moni