Introducing The World's Largest Open Multilingual Language Model: BLOOM

A Deepdive into Aya Expanse: Advancing the Frontier of Multilinguality

Understanding the capabilities, limitations, and societal impact of large language models

No Optimal Language Set Exists for Multilingual Instruction Tuning: Insights from a Linguistically-Informed Study

arXiv:2410. 07809v2 Announce Type: replace-cross Abstract: Multilingual instruction tuning (MIT) is challenged by the curse of multilinguality, data scarcity, and high computational cost.

Setting Up Your Own Large Language Model

Still a long way to go, but the future is promising The post Setting Up Your Own Large Language Model appeared first on Towards Data Science .

Very Large Language Models and How to Evaluate Them

Red-Teaming Large Language Models

Multilinguality of Large Language Models From a Structural Perspective

arXiv:2606. 01800v1 Announce Type: cross Abstract: Large language models (LLMs) have excelled in processing multiple languages through pre- and post-training on multilingual data, even though English dominates the training data.

Large Language Models: A New Moore's Law?

Fast Inference on Large Language Models: BLOOMZ on Habana Gaudi2 Accelerator

Embedding Initialization for Unseen Low-resource Languages in Multilingual NMT: A Case Study on Limbum-English Translation

arXiv:2608. 07629v1 Announce Type: cross Abstract: Multilingual neural machine translation models such as NLLB-200 cover 200 languages but leave thousands unsupported, including most Grassfields Bantu languages of Cameroon.

Speculative Decoding and the Curse of Multilinguality

arXiv:2605. 30580v2 Announce Type: replace-cross Abstract: Speculative decoding is a popular technique for large language model (LLM) inference, enabling faster generation by drafting multiple tokens with a smaller draft model.

Language Equality has a Price: A Systematic Investigation of Multi-turn LLM Performance for EU-24+

We evaluate large language models (LLMs) as language agents playing goal-directed dialogue games in self-play across 30 languages: the 24 official EU languages plus six others. Unlike static or preference-based evaluation, this paradigm is multi-turn, reference-free and programmatically scored, and because the game mechanics are language-agnostic it extends to a new language by localising a fixed set of prompt and word-list files.