arXiv:2609.39001v1 Announce Type: cross
Abstract: LLM services are billed per token and context windows are measured in tokens, yet the number of tokens needed for the same content varies across lang...
By Thomas Serval
The paper introduces AssameseLM-E2B, a 2‑billion‑parameter language model tailored for the low‑resource Assamese language, and its instruction‑tuned variant AssameseLM-E2B‑it. Built on the Gemma‑4 architecture, it uses an expanded byte‑level BPE vocabulary that cuts tokenization overhead by nearly 500 % compared with multilingual baselines, and employs a parameter‑efficient Continual Pre‑Training pipeline with Hybrid LoRA followed by supervised fine‑tuning on a balanced, multi‑domain dataset. Evaluation shows strong performance with a Bits‑per‑Byte score of 0.7488 on FLORES‑200, a 96.7 % RAG score, and 100 % refusal accuracy on adversarial prompts, highlighting the effectiveness of parameter‑efficient adaptation for locally deployable models under constrained resources.
By Pragyan Phukan
arXiv:2608. 15964v1 Announce Type: cross Abstract: Language-specific competency (LSC) is the phenomenon of a language model performing better or worse depending on the language of the prompt.
By Ishika Agarwal, Arkajyoti Charaborty, Tanner Sorensen, Neha Gupta, Andreas Stolcke
Large Language Models (LLMs) are increasingly used to optimize code for performance, but this study shows that such optimizations often increase energy consumption rather than reduce it. Across 11 open‑source models and 1,000 benchmark problems, inference energy ranged from 0.79 to 8.68 MJ, and 42 of 44 configurations produced code that used 4% to 886% more energy than human‑written reference solutions. Mixture‑of‑Experts architectures and token‑limit constraints can reduce inference energy, yet performance‑optimized code remains energy‑heavier, indicating that speed and sustainability are not always aligned goals.
By Sadra Emami, Benjamin Weigell, Mohammad Reza Mousavi, Gunel Jahangirova, Hugo Araujo, Bernhard Bauer
arXiv:2410. 07809v2 Announce Type: replace-cross Abstract: Multilingual instruction tuning (MIT) is challenged by the curse of multilinguality, data scarcity, and high computational cost.
By G\"urkan Soykan, G\"ozde G\"ul \c{S}ahin
arXiv:2610.20247v1 Announce Type: cross
Abstract: Multilingual models share capacity across languages, so adding languages can hurt performance on existing ones. Mixture-of-experts models expand this...
By Joel Dag, Nikit Srivastava, Hamada M. Zahera, Axel-Cyrille Ngonga Ngomo