arXiv AI By Naihao Deng, Alissa Shen, Yiming Feng, Joan Nwatu, Jae-Won Chung, Mosharaf Chowdhury, Yulong Chen, Rada Mihalcea

The Language-Energy Divide: Measuring Energy Costs of Multilingual LLM Inference

Read the original on arXiv AI →

The paper investigates the energy costs of multilingual large language model (LLM) inference, revealing significant disparities across languages. Using the ML.Energy framework, the authors find that energy consumption per output token can differ by up to 8.3×, and total energy for a fixed request set can vary up to 179×, with English being the cheapest and Pashto the most expensive. The study attributes these differences to higher per-token costs for complex or rare scripts and longer outputs for low‑resource languages, and notes that high‑energy languages also tend to have lower task accuracy.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv Computation and Language
Sep 3

How Do Prompt Variations Affect Energy Consumption in On-Device LLMs?

The paper investigates how prompt design influences energy consumption in on-device large language models (LLMs). It examines two prompt properties—cognitive load and phrasing pattern—across various datasets, models, and devices, using phase-level profiling to separate prefill and decode energy. Findings show that cognitive load mainly affects energy per token, while phrasing pattern influences energy mainly through token usage, and that prompt design reshapes the energy-quality trade‑off differently for each model.

By Wei Hu, Xiaolong Tu, Dawei Chen, Yitao Chen, Kyungtae Han, Haoxin Wang