← Back to all news
arXiv Machine Learning

The Environmental Impacts of Language Model Training Keep Rising Now is the Time to Catch Impacts on the Rebound

The paper analyzes the environmental footprint of machine learning model training, focusing on large language models and their hardware. It finds that energy use and environmental impacts have risen exponentially over the past decade, even when employing carbon‑efficient electricity and more efficient hardware. The study argues that optimization strategies alone cannot curb these impacts due to a rebound effect, and stresses the need to evaluate hardware life‑cycle impacts and integrate environmental metrics into NLP research practices.

Related stories

arXiv AI
Oct 2

Beyond State-of-the-Art: Standardising Environmental Impact Metrics for AI Research

The paper highlights that as Large Language Models grow in capability and prevalence, their environmental footprint is increasing, yet the machine learning community lacks standardized carbon accounting practices. An automated review of 5,285 NeurIPS 2025 papers shows almost no reporting of environmental impact. To address this, the authors propose standardized sustainability metrics for training efficiency, heuristics for estimating inference carbon costs, a software tool called carbonbenchmark for tracking emissions, and the SMAJ framework to encourage prioritizing computational efficiency and environmental accountability over marginal accuracy gains.

By Lachlan McGinness, Dan Pagendam, Robert Offner
llmsbenchmarks
More like this →
arXiv Machine Learning
Aug 19

Wasted large language models: A life cycle thinking approach

The paper argues that large language models (LLMs) have a growing carbon footprint and that current efficiency gains are offset by rebound effects such as Jevons Paradox. It proposes applying the EU waste hierarchy—prevention, reuse, recycling, recovery, and disposal—to LLMs, suggesting that preventing waste and unnecessary use can significantly reduce environmental impact. The authors emphasize that treating LLMs as products that can become waste offers new ways to motivate more sustainable practices.

By Erik Johannes Husom, Maria Emine Nylund, Ophelia Prillard
llms
More like this →
arXiv Machine Learning
Jul 13

A Survey on the Green Development of Large Models: From Resource-Efficient Architectures to Hardware-Software Co-Design

arXiv:2607. 09084v1 Announce Type: new Abstract: The rapid expansion of large-scale AI models has led to significant performance breakthroughs across diverse domains, yet it has also raised critical concerns regarding computational costs, energy consumption, and environmental sustainability.

By Linhui Xiao, Guiping Cao, Mingyue Guo, Xianchao Guan, Fan Yang, Ming Tao, Xin Li, Yuxin Peng, Yaowei Wang
fine-tuning
More like this →
arXiv AI
Sep 3

A Survey of Transformer-based Language Models with Focus on Efficiency

The paper surveys Transformer-based large language models (LLMs) with a focus on efficiency, reviewing 312 articles that cover data curation, model design, downsizing, and dynamic inference. It also examines efficiency in adaptation strategies such as pre‑training, fine‑tuning, prompt‑engineering, and Retrieval‑Augmented Generation (RAG). A statistical analysis and evaluation of over 30 prominent NLP models on 13 benchmarks provide insights into both efficiency and efficacy, highlighting trends toward sustainable NLP practices.

By Wazib Ansar, Saptarsi Goswami, Amlan Chakrabarti
llmsragnlpfine-tuningbenchmarks
More like this →
arXiv AI
Jul 3

The Rising Unsustainability of AI Graphics Cards Production

arXiv:2607. 01258v1 Announce Type: cross Abstract: The rapid advancement of Artificial Intelligence (AI) has been accompanied by significant increases in computational and environmental costs, driven by large-scale investments in AI infrastructure, hardware, and software.

By Cl\'ement Morand, Aur\'elie N\'ev\'eol, Anne-Laure Ligozat
More like this →
arXiv AI
Jun 11

The Environmental Cost of LLMs in AIED: Reporting and Practices

arXiv:2606. 11215v1 Announce Type: cross Abstract: Large Language Model (LLM) usage in recent years has become increasingly widespread in the Artificial Intelligence in Education (AIED) community.

By Sabrina C. Eimler, Lukas Erle, Daniel Flood, Aditi Haiman, Luca H\"ackert, Andr\'e Helgert, Lachlan McGinness, B\"usra Yapici
llms
More like this →
arXiv Machine Learning
Aug 20

LLM-Powered Predictive Decision-Making for Sustainable Data Center Operations

The paper presents an LLM-based predictive scheduling system that forecasts execution time and energy consumption from source code, aiming to improve data center sustainability. By integrating these predictions into a real-time GPU allocation algorithm, the system reduces both energy use and queuing delays. In a collaboration with a data center, the approach achieved a 32% drop in energy consumption and a 30% reduction in waiting time.

By Hanzhao Wang, Jingxuan Wu, Yumeng Li, Yu Pan, Guanting Chen
llms
More like this →