arXiv Machine Learning

Evaluation of ML Resource Utilization Requires Model Life Cycle Assessment

arXiv:2606. 07632v1 Announce Type: new Abstract: Proper accounting of the energy requirements and environmental impact of artificial intelligence (AI) systems is necessary for researchers, developers, policy makers, and users to assess the barriers to building systems at scale.

arXiv AI
Jun 11

The Environmental Cost of LLMs in AIED: Reporting and Practices

arXiv:2606. 11215v1 Announce Type: cross Abstract: Large Language Model (LLM) usage in recent years has become increasingly widespread in the Artificial Intelligence in Education (AIED) community.

By Sabrina C. Eimler, Lukas Erle, Daniel Flood, Aditi Haiman, Luca H\"ackert, Andr\'e Helgert, Lachlan McGinness, B\"usra Yapici
arXiv AI
Jul 3

The Rising Unsustainability of AI Graphics Cards Production

arXiv:2607. 01258v1 Announce Type: cross Abstract: The rapid advancement of Artificial Intelligence (AI) has been accompanied by significant increases in computational and environmental costs, driven by large-scale investments in AI infrastructure, hardware, and software.

By Cl\'ement Morand, Aur\'elie N\'ev\'eol, Anne-Laure Ligozat
arXiv Machine Learning
Jul 8

Life Cycle Assessment of Pre-training the Lucie 7B Open-Source Large Language Model on the Jean Zay Supercomputer

arXiv:2607. 05408v1 Announce Type: cross Abstract: The environmental impact of training large language models (LLMs) is increasingly scrutinised, yet most published estimates focus on operational energy and disclose little about manufacturing (embodied) emissions, water consumption, or the underlying highperformance computing (HPC) infrastructure.

By Marc L\'eobet, Pierre-Fran\c{c}ois Lavall\'ee, Jean-Pierre Lorr\'e
arXiv AI
Jun 29

WattLayer: Get Layers Right to Estimate Inference Energy of Neural Networks

arXiv:2606. 27841v1 Announce Type: cross Abstract: The widespread adoption of Artificial Intelligence (AI) has led to increasing concerns about energy consumption, yet there is a lack of standardized methodologies to accurately estimate AI inference energy consumption, particularly across various tasks and architectures.

By Adrien Sardi, Marie-Line Alberi Morel, Sara Alouf, Fr\'ed\'eric Giroire, Joanna Moulierac
arXiv Machine Learning
Jul 13

A Survey on the Green Development of Large Models: From Resource-Efficient Architectures to Hardware-Software Co-Design

arXiv:2607. 09084v1 Announce Type: new Abstract: The rapid expansion of large-scale AI models has led to significant performance breakthroughs across diverse domains, yet it has also raised critical concerns regarding computational costs, energy consumption, and environmental sustainability.

By Linhui Xiao, Guiping Cao, Mingyue Guo, Xianchao Guan, Fan Yang, Ming Tao, Xin Li, Yuxin Peng, Yaowei Wang
arXiv AI
5d ago

InFactPlanner: Planning Sustainable Geo-Distributed LLM Data Centers

arXiv:2608. 12915v1 Announce Type: cross Abstract: The rapid growth of LLM inference is shifting sustainability concerns from one-time training to continuous serving, where infrastructure decisions shape energy use, carbon emissions, water consumption, and service quality.

By Nicoletta Tsiopani, Moysis Symeonides, George Pallis, Marios D. Dikaiakos
arXiv Machine Learning
5d ago

Performance-Carbon Trade-Offs across Architectural Biases in Shear Flow Forecasting

arXiv:2509. 24517v3 Announce Type: replace Abstract: Development of modern deep learning methods has been driven primarily by the push for improving model efficacy (accuracy metrics), leading to large-scale models that require massive computational resources and result in considerable carbon footprint across the model lifecycle.

By Sophia N. Wilson, Jens Hesselbjerg Christensen, Raghavendra Selvan
OpenAI Blog
May 16, 2018

AI and compute

We’re releasing an analysis showing that since 2012, the amount of compute used in the largest AI training runs has been increasing exponentially with a 3. 4-month doubling time (by comparison, Moore’s Law had a 2-year doubling period)[^footnote-correction].