arXiv Machine Learning

Sustainability of TSFM Deployment and Pretraining: From Carbon Footprint Analysis to Mitigation via Pruning

arXiv Machine Learning
Sep 18

The Environmental Impacts of Language Model Training Keep Rising Now is the Time to Catch Impacts on the Rebound

The paper analyzes the environmental footprint of machine learning model training, focusing on large language models and their hardware. It finds that energy use and environmental impacts have risen exponentially over the past decade, even when employing carbon‑efficient electricity and more efficient hardware. The study argues that optimization strategies alone cannot curb these impacts due to a rebound effect, and stresses the need to evaluate hardware life‑cycle impacts and integrate environmental metrics into NLP research practices.

By Cl\'ement Morand (STL), Anne-Laure Ligozat (ENSIIE, LISN, STL), Aur\'elie N\'ev\'eol (STL, LISN)
arXiv Machine Learning
Aug 14

Performance-Carbon Trade-Offs across Architectural Biases in Shear Flow Forecasting

arXiv:2509. 24517v3 Announce Type: replace Abstract: Development of modern deep learning methods has been driven primarily by the push for improving model efficacy (accuracy metrics), leading to large-scale models that require massive computational resources and result in considerable carbon footprint across the model lifecycle.

By Sophia N. Wilson, Jens Hesselbjerg Christensen, Raghavendra Selvan
arXiv AI
Oct 2

Beyond State-of-the-Art: Standardising Environmental Impact Metrics for AI Research

The paper highlights that as Large Language Models grow in capability and prevalence, their environmental footprint is increasing, yet the machine learning community lacks standardized carbon accounting practices. An automated review of 5,285 NeurIPS 2025 papers shows almost no reporting of environmental impact. To address this, the authors propose standardized sustainability metrics for training efficiency, heuristics for estimating inference carbon costs, a software tool called carbonbenchmark for tracking emissions, and the SMAJ framework to encourage prioritizing computational efficiency and environmental accountability over marginal accuracy gains.

By Lachlan McGinness, Dan Pagendam, Robert Offner
arXiv Machine Learning
Oct 12

How Much Computation Does Every Forecast Need? Structured Block Skipping in Two Time-Series Foundation Models

The paper investigates whether entire Transformer blocks can be skipped during inference in two time‑series foundation models, Chronos‑Bolt and TimesFM 2.5. By applying block‑level masks selected on calibration windows, the authors show that moderate sparsity (e.g., 7/11 blocks for Chronos‑Bolt and 16/20 for TimesFM) preserves forecasting quality while reducing latency by roughly 11–13%. However, more aggressive skipping degrades performance on certain datasets, and dynamic, input‑dependent routing remains unproven across architectures.

By Max Bourgeat