arXiv AI September 12, 2026 By Philip Colangelo, Charles Dawson, Shayan Sengupta, Ayse Coskun, Varun Sivaram

Characterizing Job Power Elasticity for Power-Flexible AI Training

The paper introduces the Power Flexibility Index (PFI) to measure how large language model (LLM) training performance changes when GPU power is reduced. Using 131 training runs on H200 and H100 GPUs, the study finds that LLM jobs have significant but variable power elasticity and identifies telemetry signals that can predict PFI during runtime. The authors demonstrate that allocating power based on PFI maximizes overall token throughput, recovering about 1.5k tokens/s per job under a 30% power reduction, which represents 63% of the gap between equal-weight and perfect-information allocations.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv AI

Aug 13

Cutting AI Datacenter Energy with Reinforcement Learning: Measured Power Control of LLM Training from One GPU to the Fleet

arXiv:2608. 11226v1 Announce Type: new Abstract: Reinforcement-learning post-training dominates modern language-model development, yet its power behavior on GPU hardware has not been characterized, and datacenters manage GPU power with workload-blind mechanisms, static caps and reactive throttling, that slow hardware indiscriminately.

By Eliseo Curcio

llms reinforcement-learning efficiency

arXiv AI

Jul 22

CWind: A Cross-site Router for Large Language Model Inference Serving at Renewable Energy Farms

arXiv:2605. 23348v2 Announce Type: replace-cross Abstract: AI power demand is growing at an unprecedented rate while power grids are often ailing and struggle to keep up.

By Tella Rajashekhar Reddy, Atharva Deshmukh, Liangcheng Yu, Chaojie Zhang, Mike Shepperd, Rohan Gandhi, Anjaly Parayil, Srinivasan Iyengar, Ajay Manchepalli, Debopam Bhattacherjee

llms efficiency

Hugging Face Trending Papers

Jul 2

WattGPU: Predicting Inference Power and Latency on Unseen GPUs and LLMs

Large Language Model (LLM) inference workloads are a rapidly growing contributor to data center energy consumption. Optimizing these deployments requires matching specific LLMs to the most efficient GPUs, but operators currently lack the tools to do so without exhaustively profiling each combination.

llms

arXiv Machine Learning

Jul 3

WattGPU: Predicting Inference Power and Latency on Unseen GPUs and LLMs

arXiv:2607. 02391v1 Announce Type: cross Abstract: Large Language Model (LLM) inference workloads are a rapidly growing contributor to data center energy consumption.

By Mauricio Fadel Argerich, Jonathan F\"urst, Marta Pati\~no-Mart\'inez

llms

arXiv Machine Learning

Jul 30

From Tokens to Watt-hours: Analytical Energy Estimation for LLM Inference on Modern GPUs

arXiv:2607. 26571v1 Announce Type: new Abstract: The operational energy consumption of large language model (LLM) inference is becoming an increasingly important component of the environmental footprint of deployed AI systems.

By Tina Vartziotis, Rodopi Kosteli, Elli Vartziotis, George Dasoulas, Michael Keckeisen, Konstantinos Skianis, Sotirios Kotsopoulos, Francesca Dominici

llms

arXiv Machine Learning

Aug 31

Characterization of Request and Token Energy Costs for LLM Inference Workloads on GPU Platforms

arXiv:2608.28044v1 Announce Type: cross Abstract: Large language model (LLM) inference serving is priced by tokens, but GPU energy is consumed over inference windows. This accounting mismatch makes t...

By Prabhu Vellaisamy, Vanessa Lam, Shawn Blanton, John Paul Shen

llms

One email a morning, machine-written

Related stories

Cutting AI Datacenter Energy with Reinforcement Learning: Measured Power Control of LLM Training from One GPU to the Fleet

CWind: A Cross-site Router for Large Language Model Inference Serving at Renewable Energy Farms

WattGPU: Predicting Inference Power and Latency on Unseen GPUs and LLMs

WattGPU: Predicting Inference Power and Latency on Unseen GPUs and LLMs

From Tokens to Watt-hours: Analytical Energy Estimation for LLM Inference on Modern GPUs

Characterization of Request and Token Energy Costs for LLM Inference Workloads on GPU Platforms