arXiv AI
Oct 31

LLM-PowerTrace: A Dataset of Time-Resolved GPU Power Traces for AI Compute

LLM-PowerTrace is an open dataset that provides time‑resolved, per‑GPU power traces for large language model fine‑tuning and inference. The traces are sampled every 100 ms across various NVIDIA platforms and include detailed workload and system metadata. The dataset covers a wide range of model families, sizes, and controlled sweeps over batch size, sequence length, precision, parallelism, checkpointing, concurrency, GPU frequency, KV‑cache and weight quantization, prompt and output lengths, and request‑arrival patterns, and it defines power‑grid‑facing metrics and an AI‑compute power & energy scaling law.

By Jiansheng Wang, Jaskeerat Singh, Haochen Xu, Xinyi Li, Mingyuan Yan, Shaohui Liu, Yuzhuo Li, Yize Chen, Wenqi Cui