The Flow has not summarised this story yet — read it at Hugging Face Trending Papers.
The paper presents a fine‑grained monitoring study of a university GPU cluster, collecting data at 100 ms intervals using a lightweight tool built on Nvidia’s DCGM library. Analysis of a 10‑day period with 7,399 jobs shows that over 70 % of jobs use less than 20 % of GPU memory and 50 % have below 5 % SM utilization, while 80 % of jobs experience a large mismatch between requested and actual runtimes. The authors also observe highly periodic communication patterns in multi‑GPU jobs, indicating that significant performance gains could be achieved through improved scheduling and multitasking rather than hardware upgrades.
The paper introduces PWR, a scheduling policy that selects power‑efficient GPU and CPU combinations to reduce power consumption in GPU datacenters. It complements the existing Fragmentation Gradient Descent (FGD) policy, which mitigates GPU fragmentation by using a fragmentation metric. Experiments in a simulated cluster show that combining PWR with FGD balances power savings and fragmentation reduction.
arXiv:2605. 09370v3 Announce Type: replace-cross Abstract: Large-scale AI training is now fundamentally a distributed systems problem, and hardware failures have become routine operating conditions rather than rare exceptions.
arXiv:2610.28223v1 Announce Type: cross Abstract: Large language models can solve complex problems across a variety of subjects, such as mathematics and coding. For such complex analytical tasks, mod...
arXiv:2604. 10180v2 Announce Type: replace-cross Abstract: Disaggregation maps parts of an AI workload to different types of GPUs, offering a path to utilize modern heterogeneous GPU clusters.