Hugging Face Blog
GPU Management: Why Idle GPUs Are the New Grounded Aircraft
Read the original on Hugging Face Blog →The Flow has not summarised this story yet — read it at Hugging Face Blog.
Related stories
arXiv AI
Jun 2
How Much Progress Has There Been in NVIDIA Datacenter GPUs?
arXiv:2601. 20115v3 Announce Type: replace-cross Abstract: As the role of modern Graphics Processing Units (GPUs) becomes increasingly essential for several computing tasks, analyzing their past and current progress is paramount for determining future constraints on scientific research.
Towards Data Science
Jul 21
How Much of a Data Science Workflow Can Run on a GPU Today? Part 1: Accelerating Data Preparation
Exploring GPU acceleration with cuDF, cudf. pandas, and the Polars GPU Engine The post How Much of a Data Science Workflow Can Run on a GPU Today?
Towards Data Science
Jun 11
When GPU Utilization Lies: The Hidden Systems Problem Slowing Modern AI
Why “average utilization” lies about how full your GPUs really are The post When GPU Utilization Lies: The Hidden Systems Problem Slowing Modern AI appeared first on Towards Data Science .
Hugging Face Trending Papers
Jul 2
WattGPU: Predicting Inference Power and Latency on Unseen GPUs and LLMs
Large Language Model (LLM) inference workloads are a rapidly growing contributor to data center energy consumption. Optimizing these deployments requires matching specific LLMs to the most efficient GPUs, but operators currently lack the tools to do so without exhaustively profiling each combination.
arXiv Machine Learning
Jul 3
WattGPU: Predicting Inference Power and Latency on Unseen GPUs and LLMs
arXiv:2607. 02391v1 Announce Type: cross Abstract: Large Language Model (LLM) inference workloads are a rapidly growing contributor to data center energy consumption.
arXiv AI
Aug 18
DumpsterCluster: From Dumpster Diving to Serving LLaMA-70B on $60 GPUs
arXiv:2608. 14614v1 Announce Type: cross Abstract: As AI datacenters retire functional GPUs, vast quantities of still capable accelerators enter secondary markets.