Case Study: Millisecond Latency using Hugging Face Infinity and modern CPUs

Hugging Face and AMD partner on accelerating state-of-the-art models for CPU and GPU platforms

Intel and Hugging Face Partner to Democratize Machine Learning Hardware Acceleration

Hugging Face Models on Foundry Managed Compute

Accelerating over 130,000 Hugging Face models with ONNX Runtime

Hand-Written PTX Tensor-Core GEMM Kernels: A Multi-Precision Study on NVIDIA L4

arXiv:2608. 10103v1 Announce Type: cross Abstract: High-performance Tensor Core kernels rely on a low-level PTX pipeline built from asynchronous data movement with cp.

UBEP: Re-architecting Expert Parallelism Communication Library for Production Superpods

arXiv:2607. 06202v1 Announce Type: cross Abstract: The deployment of Mixture-of-Experts (MoE) models on production high-bandwidth superpods, such as NVIDIA's NVL72/576 and Huawei's CloudMatrix384, introduces critical challenges beyond raw interconnect bandwidth.

CTA-Pipelining: A Latency-Oriented Spatial Scaling Method for Multi-GPU Systems

arXiv:2607. 07862v1 Announce Type: cross Abstract: The evolution of compute infrastructure has transformed multi-GPU systems into tightly integrated shared-memory structures.

Metronome: Bound the Cache, Keep the Beat for Real-Time Interaction Model Serving

arXiv:2607. 02640v1 Announce Type: cross Abstract: Real-time interaction models -- Moshi, MiniCPM-o, Qwen-Omni -- turn serving into a periodic real-time task: on every frame a session ingests streaming audio and must respond by a recurring wall-clock deadline, while its KV cache grows monotonically and stays pinned for the whole conversation.

Fetch Cuts ML Processing Latency by 50% Using Amazon SageMaker & Hugging Face

FusionML: Prefill, Not Decode - Mechanism and Boundaries of CPU+GPU Co-Execution on Unified-Memory Apple Silicon

arXiv:2607. 22785v1 Announce Type: cross Abstract: Apple-Silicon SoCs share CPU, GPU, and Neural Engine over one unified memory system, raising the question of whether transformer inference can be accelerated by splitting single operators across units.

CPU Optimized Embeddings with 🤗 Optimum Intel and fastRAG

Bringing serverless GPU inference to Hugging Face users