arXiv:2604. 01489v2 Announce Type: replace Abstract: High-performance GPU kernels are critical to modern machine learning systems, yet developing them remains a manual, expert-driven process.
arXiv:2607. 16241v1 Announce Type: cross Abstract: Recent large language models (LLMs) can generate custom CUDA kernels that appear to outperform PyTorch on benchmarks such as KernelBench.
arXiv:2608. 00029v1 Announce Type: cross Abstract: The performance of deep learning models at scale relies heavily on how effectively high-level mathematical operations are mapped to underlying physical hardware.
DataKernelBench evaluates whether large language models (LLMs) can optimize database queries for GPU execution. The benchmark translates SQL into PyTorch TorchPlan programs and tests LLMs on optimizing core tensor snippets or full queries in CUDA or Triton, using execution-guided repair. On TPC‑H SF10 with an H100 GPU, the best full‑query CUDA configuration outperforms torch.compile by 2.11×, and extending TorchPlan with Dask‑cuDF enables a 2.54× speedup on TPC‑H SF100 across four H100 GPUs.
arXiv:2607. 24762v1 Announce Type: new Abstract: Machine learning models are increasingly embedded in everyday software, and most of their runtime is spent in a small set of compute kernels such as matrix multiplication, convolution, and normalization.
arXiv:2604. 23466v2 Announce Type: replace Abstract: NVIDIA's CUDA Tile (CuTile) introduces a Python-based, tile-centric abstraction for GPU kernel development that aims to simplify programming while retaining Tensor Core and Tensor Memory Accelerator (TMA) efficiency on modern GPUs.
arXiv:2606. 04023v1 Announce Type: cross Abstract: While large language models (LLMs) have been extensively evaluated on code generation tasks for general-purpose programming and GPU-accelerated environments (e.
KernelFoundry is a hardware‑aware evolutionary framework that optimizes GPU kernels by combining MAP‑Elites quality‑diversity search, meta‑prompt evolution, and template‑based parameter tuning. It generates SYCL and CUDA kernels, outperforming baseline methods with an average 2.3× speedup on KernelBench. The system is distributed, supports remote hardware access, and offers a flexible user interface for diverse real‑world kernel generation tasks.
arXiv:2606. 26453v1 Announce Type: new Abstract: We present KernelPro, a closed-loop multi-agent system that automatically generates, profiles, and iteratively optimizes GPU kernel code by integrating large language model (LLM) code generation with hardware profiler feedback and pluggable bottleneck detection tools.
KernelArc is a multi-agent framework designed to autonomously optimize GPU kernels across diverse workloads. It employs strategy-specialized agents that run concurrently, coordinating via conclusions-only shared memory, a deterministic benchmark guard, and read-only cross-agent state with plateau-triggered drafting. Evaluated on NVIDIA H100 and B200 GPUs with SOL-ExecBench workloads, KernelArc produced top-ranked implementations for tasks such as BF16 GEMM, cuBLASLt configuration tables, and various attention mechanisms, achieving first place on several leaderboard categories.
arXiv:2606. 02963v1 Announce Type: new Abstract: Production inference increasingly targets a heterogeneous mix of accelerators.
Meta’s paper details how the company optimizes AI training on AMD GPUs by co‑designing hardware and models, using an analytical performance model for kernel selection, and extending agentic workflows for microarchitecture‑aware optimizations. The authors compare AMD Instinct MI350X to NVIDIA B200 on a recommendation model, achieving up to 1.5× higher training throughput. Their methods, the first hyperscaler report on productionizing AMD GPUs for large‑scale training, have been incorporated into open‑source PyTorch, Triton, and ROCm.