KernelFoundry is a hardware‑aware evolutionary framework that optimizes GPU kernels by combining MAP‑Elites quality‑diversity search, meta‑prompt evolution, and template‑based parameter tuning. It generates SYCL and CUDA kernels, outperforming baseline methods with an average 2.3× speedup on KernelBench. The system is distributed, supports remote hardware access, and offers a flexible user interface for diverse real‑world kernel generation tasks.
arXiv:2605. 30359v2 Announce Type: replace-cross Abstract: Generating high-performance GPU kernels remains challenging due to the need for both correctness and hardware-aware optimization.
arXiv:2604. 01489v2 Announce Type: replace Abstract: High-performance GPU kernels are critical to modern machine learning systems, yet developing them remains a manual, expert-driven process.
The paper introduces AutoProfiler, a feedback-driven framework that learns a deterministic profiling tree for GPU kernel optimization. By iteratively refining the tree with REWRITE and SPLIT operations guided by an LLM and empirical evaluation, it selects the most useful profiling metrics for each kernel rather than relying on a fixed set. Experiments on KernelBench demonstrate that this adaptive profiling approach outperforms static configurations under limited profiling budgets.
Large language models have recently shown strong potential for automatically optimizing GPU kernels, yet their effectiveness depends critically on the hardware information available to the kernel opti...
arXiv:2512. 23236v4 Announce Type: replace-cross Abstract: Making deep learning recommendation model (DLRM) training and inference fast and efficient is important.
arXiv:2607. 14541v1 Announce Type: new Abstract: Existing GPU kernel generation benchmarks draw problems from synthetic or curated sources that diverge from deployed workloads.
arXiv:2608. 02611v1 Announce Type: cross Abstract: Automating GPU kernel optimization remains difficult in practice: generated variants can violate correctness constraints, runtime measurements are noisy, and search often stalls early.
arXiv:2606. 26453v1 Announce Type: new Abstract: We present KernelPro, a closed-loop multi-agent system that automatically generates, profiles, and iteratively optimizes GPU kernel code by integrating large language model (LLM) code generation with hardware profiler feedback and pluggable bottleneck detection tools.
arXiv:2606. 02963v1 Announce Type: new Abstract: Production inference increasingly targets a heterogeneous mix of accelerators.
arXiv:2607. 16241v1 Announce Type: cross Abstract: Recent large language models (LLMs) can generate custom CUDA kernels that appear to outperform PyTorch on benchmarks such as KernelBench.
arXiv:2607. 17979v1 Announce Type: cross Abstract: Large language models (LLMs) can assist GPU kernel generation, but their practical effectiveness depends on whether generated code can be reliably constrained, validated, profiled, and selected.
arXiv:2607. 27231v1 Announce Type: cross Abstract: Large language models (LLMs) have significantly increased the demand for efficient accelerator kernels, but kernel development remains a highly specialized and labor-intensive task.