The study investigates whether coding agents can reliably migrate PyTorch machine learning projects from GPUs to TPUs. Using Claude Code, ten projects were migrated, with eight meeting the project‑goal criterion but 76% of execution attempts failing, often due to compilation issues or silent changes in computation. The research highlights significant human effort (average 2.4 interventions) and variable costs, noting that while some TPUs can be faster and cheaper, failures and accuracy drops remain common.
arXiv:2608. 12629v1 Announce Type: new Abstract: GPU kernel agents and GPU programming languages have advanced separately, leaving expert kernels difficult to reproduce.
arXiv:2607. 14541v1 Announce Type: new Abstract: Existing GPU kernel generation benchmarks draw problems from synthetic or curated sources that diverge from deployed workloads.
arXiv:2609.34818v2 Announce Type: replace-cross Abstract: AlphaFold2 is written in JAX, so the same inference code compiles and runs unchanged on CPUs, GPUs and Google Cloud TPUs. That portability ma...
arXiv:2604.18616v2 Announce Type: replace-cross Abstract: LLM coding agents can generate correct GPU kernels, but their performance still trails expert libraries. Reaching peak throughput requires co...
TrainBridge is an agentic approach that transfers optimization guidance from GPU training to Ascend NPU training. It extracts optimization intents from highly optimized GPU execution and uses them to rewrite NPU programs, then refines these rewrites through iterative profiling. Experiments show that TrainBridge yields an average 1.7× speedup across four workloads and nearly 2.0× speedup on 27 Modded‑NanoGPT speedrun records.
The paper investigates how the skill paradigm—using modular abilities within agentic frameworks—works with small to medium open‑source language models (270 M–80 B parameters) in industrial, resource‑constrained settings. A large‑scale empirical study on an insurance‑claim classification task and a set of Python programming problems shows that very small models often fail to retrieve or select correct skills, while larger 30 B–80 B models benefit significantly from skill augmentation. The authors also present a deployment‑oriented GPU profile, reporting VRAM time occupancy (GB·min) across models, to help characterize GPU‑memory costs for different model scales. "whyItMatters":"The study provides concrete evidence on how skill augmentation scales with model size, task complexity, and GPU budget, offering practical deployment insights for industrial applications using open‑source language models."
arXiv:2610.14009v1 Announce Type: cross Abstract: Large AI models increasingly rely on distributed GPU execution, yet it remains unclear whether established failure analysis methods transfer effectiv...
arXiv:2610.03226v1 Announce Type: cross Abstract: GPU kernels generated by large language model (LLM) agents can remain less efficient than expert implementations, but runtime alone does not reveal h...
arXiv:2608. 01563v1 Announce Type: new Abstract: Training and deployed inference often cross export, conversion, and platform-specific runtime boundaries.
KernelGenBench is a unified benchmark that evaluates large language models and agentic systems for generating efficient Triton kernels across diverse operator sources and hardware platforms. It covers 210 operators from PyTorch ATen, vLLM, and cuBLAS, and tests a 110‑operator subset on six different chips, consuming over 15 billion tokens in evaluation. The study finds that no single method dominates across all sources and platforms, with significant variations in correctness and performance depending on the operator source and hardware, and that agentic approaches require millions of tokens per successful operator.
arXiv:2604. 23466v2 Announce Type: replace Abstract: NVIDIA's CUDA Tile (CuTile) introduces a Python-based, tile-centric abstraction for GPU kernel development that aims to simplify programming while retaining Tensor Core and Tensor Memory Accelerator (TMA) efficiency on modern GPUs.
InfraDev is a new benchmark comprising 36 tasks derived from real-world pull requests to Megatron‑LM, vLLM, and verl, designed to test coding agents on infrastructure development for training, inference, and reinforcement learning across many GPUs. Each task requires agents to reimplement multi‑file changes and run correctly, with grading that includes hidden probes and a prompt exposing only the interfaces used. The benchmark reveals that current frontier models resolve only about 39% of tasks, with probes rejecting a third of submissions that pass official tests, and that structural and state errors dominate failures.