arXiv Machine Learning By Leo Fan, Hongyang Wang, Wenbo Chen, Jingguo Liu, Xian Li, Xuan Wang, Ruochen Wen, Yiming Yan, Hao Wu, Yichuan Li, Qian Qu, Zheshen Wang, Benoit Dumoulin

ATTUNE: Agentic Throughput Tuning for LLM Training

Read the original on arXiv Machine Learning →

ATTUNE is a coding agent that automatically tunes large‑language‑model training recipes within a GPU‑hour budget, adjusting one lever at a time guided by search rules, scripts, and past tuning lessons. It includes a correctness gate that blocks any configuration known to alter the training objective. In Amazon’s production, ATTUNE raises throughput by an average of 1.7× on H100, H200, and B200 clusters and outperforms NVIDIA’s AutoModel benchmark recipes and other automated tuners, achieving up to 2.6× improvement on MiniMax‑M2 and more than four times the best alternative on GLM‑4.5.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv AI
Sep 30

KLineage: Recovering the Missing When of Kernel Optimization by Deoptimizing Experts

arXiv:2605.28213v2 Announce Type: replace Abstract: LLM-based agents are increasingly used to generate GPU kernels, but they often struggle to determine when an optimization is sound because its requ...

By Shuoming Zhang, Qiuchu Yu, Ruiyuan Xu, Chenjing Zhang, Junjie Peng, Zhicheng Xie, Yangyu Zhang, Xiyu Shi, Ying Liu, Guangli Li, Xiaobing Feng, Huimin Cui, Xingjun Zhang, Jiacheng Zhao
arXiv AI
Sep 16

Ave: Guiding Agentic GPU Optimization Using Data-Flow Invariants

arXiv:2604.18616v2 Announce Type: replace-cross Abstract: LLM coding agents can generate correct GPU kernels, but their performance still trails expert libraries. Reaching peak throughput requires co...

By Haohui Mai, Xiaoyan Guo, Xiangyun Ding, Daifeng Li, Qiuchu Yu, Chenzhun Guo, Cong Wang, Jiacheng Zhao, Christos Kozyrakis, Binhang Yuan