arXiv Machine Learning By Mengyuan Fan, Peizhuang Cong, Zixiao Huang, Si Xu, Tong Qiao, Yanghao Li, Jing Yang, Tong Yang, Quanlu Zhang, Yu Wang

HAPMoE: Heterogeneity-Aware Automatic Parallelism Planning for Mixture-of-Experts Models Training

Read the original on arXiv Machine Learning →

The Flow has not summarised this story yet — read it at arXiv Machine Learning.

arXiv AI
Jun 9

Meeting SLOs, Slashing Hours: Automated Enterprise LLM Optimization with OptiKIT

arXiv:2601. 20408v2 Announce Type: replace-cross Abstract: Enterprise LLM deployment faces a critical scalability challenge: organizations must optimize models systematically to scale AI initiatives within constrained compute budgets, yet the specialized expertise required for manual optimization remains a niche and scarce skillset.

By Nicholas Santavas, Kareem Eissa, Patrycja Cieplicka, Piotr Florek, Matteo Nulli, Stefan Vasilev, Seyyed Hadi Hashemi, Antonios Gasteratos, Shahram Khadivi
arXiv AI
6d ago

LM-SimBench: A Unified Framework, Dataset, and Benchmark for Large Language Model Training Simulation

LM‑SimBench is a unified framework, dataset, and benchmark designed to evaluate large language model training simulators. It decomposes simulation into functional stages—from model compilation to schedule‑level aggregation—and connects execution representations with cost estimators to measurable targets. The authors profiled 23 model settings across 10 dense and Mixture‑of‑Experts families on an Ascend NPU cluster, producing a dataset of 348 feasible configurations that vary five parallelism dimensions and activation recomputation, and used it to compare simulators, assess configuration selection, and diagnose prediction errors, with cross‑platform validation on GPUs.

By Yu Dong, Hong Li, Qiang Sun, Xu Zhou, Jinbiao Huo, Qixiu Cheng, Zhiyuan Liu