arXiv Machine Learning
Jun 11

Robustness of Mixtures of Experts to Feature Noise

arXiv:2601. 14792v2 Announce Type: replace Abstract: Despite their practical success, it remains unclear why Mixture of Experts (MoE) models can outperform dense networks beyond sheer parameter scaling.

By Dong Sun, Rahul Nittala, Rebekka Burkholz