arXiv Machine Learning By Ian D'Ambrosio (Nth Research Collective)

A Constant-Competitive Algorithm for Dynamic Mixture-of-Experts Serving

Read the original on arXiv Machine Learning →

arXiv:2608. 16947v1 Announce Type: cross Abstract: Huang, Lou, and Xiao introduced Dynamic Mixture-of-Experts Serving and gave an O(sqrt(log k))-competitive randomized algorithm for its integral primal problem, where k is the number of replica GPUs beyond the mandatory copy of each expert.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv Machine Learning
Oct 3

Sharp Oracle-Regret Tradeoffs for Projection-Free Online Convex Optimization

The paper studies online convex optimization when the learner can only query an exact linear optimization oracle. It establishes a dimension‑free minimax expected regret bound of θ(GD max{√T, T/(1+min{Q,BT})^{1/4}}) for convex G‑Lipschitz losses, where Q is the total oracle budget and B the per‑round limit. The authors provide matching lower and upper bounds, showing how strict per‑round or total‑budget constraints affect the achievable regret, and extend the analysis to smooth losses with curvature‑dependent bounds.

By Vaneet Aggarwal
arXiv Machine Learning
Oct 16

Rethinking Successive Rejects Algorithms

The paper revisits the Successive Rejects (SR) algorithm for best‑arm identification, showing that although SR appears non‑adaptive due to fixed phase lengths, it achieves an optimal worst‑instance error exponent for Gaussian arms with common variance. The authors formulate an optimization problem to design a phase schedule that maximizes the normalized error exponent, leading to a new variant called H1‑balanced Successive Rejects (H1‑SR). H1‑SR attains at least 11/12 of the optimal normalized rate for all K ≥ 2, approaching the optimum as K grows, and experiments demonstrate significant performance gains over the original SR while highlighting trade‑offs in early elimination strategies.

By Mohamed Khair, Junpei Komiyama