arXiv Machine Learning

A Deterministic Constant-Competitive Algorithm for Dynamic Mixture-of-Experts Serving

arXiv Machine Learning
Sep 22

Leveraging Inference-Time Compute for Diffusion Models via Global Scheduling of Denoising Trajectories

The paper studies how to allocate a fixed computational budget across the denoising steps of diffusion models to improve sample quality at deployment. It shows that the expected benefit of evaluating multiple candidates at a step can be decomposed into a step‑specific sensitivity and a universal sample‑size factor, and that the optimal allocation follows a water‑filling structure. Experiments demonstrate that this allocation achieves the same quality as a uniform strategy while reducing function evaluations by 20–50%.

By Yuan Cao, Yifu Tang, Hangqi Li, Zeyu Zheng
arXiv Machine Learning
Oct 22

Learning to Allocate Resources with Censored Feedback

The paper addresses an online resource allocation problem where a budget must be distributed among multiple arms under censored feedback. Each arm yields a reward only if it is activated by an unknown Bernoulli process and the allocated budget exceeds a random threshold from an unknown parametric distribution. The authors establish a worst‑case regret lower bound of Σ(√T), propose the RA‑UCB algorithm achieving near‑optimal regret when the budget is known, and introduce MG‑UCB for unknown, round‑dependent budgets, validating both approaches experimentally.

By Giovanni Montanari, C\^ome Fiegel, Corentin Pla, Aadirupa Saha, Vianney Perchet
arXiv Machine Learning
Sep 14

Quality-Constrained Routing over a Fixed Pool of Quantized Mixture-of-Experts Instances

The paper proposes a method for routing requests to a fixed pool of quantized Mixture-of-Experts (MoE) instances, aiming to maximize throughput while respecting a quality‑degradation budget. It introduces Fragility‑Weighted Perplexity (FWP) as a request‑specific risk metric derived from prompt tokens, and uses a window‑level linear program to compute a reduced‑reward score that aligns with the LP optimum. Experiments on Qwen prompts show that FWP‑based allocation improves throughput by 2.5% over request‑agnostic mixing and static configurations.

By Zhenghong Huang, Hongfan Wu, Jiheng Zhang
arXiv Machine Learning
Oct 12

Simultaneous Competitive and Regret Guarantees for TCP Acknowledgment

The paper investigates TCP acknowledgment strategies that aim to minimize both acknowledgment and waiting costs. It establishes that no deterministic online algorithm can achieve a competitive ratio better than 2, and shows that achieving sublinear regret requires at least $k$ randomized online experts.

By Tsubasa Harada, Yasushi Kawase, Hanna Sumita