arXiv Machine Learning
Federated stochastic bilevel optimization with fully first-order gradients
Read the original on arXiv Machine Learning →The Flow has not summarised this story yet — read it at arXiv Machine Learning.
Related stories
arXiv Machine Learning
Jun 16
A Fully First-Order Layer for Differentiable Optimization
arXiv:2512. 02494v2 Announce Type: replace Abstract: Differentiable optimization layers enable learning systems to make decisions by solving embedded optimization problems.
arXiv Machine Learning
Jul 24
Non-Stationary Functional Bilevel Optimization
arXiv:2601. 15363v2 Announce Type: replace-cross Abstract: Functional bilevel optimization (FBO) provides a powerful framework for hierarchical learning in function spaces, yet current methods are limited to static offline settings and perform suboptimally in online, non-stationary scenarios.
arXiv Machine Learning
Jul 14
A Provably Convergent Plug-and-Play Framework for Stochastic Bilevel Optimization
arXiv:2505. 01258v2 Announce Type: replace-cross Abstract: Bilevel optimization has recently attracted significant attention in machine learning due to its wide range of applications and advanced hierarchical optimization capabilities.
arXiv Machine Learning
Jun 18
Stochastic Adaptive Gradient Descent Without Descent
arXiv:2509. 14969v2 Announce Type: replace Abstract: We introduce a new adaptive step-size strategy for convex optimization with stochastic gradient that exploits the local geometry of the objective function only by means of a first-order stochastic oracle and without any hyper-parameter tuning.
arXiv Machine Learning
Sep 10
Stochastic Nonconvex Bilevel Optimization: Improved Rates Without Rare-Visit Assumption
arXiv:2609. 06580v1 Announce Type: cross Abstract: We investigate stochastic simple bilevel optimization with smooth and possibly nonconvex upper- and lower-level objectives.
arXiv Machine Learning
Jun 19
Federated Bilevel Performative Prediction
arXiv:2606. 19734v1 Announce Type: new Abstract: Federated bilevel optimization is widely used for nested learning problems across distributed clients, such as federated hyperparameter tuning and meta-learning under privacy and communication constraints.