arXiv:2609. 23837v1 Announce Type: cross Abstract: We study the complexity of finding $(\delta,\epsilon)$-Goldstein stationary points of nonsmooth nonconvex Lipschitz functions.
By Guy Kornowski
arXiv:2504.09409v3 Announce Type: replace-cross
Abstract: In this paper, we study nonconvex constrained stochastic zeroth-order optimization problems with exact constraints and stochastic objective e...
By Qiankun Shi, Han Yuan, Xiao Wang, Hao Wang
arXiv:2610. 13787v1 Announce Type: cross Abstract: We present new algorithms for stochastic optimization problems in which the objective is neither smooth nor convex, subject to a convex constraint set.
By Gon Buzaglo, Guy Kornowski
arXiv:2609.30499v1 Announce Type: new
Abstract: Uniform noise-moment bounds exclude stochastic gradients whose variability increases with the iterate. We study ordinary, single-sample stochastic grad...
By Wei Biao Wu
arXiv:2610.01662v1 Announce Type: cross
Abstract: We establish complexity lower bounds for stochastic first-order algorithms in nonconvex--concave minimax optimization, allowing algorithms to use var...
By Jiayi Song, Zi Xu
arXiv:2606. 05438v1 Announce Type: new Abstract: We study the deterministic first-order oracle complexity of finding \(\epsilon\)-stationary points in smooth nonconvex optimization when the objective satisfies higher-order smoothness assumptions.
By Dongruo Zhou
arXiv:2504. 09409v2 Announce Type: replace-cross Abstract: In this paper, we study nonconvex constrained stochastic zeroth-order optimization problems, for which we have access to exact information of constraints and noisy function values of the objective.
By Qiankun Shi, Han Yuan, Xiao Wang, Hao Wang
arXiv:2511. 19656v3 Announce Type: replace Abstract: Although upper bound guarantees for bilevel optimization have been widely studied, progress on lower bounds has been limited due to the complexity of the bilevel structure.
By Kaiyi Ji
arXiv:2610. 12328v1 Announce Type: new Abstract: We consider stochastic nonsmooth nonconvex composite optimization, which includes several important problems such as constrained optimization and the regularized training of neural networks.
By Mingyi Li, Taira Tsuchiya, Kenji Yamanishi
arXiv:2610. 13590v1 Announce Type: cross Abstract: Recent results [arXiv:2602.
By Sebastian Pokutta
arXiv:2609. 38561v2 Announce Type: replace-cross Abstract: Zeroth-order optimization methods are essential for solving black-box problems where gradient information is unavailable or expensive to compute.
By Alexander Sholokhov, Alexander Rogozin
In this work, we study the oracle complexity of finding an $ε$-stationary point for nonconvex-strongly-convex (NC-SC) bilevel optimization using only first-order oracles. Existing methods achieving th...