arXiv Machine Learning

A Nearly Quadratic Lower Bound for Linear Optimization over Convex Bodies in the Membership Oracle Model

The paper establishes nearly quadratic lower bounds for randomized algorithms that perform linear optimization and uniform sampling over convex bodies using a membership oracle. It shows that the lower bound for linear optimization matches the best known upper bound up to a polylogarithmic factor in the dimension, while the bound for uniform sampling improves upon the previous linear lower bound. Additionally, the authors demonstrate that their construction yields the same lower bound for volume estimation.

arXiv Machine Learning
Jul 1

The Geometry of Efficient Nonconvex Sampling

arXiv:2603. 25622v2 Announce Type: replace-cross Abstract: We present an efficient algorithm for uniformly sampling from an arbitrary compact body $\mathcal{X} \subset \mathbb{R}^n$ from a warm start under isoperimetry and a natural volume growth condition.

By Santosh S. Vempala, Andre Wibisono
arXiv Statistics ML
3d ago

Optimal Allocation and Volume under Surface

arXiv:2609.38875v1 Announce Type: cross Abstract: This paper develops a framework for estimation and inference on the volumes of sets that are projections of critical function sets, focusing particul...

By Kai Feng, Han Hong, Jessie Li, Wenshi Wei
Hugging Face Trending Papers
Aug 3

The Condition-Number Barrier in Sparse Least Squares

In [AS21], Axiotis and Sviridenko conjectured that the linear dependence on the restricted condition number in sparse convex optimization cannot be improved by a polynomial-time algorithm. We establish their conjectured lower bound for least-squares objectives, conditional on the randomized exact-volume Small-Set Expansion Hypothesis in the weighted regular-graph formulation of Raghavendra, Steurer, and Tulsiani [RST12].

arXiv Machine Learning
Jun 10

The hyper-scaled NLP bound for maximum-entropy remote sampling

arXiv:2601. 20970v3 Announce Type: replace-cross Abstract: The maximum-entropy remote sampling problem (MERSP) is to select a subset of $s$ random variables from a set of $n$ random variables, so as to maximize the information concerning a set of target random variables that are not directly observable.

By Gabriel Ponte, Marcia Fampa, Jon Lee
arXiv Machine Learning
Sep 18

The First-Order Oracle Complexity of Lipschitz Convex Optimization in Nondual Settings

arXiv:2609. 20687v1 Announce Type: cross Abstract: We study first-order black-box convex optimization over an $\ell_p$-ball for objectives Lipschitz in the $\ell_q$-norm, solving in the affirmative the nonsmooth version of the COLT open question (Guz15b) on whether the geometry of a smaller feasible set ($p < q$) can improve convergence rates in convex optimization, and matching prior lower bounds up to logarithmic factors.

By David Mart\'inez-Rubio, Brian Bullins, Crist\'obal Guzm\'an, Mathieu Molina
Hugging Face Trending Papers
Sep 24

On the SoS Certifiability of Log-Concave Distributions

For an arbitrary isotropic log-concave distribution $P$ on $\mathbb{R}^d$, we prove that the polynomial $(Cm)^m\|v\|_2^m - \mathbb{E}_{X\sim P}\langle X,v\rangle^m$ is a sum of squares for every even $m\ge2$, where $C>0$ is a universal constant. This removes the dependence on the Poincaré constant in the theorem of Kothari and Steinhardt (arXiv:1711.