arXiv Machine Learning

Algorithms for adaptive and heteroskedastic linear regression at the computational threshold

arXiv:2608. 18402v1 Announce Type: cross Abstract: We study finite-sample linear regression in the presence of varied and unknown label noise, focusing on the heteroskedastic and adaptive linear regression models.

arXiv Machine Learning
Jun 18

How fast can you find a good hypothesis?

arXiv:2509. 03734v3 Announce Type: replace-cross Abstract: In the hypothesis selection problem, we are given sample and query access to finite set of candidate distributions (hypotheses), $\mathcal{H} = \{H_1, \ldots, H_n\}$, and samples from an unknown distribution $P$, both over a domain $\mathcal{X}$.

By Anders Aamand, Maryam Aliakbarpour, Justin Y. Chen, Sandeep Silwal
arXiv Machine Learning
Jul 14

Demixing Sparse Signals from Nonlinear Observations using Generalized Non-convex Regularization

arXiv:2607. 10618v1 Announce Type: cross Abstract: We consider the recovery of a pair of sparse vectors from a limited number of nonlinear observations of their superposition: $y_i=g(\inner{\ba_i}{\bPhi\bw^\ast+\bPsi\bz^\ast})+e_i$, $i=1,\dots,m$, with $m\ll n$, incoherent orthonormal bases $\bPhi,\bPsi$, a scalar link $g$, and noise $e_i$ that may be heavy-tailed or contaminated.

By Raziyeh Takbiri
arXiv Statistics ML
Oct 1

Local polynomial density ratio estimation

arXiv:2609. 38412v1 Announce Type: cross Abstract: We propose a novel local-polynomial estimator of the ratio $r=f/g$ of two $d$-dimensional densities $f$ and $g$, from which independent samples are available.

By Hajo Holzmann, Alexander Meister
arXiv Machine Learning
Oct 7

Sample-Optimal Estimation of the Fr\'echet Inception Distance

The paper investigates the sample complexity of estimating the Fréchet Inception Distance (FID) between high‑dimensional Gaussian distributions when one distribution is known. It establishes tight bias and variance bounds for the empirical plug‑in estimator, shows how higher‑order extrapolation reduces bias, and introduces a new Relative Taylor Debiasing (RTD) algorithm that achieves optimal sample complexity. Experiments on synthetic data and ImageNet confirm the theoretical predictions and demonstrate RTD’s superior accuracy with limited samples.

By Ziyun Chen, Jerry Li, Kevin Tian, Yusong Zhu