arXiv Statistics ML

Instance-Optimal Adaptive Location Estimation via Multiscale Mid-Summaries

arXiv:2609. 20749v1 Announce Type: cross Abstract: Location estimation exhibits markedly different finite-sample behavior across noise distributions: regular families typically yield root-\(n\) rates, whereas compactly supported laws may admit faster, boundary-driven rates.

arXiv Statistics ML
Oct 1

Local polynomial density ratio estimation

arXiv:2609. 38412v1 Announce Type: cross Abstract: We propose a novel local-polynomial estimator of the ratio $r=f/g$ of two $d$-dimensional densities $f$ and $g$, from which independent samples are available.

By Hajo Holzmann, Alexander Meister
arXiv Machine Learning
Oct 22

Near Minimax Rate for Quantile Distributional Reinforcement Learning

The paper investigates quantile distributional policy evaluation by approximating the return distribution under a policy with a quantile Bellman fixed point. It constructs an estimator from an empirical Markov decision process and derives non‑asymptotic error bounds in Wasserstein distances, achieving root‑n rates that are independent of the quantile resolution for a wide range of Wasserstein orders. The authors also characterize the exact local asymptotic minimax risk and show that their estimator attains this optimal rate, while examining how the risk depends on resolution in simple state‑space examples.

By Zijie Cheng, Zhihua Zhang
arXiv Machine Learning
Nov 2

A Unified Framework for Probability Estimation of Data-Dependent Events

The paper introduces a unified framework for estimating the probability that an unknown distribution assigns to a data‑dependent event defined by a sample and a known mapping. It analyzes two classical estimators—the empirical plug‑in estimator and the leave‑one‑out (Good–Turing) estimator—showing how their errors relate to generalization gaps and stability under sample deletion. The framework is applied to error estimation for predictors that combine a base classifier with memorized exceptions, leading to new bounds based on VC dimension and mutual information for adaptive missing mass estimation.

By Vitaly Feldman, Satyen Kale, Vinod Raman, Kunal Talwar, Ambuj Tewari
arXiv Statistics ML
Oct 7

Poisson empirical Bayes estimation of sums of random variables via minimum-distance methods

The paper develops a nonparametric empirical Bayes approach for estimating sums of functions of observable and unobservable variables in Poisson mixture models, using regular and coarsened minimum‑distance estimation of the mixing distribution. It proves large‑sample guarantees that the plug‑in estimates converge to the oracle Bayes estimate, achieving nearly parametric rates when the mixing distribution has finite support. Finite‑sample analyses are provided for two specific sums—total intensity below a threshold and the number of units exceeding latent intensity—along with minimax regret bounds and conditions for bounded regret.

By Stefano Favaro, Sandra Fortini, Soham Jana
arXiv Statistics ML
Oct 27

Wasserstein-Cram\'er-Rao Theory of Unbiased Estimation

arXiv:2511.07414v2 Announce Type: replace-cross Abstract: The quantity of interest in the classical Cram\'er-Rao theory of unbiased estimation (e.g., the Cram\'er-Rao lower bound, its exact attainmen...

By Nicol\'as Garc\'ia Trillos, Adam Quinn Jaffe, Bodhisattva Sen
arXiv AI
Jun 8

A Temporal Spatial Minimax Rate for Smoothly-Varying Distributions in Wasserstein Space

arXiv:2606. 07325v1 Announce Type: cross Abstract: We study the minimax rate of estimating a future value $\mu_{t_n+h}$ of a curve $t\mapsto\mu_t$ in the $2$-Wasserstein space $\mathcal{P}_2(\mathbb{R}^d)$ from finitely many noisy snapshots of its past, under an adiabatic bound $\|\nabla_t^k v\|\le\varepsilon$ on the $k$-th covariant derivative of the velocity field.

By Munsik Kim
arXiv Machine Learning
Sep 23

Error Bounds for Statistical Estimators in BTL Model with Parametric Multivariate Utility Functions

The paper investigates preference elicitation under the Bradley‑Terry‑Luce model, focusing on estimating an unknown partworth vector from pairwise queries that satisfy a joint identifiability condition. It derives minimax lower bounds and shows that the canonical maximum likelihood estimator (MLE) exists, is unique, and achieves near‑optimal error rates once the sample size exceeds a design‑dependent threshold, without requiring compactness constraints or external regularizers. The analysis decomposes the estimation error into a linear stochastic term, a second‑order bias, and a higher‑order remainder, providing a unified non‑asymptotic theory for parametric utility elicitation.

By Yicheng Li, Huifu Xu