arXiv Machine Learning

Assumption-lean logistic regression with missing covariates

arXiv Machine Learning
Jun 9

Partial Identification under Missing Data Using Weak Shadow Variables from Pretrained Models

arXiv:2602. 16061v2 Announce Type: replace-cross Abstract: Estimating population quantities such as mean outcomes from user feedback is fundamental to platform evaluation and social science, yet feedback is often missing not at random (MNAR): users with stronger opinions are more likely to respond, so standard estimators are biased and the estimand is not identified without additional assumptions.

By Hongyu Chen, David Simchi-Levi, Ruoxuan Xiong
arXiv Statistics ML
Sep 22

Doubly robust target inference for generalized linear regression with completely missing covariates

arXiv:2609.24086v1 Announce Type: cross Abstract: Large-scale multipurpose cohort studies and biobanks often omit covariates needed for specific downstream analyses. We study target-population infere...

By Huali Zhao (School of Mathematics and Statistics, Huazhong University of Science and Technology), Ke Deng (Department of Statistics and Data Science, Tsinghua University)
arXiv Machine Learning
Sep 1

AI-Generated Measurements for Identification and Inference with Missing Data: A Weak Shadow Variable Approach

The paper introduces an assumption‑lean framework that uses AI‑generated measurements as weak shadow variables to identify and infer population quantities when data are missing not at random. Weak shadow variables are outcome‑informative proxies that are conditionally independent of missingness given the true outcome and covariates, and they do not need to predict missing outcomes accurately. The authors derive sharp bounds via linear programs and propose a localized penalized estimator with a subsampling algorithm for confidence intervals, demonstrating in semi‑synthetic experiments that the resulting intervals are substantially narrower and more accurate than classical MNAR methods.

By Hongyu Chen, David Simchi-Levi, Ruoxuan Xiong
arXiv Statistics ML
Aug 25

Model-Agnostic Covariate-Assisted Inference on Partially Identified Causal Effects

The paper introduces a model‑agnostic inference framework for partially identified causal effects that leverages covariate information without requiring discrete covariates or accurate conditional distribution estimates. Using duality theory for optimal transport, the method delivers uniformly valid inference in randomized experiments, is doubly robust in observational settings, achieves asymptotic unbiasedness when nuisance parameters converge semiparametrically, and allows multiplier‑bootstrap selection of covariates and models while remaining computationally efficient. Empirical applications show the approach consistently narrows identified sets and confidence intervals without imposing extra structural assumptions.

By Wenlong Ji, Lihua Lei, Asher Spector
arXiv Statistics ML
6d ago

Handling Covariate Mismatch in Collaborative Linear Prediction

The paper addresses the problem of covariate mismatch in collaborative linear prediction, where different centers collect different sets of features. It proposes estimators that leverage information across centers under center-wise MCAR missingness, including a plug‑in estimator for low dimensions and an impute‑then‑regress strategy with ridge regularization for higher dimensions. All methods comply with federated learning constraints, exchanging only aggregated statistics, and the authors provide theoretical learning rates and numerical validation.

By Alexis Ayme, R\'emi Khellaf
arXiv Machine Learning
Jul 15

Linear Regression under Missing or Corrupted Coordinates

arXiv:2509. 19242v2 Announce Type: replace-cross Abstract: We study multivariate linear regression under Gaussian covariates in two settings, where data may be erased or corrupted by an adversary under a coordinate-wise budget.

By Ilias Diakonikolas, Jelena Diakonikolas, Daniel M. Kane, Jasper C. H. Lee, Thanasis Pittas
arXiv Machine Learning
Jul 2

Deep learning with missing data

arXiv:2504. 15388v3 Announce Type: replace-cross Abstract: In the context of multivariate nonparametric regression with missing covariates, we propose Pattern Embedded Neural Networks (PENNs), which can be applied in conjunction with any existing imputation technique.

By Tianyi Ma, Tengyao Wang, Richard J. Samworth
arXiv Machine Learning
Sep 25

Nuclear Norm-Regularized Bayesian Matrix Completion

The paper introduces a Bayesian approach to matrix completion that uses a nuclear norm-based prior and addresses the challenge of unknown noise variance by placing a prior on it. It presents the first sampler for this model, providing a non‑asymptotic polynomial‑time guarantee in terms of matrix dimensions and desired accuracy. The method discretizes the noise precision and employs thermodynamic integration to construct a categorical posterior, offering a feasibility result for Bayesian sampling in non‑log‑concave settings.

By Calvin Tolbert