arXiv Statistics ML

Controlling the False Discovery Rate via Model-Agnostic Importance Measures

The paper introduces MAS (Model‑Agnostic Selection with agent‑X importance), a new method for controlling the false discovery rate (FDR) in variable selection that does not rely on specific model assumptions. MAS uses sample splitting, a novel agent‑X importance measure, a resplit‑per‑covariate strategy, and data aggregation to achieve asymptotic FDR control while improving computational efficiency and power. The authors provide theoretical guarantees and demonstrate competitive performance through extensive simulations and real‑data analyses.

arXiv Machine Learning
Jul 28

Robust Conformalized Selection with Noisy Responses

arXiv:2607. 22985v1 Announce Type: cross Abstract: Conformalized selection has been widely applied to select high-quality candidates from large datasets with rigorous uncertainty quantification, such as reliable labeling, drug discovery, and the alignment of large language models.

By Chengyao Yu, Hongxin Wei, Bingyi Jing
arXiv Machine Learning
Oct 21

Measuring Variable Importance Using Proportional Inclusive Marginal Effects

The paper introduces PRIME, a new variable‑importance measure that addresses two limitations of the existing proportional marginal effects (PME) method: it is applicable to stochastic models and reduces computational cost. PRIME achieves this by employing a model‑free variable‑selection technique to isolate active variables before computing importance. Experiments on synthetic test functions and real datasets demonstrate that PRIME accurately and reliably quantifies variable importance from noisy input‑output data.

By Youngseo Cho, V. Roshan Joseph
arXiv Machine Learning
Oct 3

Scientific Discovery under Validation Congestion via Multi-Fidelity Pairwise Rankings

The paper introduces PRISMS, a framework that uses expert pairwise rankings of varying fidelity to curate scientific designs without relying on data-intensive regression models. By escalating queries from lower- to higher-fidelity rankers based on Fisher-information, PRISMS improves discovery recall and reduces the number of screening rounds compared to regression-only and non‑escalated ranking methods. In optimization tasks, PRISMS outperforms Bayesian optimization by achieving higher hypervolume.

By Kevin Tirta Wijaya, Alston Lo, Michael Sun, Wojciech Matusik, Vahid Babaei
arXiv Machine Learning
Aug 18

Large Discovery Models: Empirically-grounded Model-Based Open-Ended Search

arXiv:2608. 15669v1 Announce Type: new Abstract: Scientific discovery often involves optimising expensive-to-evaluate objectives over vast, structured, and open-ended hypothesis spaces, such as molecules, protein sequences, and computer programs.

By Zhongwei Yu, Yan Song, Xue Yan, Anjie Liu, Xingyu Lu, Yihang Chen, Huichi Zhou, Siyuan Guo, Luoyang Sun, Sihan Chen, Xiangning Yu, Jun Wang
arXiv Machine Learning
Aug 4

Beyond Noise: A Hypothesis Testing Approach to Robust Feature Selection

arXiv:2511. 20851v3 Announce Type: replace-cross Abstract: Feature selection remains difficult in modern high-dimensional settings, and established methods such as Boruta and Recursive Feature Elimination are either computationally costly or lack a statistically justified stopping criterion for their importance scores.

By Mousam Sinha, Tirtha Sarathi Ghosh, Koushik Biswas, Ridam Pal
arXiv Machine Learning
Oct 16

SelectPFN: Amortized Bayesian Variable Selection for Sparse Nonlinear Regression with Prior-Data Fitted Networks

SelectPFN is a prior‑data‑fitted network that jointly performs Bayesian variable selection and prediction for sparse nonlinear regression. In a single forward pass it outputs posterior inclusion probabilities for each variable and makes predictions using only sampled subsets, ensuring excluded variables cannot influence the result. The method achieves exact finite‑sample false discovery rate control via column‑permutation equivariance and knockoff statistics, and outperforms lasso, BART, DART, LassoNet, and other sparse neural networks on synthetic and real data with up to 500 predictors.

By Bin Luo