arXiv Statistics ML By Mengtao Wen, Haojie Ren, Changliang Zou

Controlling the False Discovery Rate via Model-Agnostic Importance Measures

Read the original on arXiv Statistics ML →

The paper introduces MAS (Model‑Agnostic Selection with agent‑X importance), a new method for controlling the false discovery rate (FDR) in variable selection that does not rely on specific model assumptions. MAS uses sample splitting, a novel agent‑X importance measure, a resplit‑per‑covariate strategy, and data aggregation to achieve asymptotic FDR control while improving computational efficiency and power. The authors provide theoretical guarantees and demonstrate competitive performance through extensive simulations and real‑data analyses.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Statistics ML.

arXiv Machine Learning
Jul 28

Robust Conformalized Selection with Noisy Responses

arXiv:2607. 22985v1 Announce Type: cross Abstract: Conformalized selection has been widely applied to select high-quality candidates from large datasets with rigorous uncertainty quantification, such as reliable labeling, drug discovery, and the alignment of large language models.

By Chengyao Yu, Hongxin Wei, Bingyi Jing
arXiv Machine Learning
Oct 21

Measuring Variable Importance Using Proportional Inclusive Marginal Effects

The paper introduces PRIME, a new variable‑importance measure that addresses two limitations of the existing proportional marginal effects (PME) method: it is applicable to stochastic models and reduces computational cost. PRIME achieves this by employing a model‑free variable‑selection technique to isolate active variables before computing importance. Experiments on synthetic test functions and real datasets demonstrate that PRIME accurately and reliably quantifies variable importance from noisy input‑output data.

By Youngseo Cho, V. Roshan Joseph
arXiv Machine Learning
Oct 3

Scientific Discovery under Validation Congestion via Multi-Fidelity Pairwise Rankings

The paper introduces PRISMS, a framework that uses expert pairwise rankings of varying fidelity to curate scientific designs without relying on data-intensive regression models. By escalating queries from lower- to higher-fidelity rankers based on Fisher-information, PRISMS improves discovery recall and reduces the number of screening rounds compared to regression-only and non‑escalated ranking methods. In optimization tasks, PRISMS outperforms Bayesian optimization by achieving higher hypervolume.

By Kevin Tirta Wijaya, Alston Lo, Michael Sun, Wojciech Matusik, Vahid Babaei