arXiv Machine Learning August 4, 2026 By Mousam Sinha, Tirtha Sarathi Ghosh, Koushik Biswas, Ridam Pal

Beyond Noise: A Hypothesis Testing Approach to Robust Feature Selection

Read the original on arXiv Machine Learning →

arXiv:2511. 20851v3 Announce Type: replace-cross Abstract: Feature selection remains difficult in modern high-dimensional settings, and established methods such as Boruta and Recursive Feature Elimination are either computationally costly or lack a statistically justified stopping criterion for their importance scores.

Summary generated by The Flow from the publisher's feed. The full article lives at arXiv Machine Learning.

arXiv Machine Learning

Jul 28

An Empirical Study of Feature Selection Granularity

arXiv:2607. 24145v1 Announce Type: new Abstract: Feature selection aims to identify the most informative and relevant features for a given dataset, either in terms of capturing the underlying data structure and distribution better, or with respect to the performance on a downstream task.

By Muhammad Rajabinasab, Arthur Zimek

benchmarks

arXiv Machine Learning

Jun 11

Provable Recovery of Locally Important Signed Features and Interactions from Random Forest

arXiv:2512. 11081v2 Announce Type: replace-cross Abstract: Feature and Interaction Importance (FII) methods are essential in supervised learning for assessing the relevance of input variables and their interactions in complex prediction models.

By Kata Vuk, Nicolas Alexander Ihlo, Merle Behr

safety

arXiv Machine Learning

Jul 23

Comparing Model-agnostic Feature Selection Methods through Relative Efficiency

arXiv:2508. 14268v2 Announce Type: replace-cross Abstract: Feature selection and importance estimation in a model-agnostic setting is an ongoing challenge of significant interest.

By Chenghui Zheng, Garvesh Raskutti

benchmarks

arXiv Machine Learning

Aug 6

Automatic Statistical Test for Rationally Expressible Algorithms by Selective Inference, with Applications to Feature Selection

arXiv:2608. 04667v1 Announce Type: cross Abstract: Selective inference (SI) provides statistically valid $p$-values for hypotheses selected by applying an algorithm to the data, correcting for the bias that arises when the same data are used both to select and to test a hypothesis.

By Teruyuki Katsuoka, Tomohiro Shiraishi, Shuichi Nishino, Ichiro Takeuchi

safety

arXiv Machine Learning

Jun 2

RobustModelMaker: Coupling Bootstrap Stability Selection with Leakage-Safe Nested Cross-Validation for Scientific Machine Learning

arXiv:2606. 01566v1 Announce Type: new Abstract: Small-to-medium scientific datasets place machine learning pipelines under two compounding pressures.

By Amanda S Barnard

arXiv Machine Learning

Jul 3

Conditional Inference Trees and Forests for Feature Selection

arXiv:2607. 01417v1 Announce Type: new Abstract: Conditional inference trees (CIT) and conditional inference forests (CIF) reduce split-selection bias by testing features before choosing split thresholds, but repeated permutation tests and threshold searches can make these methods computationally expensive.

By Robert Milletich, Justin Downes, Steve Goley, Newel Hirst

benchmarks safety

Related stories

An Empirical Study of Feature Selection Granularity

Provable Recovery of Locally Important Signed Features and Interactions from Random Forest

Comparing Model-agnostic Feature Selection Methods through Relative Efficiency

Automatic Statistical Test for Rationally Expressible Algorithms by Selective Inference, with Applications to Feature Selection

RobustModelMaker: Coupling Bootstrap Stability Selection with Leakage-Safe Nested Cross-Validation for Scientific Machine Learning

Conditional Inference Trees and Forests for Feature Selection