arXiv Machine Learning

Min-Marginal Power Indices for Multi-Objective Feature Selection

The paper introduces the Min-Marginal Power Index (MinPI), a game-theoretic feature selection method that labels features as harmful, neutral, or decisive based on whether adding them to a coalition drops utility below a threshold. MinPI enables conservative feature removal without a score cutoff, and its application to six benchmark datasets removed 12.5% of features with negligible loss in held‑out utility. The method also improves multi‑objective search performance by prefiltering features, especially in datasets with many removable features.

arXiv Machine Learning
Jul 28

An Empirical Study of Feature Selection Granularity

arXiv:2607. 24145v1 Announce Type: new Abstract: Feature selection aims to identify the most informative and relevant features for a given dataset, either in terms of capturing the underlying data structure and distribution better, or with respect to the performance on a downstream task.

By Muhammad Rajabinasab, Arthur Zimek
arXiv Machine Learning
Sep 22

Are Coreset Selection Methods Worth Their Cost?

The paper evaluates coreset selection methods by incorporating both selection and training time into a unified wall‑clock budget, using a standardized benchmark across four datasets and multiple selectors. Across numerous budget anchors, simple random or full‑data training consistently outperforms sophisticated selectors, and selection costs are dominated by a full‑dataset scan that cannot be amortized. The study also identifies when subset reuse can justify selection and reports several correctness fixes in a popular codebase.

By Yangze Liu, Zhongyi Han
arXiv Machine Learning
Oct 22

Nominate-then-Adjudicate: LLM-Assisted One-Pass and Per-Instance MIP Solver Tuning

The paper introduces a "nominate-then-adjudicate" pipeline for tuning mixed‑integer programming (MIP) solvers, where a fixed portfolio of configurations is sampled once and reused across instances, eliminating per‑instance search at inference. A 20‑feature representation maps structurally different instances to the same vector, enabling a one‑pass, zero‑solve selection process that outperforms default settings and per‑instance baselines such as ISAC+. The approach demonstrates significant practical gains, with the adjudicator achieving 538 wins over the top nominee and improving win rates against defaults from 84.9% to 90.2%.

By Yifan Zhao, Qianyang Zhao, Xinyu Guan, Kai Wei, Yuming Deng
arXiv Machine Learning
Jul 21

MinShap: A Shapley-Based Framework for Feature Redundancy

arXiv:2604. 15107v2 Announce Type: replace-cross Abstract: Shapley values provide a flexible framework for attributing feature contributions to model predictions, but they are not naturally suited for feature selection: a feature may receive a positive attribution even when it is redundant given the remaining variables.

By Chenghui Zheng, Garvesh Raskutti