arXiv Machine Learning

Interval-valued SHAP in Tree-Based Models

The paper introduces an imprecise Dirichlet model (IDM) approach to evaluate the robustness of Shapley values in tree-based models such as decision trees and random forests. By quantifying interval-valued Shapley values—using pessimistic and averaging principles—when a few unannotated instances are added to tree leaves, the authors derive efficient computational methods and extend the framework to Banzhaf values. Experiments and case studies demonstrate how these interval-valued explanations can be applied to debias uninformative features.

arXiv AI
Oct 12

Regression-adjusted Monte Carlo Estimators for Shapley Values and Probabilistic Values

The paper introduces a novel method that merges Monte Carlo sampling with linear regression to estimate probabilistic values such as Shapley and Banzhaf values. It generalizes previous algorithms by allowing any efficiently computable function family, enabling the use of tree-based models like XGBoost and cross‑fitting for unbiased estimates. Experiments on eight datasets show the approach achieves state‑of‑the‑art accuracy, reducing error by up to 11× for Shapley values and 390× for general probabilistic values compared to existing methods.

By R. Teal Witter, Yurong Liu, Christopher Musco
arXiv Machine Learning
Jul 21

MinShap: A Shapley-Based Framework for Feature Redundancy

arXiv:2604. 15107v2 Announce Type: replace-cross Abstract: Shapley values provide a flexible framework for attributing feature contributions to model predictions, but they are not naturally suited for feature selection: a feature may receive a positive attribution even when it is redundant given the remaining variables.

By Chenghui Zheng, Garvesh Raskutti
arXiv Machine Learning
Sep 11

Local Robustness Quantification for Naive Bayes Classifiers and Generative Forests: a General Approach

The paper introduces techniques for measuring the robustness of predictions made by two generative classifiers—naive Bayes classifiers and generative forests—whose underlying models are probabilistic graphical models. Robustness is defined as the degree to which the classifier’s distribution can be perturbed without altering its prediction, with perturbations explored via epsilon‑contamination, total variation distance, and chi‑squared divergence neighborhoods. Experiments on benchmark datasets show that the computed robustness values can serve as indicators of prediction trustworthiness and are compared against other existing indicators.

By Adri\'an Detavernier, Jasper De Bock
arXiv Machine Learning
Aug 6

ArborEnum: Decision Tree Rashomon Sets over Continuous Features

arXiv:2608. 04310v1 Announce Type: new Abstract: The Rashomon effect describes the phenomenon that many models can achieve nearly equivalent performance on the same learning task, with significant ramifications for robustness, feature importance, and customizability.

By Zakk Heile, Hayden McTavish, Margo Seltzer, Cynthia Rudin
arXiv AI
Oct 9

From Log-Odds to Shapley Values: An Explanatory Geometry for the Weighted Naive Bayes Classifier

The paper develops an explanatory framework for weighted naive Bayes classifiers by transforming the traditional supervised distance based on conditional log-likelihoods into a discriminative log‑odds representation. It demonstrates that this new representation yields a distance identical to the α1 distance between vectors of analytical Shapley values, thereby linking model geometry to local explanations. The authors also empirically evaluate various supervised distances derived from these representations using a k‑nearest neighbors classifier.

By Vincent Lemaire, Fabrice Cl\'erot