arXiv Machine Learning

ShapDBM: Exploring Decision Boundary Maps in Shapley Space

arXiv:2603. 22235v3 Announce Type: replace-cross Abstract: Decision Boundary Maps (DBMs) are an effective tool for visualising machine learning classification boundaries.

arXiv AI
Oct 9

From Log-Odds to Shapley Values: An Explanatory Geometry for the Weighted Naive Bayes Classifier

The paper develops an explanatory framework for weighted naive Bayes classifiers by transforming the traditional supervised distance based on conditional log-likelihoods into a discriminative log‑odds representation. It demonstrates that this new representation yields a distance identical to the α1 distance between vectors of analytical Shapley values, thereby linking model geometry to local explanations. The authors also empirically evaluate various supervised distances derived from these representations using a k‑nearest neighbors classifier.

By Vincent Lemaire, Fabrice Cl\'erot
arXiv Machine Learning
Oct 9

Interval-valued SHAP in Tree-Based Models

The paper introduces an imprecise Dirichlet model (IDM) approach to evaluate the robustness of Shapley values in tree-based models such as decision trees and random forests. By quantifying interval-valued Shapley values—using pessimistic and averaging principles—when a few unannotated instances are added to tree leaves, the authors derive efficient computational methods and extend the framework to Banzhaf values. Experiments and case studies demonstrate how these interval-valued explanations can be applied to debias uninformative features.

By Chenrui Zhu, Vu-Linh Nguyen, Marie-H\'el\`ene Masson, S\'ebastien Destercke
arXiv Machine Learning
Jun 18

Unreduced Persistence Diagrams for Topological Machine Learning

arXiv:2507. 07156v2 Announce Type: replace-cross Abstract: Supervised machine learning pipelines trained on features derived from persistent homology have been experimentally observed to ignore much of the information contained in a persistence diagram.

By Nicole Abreu, Parker B. Edwards, Francis Motta
arXiv AI
Oct 31

Assessing feature scorer results on high-dimensional datasets with t-SNE

The paper introduces weighted t‑SNE, a variant of t‑SNE that incorporates feature importance scores from feature scorers into the 2‑D embedding of high‑dimensional data. It explains how to implement the method, proposes using the silhouette coefficient to evaluate the resulting visualizations, and demonstrates its use on synthetic and real‑world tabular datasets with nine different feature scorers. The approach allows practitioners to compare feature scorers visually and to interpret how machine‑learning models organize data based on learned feature importance.

By Bruno Iochins Grisci, Mario Inostroza-Ponta, M\'arcio Dorn
arXiv Machine Learning
Jul 2

Function-Counting Theory for Low-Dimensional Data Structures

arXiv:2607. 01010v1 Announce Type: cross Abstract: The success of deep learning models in classification and regression is widely attributed to the low-dimensional structure that real-world data tend to exhibit, despite their high-dimensional representation.

By Konstantin H\"aberle, Helmut B\"olcskei
arXiv Machine Learning
6d ago

Unsupervised Feature Selection Using Local Intrinsic Dimensionality -- Extended Version

The paper introduces LIDFS, an unsupervised feature selection technique that uses Local Intrinsic Dimensionality (LID) to rank features based on their local discriminability. By treating each feature as a point and estimating its LID via maximum likelihood from distances to its k nearest neighboring features, LIDFS assigns higher importance to features with lower LID and refines the ranking to remove locally redundant features. Experiments on 23 high‑dimensional datasets show that LIDFS outperforms both classic and state‑of‑the‑art methods in supervised and clustering evaluations while running faster than its closest competitor.

By Oussama Chelly, Michael E. Houle, Ken-ichi Kawarabayashi, Muhammad Rajabinasab, Arthur Zimek
arXiv Machine Learning
Aug 4

LakeMLB: Data Lake Machine Learning Benchmark

arXiv:2602. 10441v2 Announce Type: replace Abstract: Data lakes have become a fundamental platform for large-scale machine learning by enabling flexible management of heterogeneous data.

By Feiyu Pan, Tianbin Zhang, Aoqian Zhang, Yu Sun, Zheng Wang, Lixing Chen, Li Pan, Jianhua Li
arXiv AI
Jul 29

Rashomon Alignment

arXiv:2607. 25680v1 Announce Type: cross Abstract: We propose Rashomon Alignment (RA), a new measure to assess functional similarity between two models.

By Mois\'es Santos, Peter van der Putten, Bernhard Pfahringer, Carlos Soares