arXiv AI

Assessing feature scorer results on high-dimensional datasets with t-SNE

The paper introduces weighted t‑SNE, a variant of t‑SNE that incorporates feature importance scores from feature scorers into the 2‑D embedding of high‑dimensional data. It explains how to implement the method, proposes using the silhouette coefficient to evaluate the resulting visualizations, and demonstrates its use on synthetic and real‑world tabular datasets with nine different feature scorers. The approach allows practitioners to compare feature scorers visually and to interpret how machine‑learning models organize data based on learned feature importance.

arXiv Machine Learning
Sep 25

VG-TIE: An interpretable tabular-to-image encoding method based on visibility graphs

VG‑TIE is a tabular‑to‑image encoding method that uses Natural and Horizontal Visibility Graphs to map feature values into a two‑dimensional image via PCA. Each pixel represents a feature, its intensity shows deviation from the population mean, and edges encode visibility relationships. The method offers model‑agnostic, intrinsically interpretable images, providing feature ranking through node degree distributions and local/global importance via pixel intensity combined with Grad‑CAM, and demonstrates competitive performance on six public datasets.

By David Chushig-Muzo, Luis M. L\'opez-Ramos, \'Angeles Rodr\'iguez de Cara, Eva Milara, Luis Zhinin-Vera, Diego H. Peluffo-Ord\'o\~nez
arXiv Machine Learning
Oct 8

For Those Who Believe in Faithfulness: Optimizing the Area Under Insertion and Deletion Curves for Ranking Relative Feature Importance

The paper introduces Ra‑NEM, a method that optimizes the area under insertion and deletion curves to improve the faithfulness of feature importance attributions in machine learning models. By deriving an objective function from faithfulness and approximating its gradient, the authors link insertion curves to top‑k feature selection, enabling a loss function that measures attribution quality. Ra‑NEM, integrated with the neural explanation mask framework, works with any differentiable model, yielding accurate, robust, and fast attributions that outperform existing algorithms on multiple XAI metrics.

By Bj{\o}rn Leth M{\o}ller, Bulat Ibragimov, Christian Igel
arXiv Machine Learning
Oct 23

Post-Hoc Feature Selection Layer for Neural Networks Interpretability

The paper introduces a post‑hoc Feature Selection Layer (FSL) that can be added to frozen pre‑trained neural networks on tabular data to highlight the most important features. This lightweight, trainable module fine‑tunes feature weights based on the original model’s outputs without altering its architecture or parameters. Experiments on synthetic and real‑world datasets show that the post‑hoc FSL preserves predictive performance while improving interpretability, outperforming other post‑hoc methods such as Integrated Gradients and SHAP.

By Jo\~ao Kenji Suwa, Jo\~ao Pedro Silveira e Silva, Bruno Iochins Grisci
arXiv Machine Learning
Jul 28

An Empirical Study of Feature Selection Granularity

arXiv:2607. 24145v1 Announce Type: new Abstract: Feature selection aims to identify the most informative and relevant features for a given dataset, either in terms of capturing the underlying data structure and distribution better, or with respect to the performance on a downstream task.

By Muhammad Rajabinasab, Arthur Zimek
arXiv Machine Learning
Sep 4

Anisotropic View Distance Metric for High-Dimensional Data: Theory, Geometry, and Fast Computation

The paper introduces View distance, a novel metric that projects high‑dimensional data onto all pairwise two‑dimensional planes and sums the Euclidean distances across these projections. It satisfies metric axioms, couples features, suppresses redundancy, and captures anisotropic geometry. To make it scalable, the authors propose a plane‑selection strategy using iterative Maximum Weight Matching, reducing complexity from ω(n²) to ω(k) and demonstrating competitive performance on twelve datasets.

By Yiqun Zhang, Hou-biao Li
arXiv Computer Vision
Oct 26

Hierarchical Vision Transformer with Prototypes for Interpretable Medical Image Classification

HierViT is a hierarchical Vision Transformer designed for medical image classification that balances strong predictive performance with interpretability. The model first predicts clinically relevant visual appearance attributes and then uses a hierarchical reasoning process to infer the final diagnosis. Attribute‑specific prototypes and attention maps are visualized to provide complementary views of the model’s reasoning, linking representative image examples and spatial attention to semantically defined visual features.

By Luisa Gall\'ee, Meinrad Beer, Michael G\"otz