arXiv Machine Learning

Post-Hoc Feature Selection Layer for Neural Networks Interpretability

The paper introduces a post‑hoc Feature Selection Layer (FSL) that can be added to frozen pre‑trained neural networks on tabular data to highlight the most important features. This lightweight, trainable module fine‑tunes feature weights based on the original model’s outputs without altering its architecture or parameters. Experiments on synthetic and real‑world datasets show that the post‑hoc FSL preserves predictive performance while improving interpretability, outperforming other post‑hoc methods such as Integrated Gradients and SHAP.

Hugging Face Trending Papers
Jul 24

Same Predictions, Different Reasons: The Effect of Quantization on Model Explanations

Post-training quantization (PTQ) has become a practical solution for deploying deep learning models on resource-constrained edge devices by compressing high-precision floating-point weights into low-precision representations without requiring retraining. Past research has demonstrated that quantization largely preserves classification accuracy; however, whether it also preserves the model's internal reasoning remains an open question.

arXiv Machine Learning
Jul 28

Same Predictions, Different Reasons: The Effect of Quantization on Model Explanations

arXiv:2607. 22872v1 Announce Type: new Abstract: Post-training quantization (PTQ) has become a practical solution for deploying deep learning models on resource-constrained edge devices by compressing high-precision floating-point weights into low-precision representations without requiring retraining.

By Kazi Kamruzzaman Rabbi, Md. Zami Al Zunaed Farabe, M. Sohel Rahman
arXiv Machine Learning
Oct 19

A Feature Selection Layer Approach for Multi-Class Classification on Neural Networks

The paper introduces extensions to the Feature Selection Layer, an embedded feature weighting mechanism for neural networks, to improve interpretability in multi‑class classification. Experiments show that the best extension matches existing methods in identifying globally relevant features while outperforming them in capturing label‑specific relevance. The approach leverages the neural network’s internal dynamics, eliminating the need for post‑processing to reveal how individual features influence specific label predictions.

By Jo\~ao Pedro Silveira e Silva, M\'arcio Dorn, Bruno Iochins Grisci
arXiv Machine Learning
Jul 2

The Model Organism Lottery: Model Organism Interpretability Strongly Depends on Training Methodology

arXiv:2607. 01033v1 Announce Type: new Abstract: Model organisms (MOs) - language models trained to exhibit undesired or unnatural behaviours - are frequently used as testbeds for evaluating white-box interpretability techniques.

By Andrzej Szablewski, Gabriel Konar-Steenberg, Raffaello Fornasiere, Nikita Menon, Stefan Heimersheim