The paper argues that explainable AI (XAI) tools, intended to increase trust in machine learning models, often fail to do so and instead foster overreliance on incorrect predictions. It attributes this failure to the unfaithfulness of XAI methods, which oversimplify model internals and misalign explanations with the actual model behavior. The authors identify five major shortcomings in current faithfulness metrics and propose four research directions to improve their reliability.
By Marco Zullich, Emily Schiller, Ivan Gentile, David Dembinsky, Adriano Lucieri, Kilian G\"oller, Steffen Seitz
arXiv:2511.15371v3 Announce Type: replace
Abstract: Assessing the importance of individual features in Machine Learning is critical to understand the model's decision-making process. While numerous m...
By Eddie Conti, \'Alvaro Parafita, Axel Brando
arXiv:2606. 06056v1 Announce Type: cross Abstract: Multiple machine learning models can achieve near-equivalent predictive performance on the same task, yet provide divergent feature-based explanations.
By Helge Spieker, J{\o}rn Eirik Betten, Arnaud Gotlieb
arXiv:2608. 02697v1 Announce Type: cross Abstract: Attribution methods (AMs) assign an importance score to each feature and are widely adopted to explain black-box models.
By Eddie Conti, \'Alvaro Parafita, Axel Brando
The paper proposes a new evaluation test for explanation methods: if an explanation accurately captures how a model uses its features, one should be able to reconstruct the model’s predictions from it. The authors convert explanations into predictors by summing feature effects and assess how well these predictors reproduce the model on unseen data, without any fitting. They apply this test to partial dependence plots, accumulated local effects, SHAP, and LIME across multiple datasets and model families, showing that the best method depends on feature dependence and that some existing quality metrics can favor flawed explanations.
By Jacob Selb{\ae}k, Hugo L. Hammer
The paper introduces localized case-based feature importance (CBFI), a framework that decomposes individual predictions in complex tabular models into distinct structural components, separating independent main effects from pure interactions. Unlike additive explanations such as SHAP and LIME, CBFI explicitly captures feature synergies, enabling the recovery of latent interaction structures. Experiments on wine quality classification and medical insurance regression, along with fidelity tests and synthetic benchmarks, show that CBFI accurately disentangles interactions hidden by additive models and aligns with the nonlinear dependencies in gradient boosting and deep neural networks.
By Sejong Oh
Background: Understanding individual predictions in complex tabular models remains challenging, as existing additive frameworks like SHAP and LIME often obscure structural logic by absorbing nonlinear...
ProToMEx is a new explainability framework that uses Probabilistic Topic Models to learn latent topics representing high‑level reasons behind a classifier’s decisions, moving beyond simple feature attribution. It provides both global and local explanations, revealing multiple co‑existing reasons for individual predictions. Empirical results show that ProToMEx achieves comparable fidelity to SHAP and LIME while being 30–40× faster on standard tabular and synthetic datasets.
By Athina Georgara, Adarsh Valoor, Sarvapali D. Ramchurn
arXiv:2607. 14315v1 Announce Type: cross Abstract: In this paper, we present a comprehensive framework for assessing the explainability of various XAI methods, such as LIME and SHAP, across multiple datasets and machine learning models, with the ultimate goal of creating a unified multidimensional explainability score.
By Georgios Makridis, Georgios Fatouros, Athanasios Kiourtis, Dimitrios Kotios, Vasileios Koukos, Dimosthenis Kyriazis, Jonh Soldatos
arXiv:2607. 29614v1 Announce Type: cross Abstract: The rapid adoption of deep learning models in high-risk domains has intensified the need for trustworthy Explainable Artificial Intelligence (XAI).
By Christian Oliva, Luis F. Lago-Fern\'andez
arXiv:2606. 10942v1 Announce Type: cross Abstract: As artificial intelligence and machine learning (AI/ML) models become integral to network operations, their lack of transparency poses a significant barrier to operator trust.
By Kiarash Rezaei, Omran Ayoub, Sebastian Troia, Francesco Lelli, Paolo Monti, Carlos Natalino
The paper presents a systematic comparison of importance‑attribution methods for deep learning models that operate on relational databases. It evaluates four methods—Monte Carlo Shapley, Kernel SHAP, single‑attribute impact, and mask learning—across regression and classification tasks using GraphSAGE and Relational Graph Transformers. The study finds that method choice affects attribute rankings and score distributions, with single‑attribute impact often matching Shapley‑based methods at lower cost, especially in regression settings.
By Hila Levi-Yosefi, Shunit Agmon, Ester Livshits, Agapi Rissaki, Benny Kimelfeld