arXiv AI By Marco Zullich, Emily Schiller, Ivan Gentile, David Dembinsky, Adriano Lucieri, Kilian G\"oller, Steffen Seitz

Faithfulness Without Anchors: A Position Paper on the Structural Misalignments of Explainable AI Faithfulness Metrics for Feature Importance

Read the original on arXiv AI →

The paper argues that explainable AI (XAI) tools, intended to increase trust in machine learning models, often fail to do so and instead foster overreliance on incorrect predictions. It attributes this failure to the unfaithfulness of XAI methods, which oversimplify model internals and misalign explanations with the actual model behavior. The authors identify five major shortcomings in current faithfulness metrics and propose four research directions to improve their reliability.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv AI
Jul 17

Towards a Unified Multidimensional Explainability Metric: Evaluating Trustworthiness in AI Models

arXiv:2607. 14315v1 Announce Type: cross Abstract: In this paper, we present a comprehensive framework for assessing the explainability of various XAI methods, such as LIME and SHAP, across multiple datasets and machine learning models, with the ultimate goal of creating a unified multidimensional explainability score.

By Georgios Makridis, Georgios Fatouros, Athanasios Kiourtis, Dimitrios Kotios, Vasileios Koukos, Dimosthenis Kyriazis, Jonh Soldatos
arXiv Machine Learning
Oct 8

For Those Who Believe in Faithfulness: Optimizing the Area Under Insertion and Deletion Curves for Ranking Relative Feature Importance

The paper introduces Ra‑NEM, a method that optimizes the area under insertion and deletion curves to improve the faithfulness of feature importance attributions in machine learning models. By deriving an objective function from faithfulness and approximating its gradient, the authors link insertion curves to top‑k feature selection, enabling a loss function that measures attribution quality. Ra‑NEM, integrated with the neural explanation mask framework, works with any differentiable model, yielding accurate, robust, and fast attributions that outperform existing algorithms on multiple XAI metrics.

By Bj{\o}rn Leth M{\o}ller, Bulat Ibragimov, Christian Igel
arXiv AI
Aug 26

A Formal Methodological Framework for Auditing Robustness and Fidelity in Explainable AI: From Application to Trust Certification

The paper introduces a formal auditing framework to evaluate the robustness and fidelity of post‑hoc explainers such as SHAP and LIME. It defines a Trust Score that combines how stable an explanation is under small input perturbations with how well the highlighted features actually influence the model’s prediction. Experiments on a Madagascar malnutrition dataset show that even highly accurate models can produce unreliable explanations, and that fidelity scores degrade when models overfit.

By Rosa Elysabeth Ralinirina, Jean Christian Ralaivao, Niaiko Micha\"el Ralaivao, Alain Josu\'e Ratovondrahona, Thomas Mahatody