arXiv AI

The Mirror Agent Model: a Bayesian Architecture for Interpretable Agent Behavior

The paper introduces the Mirror Agent Model, a Bayesian architecture designed to produce interpretable agent behavior and explanations. It defines an observer model that mirrors the agent’s internal state, enabling explicit and implicit communication of intentions. The architecture incorporates off‑the‑shelf saliency methods to generate explanations, and the authors present preliminary qualitative results demonstrating its potential.

arXiv Computation and Language
Sep 7

From Plausible to Actionable: A Position on LLM Self-Explanations

The paper discusses how Large Language Models can produce natural language self‑explanations that appear plausible but may not accurately reflect the model’s reasoning. It critiques current evaluation methods for such explanations and offers practical guidelines to assess their plausibility and faithfulness. Additionally, it argues that evaluation should also consider the actionability of these explanations, showing how they can aid decision‑making for various stakeholders.

By Elize Herrewijnen, Benedetta Muscato, Gizem Gezici, Fosca Giannotti
arXiv AI
Sep 15

Generative Interpretability via Scalable Neuro-Symbolic Models

The paper argues that as Large Language Models transition from chatbots to agentic systems, the current post-hoc interpretability paradigm is insufficient for safe deployment because it cannot audit or intervene before an output is produced. It proposes a shift to generative interpretability, where a model’s inference process inherently exposes semantically meaningful checkpoints that are human-understandable and can be causally intervened upon. The authors illustrate the advantages of this approach and introduce Neuro‑Symbolic Models as a concrete implementation.

By Xiaocong Yang
arXiv Machine Learning
Sep 21

CASE: Contrastive Activation for Class-Sensitive Explanations

The paper introduces a diagnostic test for class sensitivity in saliency methods, revealing that many popular techniques produce nearly identical explanations regardless of the predicted class. This limitation appears across different architectures and datasets, indicating a structural issue. To address this, the authors propose CASE, a contrastive explanation method that isolates features uniquely discriminative for the predicted class, and demonstrate its improved fidelity and class specificity through experiments.

By Dane Williamson, Yangfeng Ji, Matthew Dwyer
arXiv AI
Oct 19

A Survey of Explainable Reinforcement Learning: Targets, Methods and Needs

A survey paper titled "A Survey of Explainable Reinforcement Learning: Targets, Methods and Needs" reviews over 250 studies in the sub‑domain of eXplainable AI focused on reinforcement learning (XRL). The authors introduce a taxonomy based on the questions "What" (the target of explanation) and "How" (the method of explanation) and use it to organize the state‑of‑the‑art literature. They also highlight related domains that warrant further attention and outline key needs for advancing the field of XRL.

By L\'eo Sauli\`eres
arXiv AI
Sep 10

Explaining AI Agents Through Execution Traces

arXiv:2609.06063v1 Announce Type: new Abstract: AI Agents are increasingly deployed in real-world settings, where they interact with external tools and make sequential decisions with limited human ov...

By Vittoria Vineis, Fabiano Veglianti, Lorenzo Antonelli, Claudia Di Carlo, Matteo Silvestri, Gabriele Tolomei