arXiv AI

Transformer Explainer: Learning LLM Transformers with Interactive Visual Explanation and Experimentation

arXiv:2408. 04619v2 Announce Type: replace-cross Abstract: The Transformer architecture underpins modern large language models powering state-of-the-art text generation and AI applications.

arXiv Machine Learning
Aug 27

Virgil: Navigating Explainability for Transformer-based Language Models

Virgil is an interactive system designed to help practitioners and researchers navigate the growing but fragmented ecosystem of explainability tools for transformer-based language models. It provides a unified interface backed by a curated knowledge base, allowing users—including non-experts—to discover and compare different explainability tools. The tool aims to simplify access to these resources as transformer models are increasingly deployed in high‑stakes applications.

By Martino Ciaperoni, Sezer Kutluk, Benedetta Muscato, Marta Marchiori Manerba, Fosca Giannotti
arXiv AI
Jun 2

Prototype Transformer: Towards Language Model Architectures Interpretable by Design

arXiv:2602. 11852v2 Announce Type: replace Abstract: While state-of-the-art language models (LMs) surpass most humans in certain domains, their reasoning remains largely opaque, reducing trust and increasing the risk of deception and hallucination.

By Yordan Yordanov, Matteo Forasassi, Bayar Menzat, Ruizhi Wang, Chang Qi, Markus Kaltenberger, Amine M'Charrak, Tommaso Salvatori, Thomas Lukasiewicz
arXiv Machine Learning
Jun 8

Attention Sink in Transformers: A Survey on Utilization, Interpretation, and Mitigation

arXiv:2604. 10098v2 Announce Type: replace Abstract: As the foundational architecture of modern machine learning, Transformers have driven remarkable progress across diverse AI domains.

By Zunhai Su, Hengyuan Zhang, Wei Wu, Yifan Zhang, Yaxiu Liu, He Xiao, Qingyao Yang, Yuxuan Sun, Rui Yang, Chao Zhang, Jing Xiong, Hui Shen, Keyu Fan, Weihao Ye, Chaofan Tao, Taiqiang Wu, Zhongwei Wan, Tiantian Zhang, Bowen Yan, Zhen Li, Yiming Zhang, Congkai Xie, Yulei Qian, Yuchen Xie, Yik-Chung Wu, Hongxia Yang, Ngai Wong
arXiv Machine Learning
Sep 11

Explainability Assistant: A Conversational XAI Interface for Interpreting Energy Consumption Models

The paper introduces the Explainability Assistant, an open‑source conversational XAI system designed to interpret complex energy consumption forecasting models. By leveraging large language model function‑calling, it achieves 94% intent‑parsing accuracy and supports flexible natural‑language interaction across different ML problem types without task‑specific fine‑tuning. A comparative evaluation with energy domain specialists shows improved usability and consistent task accuracy, with all experts preferring the conversational interface over a traditional XAI dashboard.

By Rodion Krjut\v{s}kov, Eduard Barbu, Nikos Sakkas, Sofia Yfanti