arXiv AI

SketchXplain: Intuitive Visual Explanations of Image Classifiers with Sketches

arXiv:2606. 17646v1 Announce Type: cross Abstract: Saliency map visualizations explain image-based AI predictions by pointing to regions, but these are often unintuitive and semantically unclear, leaving an interpretability gap.

Hugging Face Trending Papers
Oct 13

Beyond Black Boxes: Visual Grounding for Text Embeddings

The paper proposes a sketch-based visual grounding framework that converts text embeddings into topographic sketches to enhance visualization, explainability, and information retrieval. It evaluates the method on the MS-COCO dataset, finding that while SBERT outperforms the sketch-based approach in top‑1 retrieval, the two methods achieve comparable top‑5 results, and a cascaded combination improves performance further. The study suggests that sketch-based representations could be valuable for retrieval tasks if trained directly on text.

Hugging Face Trending Papers
Jun 24

Expresso-AI: Explainable Video-Based Deep Learning Models for Depression Diagnosis

Given the widespread prevalence of depression and its consequential impact on individuals and society, it is crucial to obtain objective measures for early diagnosis and intervention. As a multidisciplinary topic, these objective measures should be interpretable and accessible to health care professionals, ensuring effective collaboration and treatment planning in the realm of mental health care.

arXiv Machine Learning
Jun 9

Analysis of Information Theory for Explainable AI

arXiv:2507. 09092v2 Announce Type: replace-cross Abstract: With the intervention of machine vision in our crucial day to day necessities including healthcare and automated power plants, attention has been drawn to the internal mechanisms of convolutional neural networks, and the reason why the network provides specific inferences.

By Ram S Iyer
arXiv AI
Jul 20

Perception-Aligned AI Outputs: End-to-End Visual Prediction for Uncertainty Communication in Clinical Decision-Making

arXiv:2205. 04599v2 Announce Type: replace-cross Abstract: Explainable Artificial Intelligence (XAI) is essential for trustworthy AI in healthcare, yet many existing methods rely on technical explanations that are difficult for clinicians and patients to interpret.

By Mohammad Eslami, Solale Tabarestani, Saber Kazeminasab, Ehsan Adeli, Glyn Elwyn, Tobias Elze, Mengyu Wang, Nazlee Zebardast, Lucia Sobrin, Nassir Navab, Daniel Shu Wei Ting, Malek Adjouadi
arXiv Machine Learning
Sep 7

SMILE: Self-Explainable Multimodal Information Bottleneck for Medical Diagnosis

The paper introduces SMILE, a self‑explainable multimodal information bottleneck framework for medical diagnosis. It jointly optimizes predictive accuracy and modality‑specific explainability by selecting the most informative elements within each data modality. Experiments on diverse medical datasets show strong diagnostic performance, including a 9.1‑percentage‑point accuracy gain on the iCTCF dataset, and provide transparent, modality‑aware explanations that enhance both explainability and generalization.

By Yuqing Yang, Alexander Schmatz, Zhaozhao Ma, Changkyu Choi, Robert Jenssen, Shujian Yu