arXiv AI

HiRA-CAM: Preserving Fine-Grained Spatial Relevance in Gradient-Based Visual Explanations

arXiv:2608. 19407v1 Announce Type: cross Abstract: Deep Learning models can include billions of parameters or more, making it difficult to explain their internal transformations and outputs.

arXiv Machine Learning
Jun 9

Analysis of Information Theory for Explainable AI

arXiv:2507. 09092v2 Announce Type: replace-cross Abstract: With the intervention of machine vision in our crucial day to day necessities including healthcare and automated power plants, attention has been drawn to the internal mechanisms of convolutional neural networks, and the reason why the network provides specific inferences.

By Ram S Iyer
arXiv Computer Vision
Sep 28

OpenVAM: Open-World Visual Attention Modeling with VLMs

OpenVAM is a new framework for visual attention modeling that combines a dense saliency map with language‑based explanations. It uses a decoupled design: a visual pathway for precise localization and a vision‑language head that generates grounded what/why explanations. The method is trained in three stages to preserve localization while adding language grounding, and a scalable pipeline creates multi‑domain annotations for evaluation.

By Kiana Hooshanfar, Amirhossein Kazerouni, Alireza Hosseini, Michael Brudno, Babak Taati
arXiv Computer Vision
Aug 27

MIMONet: Multi-scale Input and Multi-scale Output Network for Salient Object Detection

MIMONet is a saliency detection model that uses multi‑scale inputs and outputs to better handle objects of varying sizes. It processes three differently sized images through separate encoder branches that exchange information, allowing each branch to learn size‑variation knowledge from the others. A Multi‑scale Perception module further refines features, and a Joint Saliency Loss ensures consistent, well‑preserved boundaries across the multiple saliency maps produced.

By Zhaojian Yao, Wei Gao, Tiesong Zhao, Hui Yuan, Sam Kwong
arXiv Computer Vision
Sep 28

Amplify What You Gaze At: Target Saliency Boosting in Text-to-Image Generation

The paper introduces Target Saliency Boosting, a new task that enhances the visual prominence of a specific object in text-to-image generation without visual priors. It proposes GazeME, a lightweight framework that inserts learnable marker tokens around object descriptions to indicate which objects to emphasize or suppress. By building a saliency-semantics dataset and using Saliency Prior Marker Activation, GazeME learns to adjust markers during training and automatically applies them at inference, effectively boosting target saliency while maintaining semantic alignment and image quality.

By Shengqi Dang, Zhengxi Yu, Feilin Han, Xingyu Lan, Nan Cao
arXiv Machine Learning
2d ago

Bridging Human and Model Attention: Explainability Analysis of CNN, Mamba, and ViT Architectures with Gaze-Based Validation

The paper presents a quantitative study of how well the attention maps of CNNs, Vision Transformers, and Vision Mamba align with human visual perception, using eye‑tracking data as ground truth. A standardized normalization pipeline maps attribution maps and gaze heatmaps to spatial probability distributions, and alignment is measured with Jensen‑Shannon similarity, Chi‑square similarity, and Pearson correlation across fine‑grained classification, medical imaging, and emotion recognition tasks. Results show that CNNs exhibit more global, diffuse saliency that generally matches human perception, ViTs focus on fine‑grained, patch‑level features, and Vision Mamba performs well in medical tasks but diverges in natural images, with architectural and training choices affecting interpretability.

By Marco Stefani, Edoardo Parpaiola, Matteo Bino, Gianluca Caregnato, Francesco Roncolato, Daniel Fusaro, Loris Nanni, Alberto Pretto
Hugging Face Trending Papers
Jun 24

Expresso-AI: Explainable Video-Based Deep Learning Models for Depression Diagnosis

Given the widespread prevalence of depression and its consequential impact on individuals and society, it is crucial to obtain objective measures for early diagnosis and intervention. As a multidisciplinary topic, these objective measures should be interpretable and accessible to health care professionals, ensuring effective collaboration and treatment planning in the realm of mental health care.