arXiv AI

Hide and Seek: HIDE Concepts to SEEK explanations for black box models

Hide and Seek (HnS) is a concept‑level attribution method that interprets black‑box vision models without needing model weights or labeled concept datasets. It retrieves concept‑aligned images via a vision‑language model, localizes and masks the concept region, and measures attribution by observing changes in the model’s output. HnS was validated on CelebA and COCO‑Stuff, showing stronger agreement with ground‑truth attributions than existing methods, and was applied to tasks like image captioning and satellite image segmentation where other concept attribution methods fail.

arXiv Machine Learning
Jul 15

Where Not to Learn: Prior-Aligned Training with Subset-based Attribution Constraints for Reliable Decision-Making

arXiv:2602. 07008v3 Announce Type: replace-cross Abstract: Reliable models should not only predict correctly, but also justify decisions with acceptable evidence.

By Ruoyu Chen, Shangquan Sun, Xiaoqing Guo, Sanyi Zhang, Kangwei Liu, Shiming Liu, Zhangcheng Wang, Qunli Zhang, Wei Wang, Hua Zhang, Xiaochun Cao
arXiv Computer Vision
Sep 23

MorphoSHAP: Rethinking the Unit of Attribution in Explanation for Deep Visual Models

MorphoSHAP is a model‑agnostic post‑hoc explanation method that uses morphological shapes—derived from the Tree of Shapes—as the units of attribution in a Shapley game. Each shape is characterized by its scale, geometry, and signed contribution, enabling explanations that reveal where evidence lies, what structural type carries it, and how strongly it influences the prediction. The approach offers spatial, textual, and global class‑level explanations, surpasses existing attribution methods on multiple benchmarks, and is preferred by users in a study.

By Anirudh Prabhakaran, Alexandre Rocchi, Gianni Franchi
arXiv AI
Aug 24

CFM: Language-aligned Concept Foundation Model for Vision

The paper introduces CFM, a language‑aligned concept foundation model for vision that generates fine‑grained, human‑interpretable concepts with spatial grounding. By pairing CFM with a strong semantic foundation model, it provides explanations for downstream tasks such as classification, segmentation, and captioning. The authors also analyze local co‑occurrence of concepts to define relationships, improving concept naming and yielding richer explanations while maintaining competitive performance.

By Kai Wittenmayer, Sukrut Rao, Amin Parchami-Araghi, Bernt Schiele, Jonas Fischer
arXiv Computer Vision
Aug 25

Where Not to Learn: Prior-Aligned Training with Subset-based Attribution Constraints

arXiv:2602.07008v5 Announce Type: replace Abstract: Reliable models should not only predict correctly, but also base their decisions on acceptable evidence. However, conventional supervised learning...

By Ruoyu Chen, Shangquan Sun, Xiaoqing Guo, Kangwei Liu, Sanyi Zhang, Zhangcheng Wang, Shiming Liu, Qunli Zhang, Wei Wang, Hua Zhang, Xiaochun Cao