arXiv Computer Vision By Dipanjyoti Paul, Arpita Chowdhury, Maneet Chatterjee, Daichi Kitaguchi, Tanya Berger-Wolf, Tetsuya Sakurai, Wei-Lun Chao

INTR++: INterpretable TRansformer with better Accuracy, Interpretability, and Adaptability

Read the original on arXiv Computer Vision →

INTR++ is an Interpretable Transformer that builds on Prompt-CAM by adding a lightweight Prompt Adapter Module (PAM) to make prompts adaptive to domain-specific image characteristics. This design allows the model to maintain consistent interpretability and performance across diverse domains such as medical imaging, microscopic imaging, remote sensing, and object-centric data, while adding only a few extra parameters. The authors demonstrate that INTR++ improves accuracy, interpretability, and adaptability compared to previous Interpretable Transformers.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computer Vision.

arXiv AI
Oct 27

SAP-ViT: A Self-Attributing Patch Vision Transformer for Medical Image Classification

SAP-ViT is a Vision Transformer that replaces the traditional global classification token with direct aggregation of last‑layer patch embeddings, enabling class predictions to be decomposed into patch‑level contributions during the forward pass. The model incorporates sparsity regularization to produce concise, readable evidence and introduces an input‑space back‑mapping mechanism to identify which input patches influence the output. Experiments on diverse medical imaging datasets show that SAP‑ViT retains strong classification performance while delivering consistent, interpretable patch‑level explanations, with ablation studies confirming the benefits of both sparsity and back‑mapping.

By Wei Zhang, Wolfgang Nejdl, Ming Tang
arXiv Computer Vision
Aug 24

ES-VP : Energy-Shaped Dynamic Visual Prompting for Efficient Model Adaptation

ES‑VP introduces Energy‑Shaped Visual Prompting, a method that generates image‑specific prompts through low‑rank initialization and energy‑guided dynamic adaptation. It achieves higher performance than existing single‑prompt and diverse‑prompt approaches while using far fewer parameters. Experiments on five architectures and fifteen datasets show consistent superiority, including a 2.6% accuracy gain over DAM‑VP on CLIP with 590× fewer prompt parameters.

By Can Jin, Ying Li, Jingchen Sun, Hongwu Peng, Jiahui Zhao, Yang Zhou, Lei Li, Dimitris N. Metaxas
arXiv AI
Jul 17

Parameter-efficient Prompt Tuning of Vision Foundation Model With Adaptive Focal Loss for Interpretable MCI Screening

arXiv:2607. 15047v1 Announce Type: cross Abstract: Mild Cognitive Impairment is a critical early stage of cognitive decline that frequently precedes Alzheimer's disease, yet its automated detection from neuropsychological drawing tests remains fundamentally constrained by data scarcity, class imbalance, and diagnostic ambiguity near clinical boundaries.

By Javad Khoramdel, Farhad Hoseyni, Amirhossein Nikoofard