INTR++ is an Interpretable Transformer that builds on Prompt-CAM by adding a lightweight Prompt Adapter Module (PAM) to make prompts adaptive to domain-specific image characteristics. This design allows the model to maintain consistent interpretability and performance across diverse domains such as medical imaging, microscopic imaging, remote sensing, and object-centric data, while adding only a few extra parameters. The authors demonstrate that INTR++ improves accuracy, interpretability, and adaptability compared to previous Interpretable Transformers.
arXiv:2606. 06664v1 Announce Type: cross Abstract: Despite high accuracy, Vision Transformer (ViT) predictions can be driven by spurious cues, raising the need to understand their inner workings before safe deployment.
SAP-ViT is a Vision Transformer that replaces the traditional global classification token with direct aggregation of last‑layer patch embeddings, enabling class predictions to be decomposed into patch‑level contributions during the forward pass. The model incorporates sparsity regularization to produce concise, readable evidence and introduces an input‑space back‑mapping mechanism to identify which input patches influence the output. Experiments on diverse medical imaging datasets show that SAP‑ViT retains strong classification performance while delivering consistent, interpretable patch‑level explanations, with ablation studies confirming the benefits of both sparsity and back‑mapping.
arXiv:2607. 02185v1 Announce Type: cross Abstract: Deep learning has achieved remarkable performance in medical image segmentation, yet it suffers from critical limitations: mathematical intractability, substantial parameter requirements, and lack of clinical interpretability.
ES‑VP introduces Energy‑Shaped Visual Prompting, a method that generates image‑specific prompts through low‑rank initialization and energy‑guided dynamic adaptation. It achieves higher performance than existing single‑prompt and diverse‑prompt approaches while using far fewer parameters. Experiments on five architectures and fifteen datasets show consistent superiority, including a 2.6% accuracy gain over DAM‑VP on CLIP with 590× fewer prompt parameters.
arXiv:2512. 21414v2 Announce Type: replace-cross Abstract: Recent tool-use frameworks powered by vision-language models (VLMs) improve image understanding by grounding model predictions with specialized tools.
arXiv:2607. 15047v1 Announce Type: cross Abstract: Mild Cognitive Impairment is a critical early stage of cognitive decline that frequently precedes Alzheimer's disease, yet its automated detection from neuropsychological drawing tests remains fundamentally constrained by data scarcity, class imbalance, and diagnostic ambiguity near clinical boundaries.
arXiv:2608. 20229v1 Announce Type: cross Abstract: Anatomically plausible segmentation remains challenging because of low contrast, ambiguous boundaries, and modality-specific artifacts.
HierViT is a hierarchical Vision Transformer designed for medical image classification that balances strong predictive performance with interpretability. The model first predicts clinically relevant visual appearance attributes and then uses a hierarchical reasoning process to infer the final diagnosis. Attribute‑specific prototypes and attention maps are visualized to provide complementary views of the model’s reasoning, linking representative image examples and spatial attention to semantically defined visual features.
arXiv:2608. 14922v1 Announce Type: cross Abstract: Mechanistic interpretability has recently expanded to Vision Transformers (ViTs), with Sparse Autoencoders (SAEs) increasingly used as post-hoc tools to decompose internal representations into sparse and more interpretable features.
arXiv:2603. 18846v3 Announce Type: replace-cross Abstract: Foundation models are used to extract transferable representations from large amounts of unlabeled data, typically via self-supervised learning (SSL).
arXiv:2608.23745v1 Announce Type: cross Abstract: Accurate brain tumor segmentation from magnetic resonance imaging (MRI) is essential for diagnosis, treatment planning, surgical guidance, and diseas...
arXiv:2608.21300v1 Announce Type: new Abstract: Foundation models for medical image segmentation, like prompt-based MedSAM, generalize well across domains and modalities, often in zero or few-shot se...