MultiAttenGastro is a plug‑and‑play attention framework that adds parallel 1‑D channel, 2‑D spatial, and 3‑D contextual heads to existing CNN and transformer backbones for gastrointestinal endoscopy classification. Across eight backbones and five public GI datasets, the framework improves performance on large‑gap datasets such as Kvasir‑Capsule but shows no benefit on small‑gap benchmarks like Kvasir‑v2, with mixed results elsewhere. Analysis using Centered Kernel Alignment indicates that the gains are linked to representational redundancy: low inter‑head redundancy under large domain gaps yields consistent improvements, while high redundancy under small gaps leads to losses.
arXiv:2610.33965v1 Announce Type: new Abstract: Automated classification of gastrointestinal (GI) findings in endoscopic images could support early diagnosis, but architectures are often chosen on ac...
arXiv:2608.08374v3 Announce Type: replace Abstract: Transformer models are increasingly used for whole-slide image analysis in computational pathology. Yet, WSIs differ fundamentally from natural ima...
The paper introduces FAD‑ViT, a vision transformer that decouples spatial and feature axes of global attention, making feature‑axis attention the primary operator. Experiments on 23 medical imaging tasks show that shifting global attention from spatial to feature leaves from‑scratch performance unchanged but significantly boosts transfer learning, achieving up to three times the gain with fewer parameters and lower compute. The study demonstrates that prioritizing feature‑axis attention is a simple, cost‑effective design choice for improving medical image transfer.
CEM‑TUDASR is a lightweight, unsupervised Transformer-based super‑resolution framework designed to enhance low‑resolution images from Wireless Capsule Endoscopy (WCE). It uses a domain‑adaptive degradation network to generate realistic WCE‑like low‑resolution images from high‑resolution conventional endoscopy data, enabling effective unpaired learning. The model incorporates Deep Attention Blocks and a Fusion Attention Block to capture both global context and fine local details, achieving superior performance on WCE datasets and demonstrating cross‑domain adaptability to retinal images, all while keeping the parameter count and computational load low.
arXiv:2607.09086v2 Announce Type: replace Abstract: We present Subtoken Vision Transformer (SubViT), a selective image tokenization method for fine-grained visual recognition. Standard Vision Transfo...
CEM‑TUDASR is a lightweight, unsupervised Transformer‑based super‑resolution framework designed for Wireless Capsule Endoscopy (WCE) images. It uses a domain‑adaptive degradation network to synthesize realistic low‑resolution WCE images from high‑resolution conventional endoscopy data, enabling unpaired training. The SR generator incorporates Deep Attention Blocks and a Fusion Attention Block to preserve both global context and fine local structures, achieving superior no‑reference quality metrics and improved restoration of mucosal textures, vascular patterns, and anatomical details while remaining computationally efficient.
The study evaluated whole‑slide image classifiers for gastric cancer across five Korean hospitals, using foundation‑model features and leave‑one‑hospital‑out validation. A hierarchical patch‑region‑slide graph aggregator (CHIME‑MIL) with site alignment and two‑scale fusion achieved a mean AUC of 0.837, outperforming six conventional attention and transformer aggregators that lacked these steps. However, when matched with the same alignment and fusion, CHIME‑MIL did not surpass simple attention‑based pooling, and global max pooling performed best (AUC 0.855). The alignment step, which subtracts each hospital’s mean feature vector without labels, enabled onboarding of a new hospital from only ten unlabeled slides but yielded only a modest 0.002 AUC improvement, and the model’s accuracy gains were inconsistent. "whyItMatters":"The findings show that adding complex aggregation methods does not necessarily improve cross‑hospital discrimination, highlighting the importance of simpler, label‑free onboarding and calibration checks for deployable pathology systems."
The paper introduces an attention‑guided fusion framework that combines global and lesion‑focused local information for image classification. Using a three‑branch architecture built on DenseNet‑121, the model generates attention maps with Grad‑CAM, refines local features with CBAM, and adaptively fuses the two representations. Experiments on synthetic and real datasets, including skin, guava leaf, and grape leaf images, show that the fusion branch outperforms individual branches, achieving up to 97.75% accuracy on skin lesions and 99.64% on guava leaves.
MDSkin-Net is a multi‑task skin lesion analysis framework that integrates Pattern Analysis priors into a hybrid CNN‑Transformer architecture. It introduces a Pattern Analysis‑Guided Attention Module (PAGAM) with improved Efficient Channel Attention, Multi‑Scale Spatial Attention, and Biased Asymmetry Attention, along with a multi‑scale spatial alignment regularization that uses segmentation masks as soft supervision. Trained only on the ISIC 2017 training split, the model achieves high segmentation and classification performance on multiple datasets, demonstrating strong zero‑shot generalization across different cohorts.
The paper introduces ACSAN, an All‑Convolutional Self‑Attention Network that replaces the fully‑connected matrix multiplications of Vision Transformers with convolution operations. Its core module, Dynamic Convolutional Self‑Attention (DCSA), uses multi‑scale dilated convolutions to produce Query, Key, and Value tensors, and combines spatial and channel self‑attention into a single output. Experiments on CIFAR‑10, CIFAR‑100, and ImageNet‑1k demonstrate that ACSAN attains competitive or superior classification accuracy to ViT while using comparable or fewer parameters, and ablation studies confirm the positive contribution of each component.
arXiv:2605.07191v2 Announce Type: replace-cross Abstract: A recent work shows that Attention Transfer, which transfers only the attention patterns from a pre-trained teacher Vision Transformer (ViT)...
arXiv:2608. 07176v1 Announce Type: cross Abstract: Developing foundation generative models for endoscopy is limited by the gap between natural and clinical images and the computational cost of training large Diffusion Transformers.