arXiv AI

Integrating Implicit and Explicit Relational Biases through Graph-Based Multiple Instance Learning: A Case Study in Skin Lesion Diagnosis

arXiv:2608. 06037v1 Announce Type: new Abstract: Relational inductive biases are essential for capturing structural dependencies among data.

arXiv AI
Aug 21

MKG-CARE: Case-Aware Reasoning with Multimodal Knowledge Graphs for Explainable Medical Image Diagnosis

arXiv:2605. 22547v3 Announce Type: replace-cross Abstract: Medical image diagnosis has achieved significant progress with deep learning, yet existing methods often rely on isolated visual evidence and lack the ability to effectively leverage similar cases and external knowledge.

By Yiming Xu, Yixuan Liu, Yuhang Zhang, Ling Zheng, Yihan Wang, Qi Song
arXiv AI
Sep 15

End-to-End Cell Detection via Instance-aware Graph Modeling

The paper introduces an end‑to‑end framework for detecting and classifying cells in pathology images by jointly modeling visual features and instance‑level interactions. It employs a dynamic graph construction module that builds cell graphs from learnable queries and an instance‑aware graph network that filters and reorganizes features, integrating appearance and relational evidence. Experiments on multiple staining protocols show the method surpasses existing approaches in both detection and classification accuracy.

By Ruochen Liu, Yalin Zheng, Jingxin Liu, Jianfeng Zhang, Shoujun Huang, Dexing Kong, Haofeng Li, Wei Lou
arXiv Machine Learning
Sep 17

Interpretable Retinal Disease Prediction Using Biology-Informed Heterogeneous Graph Representations

The paper introduces a biology-informed heterogeneous graph representation that models retinal vessel segments, intercapillary areas, and the foveal avascular zone to predict diabetic retinopathy stages from OCTA images. This graph-based approach reframes staging as a graph-level classification task solved with a graph neural network, achieving AUC-ROC values up to 84% and outperforming biomarker-based classifiers, CNNs, and vision transformers. The method also provides detailed, interpretable explanations by precisely localizing abnormal vessels and non-perfusion areas.

By Laurin Lux, Alexander H. Berger, Maria Romeo Tricas, Richard Rosen, Alaa E. Fayed, Sobha Sivaprasada, Linus Kreitner, Jonas Weidner, Martin J. Menten, Daniel Rueckert, Johannes C. Paetzold
arXiv Computer Vision
Sep 21

Graph-Augmented Topological Internalization with Dual-Stream Classifiers for Medical Report Generation

The paper introduces GDMRG, a Graph-Augmented Dual-Stream Medical Report Generation framework that incorporates a Topological Knowledge Internalization module using a Graph Convolutional Network to encode disease co-occurrence priors. It employs a dual-stream classifier—one branch generating diagnostic prompts under topological constraints and an auxiliary branch dynamically calibrating decision boundaries for imbalanced samples—alongside a Diagnosis-Guided Spatial Attention mechanism to align visual features with clinical semantics. Experiments on MIMIC-CXR show competitive clinical efficacy and natural language fluency, with strong zero-shot performance on IU X-Ray.

By Moyu Tang, Shangkun Sima, Chupei Tang, Junxiao Kong, Di Wang, Tianchi Lu
arXiv Computer Vision
Sep 7

An Attention-Guided Global and Local Fusion Framework for Lesion-Focused Image Classification

The paper introduces an attention‑guided fusion framework that combines global and lesion‑focused local information for image classification. Using a three‑branch architecture built on DenseNet‑121, the model generates attention maps with Grad‑CAM, refines local features with CBAM, and adaptively fuses the two representations. Experiments on synthetic and real datasets, including skin, guava leaf, and grape leaf images, show that the fusion branch outperforms individual branches, achieving up to 97.75% accuracy on skin lesions and 99.64% on guava leaves.

By Mst Shafia Tasnima, Md Samaun Elaheea, Tanjim Taharat Aurpab, Md Musfique Anwar
arXiv Computer Vision
Sep 25

Context-aware Skin Cancer Epithelial Cell Classification with Scalable Graph Transformers

The paper introduces scalable Graph Transformers for classifying healthy versus tumor epithelial cells in whole-slide images of cutaneous squamous cell carcinoma. By constructing a full‑WSI cell graph and incorporating morphological, texture, and neighboring cell class features, the proposed SGFormer and DIFFormer models outperform traditional image‑based methods, achieving balanced accuracies above 85% on single‑WSI tests and 83.6% on multi‑WSI evaluations. The study demonstrates that preserving tissue‑level context through graph representations improves classification of morphologically similar cell types.

By Lucas Sanc\'er\'e, No\'emie Moreau, Katarzyna Bozek