arXiv Computer Vision

Multi-Dataset Diagnostic Utility of Clinical Visual Concepts in AI Systems for Dermatology

arXiv Computer Vision
3d ago

When Annotation Patterns Are Learned: Skin-Tone Dependence in Dermatology Concepts

Concept bottleneck models (CBMs) rely on reliable concept annotations to allow clinicians to inspect and correct skin disease diagnoses. An audit of the SkinCon dermatology concept dataset reveals a tone‑dependent pattern: erythema is annotated far less often on dark skin (odds ratio 0.17) while hyperpigmentation and hypopigmentation are annotated more often (odds ratios 6.2 and 4.5). An evidential concept model trained on these annotations reproduces the same bias, and three label‑error detectors perform worse than a disease‑only baseline at detecting erythema mentioned by dermatologists but absent in SkinCon labels. The study concludes that concept annotations must be audited within each subgroup before they can be trusted for explanations.

By Y. Li, M. Bigliardi-Qi, S. Bedros, P. Bigliardi, N. Papanikolopoulos
arXiv Computer Vision
Oct 5

Bridging Research and Practice: A Systematic Evaluation of Generalist and Dermatology-Specific Models in Clinical Skin Lesion Classification

The paper evaluates how well generalist and dermatology-specific machine learning models perform on diverse skin lesion datasets, including dermoscopic images and smartphone photographs. It benchmarks a range of architectures—general-purpose vision-language models, foundation models, and task-specific dermatology classifiers—under conditions of distribution shift, modality change, and demographic variability. The study quantifies the performance gap between current state‑of‑the‑art models and the robustness needed for safe, equitable clinical deployment.

By Emanoel dos Santos, Kelvin Cunha, Rodrigo Mota, Fabio Papais, Thales Bezerra, Natalia Lopes, Erico Medeiros, Shirley Cruz, Jessica Araujo, Paulo Borba, Tsang Ing Ren
arXiv AI
Sep 3

Disease Burden over Skin Tone: Decomposing the Dermatology-AI Generalization Gap

The study examines why dermatology AI models, largely trained on light‑skinned, cancer‑focused images, perform poorly when applied to diverse patient populations. By comparing a cancer‑trained baseline, two dermatology foundation models, and a general‑purpose vision model on tone‑stratified and disease‑shifted datasets, the authors find that disease‑distribution shift, rather than skin‑tone underrepresentation, is the primary cause of generalization failure. Representation analysis shows that cancer‑specialized features lack transferable structure, while dermatology‑pretrained features maintain stronger clustering, and lightweight adaptation with about ten labeled examples per category can recover most performance.

By Nirajan Kunwor, Sanjaya Poudel, Quoc-Huy Trinh, Jahidul Arafat, Sunil Kumar Gaire
arXiv AI
Sep 28

CG-HAF: An Interpretable Global-Local Lesion-Burden Fusion Framework for Ordinal Acne Severity Grading in Agentic Skincare Support

CG-HAF is a global‑local fusion framework for ordinal acne severity grading that explicitly combines holistic facial severity probabilities with structured lesion‑burden descriptors such as lesion count, detection confidence, and lesion area. The model uses a lightweight, interpretable classifier to produce the final grade, achieving statistically significant improvements over global‑evidence‑only baselines, especially for severe cases. Cross‑dataset testing reveals that strong performance within a dataset does not automatically transfer, largely due to mismatched grading criteria rather than detection failures.

By Muhammad Muhtasim Shahriar, Md. Naimur Asif Borno, Saad Aloteibi, Mohammad Ali Moni
arXiv Machine Learning
Aug 20

MIFR: A Modality-Invariant and Fair Representation Framework for Skin Disease Classification

The paper introduces MIFR, a modality‑invariant and fair representation framework for skin disease classification that jointly processes clinical photographs and dermoscopic images using ViT‑based encoders. It employs a five‑component multi‑objective loss to balance classification accuracy, fairness across skin tones, class alignment, and modality invariance. Experiments on paired and external datasets demonstrate competitive predictive performance and fairness, with t‑SNE visualizations confirming alignment of embeddings from different modalities.

By Asonyu Senge Njih, Yvan Guifo Fodjo, Vianney Kengne Tchendji, Jerry Lacmou Zeutouo, Kerol Djoumessi
Hugging Face Trending Papers
Aug 11

Uncertainty-Aware and Explainable Ensemble Deep Learning Framework for Multi-Class Skin Lesion Classification

Skin cancer diagnosis from dermoscopic images remains challenging due to high intra-class variability, inter-class similarity, class imbalance, and the limited interpretability of deep learning models. This paper proposes an uncertainty-aware and explainable deep learning framework for multi-class skin lesion classification.