Multi-Class Skin Disease Classification using Transfer Learning and Explainable AI

Ayutri Wahyuni, Resky Ayu Dewi Talasari, Muhammad Syawal Idil Fitrah Baharuddin

Abstract


This study investigates the application of transfer learning and Explainable Artificial Intelligence (XAI) for multi-class skin disease classification. The dataset was obtained from the Kaggle Skin Diseases Image Dataset and consists of 29,153 original images spanning 10 skin disease classes. To reduce the bias introduced by class imbalance, the dataset was balanced through directed undersampling, resulting in 12,000 images, with 1,200 images per class. Three pretrained convolutional neural network (CNN) architectures—EfficientNetB0, ResNet50, and DenseNet201—were implemented and evaluated using a confusion matrix, accuracy, precision, recall, and F1-score. The experimental results demonstrate that DenseNet201 achieved the highest classification performance, with an accuracy of 0.8779, precision of 0.8751, recall of 0.8748, and F1-score of 0.8745, outperforming ResNet50 (accuracy: 0.8629) and EfficientNetB0 (accuracy: 0.8269). Model interpretability was investigated using Grad-CAM, SHAP, and LIME. Grad-CAM highlighted that the models primarily focused on the central and peripheral regions of skin lesions during prediction. SHAP identified the dominant contribution of lesion regions and pigmentation patterns to the classification process, while LIME emphasized the importance of local superpixels associated with lesion boundaries, color, and texture in supporting the model's predictions. The findings indicate that combining transfer learning with Explainable AI provides a promising foundation for developing clinical decision support systems for dermatological image classification. Future research should incorporate external dataset validation, more robust class balancing strategies, and clinical interpretation by dermatology experts to facilitate the deployment of such systems in real-world healthcare settings.

Keywords


CNN; explainable artificial intelligence; multi-class classification; skin diseases; transfer learning

Full Text:

PDF

References


A. R. F. Siregar, T. S. Kairupan, and F. O. Mawu, “Gambaran Pengetahuan, Sikap, dan Tindakan Penggunaan Tabir Surya pada Mahasiswa Program Studi Kedokteran Umum Fakultas Kedokteran Universitas Sam Ratulangi,” Medical Scope Journal, Vol. 7, No. 1, pp. 8–14, Jun. 2024, DOI: 10.35790/msj.v7i1.53652.

R. Alfadli and S. Khairunisa, “Prevalensi Penyakit Kulit Infeksi dan Non-infeksi di Poliklinik Kulit dan Kelamin RSUD Jagakarsa Periode Februari 2023 - Januari 2024,” Jurnal Kedokteran Meditek, Vol. 30, No. 3, pp. 151–156, Sep. 2024, DOI: 10.36452/jkdoktmeditek.v30i3.3254.

N. Nurkhasanah and M. Murinto, “Klasifikasi Penyakit Kulit Wajah menggunakan Metode Convolutional Neural Network,” Sainteks, Vol. 18, No. 2, p. 183, Feb. 2022, DOI: 10.30595/sainteks.v18i2.13188.

Qorry Aina Fitroh and Shofwatul ’Uyun, “Deep Transfer Learning untuk Meningkatkan Akurasi Klasifikasi pada Citra Dermoskopi Kanker Kulit,” Jurnal Nasional Teknik Elektro dan Teknologi Informasi, Vol. 12, No. 2, pp. 78–84, May 2023, DOI: 10.22146/jnteti.v12i2.6502.

R. Agustina, R. Magdalena, And N. K. C. Pratiwi, “Klasifikasi Kanker Kulit menggunakan Metode Convolutional Neural Network dengan Arsitektur VGG-16,” ELKOMIKA: Jurnal Teknik Energi Elektrik, Teknik Telekomunikasi, & Teknik Elektronika, Vol. 10, No. 2, p. 446, Apr. 2022, DOI: 10.26760/elkomika.v10i2.446.

T. Saputra and M. E. Al-Rivan, “Analisis Performa ResNet-152 dan AlexNet dalam Klasifikasi Jenis Kanker Kulit,” STRING (Satuan Tulisan Riset dan Inovasi Teknologi), Vol. 8, No. 1, p. 75, Aug. 2023, DOI: 10.30998/string.v8i1.16464.

A. C. Ramdhana and N. Pratiwi, “Perbandingan Kinerja Model Convolutional Neural Network pada Klasifikasi Kanker Kulit,” Edumatic: Jurnal Pendidikan Informatika, Vol. 7, No. 2, pp. 197–206, Dec. 2023, DOI: 10.29408/edumatic.v7i2.19823.

F. Dartiko, R. J. Pradana, R. E. Sari, W. Syahputra, and W. K. Oktoeberza, “Klasifikasi Kanker Kulit berbasis CNN dengan Metode Hybrid Preprocessing,” Medika Teknika : Jurnal Teknik Elektromedik Indonesia, Vol. 5, No. 2, pp. 124–132, Apr. 2024, DOI: 10.18196/mt.v5i2.22675.

D. Septhya, Rahmaddeni, Susanti, and Agustin, “Penerapan Algoritma Convolutional Neural Network untuk Klasifikasi Penyakit Kanker Kulit,” The Indonesian Journal of Computer Science, Vol. 13, No. 4, Aug. 2024, DOI: 10.33022/ijcs.v13i4.4262.

A. Gramegna and P. Giudici, “SHAP and LIME: An Evaluation of Discriminative Power in Credit Risk,” Front. Artif. Intell., Vol. 4, Sep. 2021, DOI: 10.3389/frai.2021.752558.

D. I. Raditya, I. Slamet, W. Sulandari, I. Susanto, E. Zukhronah, and B. Isnaini, “A Comparative Study of Densenet121 and Resnet50 with Grad-Cam for Skin Disease Classification for Improving Good Health,” Journal of Lifestyle and SDGs Review, Vol. 5, No. 7, p. e06526, Jul. 2025, DOI: 10.47172/2965-730X.SDGsReview.v5.n07.pe06526.

Ramadhan, Muhammad Eky, and Junta Zeniarja. "Implementation of Deep Transfer Learning and Explainable AI in Skin Cancer Classification." Sistemasi: Jurnal Sistem Informasi 14.5 (2025): 2266-2279.

D. Indra Raditya, I. Slamet, and dan Yuliana Susanti, “SNESTIK Seminar Nasional Teknik Elektro, Sistem Informasi, dan Teknik Informatika Penerapan Transfer Learning pada Arsitektur DenseNet121 dan ResNet50 untuk Deteksi Penyakit Kulit berbasis Citra dengan Explainable AI”, DOI: 10.31284/p.snestik.2025.7647.

Saputra, Tommy, and Muhammad Ezar Al-Rivan. "Analisis Performa ResNet-152 dan AlexNet dalam Klasifikasi Jenis Kanker Kulit." STRING (Satuan Tulisan Riset dan Inovasi Teknologi) 8.1 (2023): 75-84.

S. Alkhalaf, F. Alturise, A. A. Bahaddad, B. M. E. Elnaim, S. Shabana, S. Abdel-Khalek, and R. F. Mansour, “Adaptive Aquila Optimizer with Explainable Artificial Intelligence-Enabled Cancer Diagnosis on Medical Imaging,” Cancers (Basel)., Vol. 15, No. 5, p. 1492, Feb. 2023, DOI: 10.3390/cancers15051492.

Kaggle. "Skin Diseases Image Dataset." Kaggle.com. https://www.kaggle.com/datasets/ismailpromus/skin-diseases-image-dataset (accessed May 30, 2026).

S. Sathyanarayanan, “Confusion Matrix-based Performance Evaluation Metrics,” African Journal of Biomedical Research, pp. 4023–4031, Nov. 2024, DOI: 10.53555/AJBR.v27i4S.4345.




DOI: https://doi.org/10.32520/stmsi.v15i6.6505

Article Metrics

Abstract view : 0 times
PDF - 0 times

Refbacks

  • There are currently no refbacks.


Creative Commons License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.