{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,23]],"date-time":"2026-10-23T21:01:00Z","timestamp":1792789260035,"version":"4.5.0"},"reference-count":35,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2025,2,5]],"date-time":"2025-02-05T00:00:00Z","timestamp":1738713600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Research Projects Support Program","award":["ADEP.23.11"],"award-info":[{"award-number":["ADEP.23.11"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Diagnostics"],"abstract":"<jats:p>Background\/Objectives: As reported by the World Health Organization, Mpox (monkeypox) is an important disease present in 110 countries, mostly in South Asia and Africa. The number of Mpox cases has increased rapidly, and the medical world is worried about the emergence of a new pandemic. Detection of Mpox by traditional methods (using test kits) is a costly and slow process. For this reason, there is a need for methods that have high success rates and can diagnose Mpox disease from skin images with a deep-learning-based autonomous method. Methods: In this work, we propose a multi-class, fast, and reliable autonomous disease diagnosis model using transformer-based deep learning architectures and skin lesion images, including for Mpox disease. Our other aim is to investigate the effects of self-supervised learning, self-distillation, and shifted window techniques on classification success when multi-class skin lesion images are trained with transformer-based deep learning architectures. The Mpox Skin Lesion Dataset, Version 2.0, which was publicly released in 2024, was used in the training, validation, and testing processes of the study. Results: The SwinTransformer architecture we proposed in our study achieved about 8% higher accuracy evaluation metric classification success compared to its closest competitor in the literature. ViT, MAE, DINO, and SwinTransformer architectures achieved 93.10%, 84.60%, 90.40%, and 93.71% accuracy classification success, respectively. Conclusions: The results obtained in the study showed that Mpox disease and other skin lesion images can be diagnosed with high success and can support doctors in decision-making. In addition, the study provides important results that can be used in other medical fields where the number of images is low in terms of transformer-based architecture and technique to use.<\/jats:p>","DOI":"10.3390\/diagnostics15030374","type":"journal-article","created":{"date-parts":[[2025,2,5]],"date-time":"2025-02-05T04:15:41Z","timestamp":1738728941000},"page":"374","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":29,"title":["Multi-Classification of Skin Lesion Images Including Mpox Disease Using Transformer-Based Deep Learning Architectures"],"prefix":"10.3390","volume":"15","author":[{"ORCID":"https:\/\/orcid.org\/0009-0002-9906-8170","authenticated-orcid":false,"given":"Seyfettin","family":"Vuran","sequence":"first","affiliation":[{"name":"Department of Information Technologies, Dicle University, Diyarbakir 21200, Turkey"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9219-2262","authenticated-orcid":false,"given":"Murat","family":"Ucan","sequence":"additional","affiliation":[{"name":"Department of Computer Technologies, Dicle University, Diyarbakir 21200, Turkey"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mehmet","family":"Akin","sequence":"additional","affiliation":[{"name":"Electrical-Electronics Engineering, Faculty of Engineering, Dicle University, Diyarbakir 21280, Turkey"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mehmet","family":"Kaya","sequence":"additional","affiliation":[{"name":"Department of Computer Engineering, Firat University, Elazig 23119, Turkey"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2025,2,5]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"20","DOI":"10.1016\/j.annemergmed.2022.07.014","article-title":"Diagnosis and Management of Monkeypox: A Review for the Emergency Clinician","volume":"81","author":"Reffett","year":"2023","journal-title":"Ann. Emerg. Med."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"e28229","DOI":"10.1002\/jmv.28229","article-title":"Monkeypox Treatment: Current Evidence and Future Perspectives","volume":"95","author":"Khani","year":"2023","journal-title":"J. Med. Virol."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"307","DOI":"10.4314\/ajcem.v19i4.9","article-title":"Re-Emergence of Monkeypox in Nigeria: A Cause for Concern and Public Enlightenment","volume":"19","author":"Fowotade","year":"2018","journal-title":"Afr. J. Clin. Exp. Microbiol."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Akkuzu, N., Ucan, M., and Kaya, M. (2023, January 25\u201326). Classification of Multi-Label Electrocardiograms Utilizing the EfficientNet CNN Model. Proceedings of the 2023 4th International Conference on Data Analytics for Business and Industry (ICDABI), Bahrain.","DOI":"10.1109\/ICDABI60145.2023.10629383"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"101794","DOI":"10.1016\/j.media.2020.101794","article-title":"Deep-COVID: Predicting COVID-19 from Chest X-Ray Images Using Deep Transfer Learning","volume":"65","author":"Minaee","year":"2020","journal-title":"Med. Image Anal."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"379","DOI":"10.1016\/j.jad.2020.08.043","article-title":"Psychological Impact of COVID-19 Pandemic in the Philippines","volume":"277","author":"Tee","year":"2020","journal-title":"J. Affect. Disord."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Ucan, S., Ucan, M., and Kaya, M. (2023, January 25\u201326). Deep Learning Based Approach with EfficientNet and SE Block Attention Mechanism for Multiclass Alzheimer\u2019s Disease Detection. Proceedings of the 2023 4th International Conference on Data Analytics for Business and Industry (ICDABI), Bahrain.","DOI":"10.1109\/ICDABI60145.2023.10629380"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Charoenchue, P., Khorana, J., Chitapanarux, T., Inmutto, N., Na Chiangmai, W., Amantakul, A., Pojchamarnwiputh, S., and Tantraworasin, A. (2025). Two-Dimensional Shear-Wave Elastography: Accuracy in Liver Fibrosis Staging Using Magnetic Resonance Elastography as the Reference Standard. Diagnostics, 15.","DOI":"10.3390\/diagnostics15010062"},{"key":"ref_9","unstructured":"Song, H., Sun, D., Chun, S., Jampani, V., Han, D., Heo, B., Kim, W., and Yang, M.-H. (2022). An Extendable, Efficient and Effective Transformer-Based Object Detector. arXiv."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Ali, S.N., Ahmed, M.T., Jahan, T., Paul, J., Sakeef Sani, S.M., Noor, N., Asma, A.N., and Hasan, T. (2024). A Web-Based Mpox Skin Lesion Detection System Using State-of-the-Art Deep Learning Models Considering Racial Diversity. Biomed. Signal Process Control, 98.","DOI":"10.1016\/j.bspc.2024.106742"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"7107","DOI":"10.1007\/s11760-024-03379-8","article-title":"Binarydnet53: A Lightweight Binarized CNN for Monkeypox Virus Image Classification","volume":"18","author":"Biswas","year":"2024","journal-title":"Signal Image Video Process."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"757","DOI":"10.1016\/j.neunet.2023.02.022","article-title":"MonkeyNet: A Robust Deep Convolutional Neural Network for Monkeypox Disease Detection and Classification","volume":"161","author":"Bala","year":"2023","journal-title":"Neural Netw."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Akram, A., Jamjoom, A.A., Innab, N., Almujally, N.A., Umer, M., Alsubai, S., and Fimiani, G. (2024). SkinMarkNet: An Automated Approach for Prediction of MonkeyPox Using Image Data Augmentation with Deep Ensemble Learning Models. Multimed. Tools Appl.","DOI":"10.1007\/s11042-024-19862-w"},{"key":"ref_14","unstructured":"(2024, August 30). Mpox Skin Lesion Dataset Version 2.0 (MSLD v2.0). Available online: https:\/\/www.kaggle.com\/datasets\/joydippaul\/mpox-skin-lesion-dataset-version-20-msld-v20\/data."},{"key":"ref_15","unstructured":"Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., and Gelly, S. (2020). An Image Is Worth 16x16 Words: Transformers for Image Recognition at Scale. arXiv."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Maur\u00edcio, J., Domingues, I., and Bernardino, J. (2023). Comparing Vision Transformers and Convolutional Neural Networks for Image Classification: A Literature Review. Appl. Sci., 13.","DOI":"10.3390\/app13095521"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"87","DOI":"10.1109\/TPAMI.2022.3152247","article-title":"A Survey on Vision Transformer","volume":"45","author":"Han","year":"2023","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Manzari, O.N., Ahmadabadi, H., Kashiani, H., Shokouhi, S.B., and Ayatollahi, A. (2023). MedViT: A Robust Vision Transformer for Generalized Medical Image Classification. Comput. Biol. Med., 157.","DOI":"10.1016\/j.compbiomed.2023.106791"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"He, K., Chen, X., Xie, S., Li, Y., Doll\u00e1r, P., and Girshick, R. (2022, January 18\u201324). Masked Autoencoders Are Scalable Vision Learners. Proceedings of the 2022 IEEE\/CVF Conference on Computer Vision and Pattern Recognition, New Orleans, LA, USA.","DOI":"10.1109\/CVPR52688.2022.01553"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Xu, Z., Dai, Y., Liu, F., Chen, W., Liu, Y., Shi, L., Liu, S., and Zhou, Y. (2023). Swin MAE: Masked Autoencoders for Small Datasets. Comput. Biol. Med., 161.","DOI":"10.1016\/j.compbiomed.2023.107037"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Zhang, H., Patkar, S., Lis, R., Merino, M.J., Pinto, P.A., Choyke, P.L., Turkbey, B., and Harmon, S. (2024). Masked Image Modeling Meets Self-Distillation: A Transformer-Based Prostate Gland Segmentation Framework for Pathology Slides. Cancers, 16.","DOI":"10.3390\/cancers16233897"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Lu, Q., Wang, B., He, Q., Zhang, Q., Guo, L., Li, J., Li, J., and Ma, Q. (2024). A Blood Cell Classification Method Based on MAE and Active Learning. Biomed. Signal Process Control, 90.","DOI":"10.1016\/j.bspc.2023.105813"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Caron, M., Touvron, H., Misra, I., J\u00e9gou, H., Mairal, J., Bojanowski, P., and Joulin, A. (2021, January 10\u201317). Emerging Properties in Self-Supervised Vision Transformers. Proceedings of the 2021 IEEE\/CVF International Conference on Computer Vision, Montreal, QC, Canada.","DOI":"10.1109\/ICCV48922.2021.00951"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"143628","DOI":"10.1109\/ACCESS.2023.3342838","article-title":"An Effective Representation Learning Approach: The Integrated Self-Supervised Pre-Training Models of StyleGAN2-ADA and DINO for Colon Polyp Images","volume":"11","author":"Kim","year":"2023","journal-title":"IEEE Access"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"6180","DOI":"10.1109\/JBHI.2024.3423797","article-title":"MS-DINO: Masked Self-Supervised Distributed Learning Using Vision Transformer","volume":"28","author":"Park","year":"2024","journal-title":"IEEE J. Biomed. Health Inform."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"2233","DOI":"10.1007\/s00345-023-04489-7","article-title":"A Self-Supervised Vision Transformer to Predict Survival from Histopathology in Renal Cell Carcinoma","volume":"41","author":"Wessels","year":"2023","journal-title":"World J. Urol."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Liu, Z., Lin, Y., Cao, Y., Hu, H., Wei, Y., Zhang, Z., Lin, S., and Guo, B. (2021, January 10\u201317). Swin Transformer: Hierarchical Vision Transformer Using Shifted Windows. Proceedings of the 2021 IEEE\/CVF International Conference on Computer Vision, Montreal, QC, Canada.","DOI":"10.1109\/ICCV48922.2021.00986"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"117617","DOI":"10.1109\/ACCESS.2024.3448304","article-title":"SPT-Swin: A Shifted Patch Tokenization Swin Transformer for Image Classification","volume":"12","author":"Ferdous","year":"2024","journal-title":"IEEE Access"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"281","DOI":"10.1016\/j.neucom.2022.04.051","article-title":"Swin Transformer for Fast MRI","volume":"493","author":"Huang","year":"2022","journal-title":"Neurocomputing"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"94306","DOI":"10.1109\/ACCESS.2023.3311346","article-title":"Automated Detection of Retinopathy of Prematurity Using Quantum Machine Learning and Deep Learning Techniques","volume":"11","author":"Sankari","year":"2023","journal-title":"IEEE Access"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"125009","DOI":"10.1016\/j.eswa.2024.125009","article-title":"Swin Transformer-Based Fork Architecture for Automated Breast Tumor Classification","volume":"256","author":"Firat","year":"2024","journal-title":"Expert. Syst. Appl."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Disci, R., Gurcan, F., and Soylu, A. (2025). Advanced Brain Tumor Classification in MR Images Using Transfer Learning and Pre-Trained Deep CNN Models. Cancers, 17.","DOI":"10.3390\/cancers17010121"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Markoulidakis, I., Rallis, I., Georgoulas, I., Kopsiaftis, G., Doulamis, A., and Doulamis, N. (2021). Multiclass Confusion Matrix Reduction Method and Its Application on Net Promoter Score Classification Problem. Technologies, 9.","DOI":"10.3390\/technologies9040081"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Jaradat, A.S., Al Mamlook, R.E., Almakayeel, N., Alharbe, N., Almuflih, A.S., Nasayreh, A., Gharaibeh, H., Gharaibeh, M., Gharaibeh, A., and Bzizi, H. (2023). Automated Monkeypox Skin Lesion Detection Using Deep Learning and Transfer Learning Techniques. Int. J. Environ. Res. Public Health, 20.","DOI":"10.3390\/ijerph20054422"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"112553","DOI":"10.1016\/j.asoc.2024.112553","article-title":"MobileNetV2-Based Deep Learning Architecture with Progressive Transfer Learning for Accurate Monkeypox Detection","volume":"169","author":"Xu","year":"2025","journal-title":"Appl. Soft Comput."}],"container-title":["Diagnostics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2075-4418\/15\/3\/374\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,9]],"date-time":"2025-10-09T16:26:59Z","timestamp":1760027219000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2075-4418\/15\/3\/374"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,2,5]]},"references-count":35,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2025,2]]}},"alternative-id":["diagnostics15030374"],"URL":"https:\/\/doi.org\/10.3390\/diagnostics15030374","relation":{},"ISSN":["2075-4418"],"issn-type":[{"value":"2075-4418","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,2,5]]}}}