{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,17]],"date-time":"2026-06-17T20:30:08Z","timestamp":1781728208426,"version":"3.54.5"},"reference-count":40,"publisher":"MDPI AG","issue":"19","license":[{"start":{"date-parts":[[2022,10,4]],"date-time":"2022-10-04T00:00:00Z","timestamp":1664841600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Today, the rapid development of industrial zones leads to an increased incidence of skin diseases because of polluted air. According to a report by the American Cancer Society, it is estimated that in 2022 there will be about 100,000 people suffering from skin cancer and more than 7600 of these people will not survive. In the context that doctors at provincial hospitals and health facilities are overloaded, doctors at lower levels lack experience, and having a tool to support doctors in the process of diagnosing skin diseases quickly and accurately is essential. Along with the strong development of artificial intelligence technologies, many solutions to support the diagnosis of skin diseases have been researched and developed. In this paper, a combination of one Deep Learning model (DenseNet, InceptionNet, ResNet, etc) with Soft-Attention, which unsupervisedly extract a heat map of main skin lesions. Furthermore, personal information including age and gender are also used. It is worth noting that a new loss function that takes into account the data imbalance is also proposed. Experimental results on data set HAM10000 show that using InceptionResNetV2 with Soft-Attention and the new loss function gives 90 percent accuracy, mean of precision, F1-score, recall, and AUC of 0.81, 0.81, 0.82, and 0.99, respectively. Besides, using MobileNetV3Large combined with Soft-Attention and the new loss function, even though the number of parameters is 11 times less and the number of hidden layers is 4 times less, it achieves an accuracy of 0.86 and 30 times faster diagnosis than InceptionResNetV2.<\/jats:p>","DOI":"10.3390\/s22197530","type":"journal-article","created":{"date-parts":[[2022,10,10]],"date-time":"2022-10-10T05:12:21Z","timestamp":1665378741000},"page":"7530","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":47,"title":["Skin Lesion Classification on Imbalanced Data Using Deep Learning with Soft Attention"],"prefix":"10.3390","volume":"22","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-7152-0191","authenticated-orcid":false,"given":"Viet Dung","family":"Nguyen","sequence":"first","affiliation":[{"name":"School of Electrical and Electronic Engineering, Hanoi University of Science and Technology, Dai Co Viet, Ha Noi 100000, Vietnam"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9934-7474","authenticated-orcid":false,"given":"Ngoc Dung","family":"Bui","sequence":"additional","affiliation":[{"name":"Faculty of Information Technology, University of Transport and Communications, Ha Noi 100000, Vietnam"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2566-5637","authenticated-orcid":false,"given":"Hoang Khoi","family":"Do","sequence":"additional","affiliation":[{"name":"School of Electrical and Electronic Engineering, Hanoi University of Science and Technology, Dai Co Viet, Ha Noi 100000, Vietnam"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2022,10,4]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Datta, S.K., Shaikh, M.A., Srihari, S.N., and Gao, M. (2021). Soft-Attention Improves Skin Cancer Classification Performance. Interpretability of Machine Intelligence in Medical Image Computing, and Topological Data Analysis and Its Applications for Medical Data, Springer.","DOI":"10.1007\/978-3-030-87444-5_2"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"104065","DOI":"10.1016\/j.compbiomed.2020.104065","article-title":"Artificial Intelligence-Based Image Classification for Diagnosis of Skin Cancer: Challenges and Opportunities","volume":"127","author":"Goyal","year":"2020","journal-title":"Comput. Biol. Med."},{"key":"ref_3","unstructured":"Poduval, P., Loya, H., and Sethi, A. (2020). Functional Space Variational Inference for Uncertainty Estimation in Computer Aided Diagnosis. arXiv."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Gao, H., Zhuang, L., and Kilian, Q. (2017, January 21\u201326). Weinberger: Densely Connected Convolutional Network. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.243"},{"key":"ref_5","unstructured":"Howard, A.G., Zhu, M., Chen, B., Kalenichenko, D., Wang, W., Weyand, T., Andreetto, M., and Adam, H. (2017). MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications. arXiv."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., and Wojna, Z. (2015, January 7\u201312). Rethinking the Inception Architecture for Computer Vision. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, USA.","DOI":"10.1109\/CVPR.2016.308"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Szegedy, C., Ioffe, S., Vanhoucke, V., and Alemi, A. (2018, January 2\u20137). Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning. Proceedings of the AAAI Conference, New Orleans, LO, USA.","DOI":"10.1609\/aaai.v31i1.11231"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Sandler, M., Howard, A., Zhu, M., Zhmoginov, A., and Chen, L.C. (2018, January 18\u201322). MobileNetV2: Inverted Residuals and Linear Bottlenecks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00474"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Howard, A., Sandler, M., Chu, G., Chen, L., Chen, B., Tan, M., Wang, W., Zhu, Y., Pang, R., and Vasudevan, V. (November, January 27). Searching for MobileNetV3. Proceedings of the 2019 IEEE\/CVF International Conference on Computer Vision (ICCV), Seoul, Korea.","DOI":"10.1109\/ICCV.2019.00140"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Chollet, F. (2017, January 21\u201326). Xception: Deep Learning with Depthwise Separable Convolutions. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.195"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2015, January 7\u201312). Deep Residual Learning for Image Recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016). Identity Mappings in Deep Residual Networks. European Conference on Computer Vision, Springer.","DOI":"10.1007\/978-3-319-46493-0_38"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Zoph, B., Vasudevan, V., Shlens, J., and Le, Q.V. (2017, January 21\u201326). Learning Transferable Architectures for Scalable Image Recognition. Proceedings of the IEEE Conference on Computer Vision andPattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2018.00907"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Garg, R., Maheshwari, S., and Shukla, A. (2019). Decision Support System for Detection and Classification of Skin Cancer using CNN. Innovations in Computational Intelligence and Computer Vision, Springer.","DOI":"10.1007\/978-981-15-6067-5_65"},{"key":"ref_15","unstructured":"Rezvantalab, A., Safigholi, H., and Karimijeshni, S. (2021). Dermatologist Level Dermoscopy Skin Cancer Classification Using Different Deep Learning Convolutional Neural Networks Algorithms. arXiv."},{"key":"ref_16","unstructured":"Nadipineni, H. (2020). Method to Classify Skin Lesions using Dermoscopic images. arXiv."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"1242","DOI":"10.1109\/TMI.2021.3136682","article-title":"Single Model Deep Learning on Imbalanced Small Datasets for Skin Lesion Classification","volume":"41","author":"Yao","year":"2022","journal-title":"IEEE Trans. Med. Imaging"},{"key":"ref_18","first-page":"115","article-title":"Dermatologist Level Dermoscopy Deep neural network or dermatologist?","volume":"542","author":"Young","year":"2021","journal-title":"Nature"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Xing, X., Hou, Y., Li, H., Yuan, Y., Li, H., and Meng, M.Q.H. (2021). Categorical Relation-Preserving Contrastive Knowledge Distillation for Medical Image Classification. International Conference on Medical Image Computing and Computer-Assisted Intervention, Springer.","DOI":"10.1007\/978-3-030-87240-3_16"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"105725","DOI":"10.1016\/j.cmpb.2020.105725","article-title":"The Effects of Skin Lesion Segmentation on the Performance of Dermatoscopic Image Classification","volume":"197","author":"Mahbod","year":"2020","journal-title":"Comput. Methods Programs Biomed."},{"key":"ref_21","unstructured":"Lee, Y.C., Jung, S.H., and Won, H.H. (2019). WonDerM: Skin Lesion Classification with Fine-tuned Neural Networks. arXiv."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"100864","DOI":"10.1016\/j.mex.2020.100864","article-title":"Skin Lesion Classification Using Ensembles of Multi-Resolution EfficientNets with Meta Data","volume":"7","author":"Gessert","year":"2020","journal-title":"MethodsX"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Alberti, M., Botros, A., Schutz, N., Ingold, R., Liwicki, M., and Seuret, M. (2021, January 10\u201315). Trainable Spectrally Initializable Matrix Transformations in Convolutional Neural Networks. Proceedings of the 2020 25th International Conference on Pattern Recognition (ICPR), Milan, Italy.","DOI":"10.1109\/ICPR48806.2021.9412204"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"2600","DOI":"10.3906\/elk-2101-133","article-title":"Malignant skin melanoma detection using image augmentation by oversamplingin nonlinear lower-dimensional embedding manifold","volume":"29","author":"Damasevicius","year":"2021","journal-title":"Turk. J. Electr. Eng. Comput. Sci."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Nawaz, M., Nazir, T., Masood, M., Ali, F., Khan, M.A., Tariq, U., and Sahar, N. (2022). Robertas Dama\u0161evicius Melanoma segmentation: A framework of improved DenseNet77 and UNET convolutional neural network. Int. J. Imaging Syst. Technol.","DOI":"10.1002\/ima.22750"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Kadry, S., Taniar, D., Dama\u0161evi\u010dius, R., Rajinikanth, V., and Lawal, I.A. (2021, January 25\u201327). Extraction of abnormal skin lesion from dermoscopy image using VGG-SegNet. Proceedings of the 2021 Seventh International conference on Bio Signals, Images, and Instrumentation (ICBSII), Chennai, India.","DOI":"10.1109\/ICBSII51839.2021.9445180"},{"key":"ref_27","unstructured":"Simonyan, K., and Zisserman, A. (2016). Very Deep Convolutional Networks for Large-Scale Image Recognition. arXiv."},{"key":"ref_28","unstructured":"Tan, M., and Le, Q. (2019). EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks. arXiv."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Hu, J., Shen, L., Albanie, S., Sun, G., and Wu, E. (2018, January 18\u201322). Squeeze-and-Excitation Networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00745"},{"key":"ref_30","unstructured":"DeVries, T., and Taylor, G.W. (2017). Improved Regularization of Convolutional Neural Networks with Cutout. arXiv."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Li, X., Lu, Y., Desrosiers, C., and Liu, X. (2020). Out-of-Distribution Detection for Skin Lesion Images with Deep Isolation Forest. International Workshop on Machine Learning in Medical Imaging, Springer.","DOI":"10.1007\/978-3-030-59861-7_10"},{"key":"ref_32","first-page":"1","article-title":"The HAM10000 data set, a large collection of multi-source dermatoscopic images of common pigmented skin lesions","volume":"5","author":"Tsch","year":"2018","journal-title":"Sci. Data"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Fekri-Ershad, S., Saberi, M., and Tajeripour, F. (2012). An innovative skin detection approach using color based image retrieval technique. arXiv.","DOI":"10.5121\/ijma.2012.4305"},{"key":"ref_34","unstructured":"Fred, A. (2019). Agarap Deep Learning using Rectified Linear Units (ReLU). arXiv."},{"key":"ref_35","unstructured":"Xu, K., Ba, J., Kiros, R., Cho, K., Courville, A., Salakhudinov, R., Zemel, R., and Bengio, Y. (2015, January 7\u20139). Show, Attend and Tell: Neural Image Caption Generation with Visual Attention. Proceedings of the 32nd International Conference on Machine Learning, Lille, France."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Shaikh, M.A., Duan, T., Chauhan, M., and Srihari, S.N. (2020, January 8\u201310). Attention based writer independent verification. Proceedings of the 2020 17th International Conference on Frontiers in Handwriting Recognition, Dortmund, Germany.","DOI":"10.1109\/ICFHR2020.2020.00074"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"e1914645","DOI":"10.1001\/jamanetworkopen.2019.14645","article-title":"Attention-Based Deep Neural Networks for Detection of Cancerous and Precancerous Esophagus Tissue on Histopathological Slides","volume":"2","author":"Tomita","year":"2020","journal-title":"JAMA Netw."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"4806","DOI":"10.1109\/ACCESS.2019.2962617","article-title":"The Real-World-Weight Cross-Entropy Loss Function: Modeling the Costs of Mislabeling","volume":"8","author":"Ho","year":"2020","journal-title":"IEEE Access"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"137","DOI":"10.1093\/oxfordjournals.pan.a004868","article-title":"Logistic Regression in Rare Events Data","volume":"9","author":"King","year":"2001","journal-title":"Political Anal."},{"key":"ref_40","unstructured":"Kingma, D.P., and Ba, J. (2017). Adam: A Method for Stochastic Optimization. arXiv."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/19\/7530\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T00:46:29Z","timestamp":1760143589000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/19\/7530"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,10,4]]},"references-count":40,"journal-issue":{"issue":"19","published-online":{"date-parts":[[2022,10]]}},"alternative-id":["s22197530"],"URL":"https:\/\/doi.org\/10.3390\/s22197530","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,10,4]]}}}