{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,9]],"date-time":"2026-05-09T02:19:35Z","timestamp":1778293175471,"version":"3.51.4"},"reference-count":49,"publisher":"MDPI AG","issue":"17","license":[{"start":{"date-parts":[[2023,8,24]],"date-time":"2023-08-24T00:00:00Z","timestamp":1692835200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Ministry of Education","award":["RS-2023-00244637"],"award-info":[{"award-number":["RS-2023-00244637"]}]},{"name":"Ministry of Education","award":["NRF-2022R1A2C2091160"],"award-info":[{"award-number":["NRF-2022R1A2C2091160"]}]},{"DOI":"10.13039\/501100003725","name":"Korean government","doi-asserted-by":"publisher","award":["RS-2023-00244637"],"award-info":[{"award-number":["RS-2023-00244637"]}],"id":[{"id":"10.13039\/501100003725","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100003725","name":"Korean government","doi-asserted-by":"publisher","award":["NRF-2022R1A2C2091160"],"award-info":[{"award-number":["NRF-2022R1A2C2091160"]}],"id":[{"id":"10.13039\/501100003725","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>In this study, a combined convolutional neural network for the diagnosis of three benign skin tumors was designed, and its effectiveness was verified through quantitative and statistical analysis. To this end, 698 sonographic images were taken and diagnosed at the Department of Dermatology at Severance Hospital in Seoul, Korea, between 10 November 2017 and 17 January 2020. Through an empirical process, a convolutional neural network combining two structures, which consist of a residual structure and an attention-gated structure, was designed. Five-fold cross-validation was applied, and the train set for each fold was augmented by the Fast AutoAugment technique. As a result of training, for three benign skin tumors, an average accuracy of 95.87%, an average sensitivity of 90.10%, and an average specificity of 96.23% were derived. Also, through statistical analysis using a class activation map and physicians\u2019 findings, it was found that the judgment criteria of physicians and the trained combined convolutional neural network were similar. This study suggests that the model designed and trained in this study can be a diagnostic aid to assist physicians and enable more efficient and accurate diagnoses.<\/jats:p>","DOI":"10.3390\/s23177374","type":"journal-article","created":{"date-parts":[[2023,8,24]],"date-time":"2023-08-24T10:47:08Z","timestamp":1692874028000},"page":"7374","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["Deep Learning-Based Evaluation of Ultrasound Images for Benign Skin Tumors"],"prefix":"10.3390","volume":"23","author":[{"given":"Hyunwoo","family":"Lee","sequence":"first","affiliation":[{"name":"Department of Biomedical Engineering, Yonsei University, Wonju 26493, Republic of Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yerin","family":"Lee","sequence":"additional","affiliation":[{"name":"Department of Precision Medicine, Yonsei University Wonju College of Medicine, Wonju 26426, Republic of Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Seung-Won","family":"Jung","sequence":"additional","affiliation":[{"name":"Department of Dermatology, Yonsei University Wonju College of Medicine, Wonju 26426, Republic of Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Solam","family":"Lee","sequence":"additional","affiliation":[{"name":"Department of Dermatology, Yonsei University Wonju College of Medicine, Wonju 26426, Republic of Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Byungho","family":"Oh","sequence":"additional","affiliation":[{"name":"Department of Dermatology, Cutaneous Biology Research Institute, Yonsei University College of Medicine, Seoul 03722, Republic of Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5841-851X","authenticated-orcid":false,"given":"Sejung","family":"Yang","sequence":"additional","affiliation":[{"name":"Department of Precision Medicine, Yonsei University Wonju College of Medicine, Wonju 26426, Republic of Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2023,8,24]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"1443","DOI":"10.7863\/ultra.32.8.1443","article-title":"Accuracy of sonographic diagnosis of superficial masses","volume":"32","author":"Wagner","year":"2013","journal-title":"J. Ultrasound Med."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"e469","DOI":"10.1111\/ijd.12989","article-title":"The diagnostic value of ultrasonography with 5-15-MHz probes in benign subcutaneous lesions","volume":"54","author":"Hwang","year":"2015","journal-title":"Int. J. Dermatol."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"24","DOI":"10.1186\/s13089-021-00222-w","article-title":"High-frequency ultrasound in clinical dermatology: A review","volume":"13","author":"Levy","year":"2021","journal-title":"Ultrasound J."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"605","DOI":"10.1016\/j.clindermatol.2021.03.007","article-title":"Practical applications of ultrasound in dermatology","volume":"39","author":"Wortsman","year":"2021","journal-title":"Clin. Dermatol."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"521","DOI":"10.1002\/jum.16000","article-title":"Top advances in dermatologic ultrasound","volume":"42","author":"Wortsman","year":"2023","journal-title":"J. Ultrasound Med."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"521","DOI":"10.1177\/1203475421999326","article-title":"Overview of ultrasound imaging applications in dermatology","volume":"25","author":"Almuhanna","year":"2021","journal-title":"J. Cutan. Med. Surg."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"274","DOI":"10.3389\/fmed.2019.00274","article-title":"Skin imaging using ultrasound imaging, optical coherence tomography, confocal microscopy, and two-photon microscopy in cutaneous oncology","volume":"6","author":"Oh","year":"2019","journal-title":"Front. Med."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"1388","DOI":"10.1111\/echo.14116","article-title":"Ultrasound imaging artifacts: How to recognize them and how to avoid them","volume":"35","author":"Quien","year":"2018","journal-title":"Echocardiography"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Hoskins, P.R., Martin, K., and Thrush, A. (2019). Diagnostic Ultrasound: Physics and Equipment, CRC Press.","DOI":"10.1201\/9781138893603"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"60","DOI":"10.1016\/j.media.2017.07.005","article-title":"A survey on deep learning in medical image analysis","volume":"42","author":"Litjens","year":"2017","journal-title":"Med. Image Anal."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"1261","DOI":"10.1111\/exd.13777","article-title":"Multimodal skin lesion classification using deep learning","volume":"27","author":"Yap","year":"2018","journal-title":"Exp. Dermatol."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Li, Y., and Shen, L. (2018). Skin lesion analysis towards melanoma detection using deep learning network. Sensors, 18.","DOI":"10.3390\/s18020556"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"25","DOI":"10.1016\/j.jbi.2018.08.006","article-title":"Skin lesion classification with ensembles of deep convolutional neural networks","volume":"86","author":"Harangi","year":"2018","journal-title":"J. Biomed. Inform."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Majtner, T., Yildirim-Yayilgan, S., and Hardeberg, J.Y. (2016, January 12\u201315). Combining deep learning and hand-crafted features for skin lesion classification. Proceedings of the 2016 Sixth International Conference on Image Processing Theory, Tools and Applications (IPTA), Oulu, Finland.","DOI":"10.1109\/IPTA.2016.7821017"},{"key":"ref_15","unstructured":"Yang, X., Zeng, Z., Yeo, S.Y., Tan, C., Tey, H.L., and Su, Y. (2017). A novel multi-task deep learning model for skin lesion segmentation and classification. arXiv."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"96","DOI":"10.1007\/s10916-016-0460-2","article-title":"Novel approaches for diagnosing melanoma skin lesions through supervised and deep learning algorithms","volume":"40","author":"Premaladha","year":"2016","journal-title":"J. Med. Syst."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Czajkowska, J., Juszczyk, J., Piejko, L., and Glenc-Ambro\u017cy, M. (2022). High-frequency ultrasound dataset for deep learning-based image quality assessment. Sensors, 22.","DOI":"10.3390\/s22041478"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"e34830","DOI":"10.2196\/34830","article-title":"Machine Learning Decision Support for Detecting Lipohypertrophy with Bedside Ultrasound: Proof-of-Concept Study","volume":"6","author":"Bandari","year":"2022","journal-title":"JMIR Form. Res."},{"key":"ref_19","unstructured":"Kang, S. (2019). Fitzpatrick\u2019s Dermatology, 2-Volume Set (Fitzpatricks Dermatology in General Medicine), McGraw Hill."},{"key":"ref_20","first-page":"202","article-title":"Surgical treatment of 846 patients with benign skin tumors: Experience of a dermatologic surgeon in Korea","volume":"53","author":"Oh","year":"2015","journal-title":"Korean J. Dermatol."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Zhou, B., Khosla, A., Lapedriza, A., Oliva, A., and Torralba, A. (2016, January 27\u201330). Learning deep features for discriminative localization. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.319"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"23","DOI":"10.1080\/10867651.2004.10487596","article-title":"An image inpainting technique based on the fast marching method","volume":"9","author":"Telea","year":"2004","journal-title":"J. Graph. Tools"},{"key":"ref_23","unstructured":"Lim, S., Kim, I., Kim, T., Kim, C., and Kim, S. (2019). Fast autoaugment. arXiv."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27\u201330). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_25","unstructured":"Schlemper, J., Oktay, O., Chen, L., Matthew, J., Knight, C., Kainz, B., Glocker, B., and Rueckert, D. (2018). Attention-gated networks for improving ultrasound scan plane detection. arXiv."},{"key":"ref_26","unstructured":"Kingma, D.P., and Ba, J. (2014). Adam: A method for stochastic optimization. arXiv."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"97","DOI":"10.7863\/jum.2012.31.1.97","article-title":"Common applications of dermatologic sonography","volume":"31","author":"Wortsman","year":"2012","journal-title":"J. Ultrasound Med."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"374","DOI":"10.1002\/jcu.1052","article-title":"Relationship between sonographic and pathologic findings in epidermal inclusion cysts","volume":"29","author":"Lee","year":"2001","journal-title":"J. Clin. Ultrasound"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Wortsman, X., and Jemec, G. (2013). Dermatologic Ultrasound with Clinical and Histologic Correlations, Springer New York.","DOI":"10.1007\/978-1-4614-7184-4"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"1531","DOI":"10.1016\/j.acra.2009.07.024","article-title":"Computer-aided diagnosis of soft-tissue tumors using sonographic morphologic and texture features","volume":"16","author":"Chen","year":"2009","journal-title":"Acad. Radiol."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"318","DOI":"10.3389\/fmed.2020.00318","article-title":"Artificial Intelligence in Cutaneous Oncology","volume":"7","author":"Chu","year":"2020","journal-title":"Front. Med."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"644327","DOI":"10.3389\/fmed.2021.644327","article-title":"Convolutional neural network for skin lesion classification: Understanding the fundamentals through hands-on learning","volume":"8","author":"Manzo","year":"2021","journal-title":"Front. Med."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"1061","DOI":"10.1111\/cup.13954","article-title":"Artificial intelligence in dermatopathology: Diagnosis, education, and research","volume":"48","author":"Wells","year":"2021","journal-title":"J. Cutan. Pathol."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"202","DOI":"10.1016\/j.ejca.2021.06.049","article-title":"Skin cancer classification via convolutional neural networks: Systematic review of studies involving human experts","volume":"156","author":"Maron","year":"2021","journal-title":"Eur. J. Cancer"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"156","DOI":"10.1016\/j.ejca.2022.04.015","article-title":"Convolutional neural network assistance significantly improves dermatologists\u2019 diagnosis of cutaneous tumours using clinical images","volume":"169","author":"Ba","year":"2022","journal-title":"Eur. J. Cancer"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"1277","DOI":"10.1111\/ced.14722","article-title":"Clinical characteristics and disease burden in prurigo nodularis","volume":"46","author":"Aggarwal","year":"2021","journal-title":"Clin. Exp. Dermatol."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"549","DOI":"10.25259\/IJDVL_725_2021","article-title":"Artificial intelligence: Its role in dermatopathology","volume":"89","author":"Jartarkar","year":"2023","journal-title":"Indian J. Dermatol. Venereol. Leprol."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"1842","DOI":"10.1111\/jdv.16185","article-title":"Augmented decision-making for acral lentiginous melanoma detection using deep convolutional neural networks","volume":"34","author":"Lee","year":"2020","journal-title":"J. Eur. Acad. Dermatol. Venereol."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"104924","DOI":"10.1016\/j.compbiomed.2021.104924","article-title":"A convolutional neural network trained with dermoscopic images of psoriasis performed on par with 230 dermatologists","volume":"139","author":"Yang","year":"2021","journal-title":"Comput. Biol. Med."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"412","DOI":"10.5114\/ada.2021.107927","article-title":"Convolutional neural networks for the detection of malignant melanoma in dermoscopy images","volume":"38","author":"Kwiatkowska","year":"2021","journal-title":"Adv. Dermatol. Allergol. \/Post\u0119py Dermatol. I Alergol."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"953","DOI":"10.1210\/clinem\/dgab870","article-title":"Convolutional neural network-based computer-assisted diagnosis of Hashimoto\u2019s thyroiditis on ultrasound","volume":"107","author":"Zhao","year":"2022","journal-title":"J. Clin. Endocrinol. Metab."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"bqac135","DOI":"10.1210\/endocr\/bqac135","article-title":"Convolutional Neural Network for predicting thyroid cancer based on ultrasound elastography image of perinodular region","volume":"163","author":"Hu","year":"2022","journal-title":"Endocrinology"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"556","DOI":"10.1016\/j.ultrasmedbio.2020.10.025","article-title":"Use of a convolutional neural network and quantitative ultrasound for diagnosis of fatty liver","volume":"47","author":"Nguyen","year":"2021","journal-title":"Ultrasound Med. Biol."},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Liu, J., Li, W., Zhao, N., Cao, K., Yin, Y., Song, Q., Chen, H., and Gong, X. (2018, January 16\u201320). Integrate domain knowledge in training CNN for ultrasonography breast cancer diagnosis. Proceedings of the International Conference on Medical Image Computing and Computer-Assisted Intervention, Granada, Spain.","DOI":"10.1007\/978-3-030-00934-2_96"},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"103684","DOI":"10.1016\/j.ebiom.2021.103684","article-title":"Decoding the molecular subtypes of breast cancer seen on multimodal ultrasound images using an assembled convolutional neural network model: A prospective and multicentre study","volume":"74","author":"Zhou","year":"2021","journal-title":"eBiomedicine"},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"1332","DOI":"10.1089\/thy.2018.0082","article-title":"Deep Learning\u2013Based Computer-Aided Diagnosis System for Localization and Diagnosis of Metastatic Lymph Nodes on Ultrasound: A Pilot Study","volume":"28","author":"Lee","year":"2018","journal-title":"Thyroid"},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"1303","DOI":"10.1007\/s11548-020-02182-3","article-title":"Computer-aided diagnosis for fetal brain ultrasound images using deep convolutional neural networks","volume":"15","author":"Xie","year":"2020","journal-title":"Int. J. Comput. Assist. Radiol. Surg."},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Born, J., Wiedemann, N., Br\u00e4ndle, G., Buhre, C., Rieck, B., and Borgwardt, K. (2020). Accelerating COVID-19 differential diagnosis with explainable ultrasound image analysis. arXiv.","DOI":"10.1136\/thorax-2020-BTSabstracts.404"},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"1121","DOI":"10.1016\/j.jaad.2018.11.043","article-title":"Emerging imaging technologies in dermatology: Part II: Applications and limitations","volume":"80","author":"Schneider","year":"2019","journal-title":"J. Am. Acad. Dermatol."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/17\/7374\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T20:37:59Z","timestamp":1760128679000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/17\/7374"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,8,24]]},"references-count":49,"journal-issue":{"issue":"17","published-online":{"date-parts":[[2023,9]]}},"alternative-id":["s23177374"],"URL":"https:\/\/doi.org\/10.3390\/s23177374","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,8,24]]}}}