{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,9]],"date-time":"2026-07-09T04:26:11Z","timestamp":1783571171361,"version":"3.55.0"},"reference-count":53,"publisher":"MDPI AG","issue":"6","license":[{"start":{"date-parts":[[2020,3,13]],"date-time":"2020-03-13T00:00:00Z","timestamp":1584057600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Clinical treatment of skin lesion is primarily dependent on timely detection and delimitation of lesion boundaries for accurate cancerous region localization. Prevalence of skin cancer is on the higher side, especially that of melanoma, which is aggressive in nature due to its high metastasis rate. Therefore, timely diagnosis is critical for its treatment before the onset of malignancy. To address this problem, medical imaging is used for the analysis and segmentation of lesion boundaries from dermoscopic images. Various methods have been used, ranging from visual inspection to the textural analysis of the images. However, accuracy of these methods is low for proper clinical treatment because of the sensitivity involved in surgical procedures or drug application. This presents an opportunity to develop an automated model with good accuracy so that it may be used in a clinical setting. This paper proposes an automated method for segmenting lesion boundaries that combines two architectures, the U-Net and the ResNet, collectively called Res-Unet. Moreover, we also used image inpainting for hair removal, which improved the segmentation results significantly. We trained our model on the ISIC 2017 dataset and validated it on the ISIC 2017 test set as well as the PH2 dataset. Our proposed model attained a Jaccard Index of 0.772 on the ISIC 2017 test set and 0.854 on the PH2 dataset, which are comparable results to the current available state-of-the-art techniques.<\/jats:p>","DOI":"10.3390\/s20061601","type":"journal-article","created":{"date-parts":[[2020,3,13]],"date-time":"2020-03-13T08:58:59Z","timestamp":1584089939000},"page":"1601","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":129,"title":["Skin Lesion Segmentation from Dermoscopic Images Using Convolutional Neural Network"],"prefix":"10.3390","volume":"20","author":[{"given":"Kashan","family":"Zafar","sequence":"first","affiliation":[{"name":"Department of Biomedical Engineering and Sciences, School of Mechanical and Manufacturing Engineering, National University of Sciences and Technology, Islamabad 44000, Pakistan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5654-7863","authenticated-orcid":false,"given":"Syed Omer","family":"Gilani","sequence":"additional","affiliation":[{"name":"Department of Biomedical Engineering and Sciences, School of Mechanical and Manufacturing Engineering, National University of Sciences and Technology, Islamabad 44000, Pakistan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0190-0700","authenticated-orcid":false,"given":"Asim","family":"Waris","sequence":"additional","affiliation":[{"name":"Department of Biomedical Engineering and Sciences, School of Mechanical and Manufacturing Engineering, National University of Sciences and Technology, Islamabad 44000, Pakistan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ali","family":"Ahmed","sequence":"additional","affiliation":[{"name":"Department of Biomedical Engineering and Sciences, School of Mechanical and Manufacturing Engineering, National University of Sciences and Technology, Islamabad 44000, Pakistan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8835-2451","authenticated-orcid":false,"given":"Mohsin","family":"Jamil","sequence":"additional","affiliation":[{"name":"Department of Electrical and Computer Engineering, Memorial University of Newfoundland, Newfoundland, St. John\u2019s, NL A1C 5S7 P.O. Box 4200, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1416-4199","authenticated-orcid":false,"given":"Muhammad Nasir","family":"Khan","sequence":"additional","affiliation":[{"name":"Department of Electrical Engineering, University of Lahore, Lahore 54590, Pakistan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Amer","family":"Sohail Kashif","sequence":"additional","affiliation":[{"name":"Department of Biomedical Engineering and Sciences, School of Mechanical and Manufacturing Engineering, National University of Sciences and Technology, Islamabad 44000, Pakistan"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2020,3,13]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"315","DOI":"10.1146\/annurev.bioeng.2.1.315","article-title":"Current methods in medical image segmentation","volume":"2","author":"Pham","year":"2000","journal-title":"Annu. Rev. Biomed. Eng."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"928","DOI":"10.1016\/j.jclinepi.2012.12.018","article-title":"Time from (clinical or certainty) diagnosis to treatment onset in cancer patients: The choice of diagnostic date strongly influences differences in therapeutic delay by tumor site and stage","volume":"66","author":"Pumarega","year":"2013","journal-title":"J. Clin. Epidemiol."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"127","DOI":"10.1016\/j.cmpb.2016.03.032","article-title":"Computational methods for the image segmentation of pigmented skin lesions: A review","volume":"131","author":"Oliveira","year":"2016","journal-title":"Comput. Methods Programs Biomed."},{"key":"ref_4","unstructured":"Matthews, N.H., Li, W.-Q., Qureshi, A.A., Weinstock, M.A., and Cho, E. (2017). Epidemiology of melanoma. Cutaneous Melanoma: Etiology and Therapy, Codon Publications."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Colditz, G.A. (2015). Encyclopedia of Cancer and Society. Google Books, SAGE Publications, Inc.","DOI":"10.4135\/9781483345758"},{"key":"ref_6","unstructured":"The American Cancer Society (2020, March 09). Available online: https:\/\/contentsubscription.cancer.org\/content\/dam\/CRC\/PDF\/Public\/8606.00.pdf."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"40","DOI":"10.1007\/s13671-014-0069-y","article-title":"Advanced basal cell carcinoma: Epidemiology and therapeutic innovations","volume":"3","author":"Mohan","year":"2014","journal-title":"Curr. Dermatol. Rep."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"183","DOI":"10.1016\/j.amepre.2014.08.036","article-title":"Prevalence and costs of skin cancer treatment in the U.S., 2002\u20132006 and 2007\u20132011","volume":"48","author":"Guy","year":"2015","journal-title":"Am. J. Prev. Med."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"965","DOI":"10.1109\/JSYST.2013.2271540","article-title":"Two systems for the detection of melanomas in Dermoscopy images using texture and color features","volume":"8","author":"Barata","year":"2014","journal-title":"IEEE Syst. J."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"99","DOI":"10.1016\/j.compmedimag.2010.08.004","article-title":"Color and contrast enhancement for improved skin lesion segmentation","volume":"35","author":"Schaefer","year":"2011","journal-title":"Comput. Med. Imaging Graph."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"157","DOI":"10.1109\/TBME.2007.910651","article-title":"Independent histogram pursuit for segmentation of skin lesions","volume":"55","author":"Butakoff","year":"2008","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Maeda, J., Kawano, A., Yamauchi, S., Suzuki, Y., Mar\u00e7al, A.R.S., and Mendon\u00e7a, T. (2008, January 25\u201327). Perceptual image segmentation using fuzzy-based hierarchical algorithm and its application to images Dermoscopy. Proceedings of the 2008 IEEE Conference on Soft Computing on Industrial Applications, Muroran, Japan.","DOI":"10.1109\/SMCIA.2008.5045937"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"976","DOI":"10.1109\/TFUZZ.2009.2018300","article-title":"Accurate segmentation of dermoscopic images by image thresholding based on type-2 fuzzy logic","volume":"17","author":"Borlu","year":"2009","journal-title":"IEEE Trans. Fuzzy Syst."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"275","DOI":"10.1016\/j.compmedimag.2009.01.003","article-title":"PDE-based unsupervised repair of hair-occluded information in Dermoscopy images of melanoma","volume":"33","author":"Xie","year":"2009","journal-title":"Comput. Med. Imaging Graph."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"35","DOI":"10.1109\/JSTSP.2008.2011119","article-title":"Comparison of segmentation methods for melanoma diagnosis in dermoscopy images","volume":"3","author":"Silveira","year":"2009","journal-title":"IEEE J. Sel. Top. Signal Process."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"615","DOI":"10.1109\/JBHI.2015.2390032","article-title":"A novel approach to segment skin lesions in dermoscopic images based on a deformable model","volume":"20","author":"Ma","year":"2016","journal-title":"IEEE J. Biomed. Heal. Inform."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Mishra, R., and Daescu, O. (2017, January 13\u201316). Deep learning for skin lesion segmentation. Proceedings of the 2017 IEEE International Conference on Bioinformatics and Biomedicine, BIBM, Kansas City, MO, USA.","DOI":"10.1109\/BIBM.2017.8217826"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Li, Y., and Shen, L. (2018). Skin lesion analysis towards melanoma detection using deep learning network. Sensors, 18.","DOI":"10.3390\/s18020556"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Jafari, M.H., Karimi, N., Nasr-Esfahani, E., Samavi, S., Soroushmehr, S.M.R., Ward, K., and Najarian, K. (2016, January 4\u20138). Skin lesion segmentation in clinical images using deep learning. Proceedings of the International Conference on Pattern Recognition, Cancun, Mexico.","DOI":"10.1109\/ICPR.2016.7899656"},{"key":"ref_20","first-page":"73","article-title":"Analysis of image segmentation techniques for medical images","volume":"2","author":"Tamilselvi","year":"2014","journal-title":"Int. Conf. Emerg. Res. Comput. Inf. Commun. Appl."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"1876","DOI":"10.1109\/TMI.2017.2695227","article-title":"Automatic skin lesion segmentation using deep fully convolutional networks with jaccard distance","volume":"36","author":"Yuan","year":"2017","journal-title":"IEEE Trans. Med. Imaging"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"69","DOI":"10.1016\/j.artmed.2012.08.002","article-title":"Computerized analysis of pigmented skin lesions: A review","volume":"56","author":"Korotkov","year":"2012","journal-title":"Artif. Intell. Med."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Celebi, M.E., Iyatomi, H., and Schaefer, G. (2009, January 7\u201310). Contrast enhancement in dermoscopy images by maximizing a histogram bimodality measure. Proceedings of the International Conference on Image Processing ICIP, Cairo, Egypt.","DOI":"10.1109\/ICIP.2009.5413990"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Beuren, A.T., Janasieivicz, R., Pinheiro, G., Grando, N., and Facon, J. (2012, January 3\u20135). Skin melanoma segmentation by morphological approach. Proceedings of the ACM International Conference Proceeding Series, Chennai, India.","DOI":"10.1145\/2345396.2345553"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"533","DOI":"10.1016\/S0010-4825(97)00020-6","article-title":"DullRazor: A software approach to hair removal from images","volume":"27","author":"Lee","year":"1997","journal-title":"Comput. Biol. Med."},{"key":"ref_26","unstructured":"Chanda, B., and Majumder, D.D. (2011). Digital Image Processing and Analysis, PHI Learning Pvt. Ltd.. [2nd ed.]."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"347","DOI":"10.1111\/j.1600-0846.2008.00301.x","article-title":"Border detection in Dermoscopy images using statistical region merging","volume":"14","author":"Celebi","year":"2008","journal-title":"Skin Res. Technol."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"127","DOI":"10.1109\/MSP.2013.2273004","article-title":"Image Inpainting: Overview and recent advances","volume":"31","author":"Guillemot","year":"2014","journal-title":"IEEE Signal Process. Mag."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"61","DOI":"10.1109\/MGRS.2015.2441912","article-title":"Missing information reconstruction of remote sensing data: A technical review","volume":"3","author":"Shen","year":"2015","journal-title":"IEEE Geosci. Remote Sens. Mag."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"7086","DOI":"10.1109\/TGRS.2014.2307354","article-title":"Recovering quantitative remote sensing products contaminated by thick clouds and shadows using multitemporal dictionary learning","volume":"52","author":"Li","year":"2014","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"1088","DOI":"10.1049\/iet-cvi.2018.5289","article-title":"Automated skin lesion segmentation of Dermoscopic images using grabcut and kmeans algorithms","volume":"12","author":"Jaisakthi","year":"2018","journal-title":"IET Comput. Vis."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Aljanabi, M., \u00d6zok, Y.E., Rahebi, J., and Abdullah, A.S. (2018). Skin lesion segmentation method for Dermoscopy images using artificial bee colony algorithm. Symmetry, 10.","DOI":"10.3390\/sym10080347"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"89","DOI":"10.1016\/j.compmedimag.2016.05.002","article-title":"Skin lesion image segmentation using Delaunay Triangulation for melanoma detection","volume":"52","author":"Pennisi","year":"2016","journal-title":"Comput. Med. Imaging Graph."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"148","DOI":"10.1016\/j.compmedimag.2008.11.002","article-title":"Lesion border detection in Dermoscopy images","volume":"33","author":"Celebi","year":"2009","journal-title":"Comput. Med. Imaging Graph."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Bi, L., Kim, J., Ahn, E., Feng, D., and Fulham, M. (2016, January 13\u201316). Automated skin lesion segmentation via image-wise supervised learning and multi-scale Superpixel based cellular automata. Proceedings of the International Symposium on Biomedical Imaging, Prague, Czech Republic.","DOI":"10.1109\/ISBI.2016.7493448"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"2065","DOI":"10.1109\/TBME.2017.2712771","article-title":"Dermoscopic image segmentation via multistage fully convolutional networks","volume":"64","author":"Bi","year":"2017","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Yuan, Y. (2017). Automatic skin lesion segmentation with fully convolutional-deconvolutional networks. arXiv.","DOI":"10.1109\/TMI.2017.2695227"},{"key":"ref_38","unstructured":"Berseth, M. (2019, September 09). ISIC 2017-Skin Lesion Analysis Towards Melanoma Detection, International Skin Imaging Collaboration. Available online: https:\/\/arxiv.org\/abs\/1703.00523."},{"key":"ref_39","unstructured":"Qian, C., Jiang, H., and Liu, T. (2018). ISIC 2018-Skin Lesion Analysis. 2018. ISIC\u2014Skin Image Analysis Workshop and Challenge @ MICCAI 2018 Hosted by the International Skin Imaging Collaboration (ISIC), Springer."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"834","DOI":"10.1109\/TPAMI.2017.2699184","article-title":"IEEE Transactions on Pattern Analysis and Machine Intelligence DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs","volume":"40","author":"Chen","year":"2016","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_41","unstructured":"Guth, F., and Decampos, T.E. (2019, September 09). Skin Lesion Segmentation Using U-Net and Good Training Strategies. Available online: https:\/\/arxiv.org\/abs\/1811.11314."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Mendonca, T., Ferreira, P.M., Marques, J.S., Marcal, A.R.S., and Rozeira, J. (2013, January 3\u20137). PH2\u2014A dermoscopic image database for research and benchmarking. Proceedings of the 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), Osaka, Japan.","DOI":"10.1109\/EMBC.2013.6610779"},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Codella, N.C.F., Gutman, D., Celebi, M.E., Helba, B., Marchetti, M.A., Dusza, S.W., Kalloo, A., Liopyris, K., Mishra, N., and Kittler, H. (2017, January 4\u20137). Skin lesion analysis toward melanoma detection: A challenge at the 2017 international symposium on biomedical imaging (ISBI), hosted by the international skin imaging collaboration (ISIC). Proceedings of the 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018), Washington, DC, USA.","DOI":"10.1109\/ISBI.2018.8363547"},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"23","DOI":"10.1080\/10867651.2004.10487596","article-title":"An image inpainting technique based on the fast marching method","volume":"9","author":"Telea","year":"2004","journal-title":"J. Graph. Tools"},{"key":"ref_45","first-page":"2229","article-title":"Study and implementation of various morphology based image contrast enhancement techniques","volume":"128","author":"Thapar","year":"2012","journal-title":"Int. J. Comput. Bus. Res."},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Wang, G., Wang, Y., Li, H., Chen, X., Lu, H., Ma, Y., Peng, C., and Tang, L. (2014). Morphological background detection and illumination normalization of text image with poor lighting. PLoS ONE, 9.","DOI":"10.1371\/journal.pone.0110991"},{"key":"ref_47","unstructured":"Shelhamer, E., Long, J., and Darrell, T. (2015, January 7\u201312). Fully convolutional networks for semantic segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA."},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Ronneberger, O., Fischer, P., and Brox, T. (2015, January 5\u20139). U-Net: Convolutional networks for biomedical image segmentation. Proceedings of the Medical Image Computing and Computer Assisted Interventions, Munich, Germany.","DOI":"10.1007\/978-3-319-24574-4_28"},{"key":"ref_49","unstructured":"Wen, H. (2017). II-FCN for skin lesion analysis towards melanoma detection. arXiv."},{"key":"ref_50","unstructured":"Attia, M., Hossny, M., Nahavandi, S., and Yazdabadi, A. (2017). Spatially aware melanoma segmentation using hybrid deep learning techniques. arXiv."},{"key":"ref_51","unstructured":"Berseth, M. (2017). ISIC 2017-skin lesion analysis towards melanoma detection. arXiv."},{"key":"ref_52","unstructured":"Bi, L., Kim, J., Ahn, E., and Feng, D. (2019, December 11). Automatic Skin Lesion Analysis using Large-scale Der-moscopy Images and Deep Residual Networks. Available online: https:\/\/arxiv.org\/ftp\/arxiv\/papers\/1703\/1703.04197.pdf."},{"key":"ref_53","unstructured":"Menegola, A., Tavares, J., Fornaciali, M., Li, L.T., Avila, S., and Valle, E. (2017, November 19). RECOD Titans at ISIC Challenge 2017. Available online: https:\/\/arxiv.org\/abs\/1703.04819."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/6\/1601\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T09:06:35Z","timestamp":1760173595000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/6\/1601"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,3,13]]},"references-count":53,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2020,3]]}},"alternative-id":["s20061601"],"URL":"https:\/\/doi.org\/10.3390\/s20061601","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,3,13]]}}}