{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,25]],"date-time":"2026-03-25T16:27:11Z","timestamp":1774456031534,"version":"3.50.1"},"reference-count":50,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2022,3,16]],"date-time":"2022-03-16T00:00:00Z","timestamp":1647388800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Computers"],"abstract":"<jats:p>Deep learning models yield remarkable results in skin lesions analysis. However, these models require considerable amounts of data, while accessibility to the images with annotated skin lesions is often limited, and the classes are often imbalanced. Data augmentation is one way to alleviate the lack of labeled data and class imbalance. This paper proposes a new data augmentation method based on image fusion technique to construct large dataset on all existing tones. The fusion method consists of a pulse-coupled neural network fusion strategy in a non-subsampled shearlet transform domain and consists of three steps: decomposition, fusion, and reconstruction. The dermoscopic dataset is obtained by combining ISIC2019 and ISIC2020 Challenge datasets. A comparative study with current algorithms was performed to access the effectiveness of the proposed one. The first experiment results indicate that the proposed algorithm best preserves the lesion dermoscopic structure and skin tones features. The second experiment, which consisted of training a convolutional neural network model with the augmented dataset, indicates a more significant increase in accuracy by 15.69%, and 15.38% respectively for tanned, and brown skin categories. The model precision, recall, and F1-score have also been increased. The obtained results indicate that the proposed augmentation method is suitable for dermoscopic images and can be used as a solution to the lack of dark skin images in the dataset.<\/jats:p>","DOI":"10.3390\/computers11030044","type":"journal-article","created":{"date-parts":[[2022,3,16]],"date-time":"2022-03-16T22:09:58Z","timestamp":1647468598000},"page":"44","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":10,"title":["Towards Accurate Skin Lesion Classification across All Skin Categories Using a PCNN Fusion-Based Data Augmentation Approach"],"prefix":"10.3390","volume":"11","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-6773-0185","authenticated-orcid":false,"given":"Esther","family":"Chabi Adjobo","sequence":"first","affiliation":[{"name":"Imagerie et Vision Artificielle (ImVia), University of Bourgogne Franche-Comt\u00e9, 21078 Dijon, France"},{"name":"Institut de Math\u00e9matiques et de Sciences Physiques (IMSP), University of Abomey-Calavi, Abomey-Calavi BP 2549, Benin"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Amadou Tidjani","family":"Sanda Mahama","sequence":"additional","affiliation":[{"name":"Imagerie et Vision Artificielle (ImVia), University of Bourgogne Franche-Comt\u00e9, 21078 Dijon, France"},{"name":"Institut de Math\u00e9matiques et de Sciences Physiques (IMSP), University of Abomey-Calavi, Abomey-Calavi BP 2549, Benin"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Pierre","family":"Gouton","sequence":"additional","affiliation":[{"name":"Imagerie et Vision Artificielle (ImVia), University of Bourgogne Franche-Comt\u00e9, 21078 Dijon, France"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jo\u00ebl","family":"Tossa","sequence":"additional","affiliation":[{"name":"Institut de Math\u00e9matiques et de Sciences Physiques (IMSP), University of Abomey-Calavi, Abomey-Calavi BP 2549, Benin"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2022,3,16]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"115","DOI":"10.1038\/nature21056","article-title":"Dermatologist-level classification of skin cancer with deep neural networks","volume":"542","author":"Esteva","year":"2017","journal-title":"Nature"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Luo, C., Li, X., Wang, L., He, J., Li, D., and Zhou, J. (2018, January 10\u201312). How Does the Data set Affect CNN-based Image Classification Performance?. Proceedings of the 2018 5th International Conference on Systems and Informatics (ICSAI), Nanjing, China.","DOI":"10.1109\/ICSAI.2018.8599448"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"353","DOI":"10.1097\/00125817-200011000-00010","article-title":"Informed consent for medical photographs","volume":"2","author":"Cunniff","year":"2000","journal-title":"Genet. Med."},{"key":"ref_4","unstructured":"Simard, P.Y., Steinkraus, D., and Platt, J.C. (2003, January 3\u20136). Best practices for convolutional neural networks applied to visual document analysis. Proceedings of the 7th International Conference on Document Analysis and Recognition, Edinburgh, UK."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"100","DOI":"10.1016\/j.inffus.2016.05.004","article-title":"Pixel-level image fusion: A survey of the state of the art","volume":"33","author":"Li","year":"2017","journal-title":"Inf. Fusion"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Miko\u0142ajczyk, A., and Grochowski, M. (2018, January 9\u201312). Data augmentation for improving deep learning in image classification problem. Proceedings of the International Interdisciplinary PhD Workshop (IIPhDW), Swinoujscie, Poland.","DOI":"10.1109\/IIPHDW.2018.8388338"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"550","DOI":"10.1016\/j.neuroimage.2018.03.045","article-title":"3D conditional generative adversarial networks for high-quality PET image estimation at low dose","volume":"174","author":"Wang","year":"2018","journal-title":"NeuroImage"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"2614","DOI":"10.1109\/TIP.2018.2887342","article-title":"DenseFuse: A Fusion Approach to Infrared and Visible Images","volume":"28","author":"Li","year":"2019","journal-title":"IEEE Trans. Image Process."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"99","DOI":"10.1016\/j.inffus.2019.07.011","article-title":"IFCNN: A general image fusion framework based on convolutional neural network","volume":"54","author":"Zhang","year":"2020","journal-title":"Inf. Fusion"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"847","DOI":"10.1002\/ima.22436","article-title":"A novel approach in multimodality medical image fusion using optimal shearlet and deep learning","volume":"30","author":"Parvathy","year":"2020","journal-title":"Int. J. Imaging Syst. Technol."},{"key":"ref_11","unstructured":"Bowles, C., Chen, L., Guerrero, R., Bentley, P., Gunn, R., Hammers, A., Dickie, D.A., Hern\u00e1ndez, M.V., Wardlaw, J., and Rueckert, D. (2018). GAN Augmentation: Augmenting Training Data using Generative Adversarial Networks. arXiv."},{"key":"ref_12","unstructured":"Goodfellow, I.J., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., Courville, A., and Bengio, Y. (2014). Generative Adversarial Networks. arXiv."},{"key":"ref_13","unstructured":"Karras, T., Aila, T., Laine, S., and Lehtinen, J. (2018). Progressive Growing of Gans for Improved Quality, Stability, and Variation. arXiv."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"2536","DOI":"10.1109\/TMI.2017.2708987","article-title":"Generative Adversarial Networks for Noise Reduction in Low-Dose CT","volume":"36","author":"Wolterink","year":"2017","journal-title":"IEEE Trans. Med. Imaging"},{"key":"ref_15","unstructured":"Metzler, J.B. (2017). Accelerated Magnetic Resonance Imaging by Adversarial Neural Network. Lecture Notes in Computer Science, Springer."},{"key":"ref_16","unstructured":"Mahapatra, D., and Bozorgtabar, B. (2018). Retinal Vasculature Segmentation Using Local Saliency Maps and Generative Adversarial Networks For Image Super Resolution. arXiv."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Madani, A., Moradi, M., Karargyris, A., and Syeda-Mahmood, T. (2018). Chest x-ray generation and data augmentation for cardiovascular abnormality classification. Medical Imaging 2018: Image Processing, SPIE Medical Imaging.","DOI":"10.1117\/12.2293971"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.ifacol.2019.12.406","article-title":"Generative Adversarial Network Based Image Augmentation for Insect Pest Classification Enhancement","volume":"52","author":"Lu","year":"2019","journal-title":"IFAC-PapersOnLine"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Chuquicusma, M.J.M., Hussein, S., Burt, J., and Bagci, U. (2018). How to fool radiologists with generative adversarial networks? A visual turing test for lung cancer diagnosis. arXiv.","DOI":"10.1109\/ISBI.2018.8363564"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Calimeri, F., Marzullo, A., Stamile, C., and Terracina, G. (2017). Biomedical Data Augmentation Using Generative Adversarial Neural Networks. Artificial Neural Networks and Machine Learning\u2014ICANN 2017, Proceedings of the 26th International Conference on Artificial Neural Networks, Alghero, Italy, 11\u201314 September 2017, Springer.","DOI":"10.1007\/978-3-319-68612-7_71"},{"key":"ref_21","first-page":"105741L","article-title":"Learning implicit brain MRI manifolds with deep learning","volume":"Volume 10574","author":"Plassard","year":"2018","journal-title":"Medical Imaging 2018: Image Processing"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"321","DOI":"10.1016\/j.neucom.2018.09.013","article-title":"GAN-based synthetic medical image augmentation for increased CNN performance in liver lesion classification","volume":"321","author":"Diamant","year":"2018","journal-title":"Neurocomputing"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"102224","DOI":"10.1016\/j.bspc.2020.102224","article-title":"High-resolution dermoscopy image synthesis with conditional generative adversarial networks","volume":"64","author":"Ding","year":"2021","journal-title":"Biomed. Signal Process. Control"},{"key":"ref_24","first-page":"294","article-title":"Skin lesion synthesis with Generative Adversarial Networks","volume":"Volume 11041","author":"Bissoto","year":"2018","journal-title":"OR 2.0 Context-Aware Operating Theaters, Computer Assisted Robotic Endoscopy, Clinical Image-Based Procedures, and Skin Image Analysis"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"105568","DOI":"10.1016\/j.cmpb.2020.105568","article-title":"A GAN-based image synthesis method for skin lesion classification","volume":"195","author":"Qin","year":"2020","journal-title":"Comput. Methods Programs Biomed."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Venu, S.K., and Ravula, S. (2020). Evaluation of Deep Convolutional Generative Adversarial Networks for Data Augmentation of Chest X-ray Images. Future Internet, 13.","DOI":"10.3390\/fi13010008"},{"key":"ref_27","unstructured":"Goodfellow, I. (2016). NIPS 2016 Tutorial: Generative Adversarial Networks. arXiv."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"588","DOI":"10.1109\/JAS.2017.7510583","article-title":"Generative adversarial networks: Introduction and outlook","volume":"4","author":"Wang","year":"2017","journal-title":"IEEE\/CAA J. Autom. Sin."},{"key":"ref_29","unstructured":"Wang, N., and Wang, W. (2015, January 18\u201320). An image fusion method based on wavelet and dual-channel pulse coupled neural network. Proceedings of the 2015 IEEE International Conference on Progress in Informatics and Computing (PIC), Nanjing, China."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Li, Y., Sun, Y., Huang, X., Qi, G., Zheng, M., and Zhu, Z. (2018). An Image Fusion Method Based on Sparse Representation and Sum Modified-Laplacian in NSCT Domain. Entropy, 20.","DOI":"10.3390\/e20070522"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"1950004","DOI":"10.1142\/S0219467819500049","article-title":"Color PET-MRI Medical Image Fusion Combining Matching Regional Spectrum in Shearlet Domain","volume":"19","author":"Biswas","year":"2019","journal-title":"Int. J. Image Graph."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"2050050","DOI":"10.1142\/S0129065720500501","article-title":"Medical Image Fusion Method Based on Coupled Neural P Systems in Nonsubsampled Shearlet Transform Domain","volume":"31","author":"Li","year":"2021","journal-title":"Int. J. Neural Syst."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Li, L., and Ma, H. (2021). Pulse Coupled Neural Network-Based Multimodal Medical Image Fusion via Guided Filtering and WSEML in NSCT Domain. Entropy, 23.","DOI":"10.3390\/e23050591"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"12389","DOI":"10.1007\/s11042-020-10462-y","article-title":"A novel multiscale transform decomposition based multi-focus image fusion framework","volume":"80","author":"Li","year":"2021","journal-title":"Multimed. Tools Appl."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"107087","DOI":"10.1016\/j.knosys.2021.107087","article-title":"Joint image fusion and denoising via three-layer decomposition and sparse representation","volume":"224","author":"Li","year":"2021","journal-title":"Knowl.-Based Syst."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"166413","DOI":"10.1016\/j.ijleo.2021.166413","article-title":"Optimum weighted multimodal medical image fusion using particle swarm optimization","volume":"231","author":"Shehanaz","year":"2021","journal-title":"Optik"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"101810","DOI":"10.1016\/j.bspc.2019.101810","article-title":"Multi-modal Medical Image Fusion based on Two-scale Image Decomposition and Sparse Representation","volume":"57","author":"Maqsood","year":"2020","journal-title":"Biomed. Signal Process. Control"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Qi, G., Hu, G., Mazur, N., Liang, H., and Haner, M. (2021). A Novel Multi-Modality Image Simultaneous Denoising and Fusion Method Based on Sparse Representation. Computers, 10.","DOI":"10.3390\/computers10100129"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"63162","DOI":"10.1109\/ACCESS.2020.2983457","article-title":"Low-Light Image Enhancement Based on Nonsubsampled Shearlet Transform","volume":"8","author":"Wang","year":"2020","journal-title":"IEEE Access"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"1253","DOI":"10.1364\/OL.18.001253","article-title":"Observation of periodic waves in a pulse-coupled neural network","volume":"18","author":"Johnson","year":"1993","journal-title":"Opt. Lett."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"103","DOI":"10.1016\/j.infrared.2014.04.003","article-title":"Novel fusion method for visible light and infrared images based on NSST\u2013SF\u2013PCNN","volume":"65","author":"Kong","year":"2014","journal-title":"Infrared Phys. Technol."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"180161","DOI":"10.1038\/sdata.2018.161","article-title":"The HAM10000 dataset, a large collection of multi-source dermatoscopic images of common pigmented skin lesions","volume":"5","author":"Tschandl","year":"2018","journal-title":"Sci. Data"},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Codella, N.C.F., Gutman, D., Emre Celebi, M., Helba, B., Marchetti, M.A., Dusza, S.W., Kalloo, A., Liopyris, K., Mishra, N., and Kittler, H. (2017). Skin Lesion Analysis Toward Melanoma Detection: A Challenge at the 2017 International Symposium on Biomedical Imaging (ISBI), Hosted by the International Skin Imaging Collaboration (ISIC). arXiv.","DOI":"10.1109\/ISBI.2018.8363547"},{"key":"ref_44","unstructured":"Combalia, M., Codella, N.C.F., Rotemberg, V., Helba, B., Vilaplana, V., Reiter, O., Carrera, C., Barreiro, A., Halpern, A.C., and Puig, S. (2019). BCN20000: Dermoscopic Lesions in the Wild. arXiv."},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Kinyanjui, N.M., Odonga, T., Cintas, C., Codella, N.C.F., Panda, R., Sattigeri, P., and Varshney, K.R. (2020). Fairness of Classifiers Across Skin Tones in Dermatology. Medical Image Computing and Computer Assisted Intervention\u2014MICCAI 2017, Springer.","DOI":"10.1007\/978-3-030-59725-2_31"},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Groh, M., Harris, C., Soenksen, L., Lau, F., Han, R., Kim, A., Koochek, A., and Badri, O. (2021). Evaluating Deep Neural Networks Trained on Clinical Images in Dermatology with the Fitzpatrick 17k Dataset. arXiv.","DOI":"10.1109\/CVPRW53098.2021.00201"},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Xiao, Y., Decenciere, E., Velasco-Forero, S., Burdin, H., Bornschlogl, T., Bernerd, F., Warrick, E., and Baldeweck, T. (2019, January 8\u201311). A New Color Augmentation Method for Deep Learning Segmentation of Histological Images. Proceedings of the 2019 IEEE 16th International Symposium on Biomedical Imaging (ISBI 2019), Venice, Italy.","DOI":"10.1109\/ISBI.2019.8759591"},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"94","DOI":"10.1109\/TPAMI.2011.109","article-title":"Objective Assessment of Multiresolution Image Fusion Algorithms for Context Enhancement in Night Vision: A Comparative Study","volume":"34","author":"Liu","year":"2012","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_49","unstructured":"Adjobo, E.C., Mahama, A.T.S., Gouton, P., and Tossa, J. (2019, January 26\u201329). Proposition of Convolutional Neural Network Based System for Skin Cancer Detection. Proceedings of the 2019 15th International Conference on Signal-Image Technology & Internet-Based Systems (SITIS), Sorrento, Italy."},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"1469","DOI":"10.1111\/jdv.12316","article-title":"Dermoscopic nevus patterns in skin of colour: A prospective, cross-sectional, morphological study in individuals with skin type V and VI","volume":"28","author":"Lallas","year":"2014","journal-title":"J. Eur. Acad. Dermatol. Venereol."}],"container-title":["Computers"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2073-431X\/11\/3\/44\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T22:37:47Z","timestamp":1760135867000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2073-431X\/11\/3\/44"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,3,16]]},"references-count":50,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2022,3]]}},"alternative-id":["computers11030044"],"URL":"https:\/\/doi.org\/10.3390\/computers11030044","relation":{},"ISSN":["2073-431X"],"issn-type":[{"value":"2073-431X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,3,16]]}}}