{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,17]],"date-time":"2026-01-17T04:36:19Z","timestamp":1768624579312,"version":"3.49.0"},"reference-count":39,"publisher":"Springer Science and Business Media LLC","issue":"2","license":[{"start":{"date-parts":[[2021,12,23]],"date-time":"2021-12-23T00:00:00Z","timestamp":1640217600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2021,12,23]],"date-time":"2021-12-23T00:00:00Z","timestamp":1640217600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"the National Key Research and Development Program of China","award":["No. 2018AAA0100203"],"award-info":[{"award-number":["No. 2018AAA0100203"]}]},{"name":"the Joint Research Fund in Astronomy under cooperative agreement between the NSFC and CAS","award":["U2031136"],"award-info":[{"award-number":["U2031136"]}]},{"name":"the National Key Research and Development Program","award":["No.2017YFC 1502505"],"award-info":[{"award-number":["No.2017YFC 1502505"]}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Complex Intell. Syst."],"published-print":{"date-parts":[[2022,4]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>The success of deep learning in skin lesion classification mainly depends on the ultra-deep neural network and the significantly large training data set. Deep learning training is usually time-consuming, and large datasets with labels are hard to obtain, especially skin lesion images. Although pre-training and data augmentation can alleviate these issues, there are still some problems: (1) the data domain is not consistent, resulting in the slow convergence; and (2) low robustness to confusing skin lesions. To solve these problems, we propose an efficient structural pseudoinverse learning-based hierarchical representation learning method. Preliminary feature extraction, shallow network feature extraction and deep learning feature extraction are carried out respectively before the classification of skin lesion images. Gabor filter and pre-trained deep convolutional neural network are used for preliminary feature extraction. The structural pseudoinverse learning (S-PIL) algorithm is used to extract the shallow features. Then, S-PIL preliminarily identifies the skin lesion images that are difficult to be classified to form a new training set for deep learning feature extraction. Through the hierarchical representation learning, we analyze the features of skin lesion images layer by layer to improve the final classification. Our method not only avoid the slow convergence caused by inconsistency of data domain but also enhances the training of confusing examples. Without using additional data, our approach outperforms existing methods in the ISIC 2017 and ISIC 2018 datasets.<\/jats:p>","DOI":"10.1007\/s40747-021-00588-3","type":"journal-article","created":{"date-parts":[[2021,12,23]],"date-time":"2021-12-23T10:15:15Z","timestamp":1640254515000},"page":"1445-1457","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":9,"title":["Efficient structural pseudoinverse learning-based hierarchical representation learning for skin lesion classification"],"prefix":"10.1007","volume":"8","author":[{"given":"Xiaodan","family":"Deng","sequence":"first","affiliation":[]},{"given":"Qian","family":"Yin","sequence":"additional","affiliation":[]},{"given":"Ping","family":"Guo","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2021,12,23]]},"reference":[{"key":"588_CR1","doi-asserted-by":"crossref","unstructured":"Barata C, Marques JS, Celebi ME (2019) Deep attention model for the hierarchical diagnosis of skin lesions. In: IEEE Conference on Computer Vision and Pattern Recognition Workshops, CVPR Workshops 2019, Long Beach, CA, USA, June 16-20, 2019, Computer Vision Foundation \/ IEEE, pp 2757\u20132765","DOI":"10.1109\/CVPRW.2019.00334"},{"issue":"8","key":"588_CR2","doi-asserted-by":"publisher","first-page":"1798","DOI":"10.1109\/TPAMI.2013.50","volume":"35","author":"Y Bengio","year":"2013","unstructured":"Bengio Y, Courville A, Vincent P (2013) Representation learning: A review and new perspectives. IEEE transactions on pattern analysis and machine intelligence 35(8):1798\u20131828","journal-title":"IEEE transactions on pattern analysis and machine intelligence"},{"key":"588_CR3","doi-asserted-by":"crossref","unstructured":"Bissoto A, Perez F, Valle E, Avila S (2018) Skin lesion synthesis with generative adversarial networks. In: OR 2.0 Context-Aware Operating Theaters, Computer Assisted Robotic Endoscopy, Clinical Image-Based Procedures, and Skin Image Analysis, Springer, pp 294\u2013302","DOI":"10.1007\/978-3-030-01201-4_32"},{"issue":"2","key":"588_CR4","doi-asserted-by":"publisher","first-page":"474","DOI":"10.1109\/JBHI.2019.2895803","volume":"23","author":"Emre M Celebi","year":"2019","unstructured":"Celebi Emre M, Codella Noel, Halpern Allan (2019) Dermoscopy image analysis: Overview and future directions. IEEE Journal of Biomedical and Health Informatics 23(2):474\u2013478","journal-title":"IEEE Journal of Biomedical and Health Informatics"},{"key":"588_CR5","unstructured":"Codella N, Rotemberg V, Tschandl P, Celebi ME, Dusza S, Gutman D, Helba B, Kalloo A, Liopyris K, Marchetti Ma (2019) Skin lesion analysis toward melanoma detection 2018: A challenge hosted by the international skin imaging collaboration (isic). https:\/\/arxivorg\/abs\/190203368"},{"key":"588_CR6","doi-asserted-by":"crossref","unstructured":"Codella NC, Gutman D, Celebi ME, Helba B, Marchetti MA, Dusza SW, Kalloo A, Liopyris K, Mishra N, Kittler H, et\u00a0al. (2018) Skin lesion analysis toward melanoma detection: A challenge at the 2017 international symposium on biomedical imaging (isbi), hosted by the international skin imaging collaboration (isic). In: 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018), IEEE, pp 168\u2013172","DOI":"10.1109\/ISBI.2018.8363547"},{"issue":"10","key":"588_CR7","doi-asserted-by":"publisher","first-page":"847","DOI":"10.1016\/0042-6989(80)90065-6","volume":"20","author":"J Daugman","year":"1980","unstructured":"Daugman J (1980) Two-dimensional spectral analysis of cortical receptive field profiles. Vision Research 20(10):847\u2013856","journal-title":"Vision Research"},{"issue":"7639","key":"588_CR8","doi-asserted-by":"crossref","first-page":"115","DOI":"10.1038\/nature21056","volume":"542","author":"A Esteva","year":"2017","unstructured":"Esteva A, Kuprel B, Novoa RA, Ko J, Swetter SM, Blau HM, Thrun S (2017) Dermatologist-level classification of skin cancer with deep neural networks. Nature 542(7639):115","journal-title":"Nature"},{"key":"588_CR9","unstructured":"Gessert N, Sentker T, Madesta F, Schmitz R, Kniep H, Baltruschat I, Werner R, Schlaefer A (2018) Skin lesion diagnosis using ensembles, unscaled multi-crop evaluation and loss weighting. http:\/\/arxivorg\/abs\/180801694"},{"issue":"2","key":"588_CR10","doi-asserted-by":"publisher","first-page":"495","DOI":"10.1109\/TBME.2019.2915839","volume":"67","author":"N Gessert","year":"2020","unstructured":"Gessert N, Sentker T, Madesta F, Schmitz R, Kniep H, Baltruschat I, Werner R, Schlaefer A (2020) Skin lesion classification using cnns with patch-based attention and diagnosis-guided loss weighting. IEEE Transactions on Biomedical Engineering 67(2):495\u2013503","journal-title":"IEEE Transactions on Biomedical Engineering"},{"issue":"2","key":"588_CR11","doi-asserted-by":"publisher","first-page":"547","DOI":"10.1109\/JBHI.2018.2806962","volume":"23","author":"I Gonz\u00e1lez-D\u00edaz","year":"2019","unstructured":"Gonz\u00e1lez-D\u00edaz I (2019) Dermaknet: Incorporating the knowledge of dermatologists to convolutional neural networks for skin lesion diagnosis. IEEE Journal of Biomedical and Health Informatics 23(2):547\u2013559","journal-title":"IEEE Journal of Biomedical and Health Informatics"},{"key":"588_CR12","doi-asserted-by":"publisher","first-page":"101","DOI":"10.1016\/S0925-2312(03)00385-0","volume":"56","author":"P Guo","year":"2004","unstructured":"Guo P, Lyu MR (2004) A pseudoinverse learning algorithm for feedforward neural networks with stacked generalization applications to software reliability growth data. Neurocomputing 56:101\u2013121","journal-title":"Neurocomputing"},{"key":"588_CR13","unstructured":"Guo P, Chen CP, Sun Y (1995) An exact supervised learning for a three-layer supervised neural network. In: Proceedings of 1995 International Conference on Neural Information Processing, pp 1041\u20131044"},{"key":"588_CR14","unstructured":"Guo P, Lyu MR, Mastorakis N (2001) Pseudoinverse learning algorithm for feedforward neural networks. Advances in Neural Networks and Applications pp 321\u2013326"},{"key":"588_CR15","doi-asserted-by":"publisher","first-page":"25","DOI":"10.1016\/j.jbi.2018.08.006","volume":"86","author":"B Harangi","year":"2018","unstructured":"Harangi B (2018) Skin lesion classification with ensembles of deep convolutional neural networks. Journal of Biomedical Informatics 86:25\u201332","journal-title":"Journal of Biomedical Informatics"},{"issue":"1","key":"588_CR16","first-page":"100","volume":"28","author":"JA Hartigan","year":"1979","unstructured":"Hartigan JA, Wong MA (1979) Algorithm as 136: A k-means clustering algorithm. Journal of the royal statistical society series c (applied statistics) 28(1):100\u2013108","journal-title":"Journal of the royal statistical society series c (applied statistics)"},{"key":"588_CR17","doi-asserted-by":"crossref","unstructured":"He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 770\u2013778","DOI":"10.1109\/CVPR.2016.90"},{"key":"588_CR18","doi-asserted-by":"crossref","unstructured":"Hinton GE, Salakhutdinov RR (2006) Reducing the dimensionality of data with neural networks. science 313(5786):504\u2013507","DOI":"10.1126\/science.1127647"},{"key":"588_CR19","doi-asserted-by":"publisher","first-page":"134","DOI":"10.1016\/j.patcog.2018.05.014","volume":"83","author":"Z Hu","year":"2018","unstructured":"Hu Z, Tang J, Wang Z, Zhang K, Zhang L, Sun Q (2018) Deep learning for image-based cancer detection and diagnosis- a survey. Pattern Recognition 83:134\u2013149","journal-title":"Pattern Recognition"},{"key":"588_CR20","doi-asserted-by":"crossref","unstructured":"Huang G, Liu Z, Van Der\u00a0Maaten L, Weinberger KQ (2017) Densely connected convolutional networks. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 4700\u20134708","DOI":"10.1109\/CVPR.2017.243"},{"issue":"8","key":"588_CR21","doi-asserted-by":"publisher","first-page":"651","DOI":"10.1016\/j.patrec.2009.09.011","volume":"31","author":"AK Jain","year":"2010","unstructured":"Jain AK (2010) Data clustering: 50 years beyond k-means. Pattern recognition letters 31(8):651\u2013666","journal-title":"Pattern recognition letters"},{"key":"588_CR22","doi-asserted-by":"publisher","first-page":"735","DOI":"10.1016\/j.procs.2015.04.209","volume":"48","author":"S Jain","year":"2015","unstructured":"Jain S, Pise N et al (2015) Computer aided melanoma skin cancer detection using image processing. Procedia Computer Science 48:735\u2013740","journal-title":"Procedia Computer Science"},{"key":"588_CR23","doi-asserted-by":"crossref","unstructured":"Karar ME, ezzeldinhemdan, Shouman MA (2020) Cascaded deep learning classifiers for computer-aided diagnosis of covid-19 and pneumonia diseases in x-ray scans. Complex and Intelligent Systems (8)","DOI":"10.1007\/s40747-020-00199-4"},{"key":"588_CR24","doi-asserted-by":"publisher","first-page":"119","DOI":"10.1007\/s40747-017-0064-6","volume":"4","author":"D Kollias","year":"2018","unstructured":"Kollias D, Tagaris A, Stafylopatis A, Kollias S, Tagaris G (2018) Deep neural architectures for prediction in healthcare. Complex and Intelligent Systems 4:119\u2013131","journal-title":"Complex and Intelligent Systems"},{"key":"588_CR25","first-page":"1097","volume":"25","author":"A Krizhevsky","year":"2012","unstructured":"Krizhevsky A, Sutskever I, Hinton GE (2012) Imagenet classification with deep convolutional neural networks. Advances in neural information processing systems 25:1097\u20131105","journal-title":"Advances in neural information processing systems"},{"issue":"10","key":"588_CR26","doi-asserted-by":"publisher","first-page":"1395","DOI":"10.1109\/83.791965","volume":"8","author":"P Kruizinga","year":"1999","unstructured":"Kruizinga P, Petkov N (1999) Nonlinear operator for oriented texture. IEEE Transactions on Image Processing 8(10):1395\u20131407","journal-title":"IEEE Transactions on Image Processing"},{"issue":"2","key":"588_CR27","doi-asserted-by":"publisher","first-page":"556","DOI":"10.3390\/s18020556","volume":"18","author":"Y Li","year":"2018","unstructured":"Li Y, Shen L (2018) Skin lesion analysis towards melanoma detection using deep learning network. Sensors 18(2):556","journal-title":"Sensors"},{"key":"588_CR28","first-page":"1","volume-title":"2016 Sixth International Conference on Image Processing Theory","author":"T Majtner","year":"2016","unstructured":"Majtner T, Yildirim-Yayilgan S, Hardeberg JY (2016) Combining deep learning and hand-crafted features for skin lesion classification. 2016 Sixth International Conference on Image Processing Theory. Tools and Applications (IPTA), IEEE, pp 1\u20136"},{"key":"588_CR29","doi-asserted-by":"crossref","unstructured":"Maragoudakis M, Maglogiannis I (2010) Skin lesion diagnosis from images using novel ensemble classification techniques. In: proceedings of the 10th IEEE International Conference on Information Technology and Applications in Biomedicine, IEEE, pp 1\u20135","DOI":"10.1109\/ITAB.2010.5687620"},{"key":"588_CR30","unstructured":"Nozdryn-Plotnicki A, Yap J, Yolland W (2018) Ensembling convolutional neural networks for skin cancer classification. International Skin Imaging Collaboration (ISIC) Challenge on Skin Image Analysis for Melanoma Detection MICCAI"},{"issue":"1","key":"588_CR31","doi-asserted-by":"publisher","first-page":"1701","DOI":"10.1038\/s41598-018-19907-9","volume":"8","author":"D Roffman","year":"2018","unstructured":"Roffman D, Hart G, Girardi M, Ko CJ, Deng J (2018) Predicting non-melanoma skin cancer via a multi-parameterized artificial neural network. Scientific reports 8(1):1701","journal-title":"Scientific reports"},{"key":"588_CR32","doi-asserted-by":"crossref","unstructured":"Szegedy C, Liu W, Jia Y, Sermanet P, Reed S, Anguelov D, Erhan D, Vanhoucke V, Rabinovich A (2015) Going deeper with convolutions. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 1\u20139","DOI":"10.1109\/CVPR.2015.7298594"},{"key":"588_CR33","doi-asserted-by":"crossref","unstructured":"Szegedy C, Vanhoucke V, Ioffe S, Shlens J, Wojna Z (2016) Rethinking the inception architecture for computer vision. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 2818\u20132826","DOI":"10.1109\/CVPR.2016.308"},{"key":"588_CR34","unstructured":"Tan M, Le Q (2019) Efficientnet: Rethinking model scaling for convolutional neural networks. In: International Conference on Machine Learning, PMLR, pp 6105\u20136114"},{"key":"588_CR35","doi-asserted-by":"publisher","DOI":"10.1038\/sdata.2018.161","volume":"5","author":"P Tschandl","year":"2018","unstructured":"Tschandl P, Rosendahl C, Kittler H (2018) The ham10000 dataset, a large collection of multi-source dermatoscopic images of common pigmented skin lesions. Scientific data 5:180161","journal-title":"Scientific data"},{"key":"588_CR36","doi-asserted-by":"publisher","first-page":"303","DOI":"10.1016\/j.neucom.2019.12.003","volume":"383","author":"E Valle","year":"2020","unstructured":"Valle E, Fornaciali M, Menegola A, Tavares J, Avila S (2020) Data, depth, and design: Learning reliable models for skin lesion analysis. Neurocomputing 383:303\u2013313","journal-title":"Neurocomputing"},{"key":"588_CR37","doi-asserted-by":"crossref","unstructured":"Yu L, Chen H, Dou Q, Qin J, Heng PA (2016) Automated melanoma recognition in dermoscopy images via very deep residual networks. IEEE Transactions on Medical Imaging PP(99):994\u20131004","DOI":"10.1109\/TMI.2016.2642839"},{"issue":"9","key":"588_CR38","doi-asserted-by":"publisher","first-page":"2092","DOI":"10.1109\/TMI.2019.2893944","volume":"38","author":"J Zhang","year":"2019","unstructured":"Zhang J, Xie Y, Xia Y, Shen C (2019) Attention residual learning for skin lesion classification. IEEE Transactions on Medical Imaging 38(9):2092\u20132103","journal-title":"IEEE Transactions on Medical Imaging"},{"key":"588_CR39","unstructured":"Zhuang J, Li W, Manivannan S, Wang R, Zhang JJG, Pan J, Jiang G, Yin Z (2018) Skin lesion analysis towards melanoma detection using deep neural network ensemble. ISIC Challenge 2018:2"}],"updated-by":[{"DOI":"10.1007\/s40747-022-00654-4","type":"correction","label":"Correction","source":"publisher","updated":{"date-parts":[[2022,1,31]],"date-time":"2022-01-31T00:00:00Z","timestamp":1643587200000}}],"container-title":["Complex &amp; Intelligent Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s40747-021-00588-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s40747-021-00588-3\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s40747-021-00588-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,4,29]],"date-time":"2022-04-29T17:12:27Z","timestamp":1651252347000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s40747-021-00588-3"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,12,23]]},"references-count":39,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2022,4]]}},"alternative-id":["588"],"URL":"https:\/\/doi.org\/10.1007\/s40747-021-00588-3","relation":{},"ISSN":["2199-4536","2198-6053"],"issn-type":[{"value":"2199-4536","type":"print"},{"value":"2198-6053","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,12,23]]},"assertion":[{"value":"1 February 2021","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"20 October 2021","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"23 December 2021","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"31 January 2022","order":4,"name":"change_date","label":"Change Date","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"Correction","order":5,"name":"change_type","label":"Change Type","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"A Correction to this paper has been published:","order":6,"name":"change_details","label":"Change Details","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"https:\/\/doi.org\/10.1007\/s40747-022-00654-4","URL":"https:\/\/doi.org\/10.1007\/s40747-022-00654-4","order":7,"name":"change_details","label":"Change Details","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"Corresponding authors declare on behalf of all authors that there is no conflict of interest. We declare that we do not have any commercial or associative interest that represents a conflict of interest in connection with the work submitted.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}}]}}