{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,30]],"date-time":"2026-09-30T04:10:17Z","timestamp":1790741417138,"version":"4.1.0"},"reference-count":56,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2021,4,15]],"date-time":"2021-04-15T00:00:00Z","timestamp":1618444800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2021,4,15]],"date-time":"2021-04-15T00:00:00Z","timestamp":1618444800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["J Big Data"],"published-print":{"date-parts":[[2021,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Label noise is an important data quality issue that negatively impacts machine learning algorithms. For example, label noise has been shown to increase the number of instances required to train effective predictive models. It has also been shown to increase model complexity and decrease model interpretability. In addition, label noise can cause the classification results of a learner to be poor. In this paper, we detect label noise with three unsupervised learners, namely<jats:inline-formula><jats:alternatives><jats:tex-math>$$\\textit{principal component analysis} \\hbox { (PCA)}$$<\/jats:tex-math><mml:math xmlns:mml=\"http:\/\/www.w3.org\/1998\/Math\/MathML\"><mml:mrow><mml:mi>principal component<\/mml:mi><mml:mspace\/><mml:mi>analysis<\/mml:mi><mml:mspace\/><mml:mtext>(PCA)<\/mml:mtext><\/mml:mrow><\/mml:math><\/jats:alternatives><\/jats:inline-formula>,<jats:inline-formula><jats:alternatives><jats:tex-math>$$\\textit{independent component analysis} \\hbox { (ICA)}$$<\/jats:tex-math><mml:math xmlns:mml=\"http:\/\/www.w3.org\/1998\/Math\/MathML\"><mml:mrow><mml:mi>independent component<\/mml:mi><mml:mspace\/><mml:mi>analysis<\/mml:mi><mml:mspace\/><mml:mtext>(ICA)<\/mml:mtext><\/mml:mrow><\/mml:math><\/jats:alternatives><\/jats:inline-formula>, and autoencoders. We evaluate these three learners on a credit card fraud dataset using multiple noise levels, and then compare results to the traditional Tomek links noise filter. Our binary classification approach, which considers label noise instances as anomalies, uniquely uses reconstruction errors for noisy data in order to identify and filter label noise. For detecting noisy instances, we discovered that the autoencoder algorithm was the top performer (highest recall score of 0.90), while Tomek links performed the worst (highest recall score of 0.62).<\/jats:p>","DOI":"10.1186\/s40537-021-00447-5","type":"journal-article","created":{"date-parts":[[2021,4,15]],"date-time":"2021-04-15T14:48:47Z","timestamp":1618498127000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":36,"title":["A reconstruction error-based framework for label noise detection"],"prefix":"10.1186","volume":"8","author":[{"given":"Zahra","family":"Salekshahrezaee","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7079-7540","authenticated-orcid":false,"given":"Joffrey L.","family":"Leevy","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Taghi M.","family":"Khoshgoftaar","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2021,4,15]]},"reference":[{"issue":"4","key":"447_CR1","first-page":"343","volume":"2","author":"D Angluin","year":"1988","unstructured":"Angluin D, Laird P. Learning from noisy examples. Mach Learn. 1988;2(4):343\u201370.","journal-title":"Mach Learn"},{"issue":"1","key":"447_CR2","doi-asserted-by":"publisher","first-page":"63","DOI":"10.1007\/s10115-018-1244-4","volume":"60","author":"RC Prati","year":"2019","unstructured":"Prati RC, Luengo J, Herrera F. Emerging topics and challenges of learning from noisy data in nonstandard classification: a survey beyond binary class noise. Knowl Inf Syst. 2019;60(1):63\u201397.","journal-title":"Knowl Inf Syst"},{"issue":"2","key":"447_CR3","doi-asserted-by":"publisher","first-page":"173","DOI":"10.3390\/rs9020173","volume":"9","author":"C Pelletier","year":"2017","unstructured":"Pelletier C, Valero S, Inglada J, Champion N, Marais Sicre C, Dedieu G. Effect of training class label noise on classification performances for land cover mapping with satellite image time series. Remote Sens. 2017;9(2):173.","journal-title":"Remote Sens"},{"issue":"2","key":"447_CR4","doi-asserted-by":"publisher","first-page":"171","DOI":"10.1007\/s10115-006-0022-x","volume":"11","author":"JD Van Hulse","year":"2007","unstructured":"Van Hulse JD, Khoshgoftaar TM, Huang H. The pairwise attribute noise detection algorithm. Knowl Inf Syst. 2007;11(2):171\u201390.","journal-title":"Knowl Inf Syst"},{"issue":"4","key":"447_CR5","doi-asserted-by":"publisher","first-page":"379","DOI":"10.1109\/TSMCC.2009.2013815","volume":"39","author":"TM Khoshgoftaar","year":"2009","unstructured":"Khoshgoftaar TM, Van Hulse J. Empirical case studies in attribute noise detection. IEEE Trans Syst Man Cybern C. 2009;39(4):379\u201388.","journal-title":"IEEE Trans Syst Man Cybern C"},{"key":"447_CR6","unstructured":"Maletic JI, Marcus A. Data cleansing: Beyond integrity analysis. In: Iq, pp. 200\u2013209; 2000. Citeseer."},{"issue":"3","key":"447_CR7","doi-asserted-by":"publisher","first-page":"1542","DOI":"10.1109\/TIP.2017.2782366","volume":"27","author":"D Wang","year":"2017","unstructured":"Wang D, Tan X. Robust distance metric learning via Bayesian inference. IEEE Trans Image Process. 2017;27(3):1542\u201353.","journal-title":"IEEE Trans Image Process"},{"key":"447_CR8","unstructured":"Patel AA. Hands-On Unsupervised Learning Using Python: How to Build Applied Machine Learning Solutions from Unlabeled Data. O\u2019Reilly Media; 2019."},{"key":"447_CR9","first-page":"4","volume":"11","author":"VC Raykar","year":"2010","unstructured":"Raykar VC, Yu S, Zhao LH, Valadez GH, Florin C, Bogoni L, Moy L. Learning from crowds. J Mach Learn Res. 2010;11:4.","journal-title":"J Mach Learn Res."},{"key":"447_CR10","first-page":"9428","volume":"33","author":"A Borghesi","year":"2019","unstructured":"Borghesi A, Bartolini A, Lombardi M, Milano M, Benini L. Anomaly detection using autoencoders in high performance computing systems. Proc AAAI Conf Artif Intell. 2019;33:9428\u201333.","journal-title":"Proc AAAI Conf Artif Intell"},{"issue":"5","key":"447_CR11","doi-asserted-by":"publisher","first-page":"845","DOI":"10.1109\/TNNLS.2013.2292894","volume":"25","author":"B Fr\u00e9nay","year":"2013","unstructured":"Fr\u00e9nay B, Verleysen M. Classification in the presence of label noise: a survey. IEEE Trans Neural Netw Learn Syst. 2013;25(5):845\u201369.","journal-title":"IEEE Trans Neural Netw Learn Syst"},{"issue":"3","key":"447_CR12","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/1541880.1541882","volume":"41","author":"V Chandola","year":"2009","unstructured":"Chandola V, Banerjee A, Kumar V. Anomaly detection: a survey. ACM Comput Surv. 2009;41(3):1\u201358.","journal-title":"ACM Comput Surv"},{"key":"447_CR13","unstructured":"Binglin X, Zhanhuai L. An anomaly detection method for spacecraft using ica technology. In: International Conference on Advanced Computer Science and Electronics Information (ICACSEI 2013), pp. 50\u201354; 2013."},{"key":"447_CR14","first-page":"448","volume":"6","author":"I Tomek","year":"1976","unstructured":"Tomek I, et al. An experiment with the edited nearest-nieghbor rule. IEEE Trans Syst Man Cybern. 1976;6:448\u201352.","journal-title":"IEEE Trans Syst Man Cybern"},{"issue":"12","key":"447_CR15","doi-asserted-by":"publisher","first-page":"1513","DOI":"10.1016\/j.datak.2009.08.005","volume":"68","author":"J Van Hulse","year":"2009","unstructured":"Van Hulse J, Khoshgoftaar T. Knowledge discovery from imbalanced and noisy data. Data Knowl Eng. 2009;68(12):1513\u201342.","journal-title":"Data Knowl Eng"},{"issue":"3","key":"447_CR16","doi-asserted-by":"publisher","first-page":"297","DOI":"10.20965\/jaciii.2010.p0297","volume":"14","author":"P Jeatrakul","year":"2010","unstructured":"Jeatrakul P, Wong KW, Fung CC. Data cleaning for classification using misclassification analysis. J Adv Comput Intell Intell Inform. 2010;14(3):297\u2013302.","journal-title":"J Adv Comput Intell Intell Inform"},{"key":"447_CR17","doi-asserted-by":"publisher","first-page":"408","DOI":"10.1109\/TSMC.1972.4309137","volume":"3","author":"DL Wilson","year":"1972","unstructured":"Wilson DL. Asymptotic properties of nearest neighbor rules using edited data. IEEE Trans Syst Man Cybern. 1972;3:408\u201321.","journal-title":"IEEE Trans Syst Man Cybern"},{"issue":"3","key":"447_CR18","doi-asserted-by":"publisher","first-page":"387","DOI":"10.1007\/s11390-007-9054-2","volume":"22","author":"TM Khoshgoftaar","year":"2007","unstructured":"Khoshgoftaar TM, Rebours P. Improving software quality prediction by noise filtering techniques. J Comp Sci Technol. 2007;22(3):387\u201396.","journal-title":"J Comp Sci Technol"},{"key":"447_CR19","doi-asserted-by":"publisher","first-page":"19","DOI":"10.1016\/j.inffus.2015.04.002","volume":"27","author":"JA S\u00e1ez","year":"2016","unstructured":"S\u00e1ez JA, Galar M, Luengo J, Herrera F. Inffc: an iterative class noise filter based on the fusion of classifiers with noise sensitivity control. Inform Fusion. 2016;27:19\u201332.","journal-title":"Inform Fusion"},{"issue":"479","key":"447_CR20","doi-asserted-by":"publisher","first-page":"974","DOI":"10.1198\/016214507000000617","volume":"102","author":"Y Wu","year":"2007","unstructured":"Wu Y, Liu Y. Robust truncated hinge loss support vector machines. J Am Stat Assoc. 2007;102(479):974\u201383.","journal-title":"J Am Stat Assoc"},{"key":"447_CR21","doi-asserted-by":"crossref","unstructured":"R\u00e4tsch G, Sch\u00f6lkopf B, Smola AJ, Mika S, Onoda T, M\u00fcller K-R. Robust ensemble learning for data mining. In: Pacific-Asia Conference on Knowledge Discovery and Data Mining, pp. 341\u2013344; 2000. Springer.","DOI":"10.1007\/3-540-45571-X_39"},{"key":"447_CR22","doi-asserted-by":"crossref","unstructured":"Zhang W, Wang D, Tan X. Data cleaning and classification in the presence of label noise with class-specific autoencoder. In: International Symposium on Neural Networks, pp. 256\u2013264; 2018. Springer.","DOI":"10.1007\/978-3-319-92537-0_30"},{"issue":"7","key":"447_CR23","doi-asserted-by":"crossref","first-page":"3140","DOI":"10.1109\/TNNLS.2017.2712823","volume":"29","author":"D Wang","year":"2017","unstructured":"Wang D, Tan X. Bayesian neighborhood component analysis. IEEE Trans Neural Netw Learn Syst. 2017;29(7):3140\u201351.","journal-title":"IEEE Trans Neural Netw Learn Syst"},{"key":"447_CR24","doi-asserted-by":"crossref","unstructured":"Zhang W, Tan X. Combining outlier detection and reconstruction error minimization for label noise reduction. In: 2019 IEEE International Conference on Big Data and Smart Computing (BigComp), pp. 1\u20134 ; 2019. IEEE","DOI":"10.1109\/BIGCOMP.2019.8679275"},{"issue":"6","key":"447_CR25","doi-asserted-by":"publisher","first-page":"141","DOI":"10.1109\/MSP.2012.2211477","volume":"29","author":"L Deng","year":"2012","unstructured":"Deng L. The mnist database of handwritten digit images for machine learning research [best of the web]. IEEE Signal Process Magaz. 2012;29(6):141\u20132.","journal-title":"IEEE Signal Process Magaz"},{"key":"447_CR26","doi-asserted-by":"crossref","unstructured":"Bartholomew D. Principal components analysis. International Encyclopedia of Education, 3rd edn., pp. 374\u2013377. New York: Elsevier; 2010.","DOI":"10.1016\/B978-0-08-044894-7.01358-0"},{"key":"447_CR27","doi-asserted-by":"crossref","unstructured":"Najafabadi MM, Khoshgoftaar TM, Calvert C, Kemp C. User behavior anomaly detection for application layer ddos attacks. In: 2017 IEEE International Conference on Information Reuse and Integration (IRI), pp. 154\u2013161; 2017. IEEE.","DOI":"10.1109\/IRI.2017.44"},{"issue":"4","key":"447_CR28","doi-asserted-by":"publisher","first-page":"219","DOI":"10.1145\/1030194.1015492","volume":"34","author":"A Lakhina","year":"2004","unstructured":"Lakhina A, Crovella M, Diot C. Diagnosing network-wide traffic anomalies. ACM SIGCOMM Comp Commun Rev. 2004;34(4):219\u201330.","journal-title":"ACM SIGCOMM Comp Commun Rev"},{"key":"447_CR29","unstructured":"Najafabadi MM. Machine Learning Algorithms for the Analysis and Detection of Network Attacks. Florida Atlantic University; 2017."},{"issue":"10","key":"447_CR30","doi-asserted-by":"publisher","first-page":"1731","DOI":"10.1002\/dac.2432","volume":"27","author":"C Callegari","year":"2014","unstructured":"Callegari C, Gazzarrini L, Giordano S, Pagano M, Pepe T. Improving pca-based anomaly detection by using multiple time scale analysis and kullback-leibler divergence. Int J Commun Syst. 2014;27(10):1731\u201351.","journal-title":"Int J Commun Syst"},{"key":"447_CR31","unstructured":"Paffenroth R, Kay K, Servi L. Robust pca for anomaly detection in cyber networks. arXiv preprint arXiv:1801.01571 2018."},{"issue":"7","key":"447_CR32","doi-asserted-by":"publisher","first-page":"1483","DOI":"10.1162\/neco.1997.9.7.1483","volume":"9","author":"A Hyv\u00e4rinen","year":"1997","unstructured":"Hyv\u00e4rinen A, Oja E. A fast fixed-point algorithm for independent component analysis. Neural Comput. 1997;9(7):1483\u201392.","journal-title":"Neural Comput"},{"key":"447_CR33","volume-title":"What is Independent Component Analysis?, Independent Component Analysis","author":"A Hyv\u00e4rinen","year":"2002","unstructured":"Hyv\u00e4rinen A, Karhunen J, Oja E. What is Independent Component Analysis?, Independent Component Analysis. New York: Wiley; 2002."},{"issue":"4\u20135","key":"447_CR34","doi-asserted-by":"publisher","first-page":"411","DOI":"10.1016\/S0893-6080(00)00026-5","volume":"13","author":"A Hyv\u00e4rinen","year":"2000","unstructured":"Hyv\u00e4rinen A, Oja E. Independent component analysis: algorithms and applications. Neural Netw. 2000;13(4\u20135):411\u201330.","journal-title":"Neural Netw"},{"issue":"4","key":"447_CR35","doi-asserted-by":"publisher","first-page":"171","DOI":"10.11648\/j.sjams.20150304.11","volume":"3","author":"MS Reza","year":"2015","unstructured":"Reza MS, Ruhi S. Multivariate outlier detection using independent component analysis. Sci J Appl Math Stat. 2015;3(4):171\u20136.","journal-title":"Sci J Appl Math Stat"},{"key":"447_CR36","doi-asserted-by":"crossref","unstructured":"Chicco D, Sadowski P, Baldi P. Deep autoencoder neural networks for gene ontology annotation predictions. In: Proceedings of the 5th ACM Conference on Bioinformatics, Computational Biology, and Health Informatics, pp. 533\u2013540; 2014.","DOI":"10.1145\/2649387.2649442"},{"issue":"1","key":"447_CR37","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/s40537-014-0007-7","volume":"2","author":"MM Najafabadi","year":"2015","unstructured":"Najafabadi MM, Villanustre F, Khoshgoftaar TM, Seliya N, Wald R, Muharemagic E. Deep learning applications and challenges in big data analytics. J Big Data. 2015;2(1):1.","journal-title":"J Big Data"},{"key":"447_CR38","doi-asserted-by":"crossref","unstructured":"Almotiri J, Elleithy K, Elleithy A. Comparison of autoencoder and principal component analysis followed by neural network for e-learning using handwritten recognition. In: 2017 IEEE Long Island Systems, Applications and Technology Conference (LISAT), pp. 1\u20135; 2017. IEEE.","DOI":"10.1109\/LISAT.2017.8001963"},{"issue":"4","key":"447_CR39","doi-asserted-by":"publisher","first-page":"307","DOI":"10.1561\/2200000056","volume":"12","author":"DP Kingma","year":"2019","unstructured":"Kingma DP, Welling M. An introduction to variational autoencoders. Found Trends Mach Learn. 2019;12(4):307\u201392.","journal-title":"Found Trends Mach Learn"},{"key":"447_CR40","doi-asserted-by":"crossref","unstructured":"Zhou C, Paffenroth RC. Anomaly detection with robust deep autoencoders. In: Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 665\u2013674; 2017.","DOI":"10.1145\/3097983.3098052"},{"key":"447_CR41","unstructured":"Ranjan C. Build the Right Autoencoder \u2013 Tune and Optimize using PCA Principles. https:\/\/towardsdatascience.com\/build-the-right-autoencoder-tune-and-optimize-using-pca-principles-part-i-1f01f821999b"},{"key":"447_CR42","first-page":"769","volume":"11","author":"I Tomek","year":"1976","unstructured":"Tomek I, et al. Two modifications of cnn. IEEE Trans Syst Man Cybern. 1976;11:769\u201372.","journal-title":"IEEE Trans Syst Man Cybern"},{"key":"447_CR43","doi-asserted-by":"publisher","DOI":"10.1002\/9781118646106","volume-title":"Imbalanced Learning: Foundations, Algorithms, and Applications","author":"H He","year":"2013","unstructured":"He H, Ma Y. Imbalanced Learning: Foundations, Algorithms, and Applications. New York: Wiley; 2013."},{"key":"447_CR44","unstructured":"Brownlee J. Undersampling Algorithms for Imbalanced Classification. https:\/\/machinelearningmastery.com\/undersampling-algorithms-for-imbalanced-classification\/."},{"key":"447_CR45","unstructured":"Agarwal R. The 5 Most Useful Techniques to Handle Imbalanced Datasets. https:\/\/www.kdnuggets.com\/2020\/01\/5-most-useful-techniques-handle-imbalanced-datasets.html."},{"key":"447_CR46","unstructured":"Kaggle: Credit Card Fraud Detection. https:\/\/www.kaggle.com\/mlg-ulb\/creditcardfraud."},{"issue":"1","key":"447_CR47","doi-asserted-by":"publisher","first-page":"42","DOI":"10.1186\/s40537-018-0151-6","volume":"5","author":"JL Leevy","year":"2018","unstructured":"Leevy JL, Khoshgoftaar TM, Bauder RA, Seliya N. A survey on addressing high-class imbalance in big data. J Big Data. 2018;5(1):42.","journal-title":"J Big Data"},{"key":"447_CR48","unstructured":"Kohavi R. A study of cross-validation and bootstrap for accuracy estimation and model selection. In: Proceedings of the 14th International Joint Conference on Artificial intelligence-Volume 2, pp. 1137\u20131143; 1995. Morgan Kaufmann Publishers Inc."},{"key":"447_CR49","first-page":"2825","volume":"12","author":"F Pedregosa","year":"2011","unstructured":"Pedregosa F, Varoquaux G, Gramfort A, Michel V, Thirion B, Grisel O, Blondel M, Prettenhofer P, Weiss R, Dubourg V, et al. Scikit-learn: Machine learning in python. J Mach Learn Res. 2011;12:2825\u201330.","journal-title":"J Mach Learn Res"},{"key":"447_CR50","unstructured":"sklearn.decomposition.FastICA: FastICA: a fast algorithm for Independent Component Analysis. https:\/\/scikit-learn.org\/stable\/modules\/generated\/sklearn.decomposition.FastICA.html."},{"key":"447_CR51","volume-title":"Deep Learning with Keras","author":"A Gulli","year":"2017","unstructured":"Gulli A, Pal S. Deep Learning with Keras. New York: Packt Publishing Ltd; 2017."},{"key":"447_CR52","doi-asserted-by":"crossref","unstructured":"Seliya N, Khoshgoftaar TM, Van\u00a0Hulse J. A study on the relationships of classifier performance metrics. In: Tools with Artificial Intelligence, 2009. ICTAI\u201909. 21st International Conference On, pp. 59\u201366; 2009. IEEE","DOI":"10.1109\/ICTAI.2009.25"},{"key":"447_CR53","doi-asserted-by":"publisher","first-page":"571","DOI":"10.1016\/j.ins.2010.12.016","volume":"259","author":"C Seiffert","year":"2014","unstructured":"Seiffert C, Khoshgoftaar TM, Van Hulse J, Folleco A. An empirical study of the classification performance of learners on imbalanced and noisy software quality data. Inform Sci. 2014;259:571\u201395.","journal-title":"Inform Sci"},{"issue":"1","key":"447_CR54","doi-asserted-by":"publisher","first-page":"9","DOI":"10.1007\/s13755-018-0051-3","volume":"6","author":"RA Bauder","year":"2018","unstructured":"Bauder RA, Khoshgoftaar TM. The effects of varying class distribution on learner behavior for medicare fraud detection with imbalanced big data. Health Inform Sci Syst. 2018;6(1):9.","journal-title":"Health Inform Sci Syst"},{"key":"447_CR55","doi-asserted-by":"publisher","DOI":"10.4135\/9781412983327","volume-title":"Analysis of variance","author":"GR Iversen","year":"1987","unstructured":"Iversen GR, Wildt AR, Norpoth H, Norpoth HP. Analysis of variance. New York: Sage; 1987."},{"key":"447_CR56","doi-asserted-by":"publisher","first-page":"99","DOI":"10.2307\/3001913","volume":"1","author":"JW Tukey","year":"1949","unstructured":"Tukey JW. Comparing individual means in the analysis of variance. Biometrics. 1949;1:99\u2013114.","journal-title":"Biometrics."}],"container-title":["Journal of Big Data"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s40537-021-00447-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s40537-021-00447-5\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s40537-021-00447-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,12,24]],"date-time":"2022-12-24T11:09:07Z","timestamp":1671880147000},"score":1,"resource":{"primary":{"URL":"https:\/\/journalofbigdata.springeropen.com\/articles\/10.1186\/s40537-021-00447-5"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,4,15]]},"references-count":56,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2021,12]]}},"alternative-id":["447"],"URL":"https:\/\/doi.org\/10.1186\/s40537-021-00447-5","relation":{},"ISSN":["2196-1115"],"issn-type":[{"value":"2196-1115","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,4,15]]},"assertion":[{"value":"20 January 2021","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"7 April 2021","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"15 April 2021","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"Not applicable","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Not applicable","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"The authors declare that they have no competing interests.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"57"}}