{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,31]],"date-time":"2025-10-31T08:02:56Z","timestamp":1761897776771,"version":"3.37.3"},"reference-count":38,"publisher":"Springer Science and Business Media LLC","issue":"2","license":[{"start":{"date-parts":[[2022,8,23]],"date-time":"2022-08-23T00:00:00Z","timestamp":1661212800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2022,8,23]],"date-time":"2022-08-23T00:00:00Z","timestamp":1661212800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100002386","name":"Cairo University","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100002386","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Cluster Comput"],"published-print":{"date-parts":[[2023,4]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Coronavirus disease (COVID-19) is rapidly spreading worldwide. Recent studies show that radiological images contain accurate data for detecting the coronavirus. This paper proposes a pre-trained convolutional neural network (VGG16) with Capsule Neural Networks (CapsNet) to detect COVID-19 with unbalanced data sets. The CapsNet is proposed due to its ability to define features such as perspective, orientation, and size. Synthetic Minority Over-sampling Technique (SMOTE) was employed to ensure that new samples were generated close to the sample center, avoiding the production of outliers or changes in data distribution. As the results may change by changing capsule network parameters (Capsule dimensionality and routing number), the Gaussian optimization method has been used to optimize these parameters. Four experiments have been done, (1) CapsNet with the unbalanced data sets, (2) CapsNet with balanced data sets based on class weight, (3) CapsNet with balanced data sets based on SMOTE, and (4) CapsNet hyperparameters optimization with balanced data sets based on SMOTE. The performance has improved and achieved an accuracy rate of 96.58% and an F1- score of 97.08%, a competitive optimized model compared to other related models.<\/jats:p>","DOI":"10.1007\/s10586-022-03703-2","type":"journal-article","created":{"date-parts":[[2022,8,23]],"date-time":"2022-08-23T13:03:10Z","timestamp":1661259790000},"page":"1389-1403","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":16,"title":["A pre-trained convolutional neural network with optimized capsule networks for chest X-rays COVID-19 diagnosis"],"prefix":"10.1007","volume":"26","author":[{"given":"Lobna M.","family":"AbouEl-Magd","sequence":"first","affiliation":[]},{"given":"Ashraf","family":"Darwish","sequence":"additional","affiliation":[]},{"given":"Vaclav","family":"Snasel","sequence":"additional","affiliation":[]},{"given":"Aboul Ella","family":"Hassanien","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2022,8,23]]},"reference":[{"key":"3703_CR1","doi-asserted-by":"publisher","first-page":"m1328","DOI":"10.1136\/bmj.m1328","volume":"369","author":"L Wynants","year":"2020","unstructured":"Wynants, L., et al.: Prediction models for diagnosis and prognosis of covid-19: systematic review and critical appraisal. BMJ 369, m1328 (2020). https:\/\/doi.org\/10.1136\/bmj.m1328","journal-title":"BMJ"},{"issue":"1","key":"3703_CR2","doi-asserted-by":"publisher","first-page":"1","DOI":"10.36648\/2471-8041.6.2.135","volume":"6","author":"BD Sarkodie","year":"2020","unstructured":"Sarkodie, B.D., et al.: Diagnosing COVID-19 from chest X-ray in the resource-limited environment-case report,\" medical case reports. Imedpub J. 6(1), 1\u20133 (2020). https:\/\/doi.org\/10.36648\/2471-8041.6.2.135","journal-title":"Imedpub J."},{"key":"3703_CR3","doi-asserted-by":"publisher","DOI":"10.1016\/j.chaos.2020.109944","author":"PK Harsh Panwar","year":"2020","unstructured":"Harsh Panwar, P.K., Gupta, M.K., Siddiqui, R.M.-M., Singh, V.: Application of deep learning for fast detection of COVID-19 in X-Rays using nCOVnet. Chaos Solitons & Fractals (2020). https:\/\/doi.org\/10.1016\/j.chaos.2020.109944","journal-title":"Chaos Solitons & Fractals"},{"issue":"4","key":"3703_CR4","doi-asserted-by":"publisher","first-page":"104031","DOI":"10.1016\/j.isci.2022.104031","volume":"25","author":"D Li","year":"2022","unstructured":"Li, D., Li, S.: An artificial intelligence deep learning platform achieves high diagnostic accuracy for Covid-19 pneumonia by reading chest X-ray images. iScience 25(4), 104031 (2022). https:\/\/doi.org\/10.1016\/j.isci.2022.104031","journal-title":"iScience"},{"unstructured":"H. Wang and Y. Xia. ChestNet: A deep neural network for the classification of thoracic diseases on chest radiography. arXiv preprint 2020, arXiv: https:\/\/arxiv.org\/abs\/1807.03058","key":"3703_CR5"},{"unstructured":"P. Rajpurkar, J. Irvin, K. Zhu, B. Yang, H. Mehta, T. Duan, D. Ding, A. Bagul, C. Langlotz, K. Shpanskaya and M.P. Lungren. ChexNet: radiologist-level pneumonia detection on chest X-rays with deep learning. 2017, arXiv preprint https:\/\/arxiv.org\/abs\/1711.05225v3","key":"3703_CR6"},{"unstructured":"M. Farooq and A. Hafeez, COVID-ResNet: a deep learning framework for screening of COVID19 from radiographs, 2020, arXiv:2003.14395,https:\/\/arxiv.org\/abs\/2003.14395","key":"3703_CR7"},{"unstructured":"Geoffrey E Hinton, Sara Sabour, and Nicholas Frosst (2018) Matrix capsules with EM routing. International Conference on Learning Representations (ICLR18), pp. 1\u201315.","key":"3703_CR8"},{"unstructured":"S. Sabour, N. Frosst and G. E. Hinton, Dynamic routing between capsules, Advances in Information Processing Systems, 2017, https:\/\/arxiv.org\/abs\/1710.09829","key":"3703_CR9"},{"unstructured":"G. E. Hinton, S. Sabour and N. Frosst, \"Matrix capsules with em routing,\" ICLR (2018).","key":"3703_CR10"},{"unstructured":"A. Punjabi, J. Schmid, and A. K. Katsaggelos Examining the Benefits of Capsule Neural Networks, 2020 https:\/\/arxiv.org\/abs\/2001.10964","key":"3703_CR11"},{"issue":"3","key":"3703_CR12","first-page":"37","volume":"2","author":"SA Patil","year":"2012","unstructured":"Patil, S.A., Kuchanur, M.B.: Lung cancer classification using image processing. Int. J. Eng. Innov. Technol. 2(3), 37\u201342 (2012)","journal-title":"Int. J. Eng. Innov. Technol."},{"issue":"12","key":"3703_CR13","doi-asserted-by":"publisher","first-page":"7648-7655","DOI":"10.1016\/j.eswa.2010.04.078","volume":"37","author":"O Er","year":"2010","unstructured":"Er, O., Yumusak, N., Temurtas, F.: Chest diseases diagnosis using artificial neural networks. Exp. Syst. Appl. 37(12), 7648 (2010). https:\/\/doi.org\/10.1016\/j.eswa.2010.04.078","journal-title":"Exp. Syst. Appl."},{"unstructured":"https:\/\/www.who.int\/emergencies\/diseases\/","key":"3703_CR14"},{"doi-asserted-by":"crossref","unstructured":"Rodolfo M. Pereira, Diego Bertolini, Lucas O. Teixeira, Carlos N. Silla, Yandre M.G. Costa, COVID-19 identification in chest X-ray images on flat and hierarchical classification scenarios, Computer Methods and Programs in Biomedicine, 194, 2020. https:\/\/www.sciencedirect.com\/science\/article\/pii\/S0169260720309664","key":"3703_CR15","DOI":"10.1016\/j.cmpb.2020.105532"},{"key":"3703_CR16","doi-asserted-by":"publisher","first-page":"113909","DOI":"10.1016\/j.eswa.2020.113909","volume":"165","author":"TB Chandra","year":"2021","unstructured":"Chandra, T.B., Verma, K., Singh, B.K., Jain, D., Netam, S.S.: Coronavirus disease (COVID-19) detection in chest X-ray images using majority voting based classifier ensemble. Exp. Syst. Appl. 165, 113909 (2021). https:\/\/doi.org\/10.1016\/j.eswa.2020.113909","journal-title":"Exp. Syst. Appl."},{"issue":"2","key":"3703_CR17","doi-asserted-by":"publisher","first-page":"854","DOI":"10.1007\/s10489-020-01829-7","volume":"51","author":"A Abbas","year":"2021","unstructured":"Abbas, A., Abdelsamea, M.M., Gaber, M.M.: Classification of COVID-19 in chest X-ray images using DeTraC deep convolutional neural network. Appl. Intell. 51(2), 854 (2021). https:\/\/doi.org\/10.1007\/s10489-020-01829-7","journal-title":"Appl. Intell."},{"key":"3703_CR18","doi-asserted-by":"publisher","DOI":"10.7717\/peerj-cs.358","author":"OM Elzeki","year":"2021","unstructured":"Elzeki, O.M., Shams, M., Sarhan, S., Elfattah, M.A., Hassanien, A.E.: COVID-19: a new deep learning computer-aided model for classification. PeerJ Comput. Sci. (2021). https:\/\/doi.org\/10.7717\/peerj-cs.358","journal-title":"PeerJ Comput. Sci."},{"issue":"Part A","key":"3703_CR19","doi-asserted-by":"publisher","first-page":"106580","DOI":"10.1016\/j.asoc.2020.106580","volume":"97","author":"M Nour","year":"2020","unstructured":"Nour, M., C\u00f6mert, Z., Polat, K.: A novel medical diagnosis model for COVID-19 infection detection based on deep features and Bayesian optimization. Appl. Soft Comput. 97(Part A), 106580 (2020). https:\/\/doi.org\/10.1016\/j.asoc.2020.106580","journal-title":"Appl. Soft Comput."},{"issue":"5","key":"3703_CR20","doi-asserted-by":"publisher","first-page":"821","DOI":"10.3233\/XST-200715","volume":"28","author":"MM Rahaman","year":"2020","unstructured":"Rahaman, M.M., Li, C., Yao, Y., Kulwa, F., Rahman, M.A., Wang, Q., Qi, S., Kong, F., Zhu, X., Zhao, X.: Identification of COVID-19 samples from chest X-ray images using deep learning comparison of transfer learning approaches. J. X-ray Sci. Technol. 28(5), 821 (2020). https:\/\/doi.org\/10.3233\/XST-200715","journal-title":"J. X-ray Sci. Technol."},{"key":"3703_CR21","doi-asserted-by":"publisher","DOI":"10.1155\/2020\/8889023","author":"A Sharma","year":"2020","unstructured":"Sharma, A., Rani, S., Gupta, D.: Artificial intelligence-based classification of chest X-ray images into COVID-19 and other infectious diseases. Int. J. Biomed. Imaging (2020). https:\/\/doi.org\/10.1155\/2020\/8889023","journal-title":"Int. J. Biomed. Imaging"},{"key":"3703_CR22","doi-asserted-by":"publisher","first-page":"103792","DOI":"10.1016\/j.compbiomed.2020.103792","volume":"121","author":"T Ozturk","year":"2020","unstructured":"Ozturk, T., Talo, M., Yildirim, E.A., Baloglu, U.B., Ozal Yildirim, U., Acharya, R.: Automated detection of COVID-19 cases using deep neural networks with X-ray images. Comput. Biol. Med. 121, 103792 (2020). https:\/\/doi.org\/10.1016\/j.compbiomed.2020.103792","journal-title":"Comput. Biol. Med."},{"key":"3703_CR23","doi-asserted-by":"publisher","first-page":"106742","DOI":"10.1016\/j.asoc.2020.106742","volume":"98","author":"D Ezzat","year":"2021","unstructured":"Ezzat, D., Hassanien, A.E., Ella, H.A.: An optimized deep learning architecture for diagnosing COVID-19 disease based on gravitational search optimization. Appl. Soft Comput. 98, 106742 (2021). https:\/\/doi.org\/10.1016\/j.asoc.2020.106742","journal-title":"Appl. Soft Comput."},{"doi-asserted-by":"publisher","unstructured":"Nguyen, H.P., Ribeiro, B. (2019). Advanced Capsule Networks via Context Awareness. In: Tetko, I., K\u016frkov\u00e1, V., Karpov, P., Theis, F. (eds) Artificial neural networks and machine learning\u2014ICANN 2019: Theoretical Neural Computation. ICANN 2019. Lecture Notes in Computer Science, 11727. Springer, Cham. https:\/\/doi.org\/10.1007\/978-3-030-30487-4_14","key":"3703_CR24","DOI":"10.1007\/978-3-030-30487-4_14"},{"unstructured":"A. D. Kumar, R.Karthika and Latha Parameswaran, Novel learning model for traffic sign detection using capsule networks, International Journal of Pure and Applied Mathematics 118 (20) 4543, 2018, https:\/\/ui.adsabs.harvard.edu\/link_gateway\/2018arXiv180504424D\/arxiv:1805.04424","key":"3703_CR25"},{"key":"3703_CR26","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-05318-5","volume-title":"Hyperparameter optimization","author":"A Feurer","year":"2019","unstructured":"Feurer, A., Hutter, F.: Automated machine learning methods systems challenges. In: Hyperparameter optimization. Springer, Cham (2019). https:\/\/doi.org\/10.1007\/978-3-030-05318-5"},{"key":"3703_CR27","doi-asserted-by":"publisher","DOI":"10.1016\/j.jksuci.2019.09.014(2019)","author":"MK Patrick","year":"2019","unstructured":"Patrick, M.K., Adekoya, A.F., et al.: CapsuleNetworks\u2014a survey. J. King Saud Univ. Inf. Sci. (2019). https:\/\/doi.org\/10.1016\/j.jksuci.2019.09.014(2019)","journal-title":"J. King Saud Univ. Inf. Sci."},{"key":"3703_CR28","doi-asserted-by":"publisher","DOI":"10.1007\/s12065-020-00408-6","author":"JLD Zhao","year":"2020","unstructured":"Zhao, J.L.D., Guo-Xiong, Z.: Lung diseases identification method based on capsule neural network. Evolut. Intell. (2020). https:\/\/doi.org\/10.1007\/s12065-020-00408-6","journal-title":"Evolut. Intell."},{"key":"3703_CR29","doi-asserted-by":"publisher","first-page":"96920","DOI":"10.1109\/ACCESS.2020.2996282","volume":"8","author":"K Sun","year":"2020","unstructured":"Sun, K., Yuan, L., Xu, H., Wen, X.: Deep Tensor Capsule Network. IEEE Access 8, 96920\u201396933 (2020). https:\/\/doi.org\/10.1109\/ACCESS.2020.2996282","journal-title":"IEEE Access"},{"unstructured":"K. Simonyan and A. Zisserman, Very deep convolutional networks for large-scale image recognition,\" 3rd International Conference on Learning Representations, ICLR 2015, San Diego, CA, USA, May 7\u20139, 2015, Conference Track Proceedings.\u00a02015","key":"3703_CR30"},{"doi-asserted-by":"crossref","unstructured":"C. E. Rasmussen and C. K. I. Williams, \"Gaussian processes for machine learning,\"http:\/\/www.GaussianProcess.org\/gpml. MIT Press. (2006)","key":"3703_CR31","DOI":"10.7551\/mitpress\/3206.001.0001"},{"key":"3703_CR32","doi-asserted-by":"publisher","first-page":"321","DOI":"10.1613\/jair.953","volume":"16","author":"NV Chawla","year":"2002","unstructured":"Chawla, N.V., Bowyer, K.W., Hall, L.O., Kegelmeyer, W.P.: SMOTE: synthetic minority over-sampling technique. J. Artif. Intell. Res. 16, 321\u2013357 (2002)","journal-title":"J. Artif. Intell. Res."},{"doi-asserted-by":"publisher","unstructured":"Y. Lecun, L. Bottou, Y. Bengio and P. Haffner, \"Gradient-based learning applied to document recognition,\" Proceedings of the IEEE, Vol. 86(11), 2278. https:\/\/doi.org\/10.1109\/5.726791, 1998","key":"3703_CR33","DOI":"10.1109\/5.726791"},{"key":"3703_CR34","doi-asserted-by":"publisher","DOI":"10.1016\/j.compag.2019.01.041","author":"A Kaya","year":"2019","unstructured":"Kaya, A., Keceli, A.S., Catal, C., Yalic, H.Y., Temucin, H., Tekinerdogan, B.: Analysis of transfer learning for deep neural network based plant classification models. Comput. Electron. Agric. (2019). https:\/\/doi.org\/10.1016\/j.compag.2019.01.041","journal-title":"Comput. Electron. Agric."},{"key":"3703_CR35","doi-asserted-by":"publisher","first-page":"44","DOI":"10.1007\/978-3-642-21735-7_6","volume-title":"\"Artificial neural networks and machine learning\u2014ICANN 2011","author":"GE Hinton","year":"2011","unstructured":"Hinton, G.E., Krizhevsky, A., Wang, S.D.: Transforming auto-encoders. In: Honkela, T., Duch, W., Girolami, M., Kaski, S. (eds.) \"Artificial neural networks and machine learning\u2014ICANN 2011, pp. 44\u201351. Springer, Berlin Heidelberg, Berlin, Heidelberg (2011)"},{"doi-asserted-by":"crossref","unstructured":"Ilievski, I.; Akhtar, T.; Feng, J.; Shoemaker, C. Efficient hyperparameter optimization for deep learning algorithms using deterministic RBF surrogates.\u00a0AAAI17,\u00a031, 2017","key":"3703_CR36","DOI":"10.1609\/aaai.v31i1.10647"},{"unstructured":"https:\/\/www.kaggle.com\/tawsifurrahman\/covid19-radiography-database","key":"3703_CR37"},{"doi-asserted-by":"publisher","unstructured":"Y.Xiong, G.Su , S. Ye, Y. Sun, Y. Sun (2019) Deeper Capsule Network For Complex Data.\" IJCNN 2019. International joint conference on neural networks. Budapest, Hungary. 1419. https:\/\/doi.org\/10.1109\/ijcnn.2019.8852020","key":"3703_CR38","DOI":"10.1109\/ijcnn.2019.8852020"}],"container-title":["Cluster Computing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10586-022-03703-2.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10586-022-03703-2\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10586-022-03703-2.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,3,27]],"date-time":"2023-03-27T01:25:02Z","timestamp":1679880302000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10586-022-03703-2"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,8,23]]},"references-count":38,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2023,4]]}},"alternative-id":["3703"],"URL":"https:\/\/doi.org\/10.1007\/s10586-022-03703-2","relation":{},"ISSN":["1386-7857","1573-7543"],"issn-type":[{"type":"print","value":"1386-7857"},{"type":"electronic","value":"1573-7543"}],"subject":[],"published":{"date-parts":[[2022,8,23]]},"assertion":[{"value":"19 December 2021","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"22 June 2022","order":2,"name":"revised","label":"Revised","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"3 August 2022","order":3,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"23 August 2022","order":4,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare that they have no known competing financial interests or personal relationships that could have influenced the work reported in this paper. Also, there is no conflict of interest.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}}]}}