{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,27]],"date-time":"2026-03-27T16:29:00Z","timestamp":1774628940927,"version":"3.50.1"},"reference-count":55,"publisher":"National Library of Serbia","issue":"1","license":[{"start":{"date-parts":[[2022,1,1]],"date-time":"2022-01-01T00:00:00Z","timestamp":1640995200000},"content-version":"unspecified","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by-nc-nd\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["ComSIS","COMPUT SCI INF SYST","COMPUT SCI INFORM SY","COMPUTER SCI INFORM","COMSIS J"],"published-print":{"date-parts":[[2022]]},"abstract":"<jats:p>For more than a year the COVID-19 epidemic is threatening people all over the world. Numerous researchers are looking for all possible insights into the new corona virus SARS-CoV-2. One of the possibilities is an in-depth analysis of Xray images from COVID-19 patients, commonly conducted by a radiologist, which are due to high demand facing with overload. With the latest achievements in the field of deep learning, the approaches using transfer learning proved to be successful when tackling such problem. However, when utilizing deep learning methods, we are commonly facing the problem of hyper-parameter settings. In this research, we adapted and generalized transfer learning based classification method for detecting COVID-19 from X-ray images and employed different optimization algorithms for solving the task of hyper-parameter settings. Utilizing different optimization algorithms our method was evaluated on a dataset of 1446 X-ray images, with the overall accuracy of 84.44%, outperforming both conventional CNN method as well as the compared baseline transfer learning method. Besides quantitative analysis, we also conducted a qualitative in-depth analysis using the local interpretable modelagnostic explanations method and gain some in-depth view of COVID-19 characteristics and the predictive model perception.<\/jats:p>","DOI":"10.2298\/csis210209056v","type":"journal-article","created":{"date-parts":[[2021,11,1]],"date-time":"2021-11-01T14:51:07Z","timestamp":1635778267000},"page":"327-352","source":"Crossref","is-referenced-by-count":7,"title":["Hyper-parameter optimization of convolutional neural networks for classifying COVID-19 X-ray images"],"prefix":"10.2298","volume":"19","author":[{"given":"Grega","family":"Vrbacic","sequence":"first","affiliation":[{"name":"University of Maribor, Faculty of Electrical Engineering and Computer Science, Maribor, Slovenia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Spela","family":"Pecnik","sequence":"additional","affiliation":[{"name":"University of Maribor, Faculty of Electrical Engineering and Computer Science, Maribor, Slovenia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Vili","family":"Podgorelec","sequence":"additional","affiliation":[{"name":"University of Maribor, Faculty of Electrical Engineering and Computer Science, Maribor, Slovenia"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1078","reference":[{"key":"ref1","unstructured":"et al., M.A.: TensorFlow: Large-scale machine learning on heterogeneous systems (2015), https:\/\/www.tensorflow.org\/, software available from tensorflow.org"},{"key":"ref2","doi-asserted-by":"crossref","unstructured":"Apostolopoulos, I.D., Mpesiana, T.A.: Covid-19: automatic detection from X-ray images utilizing transfer learning with convolutional neural networks. Physical and Engineering Sciences in Medicine 43(2), 635-640 (jun 2020)","DOI":"10.1007\/s13246-020-00865-4"},{"key":"ref3","doi-asserted-by":"crossref","unstructured":"Apostolopoulos, I.D., Mpesiana, T.A.: Covid-19: automatic detection from x-ray images utilizing transfer learning with convolutional neural networks. Physical and Engineering Sciences in Medicine p. 1 (2020)","DOI":"10.1007\/s13246-020-00865-4"},{"key":"ref4","unstructured":"Bergstra, J.S., Bardenet, R., Bengio, Y., K\u00b4egl, B.: Algorithms for hyper-parameter optimization. In: Advances in neural information processing systems. pp. 2546-2554 (2011)"},{"key":"ref5","unstructured":"Brezo\u010dnik, L., Fister, I., Vrban\u010di\u010d, G.: Applying differential evolution with threshold mechanism for feature selection on a phishing websites classification. In: Welzer, T., Eder, J., Podgorelec, V., Wrembel, R., Ivanovi\u0107, M., Gamper, J., Morzy, M., Tzouramanis, T., Darmont, J., Kami\u0161ali\u0107 Latifi\u0107, A. (eds.) New Trends in Databases and Information Systems. pp. 11-18. Springer International Publishing, Cham (2019)"},{"key":"ref6","doi-asserted-by":"crossref","unstructured":"Ching, J.Y.,Wong, A.K.C., Chan, K.C.C.: Class-dependent discretization for inductive learning from continuous and mixed-mode data. IEEE Transactions on Pattern Analysis and Machine Intelligence 17(7), 641-651 (1995)","DOI":"10.1109\/34.391407"},{"key":"ref7","unstructured":"Chollet, F., et al.: Keras (2015), https:\/\/keras.io"},{"key":"ref8","unstructured":"Cohen, J.P., Morrison, P., Dao, L.: Covid-19 image data collection. arXiv 2003.11597 (2020), https:\/\/github.com\/ieee8023\/covid-chestxray-dataset"},{"key":"ref9","doi-asserted-by":"crossref","unstructured":"Das, S., Mullick, S.S., Suganthan, P.N.: Recent advances in differential evolution-an updated survey. Swarm and Evolutionary Computation 27, 1-30 (2016)","DOI":"10.1016\/j.swevo.2016.01.004"},{"key":"ref10","unstructured":"Demsar, J.: Statistical comparisons of classifiers over multiple data sets. Journal of Machine Learning Research 7 (2006)"},{"key":"ref11","doi-asserted-by":"crossref","unstructured":"Deng, J., Dong,W., Socher, R., Li, L.J., Li, K., Fei-Fei, L.: Imagenet: A large-scale hierarchical image database. In: 2009 IEEE conference on computer vision and pattern recognition. pp. 248-255. Ieee (2009)","DOI":"10.1109\/CVPR.2009.5206848"},{"key":"ref12","doi-asserted-by":"crossref","unstructured":"Dumais, S., Platt, J., Heckerman, D., Sahami, M.: Inductive learning algorithms and representations for text categorization. In: 7th International Conference on Information and Knowledge Management. pp. 148-152 (January 1998), https:\/\/www.microsoft.com\/enus\/research\/publication\/inductive-learning-algorithms-and-representations-for-textcategorization\/","DOI":"10.1145\/288627.288651"},{"key":"ref13","doi-asserted-by":"crossref","unstructured":"Duran-Lopez, L., Dominguez-Morales, J.P., Corral-Jaime, J., Vicente-Diaz, S., Linares- Barranco, A.: Covid-xnet: a custom deep learning system to diagnose and locate covid-19 in chest x-ray images. Applied Sciences 10(16), 5683 (2020)","DOI":"10.3390\/app10165683"},{"key":"ref14","doi-asserted-by":"crossref","unstructured":"Fang, Y., Zhang, H., Xie, J., Lin, M., Ying, L., Pang, P., Ji, W.: Sensitivity of chest ct for covid-19: comparison to rt-pcr. Radiology 296(2), E115-E117 (2020)","DOI":"10.1148\/radiol.2020200432"},{"key":"ref15","doi-asserted-by":"crossref","unstructured":"Faris, H., Aljarah, I., Al-Betar, M.A., Mirjalili, S.: Grey wolf optimizer: a review of recent variants and applications. Neural computing and applications 30(2), 413-435 (2018)","DOI":"10.1007\/s00521-017-3272-5"},{"key":"ref16","doi-asserted-by":"crossref","unstructured":"Fukushima, K.: Neocognitron: A self-organizing neural network model for a mechanism of pattern recognition unaffected by shift in position, BioL Cybem. 36 (1980) 193-202. S. Shiotani et al.\/Neurocomputing 9 (1995) Ill-130 130 (1980)","DOI":"10.1007\/BF00344251"},{"key":"ref17","unstructured":"Goodfellow, I., Bengio, Y., Courville, A.: Deep learning. MIT press (2016)"},{"key":"ref18","doi-asserted-by":"crossref","unstructured":"Govindarajan, S., Swaminathan, R.: Differentiation of COVID-19 conditions in planar chest radiographs using optimized convolutional neural networks. Applied Intelligence (2020)","DOI":"10.1007\/s10489-020-01941-8"},{"key":"ref19","doi-asserted-by":"crossref","unstructured":"Javaid, A., Niyaz, Q., Sun, W., Alam, M.: A deep learning approach for network intrusion detection system. In: Proceedings of the 9th EAI International Conference on Bio-inspired Information and Communications Technologies (formerly BIONETICS). pp. 21-26. ICST (Institute for Computer Sciences, Social-Informatics and . . . (2016)","DOI":"10.4108\/eai.3-12-2015.2262516"},{"key":"ref20","doi-asserted-by":"crossref","unstructured":"Kamilaris, A., Prenafeta-Bold\u00fa, F.X.: Deep learning in agriculture: A survey. Computers and electronics in agriculture 147, 70-90 (2018)","DOI":"10.1016\/j.compag.2018.02.016"},{"key":"ref21","doi-asserted-by":"crossref","unstructured":"Kikkisetti, S., Zhu, J., Shen, B., Li, H., Duong, T.Q.: Deep-learning convolutional neural networks with transfer learning accurately classify COVID-19 lung infection on portable chest radiographs. PeerJ 8 (nov 2020)","DOI":"10.7717\/peerj.10309"},{"key":"ref22","doi-asserted-by":"crossref","unstructured":"Kong, Q., Trugman, D.T., Ross, Z.E., Bianco, M.J., Meade, B.J., Gerstoft, P.: Machine learning in seismology: Turning data into insights. Seismological Research Letters 90(1), 3-14 (2018)","DOI":"10.1785\/0220180259"},{"key":"ref23","doi-asserted-by":"crossref","unstructured":"Lorenzo, P.R., Nalepa, J., Kawulok, M., Ramos, L.S., Pastor, J.R.: Particle swarm optimization for hyper-parameter selection in deep neural networks. In: Proceedings of the genetic and evolutionary computation conference. pp. 481-488 (2017)","DOI":"10.1145\/3071178.3071208"},{"key":"ref24","unstructured":"Lundberg, S., Lee, S.I.: A unified approach to interpreting model predictions. arXiv preprint arXiv:1705.07874 (2017)"},{"key":"ref25","doi-asserted-by":"crossref","unstructured":"Lundervold, A.S., Lundervold, A.: An overview of deep learning in medical imaging focusing on mri. Zeitschrift f\u00a8ur Medizinische Physik 29(2), 102-127 (2019)","DOI":"10.1016\/j.zemedi.2018.11.002"},{"key":"ref26","unstructured":"Majeed, T., Rashid, R., Ali, D., Asaad, A.: Covid-19 detection using cnn transfer learning from x-ray images. medRxiv (2020)"},{"key":"ref27","doi-asserted-by":"crossref","unstructured":"Majeed, T., Rashid, R., Ali, D., Asaad, A.: Issues associated with deploying CNN transfer learning to detect COVID-19 from chest X-rays. Physical and Engineering Sciences in Medicine 43(4), 1289-1303 (dec 2020)","DOI":"10.1007\/s13246-020-00934-8"},{"key":"ref28","doi-asserted-by":"crossref","unstructured":"Marques, G., Agarwal, D., de la Torre D\u00b4\u0131ez, I.: Automated medical diagnosis of COVID-19 through EfficientNet convolutional neural network. Applied Soft Computing Journal 96 (nov 2020)","DOI":"10.1016\/j.asoc.2020.106691"},{"key":"ref29","doi-asserted-by":"crossref","unstructured":"McKinney, W.: Data structures for statistical computing in python. In: van der Walt, S., Millman, J. (eds.) Proceedings of the 9th Python in Science Conference. pp. 51 - 56 (2010)","DOI":"10.25080\/Majora-92bf1922-00a"},{"key":"ref30","doi-asserted-by":"crossref","unstructured":"Mirjalili, S.: Genetic algorithm. In: Evolutionary algorithms and neural networks, pp. 43-55. Springer (2019)","DOI":"10.1007\/978-3-319-93025-1_4"},{"key":"ref31","doi-asserted-by":"crossref","unstructured":"Mirjalili, S., Mirjalili, S.M., Lewis, A.: Grey wolf optimizer. Advances in engineering software 69, 46-61 (2014)","DOI":"10.1016\/j.advengsoft.2013.12.007"},{"key":"ref32","doi-asserted-by":"crossref","unstructured":"Nayak, S.R., Nayak, D.R., Sinha, U., Arora, V., Pachori, R.B.: Application of deep learning techniques for detection of COVID-19 cases using chest X-ray images: A comprehensive study. Biomedical Signal Processing and Control 64, 102365 (feb 2021), https:\/\/doi.org\/10.1016\/j.bspc.2020.102365","DOI":"10.1016\/j.bspc.2020.102365"},{"key":"ref33","unstructured":"of North America, R.S.: RSNA Pneumonia Detection Challenge - Kaggle, https:\/\/www.kaggle.com\/c\/rsna-pneumonia-detection-challenge\/overview"},{"key":"ref34","unstructured":"Organization, W.H., et al.: Covid-19 weekly epidemiological update - 2 february 2021. In: COVID-19 Weekly Epidemiological update - 2 February 2021. World Health Organization (2021)"},{"key":"ref35","doi-asserted-by":"crossref","unstructured":"Ozturk, T., Talo, M., Yildirim, E.A., Baloglu, U.B., Yildirim, O., Acharya, U.R.: Automated detection of covid-19 cases using deep neural networks with x-ray images. Computers in biology and medicine 121, 103792 (2020)","DOI":"10.1016\/j.compbiomed.2020.103792"},{"key":"ref36","unstructured":"Pathak, Y., Shukla, P.K., Tiwari, A., Stalin, S., Singh, S.: Deep transfer learning based classification model for covid-19 disease. Irbm (2020)"},{"key":"ref37","unstructured":"Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., Blondel, M., Prettenhofer, P., Weiss, R., Dubourg, V., Vanderplas, J., Passos, A., Cournapeau, D., Brucher, M., Perrot, M., Duchesnay, E.: Scikit-learn: Machine learning in Python. Journal of Machine Learning Research 12, 2825-2830 (2011)"},{"key":"ref38","doi-asserted-by":"crossref","unstructured":"Podgorelec, V., Pe\u010dnik, \u0160., Vrban\u010di\u010d, G.: Classification of similar sports images using convolutional neural network with hyper-parameter optimization. Applied Sciences 10(23), 8494 (2020)","DOI":"10.3390\/app10238494"},{"key":"ref39","doi-asserted-by":"crossref","unstructured":"Ribeiro, M.T., Singh, S., Guestrin, C.: \u201d why should i trust you?\u201d explaining the predictions of any classifier. In: Proceedings of the 22nd ACM SIGKDD international conference on knowledge discovery and data mining. pp. 1135-1144 (2016)","DOI":"10.1145\/2939672.2939778"},{"key":"ref40","unstructured":"Simonyan, K., Zisserman, A.: Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556 (2014)"},{"key":"ref41","doi-asserted-by":"crossref","unstructured":"Tajbakhsh, N., Shin, J.Y., Gurudu, S.R., Hurst, R.T., Kendall, C.B., Gotway, M.B., Liang, J.: Convolutional neural networks for medical image analysis: Full training or fine tuning? IEEE transactions on medical imaging 35(5), 1299-1312 (2016)","DOI":"10.1109\/TMI.2016.2535302"},{"key":"ref42","doi-asserted-by":"crossref","unstructured":"Van Der Walt, S., Colbert, S.C., Varoquaux, G.: The numpy array: a structure for efficient numerical computation. Computing in Science & Engineering 13(2), 22 (2011)","DOI":"10.1109\/MCSE.2011.37"},{"key":"ref43","doi-asserted-by":"crossref","unstructured":"Vrban\u010di\u010d, G., \u0160. Pe\u010dnik, Podgorelec, V.: Identification of covid-19 x-ray images using cnn with optimized tuning of transfer learning. In: 2020 International Conference on INnovations in Intelligent SysTems and Applications (INISTA). pp. 1-8 (2020)","DOI":"10.1109\/INISTA49547.2020.9194615"},{"key":"ref44","doi-asserted-by":"crossref","unstructured":"Vrban\u010di\u010d, G., Brezo\u010dnik, L., Mlakar, U., Fister, D., Fister Jr., I.: NiaPy: Python microframework for building nature-inspired algorithms. Journal of Open Source Software 3 (2018), https:\/\/doi.org\/10.21105\/joss.00613","DOI":"10.21105\/joss.00613"},{"key":"ref45","doi-asserted-by":"crossref","unstructured":"Vrbancic, G., Fister, I.J., Podgorelec, V.: Automatic Detection of Heartbeats in Heart Sound Signals Using Deep Convolutional Neural Networks. Elektronika ir Elektrotechnika 25(3), 71- 76 (jun 2019), http:\/\/eejournal.ktu.lt\/index.php\/elt\/article\/view\/23680","DOI":"10.5755\/j01.eie.25.3.23680"},{"key":"ref46","doi-asserted-by":"crossref","unstructured":"Vrbancic, G., Fister, I.J., Podgorelec, V.: Parameter Setting for Deep Neural Networks Using Swarm Intelligence on Phishing Websites Classification. International Journal on Artificial Intelligence Tools 28(6), 28 (oct 2019)","DOI":"10.1142\/S021821301960008X"},{"key":"ref47","doi-asserted-by":"crossref","unstructured":"Vrbancic, G., Fister, I.J., Podgorelec, V.: Parameter Setting for Deep Neural Networks Using Swarm Intelligence on Phishing Websites Classification. International Journal on Artificial Intelligence Tools 28(6), 28 (oct 2019)","DOI":"10.1142\/S021821301960008X"},{"key":"ref48","doi-asserted-by":"crossref","unstructured":"Vrbancic, G., Podgorelec, V.: Automatic Classification of Motor Impairment Neural Disorders from EEG Signals Using Deep Convolutional Neural Networks. Elektronika ir Elektrotechnika 24(4), 3-7 (aug 2018), http:\/\/eejournal.ktu.lt\/index.php\/elt\/article\/view\/21469","DOI":"10.5755\/j01.eie.24.4.21469"},{"key":"ref49","doi-asserted-by":"crossref","unstructured":"Vrban\u010di\u010d, G., Zorman, M., Podgorelec, V.: Transfer learning tuning utilizing grey wolf optimizer for identification of brain hemorrhage from head ct images. In: StuCoSReC: proceedings of the 2019 6th Student Computer Science Research Conference. pp. 61-66 (2019)","DOI":"10.26493\/978-961-7055-82-5.61-66"},{"key":"ref50","doi-asserted-by":"crossref","unstructured":"Vrban\u010di\u010d, G., Podgorelec, V.: Transfer learning with adaptive fine-tuning. IEEE Access 8, 196197-196211 (2020)","DOI":"10.1109\/ACCESS.2020.3034343"},{"key":"ref51","doi-asserted-by":"crossref","unstructured":"Yang, Q., Ling, C., Chai, X., Pan, R.: Test-cost sensitive classification on data with missing values. IEEE Transactions on Knowledge & Data Engineering 18(5), 626-638 (2006)","DOI":"10.1109\/TKDE.2006.84"},{"key":"ref52","unstructured":"Yu, T., Zhu, H.: Hyper-parameter optimization: A review of algorithms and applications. arXiv preprint arXiv:2003.05689 (2020)"},{"key":"ref53","doi-asserted-by":"crossref","unstructured":"Zebin, T., Rezvy, S.: Covid-19 detection and disease progression visualization: Deep learning on chest x-rays for classification and coarse localization. Applied Intelligence pp. 1-12 (2020)","DOI":"10.21203\/rs.3.rs-34534\/v1"},{"key":"ref54","unstructured":"Zhang, Y., Song, K., Sun, Y., Tan, S., Udell, M.: \u201cwhy should you trust my explanation?\u201d understanding uncertainty in lime explanations. arXiv preprint arXiv:1904.12991 (aug 2014)"},{"key":"ref55","doi-asserted-by":"crossref","unstructured":"Zhu, X., Wu, X.: Class noise handling for effective cost-sensitive learning by cost-guided iterative classification filtering. IEEE Transactions on Knowledge & Data Engineering 18(10), 1435-1440 (2006)","DOI":"10.1109\/TKDE.2006.155"}],"container-title":["Computer Science and Information Systems"],"original-title":[],"language":"en","deposited":{"date-parts":[[2023,5,29]],"date-time":"2023-05-29T08:05:52Z","timestamp":1685347552000},"score":1,"resource":{"primary":{"URL":"https:\/\/doiserbia.nb.rs\/Article.aspx?ID=1820-02142100056V"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022]]},"references-count":55,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2022]]}},"URL":"https:\/\/doi.org\/10.2298\/csis210209056v","relation":{},"ISSN":["1820-0214","2406-1018"],"issn-type":[{"value":"1820-0214","type":"print"},{"value":"2406-1018","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022]]}}}