{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,16]],"date-time":"2026-06-16T17:44:55Z","timestamp":1781631895314,"version":"3.54.5"},"reference-count":47,"publisher":"MDPI AG","issue":"4","license":[{"start":{"date-parts":[[2020,10,29]],"date-time":"2020-10-29T00:00:00Z","timestamp":1603929600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["MAKE"],"abstract":"<jats:p>The outbreak of COVID-19 has caused more than 200,000 deaths so far in the USA alone, which instigates the necessity of initial screening to control the spread of the onset of COVID-19. However, screening for the disease becomes laborious with the available testing kits as the number of patients increases rapidly. Therefore, to reduce the dependency on the limited test kits, many studies suggested a computed tomography (CT) scan or chest radiograph (X-ray) based screening system as an alternative approach. Thereby, to reinforce these approaches, models using both CT scan and chest X-ray images need to develop to conduct a large number of tests simultaneously to detect patients with COVID-19 symptoms. In this work, patients with COVID-19 symptoms have been detected using eight distinct deep learning techniques, which are VGG16, InceptionResNetV2, ResNet50, DenseNet201, VGG19, MobilenetV2, NasNetMobile, and ResNet15V2, using two datasets: one dataset includes 400 CT scan and another 400 chest X-ray images. Results show that NasNetMobile outperformed all other models by achieving an accuracy of 82.94% in CT scan and 93.94% in chest X-ray datasets. Besides, Local Interpretable Model-agnostic Explanations (LIME) is used. Results demonstrate that the proposed models can identify the infectious regions and top features; ultimately, it provides a potential opportunity to distinguish between COVID-19 patients with others.<\/jats:p>","DOI":"10.3390\/make2040027","type":"journal-article","created":{"date-parts":[[2020,10,29]],"date-time":"2020-10-29T09:44:53Z","timestamp":1603964693000},"page":"490-504","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":88,"title":["COVID-19 Symptoms Detection Based on NasNetMobile with Explainable AI Using Various Imaging Modalities"],"prefix":"10.3390","volume":"2","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-0900-7930","authenticated-orcid":false,"given":"Md Manjurul","family":"Ahsan","sequence":"first","affiliation":[{"name":"School of Industrial and Systems Engineering, University of Oklahoma, Norman, OK 73019, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6867-2653","authenticated-orcid":false,"given":"Kishor Datta","family":"Gupta","sequence":"additional","affiliation":[{"name":"Department of Computer Science, University of Memphis, Memphis, TN 38152, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mohammad Maminur","family":"Islam","sequence":"additional","affiliation":[{"name":"Department of Computer Science, University of Memphis, Memphis, TN 38152, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sajib","family":"Sen","sequence":"additional","affiliation":[{"name":"Department of Computer Science, University of Memphis, Memphis, TN 38152, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Md. Lutfar","family":"Rahman","sequence":"additional","affiliation":[{"name":"Department of Computer Science, University of Memphis, Memphis, TN 38152, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mohammad","family":"Shakhawat Hossain","sequence":"additional","affiliation":[{"name":"Department of Electrical Engineering, University of South Florida, Tampa, FL 33620, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2020,10,29]]},"reference":[{"key":"ref_1","first-page":"2000094","article-title":"First cases of coronavirus disease 2019 (COVID-19) in France: Surveillance, investigations and control measures, January 2020","volume":"25","author":"Stoecklin","year":"2020","journal-title":"Eurosurveillance"},{"key":"ref_2","unstructured":"(2020, September 09). Dashbord. Covid-19 WorldMeter, September 2020. Available online: https:\/\/www.worldometers.info\/coronavirus\/."},{"key":"ref_3","unstructured":"McKeever, A. (2020, March 12). Here\u2019s what coronavirus does to the body. Natl. Geogr., Available online: https:\/\/www.freedomsphoenix.com\/Media\/Media-Files\/Heres-what-coronavirus-does-to-the-body.pdf."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Mahase, E. (2020). Coronavirus: Covid-19 Has Killed More People than SARS and MERS Combined, Despite Lower Case Fatality Rate, BMJ.","DOI":"10.1136\/bmj.m641"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Tanne, J.H., Hayasaki, E., Zastrow, M., Pulla, P., Smith, P., and Rada, A.G. (2020). Covid-19: How doctors and healthcare systems are tackling coronavirus worldwide. BMJ, 368.","DOI":"10.1136\/bmj.m1090"},{"key":"ref_6","unstructured":"Ghoshal, B., and Tucker, A. (2020). Estimating uncertainty and interpretability in deep learning for coronavirus (COVID-19) detection. arXiv."},{"key":"ref_7","unstructured":"Cohen, J.P., Morrison, P., and Dao, L. (2020). COVID-19 image data collection. arXiv."},{"key":"ref_8","unstructured":"(2020, March 10). Chest X-ray Images (Pneumonia). Available online: https:\/\/www.kaggle.com\/paultimothymooney\/chest-xray-pneumonia."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Shi, F., Wang, J., Shi, J., Wu, Z., Wang, Q., Tang, Z., He, K., Shi, Y., and Shen, D. (2020). Review of artificial intelligence techniques in imaging data acquisition, segmentation and diagnosis for covid-19. IEEE Rev. Biomed. Eng.","DOI":"10.1109\/RBME.2020.2987975"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Narin, A., Kaya, C., and Pamuk, Z. (2020). Automatic detection of coronavirus disease (covid-19) using x-ray images and deep convolutional neural networks. arXiv.","DOI":"10.1007\/s10044-021-00984-y"},{"key":"ref_11","unstructured":"Zhang, J., Xie, Y., Li, Y., Shen, C., and Xia, Y. (2020). Covid-19 screening on chest x-ray images using deep learning based anomaly detection. arXiv."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Wang, L., and Wong, A. (2020). COVID-Net: A Tailored Deep Convolutional Neural Network Design for Detection of COVID-19 Cases from Chest X-Ray Images. arXiv.","DOI":"10.1038\/s41598-020-76550-z"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Chen, J., Wu, L., Zhang, J., Zhang, L., Gong, D., Zhao, Y., Hu, S., Wang, Y., Hu, X., and Zheng, B. (2020, March 12). Deep learning-based model for detecting 2019 novel coronavirus pneumonia on high-resolution computed tomography: A prospective study. medRxiv, Available online: https:\/\/www.medrxiv.org\/content\/10.1101\/2020.02.25.20021568v2.full.pdf.","DOI":"10.1038\/s41598-020-76282-0"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Jin, C., Chen, W., Cao, Y., Xu, Z., Zhang, X., Deng, L., Zheng, C., Zhou, J., Shi, H., and Feng, J. (2020). Development and Evaluation of an AI System for COVID-19 Diagnosis. medRxiv.","DOI":"10.1101\/2020.03.20.20039834"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Song, Y., Zheng, S., Li, L., Zhang, X., Zhang, X., Huang, Z., Chen, J., Zhao, H., Jie, Y., and Wang, R. (2020). Deep learning enables accurate diagnosis of novel coronavirus (COVID-19) with CT images. medRxiv.","DOI":"10.1109\/TCBB.2021.3065361"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Butt, C., Gill, J., Chun, D., and Babu, B.A. (2020). Deep learning system to screen coronavirus disease 2019 pneumonia. Appl. Intell., 1.","DOI":"10.1007\/s10489-020-01714-3"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Li, L., Qin, L., Xu, Z., Yin, Y., Wang, X., Kong, B., Bai, J., Lu, Y., Fang, Z., and Song, Q. (2020). Artificial intelligence distinguishes COVID-19 from community acquired pneumonia on chest CT. Radiology, 200905.","DOI":"10.1148\/radiol.2020200905"},{"key":"ref_18","unstructured":"Samek, W., Wiegand, T., and M\u00fcller, K.R. (2017). Explainable artificial intelligence: Understanding, visualizing and interpreting deep learning models. arXiv."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Gilpin, L.H., Bau, D., Yuan, B.Z., Bajwa, A., Specter, M., and Kagal, L. (2018, January 1\u20133). Explaining explanations: An overview of interpretability of machine learning. Proceedings of the 2018 IEEE 5th International Conference on Data Science and Advanced Analytics (DSAA), Turin, Italy.","DOI":"10.1109\/DSAA.2018.00018"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Ribeiro, M.T., Singh, S., and Guestrin, C. (2016, January 13). \u201cWhy should i trust you?\u201d Explaining the predictions of any classifier. Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, San Francisco, CA, USA.","DOI":"10.1145\/2939672.2939778"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3236009","article-title":"A survey of methods for explaining black box models","volume":"51","author":"Guidotti","year":"2018","journal-title":"ACM Comput. Surv. (CSUR)"},{"key":"ref_22","unstructured":"Holzinger, A., Biemann, C., Pattichis, C.S., and Kell, D.B. (2017). What do we need to build explainable AI systems for the medical domain?. arXiv."},{"key":"ref_23","unstructured":"Simonyan, K., and Zisserman, A. (2014). Very deep convolutional networks for large-scale image recognition. arXiv."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"11","DOI":"10.1016\/j.patrec.2014.01.008","article-title":"A review of unsupervised feature learning and deep learning for time-series modeling","volume":"42","author":"Karlsson","year":"2014","journal-title":"Pattern Recognit. Lett."},{"key":"ref_25","unstructured":"Akiba, T., Suzuki, S., and Fukuda, K. (2017). Extremely large minibatch sgd: Training resnet-50 on imagenet in 15 minutes. arXiv."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Huang, G., Liu, Z., Van Der Maaten, L., and Weinberger, K.Q. (2017, January 21\u201326). Densely connected convolutional networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.243"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Sandler, M., Howard, A., Zhu, M., Zhmoginov, A., and Chen, L.C. (2018, January 18\u201323). Mobilenetv2: Inverted residuals and linear bottlenecks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00474"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"da N\u00f3brega, R.V.M., Peixoto, S.A., da Silva, S.P.P., and Rebou\u00e7as Filho, P.P. (2018, January 18\u201321). Lung nodule classification via deep transfer learning in CT lung images. Proceedings of the 2018 IEEE 31st International Symposium on Computer-Based Medical Systems (CBMS), Karlstad, Sweden.","DOI":"10.1109\/CBMS.2018.00050"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Varatharasan, V., Shin, H.S., Tsourdos, A., and Colosimo, N. (2019, January 25\u201327). Improving Learning Effectiveness For Object Detection and Classification in Cluttered Backgrounds. Proceedings of the 2019 Workshop on Research, Education and Development of Unmanned Aerial Systems (RED UAS), Cranfield, UK.","DOI":"10.1109\/REDUAS47371.2019.8999695"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"1345","DOI":"10.1109\/TKDE.2009.191","article-title":"A survey on transfer learning","volume":"22","author":"Pan","year":"2009","journal-title":"IEEE Trans. Knowl. Data Eng."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Deng, J., Dong, W., Socher, R., Li, L.J., Li, K., and Fei-Fei, L. (2009, January 20\u201325). Imagenet: A large-scale hierarchical image database. Proceedings of the 2009 IEEE Conference on Computer Vision and Pattern Recognition, Miami, FL, USA.","DOI":"10.1109\/CVPR.2009.5206848"},{"key":"ref_32","unstructured":"Yu, W., Yang, K., Bai, Y., Xiao, T., Yao, H., and Rui, Y. (2016, January 19\u201324). Visualizing and comparing AlexNet and VGG using deconvolutional layers. Proceedings of the 33 rd International Conference on Machine Learning, New York City, NY, USA."},{"key":"ref_33","first-page":"5","article-title":"A Robust Approach of Facial Orientation Recognition from Facial Features","volume":"8","author":"Gupta","year":"2017","journal-title":"BRAIN. Broad Res. Artif. Intell. Neurosci."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Ozturk, T., Talo, M., Yildirim, E.A., Baloglu, U.B., Yildirim, O., and Acharya, U.R. (2020). Automated detection of COVID-19 cases using deep neural networks with X-ray images. Comput. Biol. Med., 103792.","DOI":"10.1016\/j.compbiomed.2020.103792"},{"key":"ref_35","unstructured":"Denil, M., Shakibi, B., Dinh, L., Ranzato, M., and De Freitas, N. (2013, January 5\u201310). Predicting parameters in deep learning. Proceedings of the 26th International Conference on Neural Information Processing Systems\u2014Volume 2, Lake Tahoe, NV USA."},{"key":"ref_36","unstructured":"Sutskever, I., Martens, J., Dahl, G., and Hinton, G. On the importance of initialization and momentum in deep learning. Proceedings of the 30th International Conference on Machine Learning, Atlanta, GA, USA. Available online: http:\/\/proceedings.mlr.press\/v28\/sutskever13.pdf."},{"key":"ref_37","unstructured":"Kingma, D.P., and Ba, J. (2014). Adam: A method for stochastic optimization. arXiv."},{"key":"ref_38","unstructured":"Zhang, C., Liao, Q., Rakhlin, A., Miranda, B., Golowich, N., and Poggio, T. (2018). Theory of deep learning IIb: Optimization properties of SGD. arXiv."},{"key":"ref_39","unstructured":"Bengio, Y. (2015). Rmsprop and equilibrated adaptive learning rates for nonconvex optimization. arXiv."},{"key":"ref_40","unstructured":"Perez, L., and Wang, J. (2017). The effectiveness of data augmentation in image classification using deep learning. arXiv."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"2169","DOI":"10.1109\/TMI.2013.2275151","article-title":"Computer-aided breast cancer diagnosis based on the analysis of cytological images of fine needle biopsies","volume":"32","author":"Filipczuk","year":"2013","journal-title":"IEEE Trans. Med. Imaging"},{"key":"ref_42","unstructured":"Ahsan, M.M. (2018). Real Time Face Recognition in Unconstrained Environment, Lamar University-Beaumont."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"209","DOI":"10.1080\/01621459.1927.10502953","article-title":"Probable inference, the law of succession, and statistical inference","volume":"22","author":"Wilson","year":"1927","journal-title":"J. Am. Stat. Assoc."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"193","DOI":"10.1037\/h0044139","article-title":"Bayesian statistical inference for psychological research","volume":"70","author":"Edwards","year":"1963","journal-title":"Psychol. Rev."},{"key":"ref_45","unstructured":"Brownlee, J. (2020, March 12). Machine Learning Mastery. Available online: http:\/\/machinelearningmastery.com\/discover-feature-engineering-howtoengineer-features-and-how-to-getgood-at-it."},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Khan, A., Gupta, K.D., Kumar, N., and Venugopal, D. (2020, January 19\u201324). CIDMP: Completely Interpretable Detection of Malaria Parasite in Red Blood Cells using Lower-dimensional Feature Space. Proceedings of the 2020 International Joint Conference on Neural Networks (IJCNN 2020), Glasgow, UK.","DOI":"10.1109\/IJCNN48605.2020.9206885"},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Sen, S., Dasgupta, D., and Gupta, K.D. (2020, January 13\u201317). An Empirical Study on Algorithmic Bias. Proceedings of the 2020 IEEE 44th Annual Computers, Software, and Applications Conference (COMPSAC), Madrid, Spain.","DOI":"10.1109\/COMPSAC48688.2020.00-95"}],"container-title":["Machine Learning and Knowledge Extraction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2504-4990\/2\/4\/27\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T10:26:24Z","timestamp":1760178384000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2504-4990\/2\/4\/27"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,10,29]]},"references-count":47,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2020,12]]}},"alternative-id":["make2040027"],"URL":"https:\/\/doi.org\/10.3390\/make2040027","relation":{},"ISSN":["2504-4990"],"issn-type":[{"value":"2504-4990","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,10,29]]}}}