{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,24]],"date-time":"2026-06-24T15:58:23Z","timestamp":1782316703422,"version":"3.54.5"},"reference-count":55,"publisher":"MDPI AG","issue":"4","license":[{"start":{"date-parts":[[2021,12,7]],"date-time":"2021-12-07T00:00:00Z","timestamp":1638835200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100004318","name":"Microsoft","doi-asserted-by":"publisher","award":["AI For Health program"],"award-info":[{"award-number":["AI For Health program"]}],"id":[{"id":"10.13039\/100004318","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100004952","name":"Atlantic Canada Opportunities Agency","doi-asserted-by":"publisher","award":["217148"],"award-info":[{"award-number":["217148"]}],"id":[{"id":"10.13039\/501100004952","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100000038","name":"Natural Sciences and Engineering Research Council","doi-asserted-by":"publisher","award":["ALLRP 552039-20"],"award-info":[{"award-number":["ALLRP 552039-20"]}],"id":[{"id":"10.13039\/501100000038","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100000240","name":"New Brunswick Innovation Foundation","doi-asserted-by":"publisher","award":["COV2020-042"],"award-info":[{"award-number":["COV2020-042"]}],"id":[{"id":"10.13039\/501100000240","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["BDCC"],"abstract":"<jats:p>The coronavirus pandemic is spreading around the world. Medical imaging modalities such as radiography play an important role in the fight against COVID-19. Deep learning (DL) techniques have been able to improve medical imaging tools and help radiologists to make clinical decisions for the diagnosis, monitoring and prognosis of different diseases. Computer-Aided Diagnostic (CAD) systems can improve work efficiency by precisely delineating infections in chest X-ray (CXR) images, thus facilitating subsequent quantification. CAD can also help automate the scanning process and reshape the workflow with minimal patient contact, providing the best protection for imaging technicians. The objective of this study is to develop a deep learning algorithm to detect COVID-19, pneumonia and normal cases on CXR images. We propose two classifications problems, (i) a binary classification to classify COVID-19 and normal cases and (ii) a multiclass classification for COVID-19, pneumonia and normal. Nine datasets and more than 3200 COVID-19 CXR images are used to assess the efficiency of the proposed technique. The model is trained on a subset of the National Institute of Health (NIH) dataset using swish activation, thus improving the training accuracy to detect COVID-19 and other pneumonia. The models are tested on eight merged datasets and on individual test sets in order to confirm the degree of generalization of the proposed algorithms. An explainability algorithm is also developed to visually show the location of the lung-infected areas detected by the model. Moreover, we provide a detailed analysis of the misclassified images. The obtained results achieve high performances with an Area Under Curve (AUC) of 0.97 for multi-class classification (COVID-19 vs. other pneumonia vs. normal) and 0.98 for the binary model (COVID-19 vs. normal). The average sensitivity and specificity are 0.97 and 0.98, respectively. The sensitivity of the COVID-19 class achieves 0.99. The results outperformed the comparable state-of-the-art models for the detection of COVID-19 on CXR images. The explainability model shows that our model is able to efficiently identify the signs of COVID-19.<\/jats:p>","DOI":"10.3390\/bdcc5040073","type":"journal-article","created":{"date-parts":[[2021,12,7]],"date-time":"2021-12-07T09:52:29Z","timestamp":1638870749000},"page":"73","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":29,"title":["Explainable COVID-19 Detection on Chest X-rays Using an End-to-End Deep Convolutional Neural Network Architecture"],"prefix":"10.3390","volume":"5","author":[{"given":"Mohamed","family":"Chetoui","sequence":"first","affiliation":[{"name":"Perception, Robotics, and Intelligent Machines Research Group (PRIME), Department of Computer Science, Universit\u00e9 de Moncton, Moncton, NB E1A 3E9, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4378-2669","authenticated-orcid":false,"given":"Moulay A.","family":"Akhloufi","sequence":"additional","affiliation":[{"name":"Perception, Robotics, and Intelligent Machines Research Group (PRIME), Department of Computer Science, Universit\u00e9 de Moncton, Moncton, NB E1A 3E9, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3121-7045","authenticated-orcid":false,"given":"Bardia","family":"Yousefi","sequence":"additional","affiliation":[{"name":"Fischell Department of Bioengineering, University of Maryland, College Park, MD 20742, USA"},{"name":"Department of Electrical and Computer Engineering, Laval University, Qu\u00e9bec, QC G1V 0A6, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"El Mostafa","family":"Bouattane","sequence":"additional","affiliation":[{"name":"Montfort Academic Hospital & Institut du Savoir Montfort, Ottawa, ON 61350, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2021,12,7]]},"reference":[{"key":"ref_1","unstructured":"WHO (2021, October 16). Coronavirus Disease 2020. Available online: https:\/\/www.who.int\/emergencies\/diseases\/novel-coronavirus-2019\/situation-reports."},{"key":"ref_2","unstructured":"WHO (2021, October 16). Statement on the Second Meeting of the International Health Regulations (2005) Emergency Committee Regarding the Outbreak of Novel Coronavirus (2019-nCoV). Available online: https:\/\/www.who.int\/."},{"key":"ref_3","unstructured":"WHO (2021, October 16). WHO Director-General\u2019s Opening Remarks at the Media Briefing on COVID-19. Available online: https:\/\/www.who.int."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"E115","DOI":"10.1148\/radiol.2020200432","article-title":"Sensitivity of Chest CT for COVID-19: Comparison to RT-PCR","volume":"296","author":"Fang","year":"2020","journal-title":"Radiology"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"e040487","DOI":"10.1136\/bmjopen-2020-040487","article-title":"COVID-19 prevention and treatment information on the internet: A systematic analysis and quality assessment","volume":"10","author":"Fan","year":"2020","journal-title":"BMJ Open"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"132665","DOI":"10.1109\/ACCESS.2020.3010287","article-title":"Can AI help in screening viral and COVID-19 pneumonia?","volume":"8","author":"Chowdhury","year":"2020","journal-title":"IEEE Access"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"4093","DOI":"10.1007\/s10462-019-09788-3","article-title":"Using deep learning techniques in medical imaging: A systematic review of applications on CT and PET","volume":"53","author":"Domingues","year":"2020","journal-title":"Artif. Intell. Rev."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"4","DOI":"10.1109\/RBME.2020.2987975","article-title":"Review of Artificial Intelligence Techniques in Imaging Data Acquisition, Segmentation, and Diagnosis for COVID-19","volume":"14","author":"Shi","year":"2021","journal-title":"IEEE Rev. Biomed. Eng."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"044503","DOI":"10.1117\/1.JMI.7.4.044503","article-title":"Explainable end-to-end deep learning for diabetic retinopathy detection across multiple datasets","volume":"7","author":"Chetoui","year":"2020","journal-title":"J. Med. Imaging"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Chetoui, M., and Akhloufi, M.A. (2020, January 20\u201324). Explainable Diabetic Retinopathy using EfficientNET. Proceedings of the 2020 42nd Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC), Montreal, QC, Canada.","DOI":"10.1109\/EMBC44109.2020.9175664"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"635","DOI":"10.1007\/s13246-020-00865-4","article-title":"Covid-19: Automatic detection from x-ray images utilizing transfer learning with convolutional neural networks","volume":"43","author":"Apostolopoulos","year":"2020","journal-title":"Phys. Eng. Sci. Med."},{"key":"ref_12","unstructured":"Simonyan, K., and Zisserman, A. (2014). Very deep convolutional networks for large-scale image recognition. arXiv."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Sandler, M., Howard, A., Zhu, M., Zhmoginov, A., and Chen, L.C. (2018, January 18\u201322). Mobilenetv2: Inverted residuals and linear bottlenecks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00474"},{"key":"ref_14","first-page":"6677314","article-title":"Deep Learning in the Detection and Diagnosis of COVID-19 Using Radiology Modalities: A Systematic Review","volume":"2021","author":"Ghaderzadeh","year":"2021","journal-title":"J. Healthc. Eng."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27\u201330). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"19549","DOI":"10.1038\/s41598-020-76550-z","article-title":"Covid-net: A tailored deep convolutional neural network design for detection of covid-19 cases from chest X-ray images","volume":"10","author":"Wang","year":"2020","journal-title":"Sci. Rep."},{"key":"ref_17","unstructured":"Farooq, M., and Hafeez, A. (2020). Covid-resnet: A deep learning framework for screening of covid19 from radiographs. arXiv."},{"key":"ref_18","unstructured":"Hemdan, E.E.D., Shouman, M.A., and Karar, M.E. (2020). Covidx-net: A framework of deep learning classifiers to diagnose covid-19 in x-ray images. arXiv."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Huang, G., Liu, Z., Van Der Maaten, L., and Weinberger, K.Q. (2017, January 21\u201326). Densely connected convolutional networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.243"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"E167","DOI":"10.1148\/radiol.2020203511","article-title":"DeepCOVID-XR: An Artificial Intelligence Algorithm to Detect COVID-19 on Chest Radiographs Trained and Tested on a Large U.S. Clinical Data Set","volume":"299","author":"Wehbe","year":"2021","journal-title":"Radiology"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., and Wojna, Z. (2016, January 27\u201330). Rethinking the inception architecture for computer vision. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.308"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Szegedy, C., Ioffe, S., Vanhoucke, V., and Alemi, A. (2017, January 4\u20139). Inception-v4, inception-resnet and the impact of residual connections on learning. Proceedings of the AAAI Conference on Artificial Intelligence, San Francisco, CA, USA.","DOI":"10.1609\/aaai.v31i1.11231"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Chollet, F. (2017, January 21\u201326). Xception: Deep learning with depthwise separable convolutions. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.195"},{"key":"ref_24","unstructured":"Tan, M., and Le, Q. (2019, January 9\u201315). Efficientnet: Rethinking model scaling for convolutional neural networks. Proceedings of the 36th International Conference on Machine Learning, PMLR, Long Beach, CA, USA."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Chetoui, M., and Akhloufi, M.A. (2021). Deep Efficient Neural Networks for Explainable COVID-19 Detection on CXR Images. Advances and Trends in Artificial Intelligence, Artificial Intelligence Practices, IEA\/AIE. Chapter 29.","DOI":"10.1007\/978-3-030-79457-6_29"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"101794","DOI":"10.1016\/j.media.2020.101794","article-title":"Deep-COVID: Predicting COVID-19 from chest X-ray images using deep transfer learning","volume":"65","author":"Minaee","year":"2020","journal-title":"Med. Image Anal."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Hu, J., Shen, L., and Sun, G. (2018, January 18\u201323). Squeeze-and-excitation networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00745"},{"key":"ref_28","unstructured":"imageNet (2021, October 16). Large Scale Visual Recognition Challenge (ILSVRC). Available online: https:\/\/image-net.org\/."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"568","DOI":"10.2214\/AJR.19.21512","article-title":"Tackling the radiological society of north america pneumonia detection challenge","volume":"213","author":"Pan","year":"2019","journal-title":"Am. J. Roentgenol."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Cohen, J.P., Morrison, P., Dao, L., Roth, K., Duong, T.Q., and Ghassemi, M. (2020). COVID-19 Image Data Collection: Prospective Predictions Are the Future. arXiv.","DOI":"10.59275\/j.melba.2020-48g7"},{"key":"ref_31","unstructured":"de la Iglesia Vay\u00e1, M., Saborit, J.M., Montell, J.A., Pertusa, A., Bustos, A., Cazorla, M., Galant, J., Barber, X., Orozco-Beltr\u00e1n, D., and Garc\u00eda-Garc\u00eda, F. (2020). BIMCV COVID-19+: A large annotated dataset of RX and CT images from COVID-19 patients. arXiv."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"1122","DOI":"10.1016\/j.cell.2018.02.010","article-title":"Identifying Medical Diagnoses and Treatable Diseases by Image-Based Deep Learning","volume":"172","author":"Kermany","year":"2018","journal-title":"Cell"},{"key":"ref_33","unstructured":"National Library of Medicine (2021, October 16). Tuberculosis Chest X-ray Image Data Sets, Available online: https:\/\/lhncbc.nlm.nih.gov\/publication\/pub9931."},{"key":"ref_34","unstructured":"Malhotra, A., Mittal, S., Majumdar, P., Chhabra, S., Thakral, K., Vatsa, M., Singh, R., Chaudhury, S., Pudrod, A., and Agrawal, A. (2020). Multi-Task Driven Explainable Diagnosis of COVID-19 using Chest X-ray Images. arXiv."},{"key":"ref_35","unstructured":"Montfort, H. (2021, October 16). Hopital Montfort. Available online: https:\/\/hopitalmontfort.com\/."},{"key":"ref_36","unstructured":"Heaven, W.D. (2020, July 02). Google\u2019s Medical AI Was Super Accurate in a Lab. Real Life Was a Different Story. Available online: https:\/\/www.technologyreview.com\/2020\/04\/27\/1000658\/google-medical-ai-accurate-lab-real-life-clinic-covid-diabetes-retina-disease\/."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Sandler, M., Howard, A.G., Zhu, M., Zhmoginov, A., and Chen, L. (2018). Inverted Residuals and Linear Bottlenecks: Mobile Networks for Classification, Detection and Segmentation. arXiv.","DOI":"10.1109\/CVPR.2018.00474"},{"key":"ref_38","unstructured":"K\u0131zrak, A. (2021, October 16). Comparison of activation functions for deep neural networks. Available online: https:\/\/towardsdatascience.com\/comparison-of-activation-functions-for-deep-neural-networks-706ac4284c8a."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"2879","DOI":"10.1158\/1078-0432.CCR-08-1881","article-title":"Molecular detection of lymph node metastases in breast cancer patients: Results of a multicenter trial using the one-step nucleic acid amplification assay","volume":"15","author":"Tamaki","year":"2009","journal-title":"Clin. Cancer Res."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"106691","DOI":"10.1016\/j.asoc.2020.106691","article-title":"Automated medical diagnosis of COVID-19 through EfficientNet convolutional neural network","volume":"96","author":"Marques","year":"2020","journal-title":"Appl. Soft Comput."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"5591614","DOI":"10.1155\/2021\/5591614","article-title":"Remote Diagnosis and Triaging Model for Skin Cancer Using EfficientNet and Extreme Gradient Boosting","volume":"2021","author":"Khan","year":"2021","journal-title":"Complexity"},{"key":"ref_42","unstructured":"Rahman, T. (2021, October 16). COVID-19 Radiography Database. Available online: https:\/\/www.kaggle.com\/tawsifurrahman\/covid19-radiography-database."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"e180041","DOI":"10.1148\/ryai.2019180041","article-title":"Augmenting the National Institutes of Health chest radiograph dataset with expert annotations of possible pneumonia","volume":"1","author":"Shih","year":"2019","journal-title":"Radiol. Artif. Intell."},{"key":"ref_44","unstructured":"Chollet, F. (2021, October 16). Keras. Available online: https:\/\/keras.io."},{"key":"ref_45","unstructured":"Microsoft (2021, October 16). Microsoft Azure. Available online: https:\/\/azure.microsoft.com\/."},{"key":"ref_46","unstructured":"Ruder, S. (2016). An overview of gradient descent optimization algorithms. arXiv."},{"key":"ref_47","unstructured":"Kingma, D.P., and Ba, J. (2014). Adam: A method for stochastic optimization. arXiv."},{"key":"ref_48","unstructured":"Huang, W., Song, G., Li, M., Hu, W., and Xie, K. (August, January 31). Adaptive weight optimization for classification of imbalanced data. Proceedings of the International Conference on Intelligent Science and Big Data Engineering, Beijing, China."},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Selvaraju, R.R., Cogswell, M., Das, A., Vedantam, R., Parikh, D., and Batra, D. (2017, January 22\u201329). Grad-cam: Visual explanations from deep networks via gradient-based localization. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.","DOI":"10.1109\/ICCV.2017.74"},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"110190","DOI":"10.1016\/j.chaos.2020.110190","article-title":"A deep learning and grad-CAM based color visualization approach for fast detection of COVID-19 cases using chest X-ray and CT-Scan images","volume":"140","author":"Panwar","year":"2020","journal-title":"Chaos Solitons Fractals"},{"key":"ref_51","doi-asserted-by":"crossref","unstructured":"Kim, M., Janssens, O., Park, H.m., Zuallaert, J., Van Hoecke, S., and De Neve, W. (2018). Web applicable computer-aided diagnosis of glaucoma using deep learning. arXiv.","DOI":"10.1109\/BIBM.2018.8621168"},{"key":"ref_52","doi-asserted-by":"crossref","unstructured":"Kowsari, K., Sali, R., Ehsan, L., Adorno, W., Ali, A., Moore, S., Amadi, B., Kelly, P., Syed, S., and Brown, D. (2020). Hmic: Hierarchical medical image classification, a deep learning approach. Information, 11.","DOI":"10.3390\/info11060318"},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"e200337","DOI":"10.1148\/ryct.2020200337","article-title":"Determinants of chest x-ray sensitivity for covid-19: A multi-institutional study in the united states","volume":"2","author":"Stephanie","year":"2020","journal-title":"Radiol. Cardiothorac. Imaging"},{"key":"ref_54","unstructured":"Chetoui, M., Traor\u00e9, A., and Akhloufi, M.A. (2020, January 20\u201324). Deep Learning for COVID-19 Detection on Chest X-Ray and CT Scan. Proceedings of the 2020 42nd Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC), Montreal, QC, Canada."},{"key":"ref_55","unstructured":"Couturier, A., Chetoui, M., and Akhloufi, M.A. (2021, October 16). COVID-19 Detection Using Deep Learning. Available online: https:\/\/covid19.primeai.ca\/."}],"container-title":["Big Data and Cognitive Computing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2504-2289\/5\/4\/73\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T07:42:27Z","timestamp":1760168547000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2504-2289\/5\/4\/73"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,12,7]]},"references-count":55,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2021,12]]}},"alternative-id":["bdcc5040073"],"URL":"https:\/\/doi.org\/10.3390\/bdcc5040073","relation":{},"ISSN":["2504-2289"],"issn-type":[{"value":"2504-2289","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,12,7]]}}}