{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,11]],"date-time":"2026-03-11T12:38:58Z","timestamp":1773232738070,"version":"3.50.1"},"reference-count":47,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2023,12,4]],"date-time":"2023-12-04T00:00:00Z","timestamp":1701648000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Artif. Intell."],"abstract":"<jats:sec><jats:title>Introduction<\/jats:title><jats:p>The COVID-19 pandemic had a global impact and created an unprecedented emergency in healthcare and other related frontline sectors. Various Artificial-Intelligence-based models were developed to effectively manage medical resources and identify patients at high risk. However, many of these AI models were limited in their practical high-risk applicability due to their \u201cblack-box\u201d nature, i.e., lack of interpretability of the model. To tackle this problem, Explainable Artificial Intelligence (XAI) was introduced, aiming to explore the \u201cblack box\u201d behavior of machine learning models and offer definitive and interpretable evidence. XAI provides interpretable analysis in a human-compliant way, thus boosting our confidence in the successful implementation of AI systems in the wild.<\/jats:p><\/jats:sec><jats:sec><jats:title>Methods<\/jats:title><jats:p>In this regard, this study explores the use of model-agnostic XAI models, such as SHapley Additive exPlanations values (SHAP) and Local Interpretable Model-Agnostic Explanations (LIME), for COVID-19 symptom analysis in Indian patients toward a COVID severity prediction task. Various machine learning models such as Decision Tree Classifier, XGBoost Classifier, and Neural Network Classifier are leveraged to develop Machine Learning models.<\/jats:p><\/jats:sec><jats:sec><jats:title>Results and discussion<\/jats:title><jats:p>The proposed XAI tools are found to augment the high performance of AI systems with human interpretable evidence and reasoning, as shown through the interpretation of various explainability plots. Our comparative analysis illustrates the significance of XAI tools and their impact within a healthcare context. The study suggests that SHAP and LIME analysis are promising methods for incorporating explainability in model development and can lead to better and more trustworthy ML models in the future.<\/jats:p><\/jats:sec>","DOI":"10.3389\/frai.2023.1272506","type":"journal-article","created":{"date-parts":[[2023,12,4]],"date-time":"2023-12-04T06:56:13Z","timestamp":1701672973000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":18,"title":["Model-agnostic explainable artificial intelligence tools for severity prediction and symptom analysis on Indian COVID-19 data"],"prefix":"10.3389","volume":"6","author":[{"given":"Athira","family":"Nambiar","sequence":"first","affiliation":[]},{"given":"Harikrishnaa","family":"S","sequence":"additional","affiliation":[]},{"given":"Sharanprasath","family":"S","sequence":"additional","affiliation":[]}],"member":"1965","published-online":{"date-parts":[[2023,12,4]]},"reference":[{"key":"B1","doi-asserted-by":"publisher","first-page":"e00477","DOI":"10.1016\/j.sciaf.2020.e00477","article-title":"Dynamic model of COVID-19 disease with exploratory data analysis","volume":"9","author":"Adeniyi","year":"2020","journal-title":"Sci. Afr"},{"key":"B2","doi-asserted-by":"publisher","first-page":"102569","DOI":"10.1016\/j.ipm.2021.102569","article-title":"Combat COVID-19 infodemic using explainable natural language processing models","volume":"58","author":"Ayoub","year":"2021","journal-title":"Inform. Process. Manage"},{"key":"B3","doi-asserted-by":"publisher","first-page":"1225","DOI":"10.1093\/jamia\/ocad091","article-title":"AI in health: keeping the human in the loop","volume":"30","author":"Bakken","year":"2023","journal-title":"J. Am. Med. Inform. Assoc."},{"key":"B4","doi-asserted-by":"publisher","first-page":"4439","DOI":"10.1038\/s41467-020-18297-9","article-title":"Developing a COVID-19 mortality risk prediction model when individual-level data are not available","volume":"11","author":"Barda","year":"2020","journal-title":"Nat. Commun"},{"key":"B5","doi-asserted-by":"publisher","first-page":"125075","DOI":"10.1016\/j.energy.2022.125075","article-title":"Dataset level explanation of heat demand forecasting ANN with SHAP","volume":"261","author":"Bia\u0142ek","year":"2022","journal-title":"Energy"},{"key":"B6","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.1508.02790","article-title":"On the convergence of sgd training of neural networks","author":"Breuel","year":"2015","journal-title":"arXiv preprint arXiv:1508.02790"},{"key":"B7","doi-asserted-by":"crossref","first-page":"655","DOI":"10.1007\/978-3-030-10925-7_40","article-title":"\u201cVisualizing the feature importance for black box models,\u201d","volume-title":"Machine Learning and Knowledge Discovery in Databases: European Conference, ECML PKDD 2018","author":"Casalicchio","year":"2019"},{"key":"B8","doi-asserted-by":"publisher","first-page":"252","DOI":"10.1016\/j.inffus.2020.08.002","article-title":"The introduction of population migration to seiar for COVID-19 epidemic modeling with an efficient intervention strategy","volume":"64","author":"Chen","year":"2020","journal-title":"Inform. Fus"},{"key":"B9","unstructured":"2020"},{"key":"B10","doi-asserted-by":"publisher","first-page":"101982","DOI":"10.1016\/j.artmed.2020.101982","article-title":"Using interpretability approaches to update \u201cblack-box\u201d clinical prediction models: an external validation study in nephrology","volume":"111","author":"Da Cruz","year":"2021","journal-title":"Artif. Intell. Med"},{"key":"B11","unstructured":"Datameet-Data-Repository2020"},{"key":"B12","doi-asserted-by":"publisher","DOI":"10.1101\/2020.05.26.20113720","article-title":"Combining fine-scale social contact data with epidemic modelling reveals interactions between contact tracing, quarantine, testing and physical distancing for controlling COVID-19","author":"Firth","year":"2020","journal-title":"MedRxiv"},{"key":"B13","doi-asserted-by":"publisher","DOI":"10.1093\/ofid\/ofaa463","article-title":"Derivation and validation of clinical prediction rules for COVID-19 mortality in Ontario, Canada","author":"Fisman","year":"2020","journal-title":"Open Forum Infect. Dis"},{"key":"B14","doi-asserted-by":"publisher","first-page":"10417","DOI":"10.3390\/app112110417","article-title":"A lime-based explainable machine learning model for predicting the severity level of COVID-19 diagnosed patients","volume":"11","author":"Gabbay","year":"2021","journal-title":"Appl. Sci"},{"key":"B15","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3236009","article-title":"A survey of methods for explaining black box models","volume":"51","author":"Guidotti","year":"2018","journal-title":"ACM Comput. Surveys"},{"key":"B16","doi-asserted-by":"publisher","first-page":"60","DOI":"10.4103\/2045-9912.326002","article-title":"Prediction of diagnosis and prognosis of covid-19 disease by blood gas parameters using decision trees machine learning model: a retrospective observational study","volume":"12","author":"Huyut","year":"2022","journal-title":"Med. Gas Res"},{"key":"B17","doi-asserted-by":"publisher","first-page":"104326","DOI":"10.1016\/j.ijmedinf.2020.104326","article-title":"Machine learning-based models to support decision-making in emergency department triage for patients with suspected cardiovascular disease","volume":"145","author":"Jiang","year":"2021","journal-title":"Int. J. Med. Inform"},{"key":"B18","first-page":"111","article-title":"Performance analysis of various activation functions in generalized mlp architectures of neural networks","volume":"1","author":"Karlik","year":"2011","journal-title":"Int. J. Artif. Intell. Expert Syst"},{"key":"B19","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2021.naacl-main.99","article-title":"Text modular networks: learning to decompose tasks in the language of existing models","author":"Khot","year":"2020","journal-title":"arXiv preprint arXiv:2009.00751"},{"key":"B20","doi-asserted-by":"publisher","first-page":"108255","DOI":"10.1016\/j.patcog.2021.108255","article-title":"SARS-Net: COVID-19 detection from chest x-rays by combining graph convolutional network and convolutional neural network","volume":"122","author":"Kumar","year":"2022","journal-title":"Pattern Recogn"},{"key":"B21","doi-asserted-by":"publisher","first-page":"2013","DOI":"10.1007\/s13204-021-01868-7","article-title":"Coronavirus disease (COVID-19) cases analysis using machine-learning applications","volume":"13","author":"Kwekha-Rashid","year":"2021","journal-title":"Appl. Nanosci"},{"key":"B22","doi-asserted-by":"publisher","first-page":"321","DOI":"10.3389\/fmed.2020.00321","article-title":"Spread and impact of COVID-19 in China: a systematic review and synthesis of predictions from transmission-dynamic models","volume":"7","author":"Lin","year":"2020","journal-title":"Front. Med"},{"key":"B23","doi-asserted-by":"publisher","first-page":"674055","DOI":"10.3389\/fnins.2021.674055","article-title":"Explainable deep learning for personalized age prediction with brain morphology","volume":"15","author":"Lombardi","year":"2021","journal-title":"Front. Neurosci"},{"key":"B24","article-title":"A unified approach to interpreting model predictions","author":"Lundberg","year":"2017","journal-title":"Adv. Neural Inform. Process. Syst"},{"key":"B25","doi-asserted-by":"publisher","first-page":"110927","DOI":"10.1016\/j.engstruct.2020.110927","article-title":"Failure mode and effects analysis of RC members based on machine-learning-based Shapley additive explanations (SHAP) approach","volume":"219","author":"Mangalathu","year":"2020","journal-title":"Eng. Struct"},{"key":"B26","first-page":"537","article-title":"\u201cLocal interpretable model-agnostic explanations for music content analysis,\u201d","author":"Mishra","year":"2017","journal-title":"ISMIR, Vol. 53"},{"key":"B27","doi-asserted-by":"publisher","first-page":"2278","DOI":"10.17577\/IJERTV9IS090235","article-title":"An exploratory data analysis of COVID-19 in India","volume":"9","author":"Mittal","year":"2020","journal-title":"Int. J. Eng. Res. Technol"},{"key":"B28","unstructured":"Ministry of Health and Family Welfare2021"},{"key":"B29","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.1900654116","article-title":"Interpretable machine learning: definitions, methods, and applications","author":"Murdoch","year":"2019","journal-title":"arXiv preprint arXiv:1901.04592"},{"key":"B30","doi-asserted-by":"publisher","first-page":"185","DOI":"10.1109\/ICSIPA52582.2021.9576766","article-title":"\u201cComparative analysis of explainable artificial intelligence for COVID-19 diagnosis on CXR image,\u201d","author":"Ong","year":"2021","journal-title":"2021 IEEE International Conference on Signal and Image Processing Applications (ICSIPA)"},{"key":"B31","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2201.06997","article-title":"Explainable AI framework for COVID-19 prediction in different provinces of India","author":"Pandianchery","year":"2022","journal-title":"arXiv preprint arXiv:2201.06997"},{"key":"B32","doi-asserted-by":"publisher","DOI":"10.1101\/2020.04.08.20057794","article-title":"Factors associated with hospitalization and critical illness among 4,103 patients with COVID-19 disease in new york city","author":"Petrilli","year":"2020","journal-title":"MedRxiv"},{"key":"B33","doi-asserted-by":"publisher","first-page":"e24572","DOI":"10.2196\/24572","article-title":"Development and validation of a machine learning approach for automated severity assessment of covid-19 based on clinical and imaging data: retrospective study","volume":"9","author":"Quiroz","year":"2021","journal-title":"JMIR Med. Inform"},{"key":"B34","doi-asserted-by":"publisher","first-page":"3619","DOI":"10.1370\/afm.21.s1.3619","article-title":"Explainable machine learning model to predict covid-19 severity among older adults in the province of Quebec","volume":"21","author":"Rahimi","year":"2023","journal-title":"Ann. Fam. Med."},{"key":"B35","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1109\/ICVEE50212.2020.9243246","article-title":"\u201cCOVID symptom severity using decision tree,\u201d","author":"Rochmawati","year":"2020","journal-title":"2020 Third International Conference on Vocational Education and Electrical Engineering (ICVEE)"},{"key":"B36","doi-asserted-by":"publisher","first-page":"1000","DOI":"10.1038\/s41598-022-04835-6","article-title":"Blood cancer prediction using leukemia microarray gene data and hybrid logistic vector trees model","volume":"12","author":"Rupapara","year":"2022","journal-title":"Sci. Rep"},{"key":"B37","doi-asserted-by":"publisher","first-page":"115411","DOI":"10.1016\/j.desal.2021.115411","article-title":"Predictive modelling for solar power-driven hybrid desalination system using artificial neural network regression with adam optimization","volume":"522","author":"Salem","year":"2022","journal-title":"Desalination"},{"key":"B38","doi-asserted-by":"publisher","first-page":"675766","DOI":"10.3389\/fpubh.2021.759014","article-title":"Identification of variable importance for predictions of mortality from COVID-19 using AI models for Ontario, Canada","volume":"9","author":"Snider","year":"2021","journal-title":"Front. Publ. Health"},{"key":"B39","doi-asserted-by":"publisher","first-page":"36","DOI":"10.1016\/j.ijcce.2023.01.003","article-title":"Automatic COVID-19 prediction using explainable machine learning techniques","volume":"4","author":"Solayman","year":"2023","journal-title":"Int. J. Cogn. Comput. Eng"},{"key":"B40","doi-asserted-by":"publisher","first-page":"1502","DOI":"10.12928\/telkomnika.v14i4.3956","article-title":"Svm parameter optimization using grid search and genetic algorithm to improve classification performance","volume":"14","author":"Syarif","year":"2016","journal-title":"TELKOMNIKA"},{"key":"B41","doi-asserted-by":"crossref","DOI":"10.1007\/978-0-387-21706-2","author":"Venables","year":"2002","journal-title":"Modern Applied Statistics With S"},{"key":"B42","unstructured":"WHO COVID-19 India Data2020"},{"key":"B43","unstructured":"2020"},{"key":"B44","doi-asserted-by":"publisher","first-page":"110050","DOI":"10.1016\/j.chaos.2020.110050","article-title":"Analysis on novel coronavirus (COVID-19) using machine learning methods","volume":"139","author":"Yadav","year":"2020","journal-title":"Chaos Solitons Fract"},{"key":"B45","doi-asserted-by":"publisher","first-page":"283","DOI":"10.1038\/s42256-020-0180-7","article-title":"An interpretable mortality prediction model for COVID-19 patients","volume":"2","author":"Yan","year":"2020","journal-title":"Nat. Mach. Intell"},{"key":"B46","doi-asserted-by":"publisher","first-page":"7331","DOI":"10.1109\/TCOMM.2019.2924010","article-title":"Wireless networks design in the era of deep learning: model-based, AI-based, or both?","volume":"67","author":"Zappone","year":"2019","journal-title":"IEEE Trans. Commun"},{"key":"B47","doi-asserted-by":"publisher","first-page":"242","DOI":"10.1109\/TAI.2022.3153754","article-title":"Ensemble image explainable ai (XAI) algorithm for severe community-acquired pneumonia and COVID-19 respiratory infections","volume":"4","author":"Zou","year":"2022","journal-title":"IEEE Trans. Artif. Intell"}],"container-title":["Frontiers in Artificial Intelligence"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/frai.2023.1272506\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,12,4]],"date-time":"2023-12-04T06:56:26Z","timestamp":1701672986000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/frai.2023.1272506\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,12,4]]},"references-count":47,"alternative-id":["10.3389\/frai.2023.1272506"],"URL":"https:\/\/doi.org\/10.3389\/frai.2023.1272506","relation":{},"ISSN":["2624-8212"],"issn-type":[{"value":"2624-8212","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,12,4]]},"article-number":"1272506"}}