{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,19]],"date-time":"2026-06-19T06:08:39Z","timestamp":1781849319087,"version":"3.54.5"},"reference-count":114,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2024,11,28]],"date-time":"2024-11-28T00:00:00Z","timestamp":1732752000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Robot. AI"],"abstract":"<jats:p>Artificial Intelligence (AI) has demonstrated exceptional performance in automating critical healthcare tasks, such as diagnostic imaging analysis and predictive modeling, often surpassing human capabilities. The integration of AI in healthcare promises substantial improvements in patient outcomes, including faster diagnosis and personalized treatment plans. However, AI models frequently lack interpretability, leading to significant challenges concerning their performance and generalizability across diverse patient populations. These opaque AI technologies raise serious patient safety concerns, as non-interpretable models can result in improper treatment decisions due to misinterpretations by healthcare providers. Our systematic review explores various AI applications in healthcare, focusing on the critical assessment of model interpretability and accuracy. We identify and elucidate the most significant limitations of current AI systems, such as the black-box nature of deep learning models and the variability in performance across different clinical settings. By addressing these challenges, our objective is to provide healthcare providers with well-informed strategies to develop innovative and safe AI solutions. This review aims to ensure that future AI implementations in healthcare not only enhance performance but also maintain transparency and patient safety.<\/jats:p>","DOI":"10.3389\/frobt.2024.1444763","type":"journal-article","created":{"date-parts":[[2024,11,28]],"date-time":"2024-11-28T05:10:20Z","timestamp":1732770620000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":165,"title":["Enhancing interpretability and accuracy of AI models in healthcare: a comprehensive review on challenges and future directions"],"prefix":"10.3389","volume":"11","author":[{"given":"Mohammad","family":"Ennab","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hamid","family":"Mcheick","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1965","published-online":{"date-parts":[[2024,11,28]]},"reference":[{"key":"B1","doi-asserted-by":"publisher","first-page":"6","DOI":"10.1186\/s12876-022-02626-x","article-title":"Establishing machine learning models to predict the early risk of gastric cancer based on lifestyle factors","volume":"23","author":"Afrash","year":"2023","journal-title":"BMC Gastroenterol."},{"key":"B2","doi-asserted-by":"publisher","DOI":"10.21203\/rs.3.rs-53594\/v1","article-title":"Machine learning to guide the use of adjuvant therapies for breast cancer","author":"Alaa","year":"2020"},{"key":"B3","doi-asserted-by":"publisher","first-page":"9","DOI":"10.1038\/s41746-017-0015-z","article-title":"Advanced machine learning in action: identification of intracranial hemorrhage on computed tomography scans of the head with clinical workflow integration","volume":"1","author":"Arbabshirani","year":"2018","journal-title":"NPJ Digit. Med."},{"key":"B4","doi-asserted-by":"publisher","first-page":"11","DOI":"10.1007\/s10462-023-10631-z","article-title":"Deep learning models for digital image processing: a review","volume":"57","author":"Archana","year":"2024","journal-title":"Artif. Intell. Rev."},{"key":"B5","doi-asserted-by":"publisher","first-page":"e000181","DOI":"10.1136\/bmjsit-2022-000181","article-title":"New robotic platform for transoral robotic surgery: an IDEAL stage 0 study","volume":"6","author":"Arora","year":"2024","journal-title":"BMJ Surg. interventions, & health Technol."},{"key":"B7","first-page":"1","article-title":"Ethical challenges in AI","author":"Baeza-Yates","year":"2022"},{"key":"B8","doi-asserted-by":"publisher","first-page":"6648574","DOI":"10.1155\/2020\/6648574","article-title":"IoMT-based automated detection and classification of leukemia using deep learning","volume":"6648574","author":"Bibi","year":"2020","journal-title":"J. Healthc. Eng."},{"key":"B9","doi-asserted-by":"publisher","first-page":"23","DOI":"10.1016\/j.radonc.2020.11.027","article-title":"Multicentre, deep learning, synthetic-CT generation for ano-rectal MR-only radiotherapy treatment planning","volume":"156","author":"Bird","year":"2021","journal-title":"Radiother. Oncol."},{"key":"B10","doi-asserted-by":"publisher","first-page":"100109","DOI":"10.1016\/j.bea.2023.100109","article-title":"Recent advances in robot-assisted surgical systems","volume":"6","author":"Biswas","year":"2023","journal-title":"Biomed. Eng. Adv."},{"key":"B11","doi-asserted-by":"publisher","first-page":"74","DOI":"10.14744\/AnatolJCardiol.2023.3685","article-title":"Artificial intelligence-based clinical decision support systems in cardiovascular diseases","volume":"28","author":"Bozyel","year":"2024","journal-title":"Anatol. J. Cardiol."},{"key":"B12","doi-asserted-by":"crossref","DOI":"10.1155\/2022\/2801227","article-title":"A deep learning framework for leukemia cancer detection in microscopic blood samples using squeeze and excitation learning","volume-title":"Mathematical problems in engineering","author":"Bukhari","year":"2022"},{"key":"B13","article-title":"A systematic literature review on explainability for machine\/deep learning-based software engineering research","author":"Cao","year":"2024","journal-title":"ArXiv, abs\/2401.14617"},{"key":"B14","doi-asserted-by":"publisher","first-page":"832","DOI":"10.3390\/electronics8080832","article-title":"Machine learning interpretability: a survey on methods and metrics","volume":"8","author":"Carvalho","year":"2019","journal-title":"Electronics"},{"key":"B15","doi-asserted-by":"publisher","first-page":"332","DOI":"10.1016\/j.gie.2019.09.016","article-title":"Comparing blind spots of unsedated ultrafine, sedated, and unsedated conventional gastroscopy with and without artificial intelligence: a prospective, single-blind, 3-parallel-group, randomized, single-center trial","volume":"91","author":"Chen","year":"2020","journal-title":"Gastrointest. Endosc."},{"key":"B16","doi-asserted-by":"publisher","first-page":"1561","DOI":"10.1038\/s41598-024-51969-w","article-title":"Conversational AI and equity through assessing GPT-3\u2019s communication with diverse social groups on contentious topics","volume":"14","author":"Chen","year":"2024","journal-title":"Sci. Rep."},{"key":"B123","doi-asserted-by":"crossref","DOI":"10.3390\/healthcare10101815","volume-title":"Augmented reality surgical navigation system for external ventricular drain","author":"Chiou","year":"2022"},{"key":"B121","unstructured":"Nature Biotechnology\n          \n          433\n          10.1038\/s41587-023-01770-3\n          \n          2023"},{"key":"B19","doi-asserted-by":"publisher","first-page":"47","DOI":"10.1186\/s41747-024-00446-0","article-title":"Reconstruction of 3D knee MRI using deep learning and compressed sensing: a validation study on healthy volunteers","volume":"8","author":"Dratsch","year":"2024","journal-title":"Eur. Radiol. Exp."},{"key":"B20","doi-asserted-by":"publisher","first-page":"111","DOI":"10.1038\/s41375-021-01408-w","article-title":"Deep learning detects acute myeloid leukemia and predicts NPM1 mutation status from bone marrow smears","volume":"36","author":"Eckardt","year":"2022","journal-title":"Leukemia"},{"key":"B21","doi-asserted-by":"crossref","first-page":"275","DOI":"10.1109\/CBMS.2019.00065","article-title":"Interpretability in HealthCare A comparative study of local machine learning interpretability techniques","volume-title":"2019 IEEE 32nd international symposium on computer-based medical systems (CBMS)","author":"El Shawi","year":"2019"},{"key":"B22","doi-asserted-by":"publisher","first-page":"1557","DOI":"10.3390\/diagnostics12071557","article-title":"Designing an interpretability-based model to explain the artificial intelligence algorithms in healthcare","volume":"12","author":"Ennab","year":"","journal-title":"Diagn. (Basel, Switzerland)"},{"key":"B23","doi-asserted-by":"publisher","first-page":"14","DOI":"10.11648\/j.ijiis.20221102.11","article-title":"Survey of COVID-19 prediction models and their limitations","volume":"11","author":"Ennab","year":"","journal-title":"Inf. Syst."},{"key":"B119","doi-asserted-by":"crossref","DOI":"10.1007\/978-3-319-98131-4","article-title":"Explainable and interpretable models in computer vision and machine learning","volume-title":"Springer Verlag","author":"Escalante","year":"2018"},{"key":"B24","doi-asserted-by":"publisher","first-page":"686","DOI":"10.1038\/nature22985","article-title":"Erratum: corrigendum: Dermatologist-level classification of skin cancer with deep neural networks","volume":"546","author":"Esteva","year":"2017","journal-title":"Nature"},{"key":"B25","doi-asserted-by":"publisher","first-page":"1147","DOI":"10.1016\/j.ijrobp.2024.01.200","article-title":"Radiation therapy plays an important role in the treatment of atypical teratoid\/rhabdoid tumors: analysis of the EU-RHAB cohorts and their precursors","volume":"119","author":"Frisch","year":"2024","journal-title":"Int. J. Radiat. Oncol. Biol. Phys."},{"key":"B26","doi-asserted-by":"publisher","first-page":"633","DOI":"10.1007\/s11517-018-1905-1","article-title":"Intertrochanteric fracture visualization and analysis using a map projection technique","volume":"57","author":"Fu","year":"2019","journal-title":"Med. Biol. Eng. Comput."},{"key":"B27","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1002\/mp.15359","article-title":"A review of explainable and interpretable AI with applications in COVID\u201019 imaging","volume":"49","author":"Fuhrman","year":"2022","journal-title":"Med. Phys."},{"key":"B28","first-page":"1287","article-title":"Explaining the explainer: a first theoretical analysis of LIME","volume-title":"Proceedings of the twenty third international Conference on artificial Intelligence and statistics","author":"Garreau","year":"2020"},{"key":"B29","doi-asserted-by":"crossref","first-page":"80","DOI":"10.1109\/DSAA.2018.00018","article-title":"Explaining explanations: an overview of interpretability of machine learning","volume-title":"2018 IEEE 5th International Conference on data science and advanced analytics (DSAA)","author":"Gilpin","year":"2018"},{"key":"B30","doi-asserted-by":"publisher","first-page":"81","DOI":"10.1016\/j.ajem.2023.05.018","article-title":"ChatGPT and conversational artificial intelligence: friend, foe, or future of research?","volume":"70","author":"Gottlieb","year":"2023","journal-title":"Am. J. Emerg. Med."},{"key":"B31","doi-asserted-by":"publisher","first-page":"5526","DOI":"10.3390\/s21165526","article-title":"Artificial intelligence surgery: how do we get to autonomous actions in surgery?","volume":"21","author":"Gumbs","year":"2021","journal-title":"Sensors (Basel, Switzerland)"},{"key":"B32","article-title":"Explaining deep learning models--A bayesian non-parametric approach","volume":"31","author":"Guo","year":"2018","journal-title":"Adv. neural Inf. Process. Syst."},{"key":"B33","doi-asserted-by":"publisher","first-page":"34","DOI":"10.3322\/caac.21707","article-title":"Magnetic resonance linear accelerator technology and adaptive radiation therapy: an overview for clinicians","volume":"72","author":"Hall","year":"2022","journal-title":"CA a cancer J. Clin."},{"key":"B34","doi-asserted-by":"publisher","first-page":"104134","DOI":"10.1016\/j.ijmedinf.2020.104134","article-title":"Clinical decision support system to predict chronic kidney disease: a fuzzy expert system approach","volume":"138","author":"Hamedan","year":"2020","journal-title":"Int. J. Med. Inf."},{"key":"B35","doi-asserted-by":"publisher","first-page":"222276","DOI":"10.1148\/radiol.222276","article-title":"Interactive explainable deep learning model informs prostate cancer diagnosis at MRI","volume":"307","author":"Hamm","year":"2023","journal-title":"Radiology"},{"key":"B36","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2304.08247","article-title":"MedAlpaca \u2013 an open-source collection of medical conversational AI models and training data","author":"Han","year":"2023"},{"key":"B37","volume-title":"\u201chaptik\u201d, conversational AI in healthcare","author":"Haptik","year":"2023"},{"key":"B38","doi-asserted-by":"publisher","first-page":"21369","DOI":"10.1007\/s11042-023-16206-y","article-title":"Detection of central serous retinopathy using deep learning through retinal images","volume":"83","author":"Hassan","year":"2024","journal-title":"Multimedia Tools Appl."},{"key":"B118","doi-asserted-by":"publisher","first-page":"104643","DOI":"10.1016\/j.ijmedinf.2021.104643","article-title":"Engaging clinicians early during the development of a graphical user display of an intelligent alerting system at the bedside","volume":"159","author":"Helman","year":"2022","journal-title":"Int. J. Med. Inform."},{"key":"B39","doi-asserted-by":"publisher","first-page":"1717","DOI":"10.1007\/s11030-020-10144-9","article-title":"A multimodal deep learning-based drug repurposing approach for treatment of COVID-19","volume":"25","author":"Hooshmand","year":"2021","journal-title":"Mol. Divers"},{"key":"B40","doi-asserted-by":"publisher","first-page":"200077","DOI":"10.1016\/j.sasc.2024.200077","article-title":"COVID-19 detection from chest CT images using optimized deep features and ensemble classification","volume":"6","author":"Hossain","year":"2024","journal-title":"Syst. Soft Comput."},{"key":"B41","doi-asserted-by":"publisher","first-page":"e2025881","DOI":"10.1001\/jamanetworkopen.2020.25881","article-title":"Machine learning-guided adjuvant treatment of head and neck cancer","volume":"3","author":"Howard","year":"2020","journal-title":"JAMA Netw. open"},{"key":"B42","doi-asserted-by":"crossref","first-page":"557","DOI":"10.1109\/IVS.2019.8813796","article-title":"Multi-modal probabilistic prediction of interactive behavior via an interpretable model","volume-title":"2019 IEEE intelligent vehicles symposium (IV)","author":"Hu","year":"2019"},{"key":"B45","doi-asserted-by":"publisher","first-page":"2200240","DOI":"10.1002\/aisy.202200240","article-title":"A deep learning system to predict recurrence and disability outcomes in patients with transient ischemic attack or ischemic stroke","volume":"5","author":"Jing","year":"2023","journal-title":"Adv. Intell. Syst."},{"key":"B47","doi-asserted-by":"publisher","first-page":"647","DOI":"10.4155\/fmc.11.23","article-title":"Trade-off between accuracy and interpretability for predictive in silico modeling","volume":"3","author":"Johansson","year":"2011","journal-title":"Future Med. Chem."},{"key":"B48","doi-asserted-by":"publisher","DOI":"10.55054\/ajpp.v3i01.630","article-title":"Artificial intelligence accelerated transformation in the healthcare industry","volume":"3","author":"Kaushik","year":"2023","journal-title":"Amity J. Prof. Pract."},{"key":"B49","doi-asserted-by":"publisher","first-page":"355","DOI":"10.1016\/j.bj.2020.05.001","article-title":"Artificial intelligence approach fighting COVID-19 with repurposing drugs","volume":"43","author":"Ke","year":"2020","journal-title":"Biomed. J."},{"key":"B50","doi-asserted-by":"publisher","first-page":"100142","DOI":"10.1016\/j.cmpbup.2024.100142","article-title":"Advancing clinical decision support: the role of artificial intelligence across six domains","volume":"5","author":"Khalifa","year":"2024","journal-title":"Comput. Methods Programs Biomed. Update"},{"key":"B51","doi-asserted-by":"publisher","first-page":"23","DOI":"10.1038\/s41746-020-0232-8","article-title":"Impact of a deep learning assistant on the histopathologic classification of liver cancer","volume":"3","author":"Kiani","year":"2020","journal-title":"NPJ Digit. Med."},{"key":"B52","doi-asserted-by":"publisher","DOI":"10.48550\/ARXIV.1711.11279","article-title":"Interpretability beyond feature attribution: quantitative testing with concept activation vectors (TCAV)","author":"Kim","year":"2017"},{"key":"B53","doi-asserted-by":"crossref","first-page":"4149","DOI":"10.1109\/ICCVW.2019.00510","article-title":"Why are saliency maps noisy? Cause of and solution to noisy saliency maps","volume-title":"2019 IEEE\/CVF international conference on computer vision workshop (ICCVW)","author":"Kim","year":"2019"},{"key":"B54","doi-asserted-by":"publisher","first-page":"8504","DOI":"10.1038\/s41598-024-59014-6","article-title":"Clinical feasibility of deep learning-based synthetic CT images from T2-weighted MR images for cervical cancer patients compared to MRCAT","volume":"14","author":"Kim","year":"2024","journal-title":"Sci. Rep."},{"key":"B55","unstructured":"\u201cCOGNEX\u201d, Overview of interpretable machine learning: (2) main interpretation methods of deep learning models in image recognition problems, 21 February\n          \n          \n            \n              Kim\n              K.\n            \n          \n          \n          2023"},{"key":"B56","doi-asserted-by":"publisher","first-page":"103","DOI":"10.1038\/s41746-024-01102-y","article-title":"Levels of autonomy in FDA-cleared surgical robots: a systematic review","volume":"7","author":"Lee","year":"2024","journal-title":"npj Digit. Med."},{"key":"B57","doi-asserted-by":"publisher","first-page":"70","DOI":"10.1016\/j.knosys.2018.04.006","article-title":"Sentiment classification with word localization based on weakly supervised learning with a convolutional neural network","volume":"152","author":"Lee","year":"2018","journal-title":"Knowledge-Based Syst."},{"key":"B58","doi-asserted-by":"publisher","first-page":"21","DOI":"10.1007\/978-3-030-33850-3_3","article-title":"Generation of multimodal justification using visual word constraint model for explainable computer-aided diagnosis","author":"Lee","year":"2019","journal-title":"CoRR"},{"key":"B59","unstructured":"New algorithm SISE of \u201cexplainable artificial intelligence\u201d (XAI), Naver\n          \n          \n          2021"},{"key":"B60","doi-asserted-by":"publisher","first-page":"117238","DOI":"10.1016\/j.apenergy.2021.117238","article-title":"Attention-based interpretable neural network for building cooling load prediction","volume":"299","author":"Li","year":"2021","journal-title":"Appl. Energy"},{"key":"B61","doi-asserted-by":"publisher","first-page":"18","DOI":"10.3390\/e23010018","article-title":"Explainable ai: a review of machine learning interpretability methods","volume":"23","author":"Linardatos","year":"2020","journal-title":"Entropy"},{"key":"B62","article-title":"Entropy [preprint]","author":"Linardatos","year":"2021"},{"key":"B63","doi-asserted-by":"publisher","first-page":"11591","DOI":"10.1073\/pnas.1806905115","article-title":"Deep neural network improves fracture detection by clinicians","volume":"115","author":"Lindsey","year":"2018","journal-title":"Proc. Natl. Acad. Sci. U. S. A."},{"key":"B64","doi-asserted-by":"publisher","first-page":"671","DOI":"10.1109\/taffc.2023.3288885","article-title":"Fine-grained interpretability for EEG emotion recognition: concat-aided grad-CAM and systematic brain functional network","volume":"15","author":"Liu","year":"2023","journal-title":"IEEE Trans. Affect. Comput."},{"key":"B65","doi-asserted-by":"publisher","first-page":"637","DOI":"10.1007\/s10278-021-00457-y","article-title":"Rapid assessment of acute ischemic stroke by computed tomography using deep convolutional neural networks","volume":"34","author":"Lo","year":"2021","journal-title":"J. Digit. Imaging"},{"key":"B120","doi-asserted-by":"crossref","first-page":"619629","DOI":"10.3389\/fpsyt.2020.619629","article-title":"Brain age prediction with morphological features using deep neural networks: Results from predictive analytic competition 2019","volume":"11","author":"Lombardi","year":"2021","journal-title":"Front. Psychiatry."},{"key":"B66","doi-asserted-by":"publisher","first-page":"102301","DOI":"10.1016\/j.inffus.2024.102301","article-title":"Explainable Artificial Intelligence (XAI) 2.0: a manifesto of open challenges and interdisciplinary research directions","volume":"106","author":"Longo","year":"2024","journal-title":"Inf. Fusion"},{"key":"B67","doi-asserted-by":"publisher","first-page":"244","DOI":"10.1038\/s41591-020-01174-9","article-title":"Robust breast cancer detection in mammography and digital breast tomosynthesis using an annotation-efficient deep learning approach","volume":"27","author":"Lotter","year":"2021","journal-title":"Nat. Med."},{"key":"B68","doi-asserted-by":"publisher","first-page":"117","DOI":"10.1016\/j.jbi.2018.01.005","article-title":"Computer-assisted decision support system in pulmonary cancer detection and stage classification on CT images","volume":"79","author":"Masood","year":"2018","journal-title":"J. Biomed. Inf."},{"key":"B69","doi-asserted-by":"publisher","first-page":"114","DOI":"10.1038\/s41746-024-01106-8","article-title":"Artificial intelligence in digital pathology: a systematic review and meta-analysis of diagnostic test accuracy","volume":"7","author":"McGenity","year":"2024","journal-title":"npj Digit. Med."},{"key":"B70","doi-asserted-by":"publisher","first-page":"2303","DOI":"10.3390\/jcm12062303","article-title":"Transoral robotic surgery for head and neck cancer: advances and residual knowledge gaps","volume":"12","author":"Mella","year":"2023","journal-title":"J. Clin. Med."},{"key":"B117","first-page":"1","article-title":"Sampling permutations for shapley value estimation","volume":"23","author":"Mitchell","year":"2022","journal-title":"J. Mach. Learn. Res."},{"key":"B71","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1371\/journal.pone.0262349","article-title":"Deep learning model for fully automated breast cancer detection system from thermograms","volume":"17","author":"Mohamed","year":"2022","journal-title":"PLOS ONE"},{"key":"B72","doi-asserted-by":"publisher","first-page":"113941","DOI":"10.1016\/j.eswa.2020.113941","article-title":"Post-hoc explanation of black-box classifiers using confident itemsets","volume":"165","author":"Moradi","year":"2021","journal-title":"Expert Syst. Appl."},{"key":"B73","doi-asserted-by":"publisher","first-page":"470","DOI":"10.1016\/j.brachy.2020.03.004","article-title":"Conventional vs machine learning-based treatment planning in prostate brachytherapy: results of a Phase I randomized controlled trial","volume":"19","author":"Nicolae","year":"2020","journal-title":"Brachytherapy"},{"key":"B74","doi-asserted-by":"publisher","first-page":"73","DOI":"10.1109\/msp.2022.3142719","article-title":"Robust explainability: a tutorial on gradient-based attribution methods for deep neural networks","volume":"39","author":"Nielsen","year":"2022","journal-title":"IEEE Signal Process. Mag."},{"key":"B75","doi-asserted-by":"publisher","first-page":"867","DOI":"10.5351\/kjas.2014.27.6.867","article-title":"Nonparametric bayesian statistical models in biomedical research","volume":"27","author":"Noh","year":"2014","journal-title":"Korean J. Appl. Statistics"},{"key":"B76","doi-asserted-by":"crossref","unstructured":"Artificial intelligence assisted diagnosis\n          \n          \n          2022","DOI":"10.1155\/2022\/3972298"},{"key":"B77","doi-asserted-by":"publisher","first-page":"e0217647","DOI":"10.1371\/journal.pone.0217647","article-title":"A novel YOLOv3-arch model for identifying cholelithiasis and classifying gallstones on CT images","volume":"14","author":"Pang","year":"2019","journal-title":"PLoS one"},{"key":"B78","doi-asserted-by":"publisher","first-page":"293","DOI":"10.1080\/17579961.2024.2313795","article-title":"Unlocking the black box: analysing the EU artificial intelligence act\u2019s framework for explainability in AI","volume":"16","author":"Pavlidis","year":"2024","journal-title":"Law, Innovation Technol."},{"key":"B79","article-title":"Model agnostic supervised local explanations","volume-title":"Advances in neural information processing systems","author":"Plumb","year":"2018"},{"key":"B80","doi-asserted-by":"publisher","first-page":"e24572","DOI":"10.2196\/24572","article-title":"Development and validation of a machine learning approach for automated severity assessment of COVID-19 based on clinical and imaging data: retrospective study","volume":"9","author":"Quiroz","year":"2021","journal-title":"JMIR Med. Inf."},{"key":"B81","doi-asserted-by":"publisher","first-page":"2103","DOI":"10.1093\/cid\/ciaa383","article-title":"A real-world evaluation of a case-based reasoning algorithm to support antimicrobial prescribing decisions in acute care","volume":"72","author":"Rawson","year":"2021","journal-title":"Clin. Infect. Dis."},{"key":"B122","doi-asserted-by":"publisher","first-page":"e50415","DOI":"10.7759\/cureus.50415","article-title":"Advancements in robotic surgery: a comprehensive overview of current utilizations and upcoming frontiers","volume":"15","author":"Reddy","year":"2023","journal-title":"Cureus."},{"key":"B82","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v32i1.11491","article-title":"Anchors: high-precision model-agnostic explanations","volume":"32","author":"Ribeiro","year":"2018","journal-title":"Proc. AAAI Conf. Artif. Intell."},{"key":"B83","doi-asserted-by":"publisher","first-page":"109370","DOI":"10.1016\/j.compeleceng.2024.109370","article-title":"A review of explainable artificial intelligence in healthcare","volume":"118","author":"Sadeghi","year":"2024","journal-title":"Comput. Electr. Eng."},{"key":"B84","doi-asserted-by":"publisher","first-page":"110273","DOI":"10.1016\/j.knosys.2023.110273","article-title":"Explainable AI (XAI): a systematic meta-survey of current challenges and future opportunities","volume":"263","author":"Saeed","year":"2023","journal-title":"Knowledge-Based Syst."},{"key":"B85","doi-asserted-by":"publisher","first-page":"100106","DOI":"10.1016\/j.cmpbup.2023.100106","article-title":"Machine and deep learning identified metabolites and clinical features associated with gallstone disease","volume":"3","author":"Salem","year":"2023","journal-title":"Comput. Methods Programs Biomed. Update"},{"key":"B86","unstructured":"Understanding machine learning interpretability\n          \n          \n            \n              Salih\n              S.\n            \n          \n          \n          2022"},{"key":"B87","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1080\/0960085X.2024.2330402","article-title":"Design principles for artificial intelligence-augmented decision making: an action design research study","author":"Savindu Herath Pathirannehelage","year":"2024","journal-title":"Eur. J. Inf. Syst."},{"key":"B88","doi-asserted-by":"crossref","first-page":"348","DOI":"10.1109\/ACIT49673.2020.9208950","article-title":"A light-weight method to foster the (Grad) CAM interpretability and explainability of classification networks","volume-title":"2020 10th international conference on advanced computer information technologies (ACIT)","author":"Sch\u00f6ttl","year":"2020"},{"key":"B89","first-page":"618","article-title":"Grad-cam: visual explanations from deep networks via gradient-based localization","author":"Selvaraju","year":"2017"},{"key":"B91","doi-asserted-by":"publisher","first-page":"213","DOI":"10.5114\/wiitm.2022.124088","article-title":"Minimizing blood loss and transfusion rate in laparoscopic liver surgery: a review","volume":"18","author":"Serednicki","year":"2023","journal-title":"Wideochir. Inne. Tech. Maloinwazyjne"},{"key":"B92","first-page":"307","article-title":"17. A value for n-person games","volume-title":"Contributions to the theory of games (AM-28)","author":"Shapley","year":"2016"},{"key":"B93","article-title":"An extension of LIME with improvement of interpretability and fidelity","author":"Shi","year":"2020"},{"key":"B94","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1155\/2021\/5513679","article-title":"Artificial neural network-based deep learning model for COVID-19 patient detection using X-ray chest images","volume":"2021","author":"Shorfuzzaman","year":"2021","journal-title":"J. Healthc. Eng."},{"key":"B95","doi-asserted-by":"publisher","first-page":"52","DOI":"10.3390\/jimaging6060052","article-title":"Explainable deep learning models in medical image analysis","volume":"6","author":"Singh","year":"2020","journal-title":"arXiv"},{"key":"B96","doi-asserted-by":"publisher","first-page":"938","DOI":"10.1038\/s43018-024-00756-7","article-title":"PERCEPTION predicts patient response and resistance to treatment using single-cell transcriptomics of their tumors","volume":"5","author":"Sinha","year":"2024","journal-title":"Nat. Cancer"},{"key":"B97","doi-asserted-by":"publisher","first-page":"537","DOI":"10.3390\/diagnostics12020537","article-title":"Knee injury detection using deep learning on MRI studies: a systematic review","volume":"12","author":"Siouras","year":"2022","journal-title":"Diagn. (Basel, Switzerland)"},{"key":"B99","doi-asserted-by":"crossref","first-page":"507","DOI":"10.1117\/12.2557314","article-title":"Explainable 3D convolutional neural network using GMM encoding","volume-title":"Twelfth international conference on machine vision (ICMV 2019)","author":"Stano","year":"2020"},{"key":"B100","doi-asserted-by":"publisher","first-page":"136","DOI":"10.3390\/robotics12050136","article-title":"Hand prosthesis sensorimotor control inspired by the human somatosensory system","volume":"12","author":"Stefanelli","year":"2023","journal-title":"Robotics"},{"key":"B101","doi-asserted-by":"publisher","DOI":"10.1177\/20539517231224247","article-title":"A feeling for the algorithm: diversity, expertise, and artificial intelligence","volume":"11","author":"Stinson","year":"2024","journal-title":"Big Data & Soc."},{"key":"B102","doi-asserted-by":"publisher","first-page":"21","DOI":"10.1007\/978-3-642-20267-4_3","article-title":"A general method for visualizing and explaining black-box regression models","author":"Strumbelj","year":"2011"},{"key":"B103","doi-asserted-by":"publisher","first-page":"1150933","DOI":"10.3389\/fmed.2023.1150933","article-title":"Cardiovascular diseases prediction by machine learning incorporation with deep learning","volume":"10","author":"Subramani","year":"2023","journal-title":"Front. Med."},{"key":"B104","article-title":"[Interpretable machine learning (5-8)] scope rule (anchor)","author":"T","year":"2020","journal-title":"Tistory"},{"key":"B106","first-page":"13943","article-title":"Towards interpretable semantic segmentation via gradient-weighted class activation mapping (student abstract)","author":"Vinogradova","year":"2020"},{"key":"B107","doi-asserted-by":"publisher","first-page":"343","DOI":"10.1016\/S2468-1253(19)30411-X","article-title":"Effect of a deep-learning computer-aided detection system on adenoma detection during colonoscopy (CADe-DB trial): a double-blind randomised study","volume":"5","author":"Wang","year":"2020","journal-title":"Lancet Gastroenterol. Hepatol"},{"key":"B108","doi-asserted-by":"publisher","first-page":"95","DOI":"10.1007\/s13246-017-0613-8","article-title":"Application of image recognition-based automatic hyphae detection in fungal keratitis","volume":"41","author":"Wu","year":"2018","journal-title":"Australas. Phys. Eng. Sci. Med."},{"key":"B109","doi-asserted-by":"publisher","first-page":"89","DOI":"10.16016\/j.1000-5404.202112092","article-title":"Research progress and prospect of artificial intelligence in the clinical field","volume":"44","author":"Wu Yazhou","year":"2022","journal-title":"J. Army Med. Univ."},{"key":"B110","doi-asserted-by":"publisher","first-page":"741098","DOI":"10.3389\/fped.2021.741098","article-title":"Preliminary experiences with robot-assisted choledochal cyst excision using the da vinci surgical system in children below the age of one","volume":"23","author":"Xie","year":"2021","journal-title":"Front. Pediatr."},{"key":"B111","doi-asserted-by":"publisher","first-page":"161","DOI":"10.1007\/s44230-023-00038-y","article-title":"Survey on explainable AI: from approaches, limitations and applications aspects","volume":"3","author":"Yang","year":"2023","journal-title":"Human-Centric Intell. Syst."},{"key":"B112","doi-asserted-by":"publisher","first-page":"665","DOI":"10.3348\/kjr.2018.19.4.665","article-title":"Computer-aided diagnosis of thyroid nodules via ultrasonography: initial clinical experience","volume":"19","author":"Yoo","year":"2018","journal-title":"Korean J. Radiol."},{"key":"B113","doi-asserted-by":"publisher","first-page":"337","DOI":"10.1038\/s41416-021-01394-x","article-title":"A deep convolutional neural network for segmentation of whole-slide pathology images identifies novel tumour cell-perivascular niche interactions that are associated with poor survival in glioblastoma","volume":"125","author":"Zadeh Shirazi","year":"2021","journal-title":"Br. J. Cancer"},{"key":"B114","doi-asserted-by":"publisher","first-page":"7","DOI":"10.1186\/s12911-023-02103-9","article-title":"Ethics and governance of trustworthy medical artificial intelligence","volume":"23","author":"Zhang","year":"2023","journal-title":"BMC Med. Inf. Decis. Mak."},{"key":"B115","doi-asserted-by":"publisher","first-page":"2126","DOI":"10.1038\/s41598-024-51765-6","article-title":"GlioPredictor: a deep learning model for identification of high-risk adult IDH-mutant glioma towards adjuvant treatment planning","volume":"14","author":"Zheng","year":"2024","journal-title":"Sci. Rep."},{"key":"B116","unstructured":"Development and application of software testing under artificial intelligence, 21ks\n          \n          \n            \n              Zhongqi\n              H.\n            \n            \n              Jia\n              Z. C.\n            \n          \n          \n          2022"}],"container-title":["Frontiers in Robotics and AI"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/frobt.2024.1444763\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,11,29]],"date-time":"2024-11-29T07:27:28Z","timestamp":1732865248000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/frobt.2024.1444763\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,11,28]]},"references-count":114,"alternative-id":["10.3389\/frobt.2024.1444763"],"URL":"https:\/\/doi.org\/10.3389\/frobt.2024.1444763","relation":{},"ISSN":["2296-9144"],"issn-type":[{"value":"2296-9144","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,11,28]]},"article-number":"1444763"}}