{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,22]],"date-time":"2026-07-22T16:07:42Z","timestamp":1784736462273,"version":"3.55.0"},"reference-count":68,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2025,7,25]],"date-time":"2025-07-25T00:00:00Z","timestamp":1753401600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2025,7,25]],"date-time":"2025-07-25T00:00:00Z","timestamp":1753401600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Prog Artif Intell"],"published-print":{"date-parts":[[2026,3]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>Nonalcoholic steatohepatitis (NASH) is a common disease that ultimately can lead to the development of end-stage liver disease, cirrhosis, or hepatocellular carcinoma. An early prediction of NASH provides an opportunity to make an appropriate strategy for prevention, early diagnosis, and treatment. The most accurate approach for NASH diagnostics is a liver biopsy, which can lead to various complications for the patient. Many papers have studied non-invasive machine learning (ML)-driven approaches to early non-invasive NASH prediction; however, to the best of our knowledge, none of the works considered the problem of explainability of the trained ML models to the medical experts. In this work, we address this issue. We use the National Institute of Diabetes and Digestive and Kidney Diseases (NIDDK) nonalcoholic fatty liver disease adult database to train different ML models and propose the technique to explain their predictions. We compare the explanations obtained from a transparent model (Decision Tree) and a non-transparent model (Random Forest). Furthermore, we analyze the quality of explanation prediction by objective means and with a user study involving 11 medical practitioners. Our findings show that there is no significant difference in the perception of explanation obtained from transparent and non-transparent models, and that the explanation of the models\u2019 predictions slightly increases their usability and trustworthiness for real practitioners, enhancing their practical adoption in clinical settings.<\/jats:p>","DOI":"10.1007\/s13748-025-00387-8","type":"journal-article","created":{"date-parts":[[2025,7,25]],"date-time":"2025-07-25T10:05:47Z","timestamp":1753437947000},"page":"35-56","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["On the role of explanations in machine learning prediction of nonalcoholic steatohepatitis"],"prefix":"10.1007","volume":"15","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-2568-6702","authenticated-orcid":false,"given":"Nikolay","family":"Babakov","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Elena","family":"Rezgova","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7548-9504","authenticated-orcid":false,"given":"Ehud","family":"Reiter","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3574-3843","authenticated-orcid":false,"given":"Alberto","family":"Bugar\u00edn-Diz","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2025,7,25]]},"reference":[{"issue":"1","key":"387_CR1","doi-asserted-by":"publisher","first-page":"73","DOI":"10.1002\/hep.28431","volume":"64","author":"ZM Younossi","year":"2016","unstructured":"Younossi, Z.M., Koenig, A.B., Abdelatif, D., Fazel, Y., Henry, L., Wymer, M.: Global epidemiology of nonalcoholic fatty liver disease-meta-analytic assessment of prevalence, incidence, and outcomes. Hepatology 64(1), 73\u201384 (2016)","journal-title":"Hepatology"},{"issue":"4","key":"387_CR2","doi-asserted-by":"publisher","first-page":"421","DOI":"10.1097\/01.mol.0000174153.53683.f2","volume":"16","author":"G Marchesini","year":"2005","unstructured":"Marchesini, G., Marzocchi, R., Agostini, F., Bugianesi, E.: Nonalcoholic fatty liver disease and the metabolic syndrome. Curr. Opin. Lipidol. 16(4), 421\u2013427 (2005)","journal-title":"Curr. Opin. Lipidol."},{"issue":"2","key":"387_CR3","doi-asserted-by":"publisher","first-page":"372","DOI":"10.1016\/j.jhep.2010.04.008","volume":"53","author":"V Ratziu","year":"2010","unstructured":"Ratziu, V., Bellentani, S., Cortez-Pinto, H., Day, C., Marchesini, G.: A position statement on NAFLD\/NASH based on the EASL 2009 special conference. J. Hepatol. 53(2), 372\u2013384 (2010)","journal-title":"J. Hepatol."},{"issue":"8","key":"387_CR4","doi-asserted-by":"publisher","first-page":"845","DOI":"10.3390\/cells8080845","volume":"8","author":"HK Drescher","year":"2019","unstructured":"Drescher, H.K., Weiskirchen, S., Weiskirchen, R.: Current status in testing for nonalcoholic fatty liver disease (NAFLD) and nonalcoholic steatohepatitis (nash). Cells 8(8), 845 (2019)","journal-title":"Cells"},{"issue":"9615","key":"387_CR5","doi-asserted-by":"publisher","first-page":"838","DOI":"10.1016\/S0140-6736(08)60383-9","volume":"371","author":"D Schuppan","year":"2008","unstructured":"Schuppan, D., Afdhal, N.H.: Liver cirrhosis. The Lancet 371(9615), 838\u2013851 (2008)","journal-title":"The Lancet"},{"issue":"6","key":"387_CR6","doi-asserted-by":"publisher","first-page":"2005","DOI":"10.1002\/hep.25762","volume":"55","author":"N Chalasani","year":"2012","unstructured":"Chalasani, N., Younossi, Z., Lavine, J.E., Diehl, A.M., Brunt, E.M., Cusi, K., Charlton, M., Sanyal, A.J.: The diagnosis and management of non-alcoholic fatty liver disease: practice guideline by the american association for the study of liver diseases, american college of gastroenterology, and the american gastroenterological association. Hepatology 55(6), 2005\u20132023 (2012)","journal-title":"Hepatology"},{"key":"387_CR7","doi-asserted-by":"publisher","DOI":"10.1016\/j.metabol.2020.154320","volume":"111","author":"N Perakakis","year":"2020","unstructured":"Perakakis, N., Stefanakis, K., Mantzoros, C.S.: The role of omics in the pathophysiology, diagnosis and treatment of non-alcoholic fatty liver disease. Metabolism 111, 154320 (2020)","journal-title":"Metabolism"},{"key":"387_CR8","doi-asserted-by":"crossref","unstructured":"Yang, Y., Liu, J., Sun, C., Shi, Y., Hsing, J.C., Kamya, A., Keller, C.A., Antil, N., Rubin, D., Wang, H., et al.: Nonalcoholic fatty liver disease (NAFLD) detection and deep learning in a chinese community-based population. European Radiology, 1\u201313 (2023)","DOI":"10.1007\/s00330-023-09515-1"},{"issue":"1","key":"387_CR9","doi-asserted-by":"publisher","first-page":"73","DOI":"10.31661\/jbpe.v0i0.2009-1180","volume":"11","author":"H Zamanian","year":"2021","unstructured":"Zamanian, H., Mostaar, A., Azadeh, P., Ahmadi, M.: Implementation of combinational deep learning algorithm for non-alcoholic fatty liver classification in ultrasound images. Journal of Biomedical Physics & Engineering 11(1), 73 (2021)","journal-title":"Journal of Biomedical Physics & Engineering"},{"key":"387_CR10","doi-asserted-by":"crossref","unstructured":"Pushpa, B., Baskaran, B., Vivekanandan, S., Gokul, P.: Liver fat analysis using optimized support vector machine with support vector regression. Technology and Health Care (Preprint), 1\u201320 (2023)","DOI":"10.3233\/THC-220254"},{"issue":"6","key":"387_CR11","doi-asserted-by":"publisher","first-page":"1235","DOI":"10.1093\/jamia\/ocab003","volume":"28","author":"M Docherty","year":"2021","unstructured":"Docherty, M., Regnier, S.A., Capkun, G., Balp, M.-M., Ye, Q., Janssens, N., Tietz, A., L\u00f6ffler, J., Cai, J., Pedrosa, M.C., Schattenberg, J.M.: Development of a novel machine learning model to predict presence of nonalcoholic steatohepatitis. J. Am. Med. Inform. Assoc. 28(6), 1235\u20131241 (2021). https:\/\/doi.org\/10.1093\/jamia\/ocab003","journal-title":"J. Am. Med. Inform. Assoc."},{"key":"387_CR12","doi-asserted-by":"publisher","DOI":"10.1016\/j.metabol.2019.154005","volume":"101","author":"N Perakakis","year":"2019","unstructured":"Perakakis, N., Polyzos, S.A., Yazdani, A., Sala-Vila, A., Kountouras, J., Anastasilakis, A.D., Mantzoros, C.S.: Non-invasive diagnosis of non-alcoholic steatohepatitis and fibrosis with the use of omics and supervised learning: a proof of concept study. Metabolism 101, 154005 (2019)","journal-title":"Metabolism"},{"key":"387_CR13","doi-asserted-by":"crossref","unstructured":"Ma, H., Xu, C.-f., Shen, Z., Yu, C.-h., Li, Y.-m.: Application of machine learning techniques for clinical predictive modeling: a cross-sectional study on nonalcoholic fatty liver disease in china. BioMed research international 2018 (2018)","DOI":"10.1155\/2018\/4304376"},{"issue":"1","key":"387_CR14","doi-asserted-by":"publisher","first-page":"20240","DOI":"10.1038\/s41598-021-99400-y","volume":"11","author":"P Sorino","year":"2021","unstructured":"Sorino, P., Campanella, A., Bonfiglio, C., Mirizzi, A., Franco, I., Bianco, A., Caruso, M.G., Misciagna, G., Aballay, L.R., Buongiorno, C.: Development and validation of a neural network for NAFLD diagnosis. Sci. Rep. 11(1), 20240 (2021)","journal-title":"Sci. Rep."},{"issue":"7","key":"387_CR15","doi-asserted-by":"publisher","first-page":"593","DOI":"10.1002\/jhbp.972","volume":"28","author":"G Feng","year":"2021","unstructured":"Feng, G., Zheng, K.I., Li, Y.-Y., Rios, R.S., Zhu, P.-W., Pan, X.-Y., Li, G., Ma, H.-L., Tang, L.-J., Byrne, C.D.: Machine learning algorithm outperforms fibrosis markers in predicting significant fibrosis in biopsy-confirmed NAFLD. J. Hepatobiliary Pancreat. Sci. 28(7), 593\u2013603 (2021)","journal-title":"J. Hepatobiliary Pancreat. Sci."},{"key":"387_CR16","doi-asserted-by":"crossref","unstructured":"Deo, R., Panigrahi, S.: Explainability analysis of black box svm models for hepatic steatosis screening. In: 2022 IEEE Healthcare Innovations and Point of Care Technologies (HI-POCT), pp. 22\u201325 (2022). IEEE","DOI":"10.1109\/HI-POCT54491.2022.9744067"},{"key":"387_CR17","unstructured":"Fialoke, S., Malarstig, A., Miller, M.R., Dumitriu, A.: Application of machine learning methods to predict non-alcoholic steatohepatitis (nash) in non-alcoholic fatty liver (nafl) patients. In: AMIA Annual Symposium Proceedings, vol. 2018, p. 430 (2018). American Medical Informatics Association"},{"issue":"3","key":"387_CR18","doi-asserted-by":"publisher","first-page":"0214436","DOI":"10.1371\/journal.pone.0214436","volume":"14","author":"A Canbay","year":"2019","unstructured":"Canbay, A., K\u00e4lsch, J., Neumann, U., Rau, M., Hohenester, S., Baba, H.A., Rust, C., Geier, A., Heider, D., Sowa, J.-P.: Non-invasive assessment of NAFLD as systemic disease-a machine learning perspective. PLoS ONE 14(3), 0214436 (2019)","journal-title":"PLoS ONE"},{"key":"387_CR19","doi-asserted-by":"publisher","first-page":"23","DOI":"10.1016\/j.cmpb.2018.12.032","volume":"170","author":"C-C Wu","year":"2019","unstructured":"Wu, C.-C., Yeh, W.-C., Hsu, W.-D., Islam, M.M., Nguyen, P.A.A., Poly, T.N., Wang, Y.-C., Yang, H.-C., Li, Y.-C.J.: Prediction of fatty liver disease using machine learning algorithms. Comput. Methods Programs Biomed. 170, 23\u201329 (2019)","journal-title":"Comput. Methods Programs Biomed."},{"issue":"1","key":"387_CR20","doi-asserted-by":"publisher","first-page":"8589","DOI":"10.1038\/s41598-024-59183-4","volume":"14","author":"B Njei","year":"2024","unstructured":"Njei, B., Osta, E., Njei, N., Al-Ajlouni, Y.A., Lim, J.K.: An explainable machine learning model for prediction of high-risk nonalcoholic steatohepatitis. Sci. Rep. 14(1), 8589 (2024)","journal-title":"Sci. Rep."},{"issue":"3","key":"387_CR21","doi-asserted-by":"publisher","first-page":"196","DOI":"10.1002\/jgh3.12716","volume":"6","author":"S Ghandian","year":"2022","unstructured":"Ghandian, S., Thapa, R., Garikipati, A., Barnes, G., Green-Saxena, A., Calvert, J., Mao, Q., Das, R.: Machine learning to predict progression of non-alcoholic fatty liver to non-alcoholic steatohepatitis or fibrosis. JGH Open 6(3), 196\u2013204 (2022)","journal-title":"JGH Open"},{"issue":"7","key":"387_CR22","doi-asserted-by":"publisher","first-page":"1173","DOI":"10.1093\/jamia\/ocaa053","volume":"27","author":"SN Payrovnaziri","year":"2020","unstructured":"Payrovnaziri, S.N., Chen, Z., Rengifo-Moreno, P., Miller, T., Bian, J., Chen, J.H., Liu, X., He, Z.: Explainable artificial intelligence models using real-world electronic health record data: a systematic scoping review. J. Am. Med. Inform. Assoc. 27(7), 1173\u20131185 (2020). https:\/\/doi.org\/10.1093\/jamia\/ocaa053","journal-title":"J. Am. Med. Inform. Assoc."},{"key":"387_CR23","doi-asserted-by":"publisher","DOI":"10.1016\/j.artmed.2021.102079","volume":"116","author":"E Kyrimi","year":"2021","unstructured":"Kyrimi, E., Dube, K., Fenton, N., Fahmi, A., Neves, M.R., Marsh, W., McLachlan, S.: Bayesian networks in healthcare: What is preventing their adoption? Artif. Intell. Med. 116, 102079 (2021). https:\/\/doi.org\/10.1016\/j.artmed.2021.102079","journal-title":"Artif. Intell. Med."},{"key":"387_CR24","doi-asserted-by":"crossref","unstructured":"Salih, A., Galazzo, I.B., Gkontra, P., Rauseo, E., Lee, A.M., Lekadir, K., Radeva, P., Petersen, S., Menegaz, G.: A review of evaluation approaches for explainable ai with applications in cardiology. Authorea Preprints (2023)","DOI":"10.36227\/techrxiv.24573304.v1"},{"issue":"13s","key":"387_CR25","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3583558","volume":"55","author":"M Nauta","year":"2023","unstructured":"Nauta, M., Trienes, J., Pathak, S., Nguyen, E., Peters, M., Schmitt, Y., Schl\u00f6tterer, J., Keulen, M., Seifert, C.: From anecdotal evidence to quantitative evaluation methods: A systematic review on evaluating explainable ai. ACM Comput. Surv. 55(13s), 1\u201342 (2023)","journal-title":"ACM Comput. Surv."},{"key":"387_CR26","doi-asserted-by":"publisher","unstructured":"Quinn, T.P., Jacobs, S., Senadeera, M., Le, V., Coghlan, S.: The three ghosts of medical ai: Can the black-box present deliver? Artificial Intelligence in Medicine 124, 102158 (2022) https:\/\/doi.org\/10.1016\/j.artmed.2021.102158","DOI":"10.1016\/j.artmed.2021.102158"},{"key":"387_CR27","doi-asserted-by":"crossref","unstructured":"Loh, H.W., Ooi, C.P., Seoni, S., Barua, P.D., Molinari, F., Acharya, U.R.: Application of explainable artificial intelligence for healthcare: A systematic review of the last decade (2011\u20132022). Computer Methods and Programs in Biomedicine, 107161 (2022)","DOI":"10.1016\/j.cmpb.2022.107161"},{"issue":"2","key":"387_CR28","doi-asserted-by":"publisher","first-page":"141","DOI":"10.1197\/jamia.M2334","volume":"14","author":"JA Osheroff","year":"2007","unstructured":"Osheroff, J.A., Teich, J.M., Middleton, B., Steen, E.B., Wright, A., Detmer, D.E.: A roadmap for national action on clinical decision support. J. Am. Med. Inform. Assoc. 14(2), 141\u2013145 (2007)","journal-title":"J. Am. Med. Inform. Assoc."},{"issue":"2","key":"387_CR29","doi-asserted-by":"publisher","first-page":"8912","DOI":"10.2196\/medinform.8912","volume":"6","author":"S Khairat","year":"2018","unstructured":"Khairat, S., Marc, D., Crosby, W., Al Sanousi, A.: Reasons for physicians not adopting clinical decision support systems: critical analysis. JMIR Med. Inform. 6(2), 8912 (2018)","journal-title":"JMIR Med. Inform."},{"key":"387_CR30","doi-asserted-by":"crossref","unstructured":"Yang, Q., Zimmerman, J., Steinfeld, A., Carey, L., Antaki, J.F.: Investigating the heart pump implant decision process: opportunities for decision support tools to help. In: Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, pp. 4477\u20134488 (2016)","DOI":"10.1145\/2858036.2858373"},{"key":"387_CR31","unstructured":"Tonekaboni, S., Joshi, S., McCradden, M.D., Goldenberg, A.: What clinicians want: contextualizing explainable machine learning for clinical end use. In: Machine Learning for Healthcare Conference, pp. 359\u2013380 (2019). PMLR"},{"issue":"10","key":"387_CR32","doi-asserted-by":"publisher","first-page":"719","DOI":"10.1038\/s41551-018-0305-z","volume":"2","author":"K-H Yu","year":"2018","unstructured":"Yu, K.-H., Beam, A.L., Kohane, I.S.: Artificial intelligence in healthcare. Nature biomedical engineering 2(10), 719\u2013731 (2018)","journal-title":"Nature biomedical engineering"},{"key":"387_CR33","doi-asserted-by":"crossref","unstructured":"Musen, M.A., Middleton, B., Greenes, R.A.: Clinical decision-support systems. In: Biomedical Informatics: Computer Applications in Health Care and Biomedicine, pp. 795\u2013840. Springer, (2021)","DOI":"10.1007\/978-3-030-58721-5_24"},{"key":"387_CR34","unstructured":"Lundberg, S.M., Lee, S.-I.: A unified approach to interpreting model predictions. In: Proceedings of the 31st International Conference on Neural Information Processing Systems. NIPS\u201917, pp. 4768\u20134777. Curran Associates Inc., Red Hook, NY, USA (2017)"},{"key":"387_CR35","doi-asserted-by":"crossref","unstructured":"Ribeiro, M.T., Singh, S., Guestrin, C.: \" why should i trust you?\" explaining the predictions of any classifier. In: Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 1135\u20131144 (2016)","DOI":"10.1145\/2939672.2939778"},{"key":"387_CR36","doi-asserted-by":"crossref","unstructured":"Selvaraju, R.R., Cogswell, M., Das, A., Vedantam, R., Parikh, D., Batra, D.: Grad-cam: Visual explanations from deep networks via gradient-based localization. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 618\u2013626 (2017)","DOI":"10.1109\/ICCV.2017.74"},{"issue":"5","key":"387_CR37","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3236009","volume":"51","author":"R Guidotti","year":"2018","unstructured":"Guidotti, R., Monreale, A., Ruggieri, S., Turini, F., Giannotti, F., Pedreschi, D.: A survey of methods for explaining black box models. ACM computing surveys (CSUR) 51(5), 1\u201342 (2018)","journal-title":"ACM computing surveys (CSUR)"},{"issue":"1","key":"387_CR38","doi-asserted-by":"publisher","first-page":"167","DOI":"10.1038\/s41746-021-00536-y","volume":"4","author":"H Chen","year":"2021","unstructured":"Chen, H., Lundberg, S.M., Erion, G., Kim, J.H., Lee, S.-I.: Forecasting adverse surgical events using self-supervised transfer learning for physiological signals. NPJ Digital Medicine 4(1), 167 (2021)","journal-title":"NPJ Digital Medicine"},{"issue":"1","key":"387_CR39","doi-asserted-by":"publisher","first-page":"23017","DOI":"10.1038\/s41598-021-02481-y","volume":"11","author":"C Duckworth","year":"2021","unstructured":"Duckworth, C., Chmiel, F.P., Burns, D.K., Zlatev, Z.D., White, N.M., Daniels, T.W., Kiuber, M., Boniface, M.J.: Using explainable machine learning to characterise data drift and detect emergent health risks for emergency department admissions during covid-19. Sci. Rep. 11(1), 23017 (2021)","journal-title":"Sci. Rep."},{"issue":"1","key":"387_CR40","doi-asserted-by":"publisher","first-page":"17244","DOI":"10.1038\/s41598-021-96721-w","volume":"11","author":"X Zeng","year":"2021","unstructured":"Zeng, X., Hu, Y., Shu, L., Li, J., Duan, H., Shu, Q., Li, H.: Explainable machine-learning predictions for complications after pediatric congenital heart surgery. Sci. Rep. 11(1), 17244 (2021)","journal-title":"Sci. Rep."},{"issue":"1","key":"387_CR41","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/s13075-021-02567-y","volume":"23","author":"BS Koo","year":"2021","unstructured":"Koo, B.S., Eun, S., Shin, K., Yoon, H., Hong, C., Kim, D.-H., Hong, S., Kim, Y.-G., Lee, C.-K., Yoo, B.: Machine learning model for identifying important clinical features for predicting remission in patients with rheumatoid arthritis treated with biologics. Arthritis Research & Therapy 23(1), 1\u201310 (2021)","journal-title":"Arthritis Research & Therapy"},{"issue":"1","key":"387_CR42","doi-asserted-by":"publisher","first-page":"2660","DOI":"10.1038\/s41598-021-82098-3","volume":"11","author":"S El-Sappagh","year":"2021","unstructured":"El-Sappagh, S., Alonso, J.M., Islam, S.R., Sultan, A.M., Kwak, K.S.: A multilayer multimodal detection and prediction model based on explainable artificial intelligence for alzheimer\u2019s disease. Sci. Rep. 11(1), 2660 (2021)","journal-title":"Sci. Rep."},{"key":"387_CR43","unstructured":"Hoffman, R.R., Mueller, S.T., Klein, G., Litman, J.: Metrics for explainable ai: Challenges and prospects. arXiv preprint arXiv:1812.04608 (2018)"},{"key":"387_CR44","doi-asserted-by":"crossref","unstructured":"Bu\u00e7inca, Z., Lin, P., Gajos, K.Z., Glassman, E.L.: Proxy tasks and subjective measures can be misleading in evaluating explainable ai systems. In: Proceedings of the 25th International Conference on Intelligent User Interfaces, pp. 454\u2013464 (2020)","DOI":"10.1145\/3377325.3377498"},{"key":"387_CR45","doi-asserted-by":"crossref","unstructured":"Rosenfeld, A.: Better metrics for evaluating explainable artificial intelligence. In: Proceedings of the 20th International Conference on Autonomous Agents and Multiagent Systems, pp. 45\u201350 (2021)","DOI":"10.65109\/GNWD5518"},{"key":"387_CR46","doi-asserted-by":"publisher","first-page":"29","DOI":"10.1016\/j.inffus.2021.07.016","volume":"77","author":"G Yang","year":"2022","unstructured":"Yang, G., Ye, Q., Xia, J.: Unbox the black-box for the medical explainable ai via multi-modal and multi-centre data fusion: A mini-review, two showcases and beyond. Information Fusion 77, 29\u201352 (2022)","journal-title":"Information Fusion"},{"issue":"11","key":"387_CR47","doi-asserted-by":"publisher","first-page":"745","DOI":"10.1016\/S2589-7500(21)00208-9","volume":"3","author":"M Ghassemi","year":"2021","unstructured":"Ghassemi, M., Oakden-Rayner, L., Beam, A.L.: The false hope of current approaches to explainable artificial intelligence in health care. The Lancet Digital Health 3(11), 745\u2013750 (2021)","journal-title":"The Lancet Digital Health"},{"key":"387_CR48","doi-asserted-by":"publisher","first-page":"5","DOI":"10.1023\/A:1010933404324","volume":"45","author":"L Breiman","year":"2001","unstructured":"Breiman, L.: Random forests. Machine learning 45, 5\u201332 (2001)","journal-title":"Random forests. Machine learning"},{"key":"387_CR49","unstructured":"Koller, D., Friedman, N.: Probabilistic Graphical Models: Principles and Techniques. MIT press, (2009)"},{"key":"387_CR50","doi-asserted-by":"publisher","unstructured":"Chen, T., Guestrin, C.: Xgboost: A scalable tree boosting system. In: Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. KDD \u201916, pp. 785\u2013794. Association for Computing Machinery, New York, NY, USA (2016). https:\/\/doi.org\/10.1145\/2939672.2939785","DOI":"10.1145\/2939672.2939785"},{"key":"387_CR51","unstructured":"Dorogush, A.V., Ershov, V., Gulin, A.: Catboost: gradient boosting with categorical features support. arXiv preprint arXiv:1810.11363 (2018)"},{"issue":"7","key":"387_CR52","first-page":"579","volume":"8","author":"M-C Popescu","year":"2009","unstructured":"Popescu, M.-C., Balas, V.E., Perescu-Popescu, L., Mastorakis, N.: Multilayer perceptron and neural networks. WSEAS Transactions on Circuits and Systems 8(7), 579\u2013588 (2009)","journal-title":"WSEAS Transactions on Circuits and Systems"},{"key":"387_CR53","unstructured":"Izza, Y., Ignatiev, A., Marques-Silva, J.: On explaining decision trees. arXiv preprint arXiv:2010.11034 (2020)"},{"key":"387_CR54","doi-asserted-by":"crossref","unstructured":"Audemard, G., Bellart, S., Bounia, L., Koriche, F., Lagniez, J.-M., Marquis, P.: On the explanatory power of decision trees. arXiv preprint arXiv:2108.05266 (2021)","DOI":"10.1016\/j.datak.2022.102088"},{"key":"387_CR55","doi-asserted-by":"publisher","DOI":"10.1016\/j.compbiomed.2021.104335","volume":"132","author":"MA Alves","year":"2021","unstructured":"Alves, M.A., Castro, G.Z., Oliveira, B.A.S., Ferreira, L.A., Ram\u00edrez, J.A., Silva, R., Guimar\u00e3es, F.G.: Explaining machine learning based diagnosis of covid-19 from routine blood tests with decision trees and criteria graphs. Comput. Biol. Med. 132, 104335 (2021). https:\/\/doi.org\/10.1016\/j.compbiomed.2021.104335","journal-title":"Comput. Biol. Med."},{"key":"387_CR56","first-page":"30","volume":"21","author":"F Rahimibashar","year":"2022","unstructured":"Rahimibashar, F., Miller, A.C., Salesi, M., Bagheri, M., Vahedian-Azimi, A., Ashtari, S., Moghadam, K.G., Sahebkar, A.: Risk factors, time to onset and recurrence of delirium in a mixed medical-surgical icu population: A secondary analysis using cox and chaid decision tree modeling. EXCLI J. 21, 30 (2022)","journal-title":"EXCLI J."},{"key":"387_CR57","doi-asserted-by":"publisher","DOI":"10.1016\/j.cmpb.2020.105400","volume":"192","author":"MM Ghiasi","year":"2020","unstructured":"Ghiasi, M.M., Zendehboudi, S., Mohsenipour, A.A.: Decision tree-based diagnosis of coronary artery disease: Cart model. Comput. Methods Programs Biomed. 192, 105400 (2020)","journal-title":"Comput. Methods Programs Biomed."},{"key":"387_CR58","doi-asserted-by":"crossref","unstructured":"Sivaprasad, A., Reiter, E., Tintarev, N., Oren, N.: Evaluation of Human-Understandability of Global Model Explanations using Decision Tree (2023)","DOI":"10.1007\/978-3-031-50396-2_3"},{"key":"387_CR59","doi-asserted-by":"crossref","unstructured":"Maruf, S., Zukerman, I., Reiter, E., Haffari, G.: Explaining Decision-Tree predictions by addressing potential conflicts between predictions and plausible expectations. In: Belz, A., Fan, A., Reiter, E., Sripada, Y. (eds.) Proceedings of the 14th International Conference on Natural Language Generation, pp. 114\u2013127. Association for Computational Linguistics, Aberdeen, Scotland, UK (2021). https:\/\/aclanthology.org\/2021.inlg-1.12","DOI":"10.18653\/v1\/2021.inlg-1.12"},{"key":"387_CR60","unstructured":"Mariotti, E., Alonso, J.M., Gatt, A.: Towards harnessing natural language generation to explain black-box models. In: 2nd Workshop on Interactive Natural Language Technology for Explainable Artificial Intelligence, pp. 22\u201327. Association for Computational Linguistics, Dublin, Ireland (2020). https:\/\/aclanthology.org\/2020.nl4xai-1.6"},{"key":"387_CR61","doi-asserted-by":"publisher","DOI":"10.1016\/j.artmed.2020.101812","volume":"103","author":"E Kyrimi","year":"2020","unstructured":"Kyrimi, E., Mossadegh, S., Tai, N., Marsh, W.: An incremental explanation of inference in Bayesian Networks for increasing model trustworthiness and supporting clinical decision making. Artif. Intell. Med. 103, 101812 (2020)","journal-title":"Artif. Intell. Med."},{"key":"387_CR62","doi-asserted-by":"publisher","first-page":"475","DOI":"10.1016\/j.ijar.2016.09.002","volume":"80","author":"ST Timmer","year":"2017","unstructured":"Timmer, S.T., Meyer, J.-J.C., Prakken, H., Renooij, S., Verheij, B.: A two-phase method for extracting explanatory arguments from Bayesian Networks. Int. J. Approximate Reasoning 80, 475\u2013494 (2017). https:\/\/doi.org\/10.1016\/j.ijar.2016.09.002","journal-title":"Int. J. Approximate Reasoning"},{"key":"387_CR63","doi-asserted-by":"crossref","unstructured":"Kitson, N.K., Constantinou, A.C., Guo, Z., Liu, Y., Chobtham, K.: A survey of bayesian network structure learning. Artificial Intelligence Review, 1\u201394 (2023)","DOI":"10.1007\/s10462-022-10351-w"},{"key":"387_CR64","volume":"69","author":"L-V Herm","year":"2023","unstructured":"Herm, L.-V., Heinrich, K., Wanner, J., Janiesch, C.: Stop ordering machine learning algorithms by their explainability! a user-centered investigation of performance and explainability. Int. J. Inf. Manage. 69, 102538 (2023)","journal-title":"Int. J. Inf. Manage."},{"key":"387_CR65","doi-asserted-by":"crossref","unstructured":"Rosenfeld, A.: Better metrics for evaluating explainable artificial intelligence. In: Proceedings of the 20th International Conference on Autonomous Agents and MultiAgent Systems. AAMAS \u201921, pp. 45\u201350. International Foundation for Autonomous Agents and Multiagent Systems, Richland, SC (2021)","DOI":"10.65109\/GNWD5518"},{"key":"387_CR66","doi-asserted-by":"crossref","unstructured":"Crook, B., Schl\u00fcter, M., Speith, T.: Revisiting the performance-explainability trade-off in explainable artificial intelligence (xai). In: 2023 IEEE 31st International Requirements Engineering Conference Workshops (REW), pp. 316\u2013324 (2023). IEEE","DOI":"10.1109\/REW57809.2023.00060"},{"key":"387_CR67","doi-asserted-by":"publisher","unstructured":"Nanfack, G., Temple, P., Fr\u00e9nay, B.: Constraint enforcement on decision trees: A survey. ACM Comput. Surv. 54(10s) (2022) https:\/\/doi.org\/10.1145\/3506734","DOI":"10.1145\/3506734"},{"key":"387_CR68","doi-asserted-by":"crossref","unstructured":"Ankan, A., Panda, A.: pgmpy: Probabilistic graphical models using python. In: Proceedings of the 14th Python in Science Conference (SCIPY 2015) (2015). Citeseer","DOI":"10.25080\/Majora-7b98e3ed-001"}],"container-title":["Progress in Artificial Intelligence"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s13748-025-00387-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s13748-025-00387-8","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s13748-025-00387-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,2,20]],"date-time":"2026-02-20T14:07:13Z","timestamp":1771596433000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s13748-025-00387-8"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,7,25]]},"references-count":68,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2026,3]]}},"alternative-id":["387"],"URL":"https:\/\/doi.org\/10.1007\/s13748-025-00387-8","relation":{},"ISSN":["2192-6352","2192-6360"],"issn-type":[{"value":"2192-6352","type":"print"},{"value":"2192-6360","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,7,25]]},"assertion":[{"value":"8 August 2024","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"13 July 2025","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"25 July 2025","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare that they are not involved in any financial and personal relationships with other people or organizations that could inappropriately influence this work.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflicts of Interest"}}]}}