{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,8]],"date-time":"2026-07-08T16:31:51Z","timestamp":1783528311374,"version":"3.55.0"},"reference-count":96,"publisher":"Oxford University Press (OUP)","issue":"7","license":[{"start":{"date-parts":[[2020,5,17]],"date-time":"2020-05-17T00:00:00Z","timestamp":1589673600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/journals\/pages\/open_access\/funder_policies\/chorus\/standard_publication_model"}],"funder":[{"DOI":"10.13039\/100000049","name":"National Institute on Aging","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100000049","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000002","name":"National Institutes of Health","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000002","name":"NIH","doi-asserted-by":"publisher","award":["R21AG061431"],"award-info":[{"award-number":["R21AG061431"]}],"id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000054","name":"National Cancer Institute","doi-asserted-by":"publisher","award":["R01CA246418"],"award-info":[{"award-number":["R01CA246418"]}],"id":[{"id":"10.13039\/100000054","id-type":"DOI","asserted-by":"publisher"}]},{"name":"University of Florida Clinical and Translational Science Institute"},{"DOI":"10.13039\/100000002","name":"NIH","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100006108","name":"National Center for Advancing Translational Sciences","doi-asserted-by":"publisher","award":["UL1TR001427"],"award-info":[{"award-number":["UL1TR001427"]}],"id":[{"id":"10.13039\/100006108","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000002","name":"National Institutes of Health","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000002","name":"NIH","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2020,7,1]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:sec><jats:title>Objective<\/jats:title><jats:p>To conduct a systematic scoping review of explainable artificial intelligence (XAI) models that use real-world electronic health record data, categorize these techniques according to different biomedical applications, identify gaps of current studies, and suggest future research directions.<\/jats:p><\/jats:sec><jats:sec><jats:title>Materials and Methods<\/jats:title><jats:p>We searched MEDLINE, IEEE Xplore, and the Association for Computing Machinery (ACM) Digital Library to identify relevant papers published between January 1, 2009 and May 1, 2019. We summarized these studies based on the year of publication, prediction tasks, machine learning algorithm, dataset(s) used to build the models, the scope, category, and evaluation of the XAI methods. We further assessed the reproducibility of the studies in terms of the availability of data and code and discussed open issues and challenges.<\/jats:p><\/jats:sec><jats:sec><jats:title>Results<\/jats:title><jats:p>Forty-two articles were included in this review. We reported the research trend and most-studied diseases. We grouped XAI methods into 5 categories: knowledge distillation and rule extraction (N\u2009=\u200913), intrinsically interpretable models (N\u2009=\u20099), data dimensionality reduction (N\u2009=\u20098), attention mechanism (N\u2009=\u20097), and feature interaction and importance (N\u2009=\u20095).<\/jats:p><\/jats:sec><jats:sec><jats:title>Discussion<\/jats:title><jats:p>XAI evaluation is an open issue that requires\u00a0a deeper focus in the case of medical applications. We also discuss the importance of reproducibility of research work in this field, as well as the challenges and opportunities of XAI from 2 medical professionals\u2019 point of view.<\/jats:p><\/jats:sec><jats:sec><jats:title>Conclusion<\/jats:title><jats:p>Based on our review, we found that XAI evaluation in medicine has not been adequately and formally practiced. Reproducibility remains a critical concern. Ample opportunities exist to advance XAI research in medicine.<\/jats:p><\/jats:sec>","DOI":"10.1093\/jamia\/ocaa053","type":"journal-article","created":{"date-parts":[[2020,4,8]],"date-time":"2020-04-08T11:10:52Z","timestamp":1586344252000},"page":"1173-1185","source":"Crossref","is-referenced-by-count":265,"title":["Explainable artificial intelligence models using real-world electronic health\u00a0record data: a systematic scoping review"],"prefix":"10.1093","volume":"27","author":[{"given":"Seyedeh Neelufar","family":"Payrovnaziri","sequence":"first","affiliation":[{"name":"School of Information, Florida State University, Tallahassee, Florida, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zhaoyi","family":"Chen","sequence":"additional","affiliation":[{"name":"Department of Health Outcomes and Biomedical Informatics, University of Florida, Gainesville, Florida, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Pablo","family":"Rengifo-Moreno","sequence":"additional","affiliation":[{"name":"College of Medicine, Florida State University, Tallahassee, Florida, USA"},{"name":"Tallahassee Memorial Hospital, Tallahassee, Florida, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tim","family":"Miller","sequence":"additional","affiliation":[{"name":"School of Computing and Information Systems, The University of Melbourne, Melbourne, Victoria, Australia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jiang","family":"Bian","sequence":"additional","affiliation":[{"name":"Department of Health Outcomes and Biomedical Informatics, University of Florida, Gainesville, Florida, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jonathan H","family":"Chen","sequence":"additional","affiliation":[{"name":"Center for Biomedical Informatics Research, Department of Medicine, Stanford University, Stanford, California, USA"},{"name":"Division of Hospital Medicine, Department of Medicine, Stanford University, Stanford, California, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xiuwen","family":"Liu","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Florida State University, Tallahassee, Florida, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zhe","family":"He","sequence":"additional","affiliation":[{"name":"School of Information, Florida State University, Tallahassee, Florida, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"286","published-online":{"date-parts":[[2020,5,17]]},"reference":[{"issue":"23","key":"2021012411203875600_ocaa053-B1","doi-asserted-by":"crossref","first-page":"2668","DOI":"10.1016\/j.jacc.2018.03.521","article-title":"Artificial intelligence in cardiology","volume":"71","author":"Johnson","year":"2018","journal-title":"J Am Coll Cardiol"},{"issue":"21","key":"2021012411203875600_ocaa053-B2","doi-asserted-by":"crossref","first-page":"2657","DOI":"10.1016\/j.jacc.2017.03.571","article-title":"Artificial intelligence in precision cardiovascular medicine","volume":"69","author":"Krittanawong","year":"2017","journal-title":"J Am Coll Cardiol"},{"key":"2021012411203875600_ocaa053-B3","volume-title":". Artificial Intelligence:A Modern Approach","author":"Stuart","year":"2009","edition":"3rd ed."},{"key":"2021012411203875600_ocaa053-B4","doi-asserted-by":"crossref","DOI":"10.4324\/9780429052071","volume-title":"Artificial Intelligence in Medicine","author":"Szolovits","year":"2019"},{"issue":"1","key":"2021012411203875600_ocaa053-B5","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1038\/s41746-018-0029-1","article-title":"Scalable and accurate deep learning with electronic health records","volume":"1","author":"Rajkomar","year":"2018","journal-title":"NPJ Digit Med"},{"key":"2021012411203875600_ocaa053-B6","first-page":"301","author":"Choi"},{"issue":"5","key":"2021012411203875600_ocaa053-B7","doi-asserted-by":"crossref","first-page":"239","DOI":"10.1080\/23808993.2017.1380516","article-title":"The role of artificial intelligence in precision medicine","volume":"2","author":"Mesko","year":"2017","journal-title":"Exp Rev Precis Med Drug Dev"},{"issue":"6","key":"2021012411203875600_ocaa053-B8","doi-asserted-by":"crossref","first-page":"395","DOI":"10.1038\/nrg3208","article-title":"Mining electronic health records: towards better research applications and clinical care","volume":"13","author":"Jensen","year":"2012","journal-title":"Nat Rev Genet"},{"issue":"3","key":"2021012411203875600_ocaa053-B9","doi-asserted-by":"crossref","first-page":"713","DOI":"10.1148\/radiol.2017171183","article-title":"When machines think: radiology\u2019s next frontier","volume":"285","author":"Dreyer","year":"2017","journal-title":"Radiology"},{"key":"2021012411203875600_ocaa053-B10","year":"2019"},{"issue":"1","key":"2021012411203875600_ocaa053-B11","doi-asserted-by":"crossref","first-page":"30","DOI":"10.1038\/s41591-018-0307-0","article-title":"The practical implementation of artificial intelligence technologies in medicine","volume":"25","author":"He","year":"2019","journal-title":"Nat Med"},{"key":"2021012411203875600_ocaa053-B12","first-page":"36","article-title":"Explainable artificial intelligence (XAI)","author":"Gunning","year":"2017","journal-title":"Defense Advanced Research Projects Agency (DARPA)"},{"key":"2021012411203875600_ocaa053-B13","author":"Kim"},{"issue":"1","key":"2021012411203875600_ocaa053-B14","doi-asserted-by":"crossref","first-page":"59","DOI":"10.7326\/M19-2548","article-title":"Should health care demand interpretable artificial intelligence or accept \u2018black box\u2019 medicine","volume":"172","author":"Wang","year":"2020","journal-title":"Ann Intern Med"},{"issue":"6","key":"2021012411203875600_ocaa053-B15","doi-asserted-by":"crossref","first-page":"497","DOI":"10.1001\/jama.2018.20563","article-title":"Promoting trust between patients and physicians in the era of artificial intelligence","volume":"322","author":"Nundy","year":"2019","journal-title":"JAMA"},{"issue":"4","key":"2021012411203875600_ocaa053-B16","first-page":"e1312","article-title":"Causability and explainability of artificial intelligence in medicine","volume":"9","author":"Holzinger","year":"2019","journal-title":"Wiley Interdiscip Rev: Data Min Knowl Discov"},{"key":"2021012411203875600_ocaa053-B17","article-title":"The importance of interpretability and visualization in machine learning for applications in medicine and health care","author":"Vellido","year":"2019","journal-title":"Neural Comput Appl"},{"issue":"7","key":"2021012411203875600_ocaa053-B18","doi-asserted-by":"crossref","first-page":"e1000097","DOI":"10.1371\/journal.pmed.1000097","article-title":"Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement","volume":"6","author":"Moher","year":"2009","journal-title":"PLoS Med"},{"issue":"1","key":"2021012411203875600_ocaa053-B19","doi-asserted-by":"crossref","first-page":"1","DOI":"10.26599\/BDMA.2018.9020001","article-title":"Applications of deep learning to MRI images: a survey","volume":"1","author":"Liu","year":"2018","journal-title":"Big Data Min Anal"},{"issue":"8","key":"2021012411203875600_ocaa053-B20","doi-asserted-by":"crossref","first-page":"500","DOI":"10.1038\/s41568-018-0016-5","article-title":"Artificial intelligence in radiology","volume":"18","author":"Hosny","year":"2018","journal-title":"Nat Rev Cancer"},{"key":"2021012411203875600_ocaa053-B21","author":"Iftikhar"},{"key":"2021012411203875600_ocaa053-B22","first-page":"77","article-title":"National Vital Statistics Reports Deaths: Final Data for 2017","year":"2017"},{"issue":"2","key":"2021012411203875600_ocaa053-B23","doi-asserted-by":"crossref","first-page":"319","DOI":"10.1016\/j.jbi.2010.12.001","article-title":"Data mining methods for classification of Medium-Chain Acyl-CoA dehydrogenase deficiency (MCADD) using non-derivatized tandem MS neonatal screening data","volume":"44","author":"Van den Bulcke","year":"2011","journal-title":"J Biomed Inform"},{"key":"2021012411203875600_ocaa053-B24","author":"Fejza"},{"issue":"12","key":"2021012411203875600_ocaa053-B25","doi-asserted-by":"crossref","first-page":"1122","DOI":"10.1111\/j.1464-5491.1995.tb00431.x","article-title":"High prevalence of diabetes mellitus and impaired glucose tolerance in the Sultanate of Oman: results of the 1991 national survey","volume":"12","author":"Asfour","year":"1995","journal-title":"Diabet Med"},{"issue":"4","key":"2021012411203875600_ocaa053-B26","doi-asserted-by":"crossref","first-page":"1114","DOI":"10.1109\/TITB.2009.2039485","article-title":"Intelligible support vector machines for diagnosis of diabetes mellitus","volume":"14","author":"Barakat","year":"2010","journal-title":"IEEE Trans Inform Technol Biomed"},{"issue":"5439","key":"2021012411203875600_ocaa053-B27","doi-asserted-by":"crossref","first-page":"531","DOI":"10.1126\/science.286.5439.531","article-title":"Molecular classification of cancer: class discovery and class prediction by gene expression monitoring","volume":"286","author":"Golub","year":"1999","journal-title":"Science"},{"issue":"2","key":"2021012411203875600_ocaa053-B28","doi-asserted-by":"crossref","first-page":"203","DOI":"10.1016\/S1535-6108(02)00030-2","article-title":"Gene expression correlates of clinical prostate cancer behavior","volume":"1","author":"Singh","year":"2002","journal-title":"Cancer Cell"},{"issue":"12","key":"2021012411203875600_ocaa053-B29","doi-asserted-by":"crossref","first-page":"6745","DOI":"10.1073\/pnas.96.12.6745","article-title":"Broad patterns of gene expression revealed by clustering analysis of tumor and normal colon tissues probed by oligonucleotide arrays","volume":"96","author":"Alon","year":"1999","journal-title":"Proc Natl Acad Sci U S A"},{"issue":"S13","key":"2021012411203875600_ocaa053-B30","doi-asserted-by":"crossref","first-page":"S4","DOI":"10.1186\/1471-2105-14-S13-S4","article-title":"Fuzzy support vector machine: an efficient rule-based classification technique for microarrays","volume":"14","author":"Hajiloo","year":"2013","journal-title":"BMC Bioinform"},{"issue":"4","key":"2021012411203875600_ocaa053-B31","doi-asserted-by":"crossref","first-page":"1512","DOI":"10.1096\/fj.15-278622","article-title":"Composition and stability of intestinal microbiota of healthy children within a Dutch population","volume":"30","author":"Meij","year":"2016","journal-title":"FASEB J"},{"issue":"1","key":"2021012411203875600_ocaa053-B32","doi-asserted-by":"crossref","first-page":"441","DOI":"10.1186\/s12859-017-1843-1","article-title":"Interpretation of microbiota-based diagnostics by explaining individual classifier decisions","volume":"18","author":"Eck","year":"2017","journal-title":"BMC Bioinform"},{"issue":"1","key":"2021012411203875600_ocaa053-B33","doi-asserted-by":"crossref","first-page":"235","DOI":"10.1109\/JBHI.2019.2899218","article-title":"Discovering the type 2 diabetes in electronic health records using the sparse balanced support vector machine","volume":"24","author":"Bernardini","year":"2020","journal-title":"IEEE J Biomed Health Inform"},{"issue":"4","key":"2021012411203875600_ocaa053-B34","doi-asserted-by":"crossref","first-page":"690","DOI":"10.1109\/JPROC.2017.2789319","article-title":"Predicting chronic disease hospitalizations from electronic health records: an interpretable classification approach","volume":"106","author":"Brisimi","year":"2018","journal-title":"Proc IEEE"},{"issue":"3","key":"2021012411203875600_ocaa053-B35","doi-asserted-by":"crossref","first-page":"e33812","DOI":"10.1371\/journal.pone.0033812","article-title":"Comprehensive decision tree models in bioinformatics","volume":"7","author":"Stiglic","year":"2012","journal-title":"PLoS ONE"},{"issue":"1","key":"2021012411203875600_ocaa053-B36","doi-asserted-by":"crossref","first-page":"2","DOI":"10.1186\/s13755-016-0015-4","article-title":"Automatically explaining machine learning prediction results: a demonstration on type 2 diabetes risk prediction","volume":"4","author":"Luo","year":"2016","journal-title":"Health Inf Sci Syst"},{"issue":"1","key":"2021012411203875600_ocaa053-B37","doi-asserted-by":"crossref","first-page":"501","DOI":"10.1186\/s12864-016-2647-9","article-title":"Interpretable per case weighted ensemble method for cancer associations","volume":"17","author":"Jalali","year":"2016","journal-title":"BMC Genomics"},{"issue":"1","key":"2021012411203875600_ocaa053-B38","doi-asserted-by":"crossref","first-page":"e11728","DOI":"10.2196\/11728","article-title":"Development of prediction models using machine learning algorithms for girls with suspected central precocious puberty: retrospective study","volume":"7","author":"Pan","year":"2019","journal-title":"JMIR Med Inform"},{"issue":"1","key":"2021012411203875600_ocaa053-B39","doi-asserted-by":"crossref","first-page":"37854","DOI":"10.1038\/srep37854","article-title":"MediBoost: a patient stratification tool for interpretable decision making in the era of precision medicine","volume":"6","author":"Valdes","year":"2016","journal-title":"Sci Rep"},{"key":"2021012411203875600_ocaa053-B40","first-page":"707","author":"Crielaard"},{"issue":"1","key":"2021012411203875600_ocaa053-B41","doi-asserted-by":"crossref","first-page":"365","DOI":"10.1186\/s12859-015-0774-y","article-title":"Predicting drug side effects by multi-label learning and ensemble learning","volume":"16","author":"Zhang","year":"2015","journal-title":"BMC Bioinform"},{"issue":"2","key":"2021012411203875600_ocaa053-B42","doi-asserted-by":"crossref","first-page":"e86456","DOI":"10.1371\/journal.pone.0086456","article-title":"Ant colony optimization algorithm for interpretable Bayesian classifiers combination: application to medical predictions","volume":"9","author":"Bouktif","year":"2014","journal-title":"PLoS ONE"},{"key":"2021012411203875600_ocaa053-B43","doi-asserted-by":"crossref","first-page":"48","DOI":"10.1016\/j.jbi.2018.02.008","article-title":"Mortality prediction in intensive care units (ICUs) using a deep rule-based fuzzy classifier","volume":"79","author":"Davoodi","year":"2018","journal-title":"J Biomed Inform"},{"issue":"3","key":"2021012411203875600_ocaa053-B44","doi-asserted-by":"crossref","first-page":"257","DOI":"10.1007\/s13246-012-0155-z","article-title":"Generating fuzzy rules for constructing interpretable classifier of diabetes disease","volume":"35","author":"Settouti","year":"2012","journal-title":"Australas Phys Eng Sci Med"},{"issue":"8","key":"2021012411203875600_ocaa053-B45","doi-asserted-by":"crossref","first-page":"1332","DOI":"10.1093\/bioinformatics\/bti166","article-title":"SpliceMachine: predicting splice sites from high-dimensional local context representations","volume":"21","author":"Degroeve","year":"2005","journal-title":"Bioinformatics"},{"key":"2021012411203875600_ocaa053-B46","doi-asserted-by":"crossref","first-page":"S7","DOI":"10.1186\/1471-2105-8-S10-S7","article-title":"Accurate splice site prediction using support vector machines","volume":"8 (Suppl 10","author":"Sonnenburg","year":"2007","journal-title":"BMC Bioinform"},{"key":"2021012411203875600_ocaa053-B47","author":"Bari","year":"2014"},{"issue":"24","key":"2021012411203875600_ocaa053-B48","doi-asserted-by":"crossref","first-page":"4180","DOI":"10.1093\/bioinformatics\/bty497","article-title":"SpliceRover: interpretable convolutional neural networks for improved splice site prediction","volume":"34","author":"Zuallaert","year":"2018","journal-title":"Bioinformatics"},{"issue":"4","key":"2021012411203875600_ocaa053-B49","doi-asserted-by":"crossref","first-page":"e0195024","DOI":"10.1371\/journal.pone.0195024","article-title":"Readmission prediction via deep contextual embedding of clinical concepts","volume":"13","author":"Xiao","year":"2018","journal-title":"Plos ONE"},{"issue":"1","key":"2021012411203875600_ocaa053-B50","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1038\/s41598-019-38491-0","article-title":"DeepSOFA: a continuous acuity score for critically ill patients using clinically interpretable deep learning","volume":"9","author":"Shickel","year":"2019","journal-title":"Sci Rep"},{"issue":"1","key":"2021012411203875600_ocaa053-B51","doi-asserted-by":"crossref","first-page":"299","DOI":"10.1109\/TVCG.2018.2865027","article-title":"RetainVis: visual analytics with interpretable and interactive recurrent neural networks on electronic medical records","volume":"25","author":"Kwon","year":"2019","journal-title":"IEEE Trans Vis Comput Graph"},{"issue":"S2","key":"2021012411203875600_ocaa053-B52","doi-asserted-by":"crossref","first-page":"54","DOI":"10.1186\/s12918-016-0302-3","article-title":"Opening up the blackbox: an interpretable deep neural network-based classifier for cell-type specific enhancer predictions","volume":"10","author":"Kim","year":"2016","journal-title":"BMC Syst Biol"},{"key":"2021012411203875600_ocaa053-B53","first-page":"371","article-title":"Interpretable deep models for ICU outcome prediction","volume":"2016","author":"Che","year":"2017","journal-title":"AMIA Annu Symp Proc"},{"key":"2021012411203875600_ocaa053-B54","first-page":"460","article-title":"An interpretable ICU mortality prediction model based on logistic regression and recurrent neural networks with LSTM units","volume":"2018","author":"Ge","year":"2018","journal-title":"AMIA Annu Symp Proc"},{"issue":"4","key":"2021012411203875600_ocaa053-B55","doi-asserted-by":"crossref","first-page":"515","DOI":"10.1007\/s12031-019-01311-1","article-title":"Application of single-nucleotide polymorphisms in the diagnosis of autism spectrum disorders: a preliminary study with artificial neural networks","volume":"68","author":"Ghafouri-Fard","year":"2019","journal-title":"J Mol Neurosci"},{"issue":"1","key":"2021012411203875600_ocaa053-B56","doi-asserted-by":"crossref","first-page":"510","DOI":"10.1186\/s12859-018-2500-z","article-title":"PASNet: pathway-associated sparse deep neural network for prognosis prediction from high-throughput data","volume":"19","author":"Hao","year":"2018","journal-title":"BMC Bioinform"},{"key":"2021012411203875600_ocaa053-B57","author":"Hartono"},{"issue":"10","key":"2021012411203875600_ocaa053-B58","doi-asserted-by":"crossref","first-page":"1660","DOI":"10.1093\/bioinformatics\/bty842","article-title":"DeepHINT: understanding HIV-1 integration via deep learning with attention","volume":"35","author":"Hu","year":"2019","journal-title":"Bioinformatics"},{"issue":"2","key":"2021012411203875600_ocaa053-B59","doi-asserted-by":"crossref","first-page":"e0211057","DOI":"10.1371\/journal.pone.0211057","article-title":"An attention based deep learning model of clinical events in the intensive care unit","volume":"14","author":"Kaji","year":"2019","journal-title":"PLoS ONE"},{"key":"2021012411203875600_ocaa053-B60","first-page":"3504","article-title":"Retain: an interpretable predictive model for healthcare using reverse time attention mechanism","author":"Choi","year":"2016","journal-title":"Presented at the Advances in Neural Information Processing Systems"},{"key":"2021012411203875600_ocaa053-B61","author":"Park"},{"key":"2021012411203875600_ocaa053-B62","doi-asserted-by":"crossref","first-page":"65333","DOI":"10.1109\/ACCESS.2018.2875677","article-title":"Patient2Vec: a personalized interpretable deep representation of the longitudinal electronic health record","volume":"6","author":"Zhang","year":"2018","journal-title":"IEEE Access"},{"key":"2021012411203875600_ocaa053-B63","doi-asserted-by":"crossref","first-page":"28","DOI":"10.1016\/j.imu.2016.12.004","article-title":"Devising an interpretable calibrated scale to quantitatively assess the dementia stage of subjects with Alzheimer\u2019s disease: a machine learning approach","volume":"6","author":"Aditya","year":"2017","journal-title":"Inform Med Unlocked"},{"key":"2021012411203875600_ocaa053-B64","doi-asserted-by":"crossref","first-page":"431","DOI":"10.1016\/j.jbi.2016.03.001","article-title":"Object-oriented regression for building predictive models with high dimensional omics data from translational studies","volume":"60","author":"Zhao","year":"2016","journal-title":"J Biomed Inform"},{"key":"2021012411203875600_ocaa053-B65","author":"Paredes"},{"issue":"3","key":"2021012411203875600_ocaa053-B66","doi-asserted-by":"crossref","first-page":"e0194985","DOI":"10.1371\/journal.pone.0194985","article-title":"Personalized survival predictions via trees of predictors: an application to cardiac transplantation","volume":"13","author":"Yoon","year":"2018","journal-title":"PLoS ONE"},{"issue":"1","key":"2021012411203875600_ocaa053-B67","doi-asserted-by":"crossref","first-page":"36812","DOI":"10.1038\/srep36812","article-title":"Logic models to predict continuous outputs based on binary inputs with an application to personalized cancer therapy","volume":"6","author":"Knijnenburg","year":"2016","journal-title":"Sci Rep"},{"issue":"1","key":"2021012411203875600_ocaa053-B68","doi-asserted-by":"crossref","first-page":"342","DOI":"10.1109\/TVCG.2018.2864812","article-title":"RuleMatrix: visualizing and understanding classifiers with rules","volume":"25","author":"Ming","year":"2019","journal-title":"IEEE Trans Vis Comput Graph"},{"key":"2021012411203875600_ocaa053-B69","first-page":"1675","author":"Lakkaraju","year":"2016"},{"issue":"1","key":"2021012411203875600_ocaa053-B70","doi-asserted-by":"crossref","first-page":"41","DOI":"10.1038\/ng765","article-title":"MLL translocations specify a distinct gene expression profile that distinguishes a unique leukemia","volume":"30","author":"Armstrong","year":"2002","journal-title":"Nat Genet"},{"issue":"1","key":"2021012411203875600_ocaa053-B71","doi-asserted-by":"crossref","first-page":"25","DOI":"10.1186\/1423-0127-16-25","article-title":"An integrated method for cancer classification and rule extraction from microarray data","volume":"16","author":"Huang","year":"2009","journal-title":"J Biomed Sci"},{"key":"2021012411203875600_ocaa053-B72","author":"Ponce"},{"key":"2021012411203875600_ocaa053-B73","doi-asserted-by":"crossref","first-page":"e6543","DOI":"10.7717\/peerj.6543","article-title":"An interpretable machine learning model for diagnosis of Alzheimer\u2019s disease","volume":"7","author":"Das","year":"2019","journal-title":"PeerJ"},{"issue":"1","key":"2021012411203875600_ocaa053-B74","doi-asserted-by":"publisher","first-page":"68","DOI":"10.1145\/3359786","article-title":"Techniques for interpretable machine learning","volume":"63","author":"Du","year":"2019","journal-title":"Commun ACM"},{"issue":"8","key":"2021012411203875600_ocaa053-B75","doi-asserted-by":"crossref","first-page":"832","DOI":"10.3390\/electronics8080832","article-title":"Machine learning interpretability: a survey on methods and metrics","volume":"8","author":"Carvalho","year":"2019","journal-title":"Electronics"},{"key":"2021012411203875600_ocaa053-B76","doi-asserted-by":"crossref","first-page":"52138","DOI":"10.1109\/ACCESS.2018.2870052","article-title":"Peeking inside the black-box: a survey on explainable artificial intelligence (XAI)","volume":"6","author":"Adadi","year":"2018","journal-title":"IEEE Access"},{"key":"2021012411203875600_ocaa053-B77","author":"Ribeiro","year":"2016"},{"key":"2021012411203875600_ocaa053-B78","author":"Bahdanau","year":"2014"},{"key":"2021012411203875600_ocaa053-B79","author":"Shrikumar"},{"key":"2021012411203875600_ocaa053-B80","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.dsp.2017.10.011","article-title":"Methods for interpreting and understanding deep neural networks","volume":"73","author":"Montavon","year":"2018","journal-title":"Digit Signal Process"},{"key":"2021012411203875600_ocaa053-B81","author":"Mascharka"},{"issue":"1","key":"2021012411203875600_ocaa053-B82","doi-asserted-by":"crossref","first-page":"267","DOI":"10.1111\/j.2517-6161.1996.tb02080.x","article-title":"Regression shrinkage and selection via the Lasso","volume":"58","author":"Tibshirani","year":"1996","journal-title":"J R Stat Soc Ser B"},{"key":"2021012411203875600_ocaa053-B83","author":"Hinton","year":"2015"},{"issue":"6377","key":"2021012411203875600_ocaa053-B84","doi-asserted-by":"crossref","first-page":"725","DOI":"10.1126\/science.359.6377.725","article-title":"Artificial intelligence faces reproducibility crisis","volume":"359","author":"Hutson","year":"2018","journal-title":"Science"},{"issue":"3","key":"2021012411203875600_ocaa053-B85","doi-asserted-by":"crossref","first-page":"56","DOI":"10.1609\/aimag.v39i3.2816","article-title":"On reproducible AI: towards reproducible research, open science, and digital scholarship in AI publications","volume":"39","author":"Gundersen","year":"2018","journal-title":"AI Mag"},{"issue":"4","key":"2021012411203875600_ocaa053-B86","doi-asserted-by":"crossref","first-page":"305","DOI":"10.1001\/jama.2019.20866","article-title":"Challenges to the reproducibility of machine learning models in health care","volume":"323","author":"Beam","year":"2020","journal-title":"JAMA"},{"issue":"3","key":"2021012411203875600_ocaa053-B87","doi-asserted-by":"crossref","first-page":"472","DOI":"10.1093\/jamia\/ocw136","article-title":"Predicting inpatient clinical order patterns with probabilistic topic models vs conventional order sets","volume":"24","author":"Chen","year":"2017","journal-title":"J Am Med Inform Assoc"},{"issue":"4","key":"2021012411203875600_ocaa053-B88","doi-asserted-by":"crossref","first-page":"592","DOI":"10.1093\/jamia\/ocz229","article-title":"Physician understanding, explainability, and trust in a hypothetical machine learning risk calculator","volume":"27","author":"Diprose","year":"2020","journal-title":"J Am Med Inform Assoc"},{"issue":"01","key":"2021012411203875600_ocaa053-B89","doi-asserted-by":"crossref","first-page":"3681","DOI":"10.1609\/aaai.v33i01.33013681","article-title":"Interpretation of neural networks is fragile","volume":"33","author":"Ghorbani","year":"2019","journal-title":"AAAI"},{"key":"2021012411203875600_ocaa053-B90","author":"Szegedy","year":"2014"},{"key":"2021012411203875600_ocaa053-B91","doi-asserted-by":"crossref","DOI":"10.1007\/s13218-020-00637-y","article-title":"One explanation does not fit all","author":"Sokol","year":"2020","journal-title":"K\u00fcnstl Intell"},{"key":"2021012411203875600_ocaa053-B92","author":"Miller","year":"2017"},{"key":"2021012411203875600_ocaa053-B93","author":"Jain","year":"2019"},{"key":"2021012411203875600_ocaa053-B94","author":"Wiegreffe"},{"issue":"5","key":"2021012411203875600_ocaa053-B95","doi-asserted-by":"crossref","first-page":"206","DOI":"10.1038\/s42256-019-0048-x","article-title":"Stop explaining black box machine learning models for high stakes decisions and use interpretable models instead","volume":"1","author":"Rudin","year":"2019","journal-title":"Nat Mach Intell"},{"issue":"2","key":"2021012411203875600_ocaa053-B96","doi-asserted-by":"crossref","first-page":"44","DOI":"10.1609\/aimag.v40i2.2850","article-title":"DARPA\u2019s Explainable Artificial Intelligence (XAI) Program","volume":"40","author":"Gunning","year":"2019","journal-title":"AIMag"}],"container-title":["Journal of the American Medical Informatics Association"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/academic.oup.com\/jamia\/article-pdf\/27\/7\/1173\/36089276\/ocaa053.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"http:\/\/academic.oup.com\/jamia\/article-pdf\/27\/7\/1173\/36089276\/ocaa053.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,8,3]],"date-time":"2024-08-03T17:26:25Z","timestamp":1722705985000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jamia\/article\/27\/7\/1173\/5838471"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,5,17]]},"references-count":96,"journal-issue":{"issue":"7","published-online":{"date-parts":[[2020,5,17]]},"published-print":{"date-parts":[[2020,7,1]]}},"URL":"https:\/\/doi.org\/10.1093\/jamia\/ocaa053","relation":{},"ISSN":["1527-974X"],"issn-type":[{"value":"1527-974X","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2020,7]]},"published":{"date-parts":[[2020,5,17]]}}}