{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,15]],"date-time":"2026-01-15T02:09:11Z","timestamp":1768442951833,"version":"3.49.0"},"reference-count":49,"publisher":"Oxford University Press (OUP)","issue":"7","license":[{"start":{"date-parts":[[2024,5,28]],"date-time":"2024-05-28T00:00:00Z","timestamp":1716854400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Basic Science Research Program"},{"DOI":"10.13039\/501100003725","name":"National Research Foundation of Korea","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100003725","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Korea Government","award":["2022R1A4A1030189"],"award-info":[{"award-number":["2022R1A4A1030189"]}]},{"name":"Institute of Information & Communications Technology Planning & Evaluation"},{"name":"Artificial Intelligence Convergence Innovation Human Resources Development","award":["IITP-2023-00254177"],"award-info":[{"award-number":["IITP-2023-00254177"]}]},{"name":"Pusan National University Hospital Clinical Research Funding","award":["2022"],"award-info":[{"award-number":["2022"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2024,6,20]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:sec>\n                  <jats:title>Objective<\/jats:title>\n                  <jats:p>Predicting mortality after acute myocardial infarction (AMI) is crucial for timely prescription and treatment of AMI patients, but there are no appropriate AI systems for clinicians. Our primary goal is to develop a reliable and interpretable AI system and provide some valuable insights regarding short, and long-term mortality.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Materials and methods<\/jats:title>\n                  <jats:p>We propose the RIAS framework, an end-to-end framework that is designed with reliability and interpretability at its core and automatically optimizes the given model. Using RIAS, clinicians get accurate and reliable predictions which can be used as likelihood, with global and local explanations, and \u201cwhat if\u201d scenarios to achieve desired outcomes as well.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Results<\/jats:title>\n                  <jats:p>We apply RIAS to AMI prognosis prediction data which comes from the Korean Acute Myocardial Infarction Registry. We compared FT-Transformer with XGBoost and MLP and found that FT-Transformer has superiority in sensitivity and comparable performance in AUROC and F1 score to XGBoost. Furthermore, RIAS reveals the significance of statin-based medications, beta-blockers, and age on mortality regardless of time period. Lastly, we showcase reliable and interpretable results of RIAS with local explanations and counterfactual examples for several realistic scenarios.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Discussion<\/jats:title>\n                  <jats:p>RIAS addresses the \u201cblack-box\u201d issue in AI by providing both global and local explanations based on SHAP values and reliable predictions, interpretable as actual likelihoods. The system\u2019s \u201cwhat if\u201d counterfactual explanations enable clinicians to simulate patient-specific scenarios under various conditions, enhancing its practical utility.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Conclusion<\/jats:title>\n                  <jats:p>The proposed framework provides reliable and interpretable predictions along with counterfactual examples.<\/jats:p>\n               <\/jats:sec>","DOI":"10.1093\/jamia\/ocae114","type":"journal-article","created":{"date-parts":[[2024,5,28]],"date-time":"2024-05-28T19:10:11Z","timestamp":1716923411000},"page":"1540-1550","source":"Crossref","is-referenced-by-count":8,"title":["Acute myocardial infarction prognosis prediction with reliable and interpretable artificial intelligence system"],"prefix":"10.1093","volume":"31","author":[{"given":"Minwook","family":"Kim","sequence":"first","affiliation":[{"name":"School of Computer Science and Engineering, Pusan National University , Busan 46421, Republic of Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Donggil","family":"Kang","sequence":"additional","affiliation":[{"name":"School of Computer Science and Engineering, Pusan National University , Busan 46421, Republic of Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Min Sun","family":"Kim","sequence":"additional","affiliation":[{"name":"Department of Cardiology, Medical Research Institute, Pusan National University Hospital , Busan 49241, Republic of Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jeong Cheon","family":"Choe","sequence":"additional","affiliation":[{"name":"Department of Cardiology, Medical Research Institute, Pusan National University Hospital , Busan 49241, Republic of Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Sun-Hack","family":"Lee","sequence":"additional","affiliation":[{"name":"Department of Cardiology, Medical Research Institute, Pusan National University Hospital , Busan 49241, Republic of Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jin Hee","family":"Ahn","sequence":"additional","affiliation":[{"name":"Department of Cardiology, Medical Research Institute, Pusan National University Hospital , Busan 49241, Republic of Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jun-Hyok","family":"Oh","sequence":"additional","affiliation":[{"name":"Department of Cardiology, Medical Research Institute, Pusan National University Hospital , Busan 49241, Republic of Korea"},{"name":"College of Medicine, Pusan National University , Gyeongsangnam-do 50612, Republic of Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jung Hyun","family":"Choi","sequence":"additional","affiliation":[{"name":"Department of Cardiology, Medical Research Institute, Pusan National University Hospital , Busan 49241, Republic of Korea"},{"name":"College of Medicine, Pusan National University , Gyeongsangnam-do 50612, Republic of Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Han Cheol","family":"Lee","sequence":"additional","affiliation":[{"name":"Department of Cardiology, Medical Research Institute, Pusan National University Hospital , Busan 49241, Republic of Korea"},{"name":"College of Medicine, Pusan National University , Gyeongsangnam-do 50612, Republic of Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Kwang Soo","family":"Cha","sequence":"additional","affiliation":[{"name":"Department of Cardiology, Medical Research Institute, Pusan National University Hospital , Busan 49241, Republic of Korea"},{"name":"College of Medicine, Pusan National University , Gyeongsangnam-do 50612, Republic of Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Kyungtae","family":"Jang","sequence":"additional","affiliation":[{"name":"Gupo Sungshim Hospital , Busan 46581, Republic of Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"WooR I","family":"Bong","sequence":"additional","affiliation":[{"name":"Division of Cardiology, Department of Medicine, Busan Veterans Hospital , Busan 46996, Republic of Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8796-4678","authenticated-orcid":false,"given":"Giltae","family":"Song","sequence":"additional","affiliation":[{"name":"School of Computer Science and Engineering, Pusan National University , Busan 46421, Republic of Korea"},{"name":"Center for Artificial Intelligence Research, Pusan National University , Busan 46421, Republic of Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hyewon","family":"Lee","sequence":"additional","affiliation":[{"name":"Department of Cardiology, Medical Research Institute, Pusan National University Hospital , Busan 49241, Republic of Korea"},{"name":"College of Medicine, Pusan National University , Gyeongsangnam-do 50612, Republic of Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"286","published-online":{"date-parts":[[2024,5,28]]},"reference":[{"issue":"8","key":"2024062008073690200_ocae114-B1","doi-asserted-by":"crossref","first-page":"e93","DOI":"10.1161\/CIR.0000000000001123","article-title":"Heart disease and stroke statistics\u20142023 update: a report from the American Heart Association","volume":"147","author":"Tsao","year":"2023","journal-title":"Circulation"},{"issue":"1","key":"2024062008073690200_ocae114-B2","doi-asserted-by":"crossref","first-page":"222","DOI":"10.1002\/ehf2.13144","article-title":"Heart failure after myocardial infarction: incidence and predictors","volume":"8","author":"Jen\u010da","year":"2021","journal-title":"ESC Heart Fail"},{"issue":"7","key":"2024062008073690200_ocae114-B3","doi-asserted-by":"crossref","first-page":"835","DOI":"10.1001\/jama.284.7.835","article-title":"The TIMI risk score for unstable angina\/non-ST elevation MI: a method for prognostication and therapeutic decision making","volume":"284","author":"Antman","year":"2000","journal-title":"JAMA"},{"issue":"17","key":"2024062008073690200_ocae114-B4","doi-asserted-by":"crossref","first-page":"2031","DOI":"10.1161\/01.CIR.102.17.2031","article-title":"TIMI risk score for ST-elevation myocardial infarction: a convenient, bedside. clinical score for risk assessment at presentation: an intravenous nPA for treatment of infarcting myocardium early II trial substudy","volume":"102","author":"Morrow","year":"2000","journal-title":"Circulation"},{"issue":"6","key":"2024062008073690200_ocae114-B5","doi-asserted-by":"crossref","first-page":"640","DOI":"10.1016\/S0300-8932(10)70156-1","article-title":"Validation of the GRACE risk score for predicting death within 6 months of follow-up in a contemporary cohort of patients with acute coronary syndrome","volume":"63","author":"Abu-Assi","year":"2010","journal-title":"Rev Esp Cardiol"},{"issue":"19","key":"2024062008073690200_ocae114-B6","doi-asserted-by":"crossref","first-page":"2345","DOI":"10.1001\/archinte.163.19.2345","article-title":"Predictors of hospital mortality in the global registry of acute coronary events","volume":"163","author":"Granger","year":"2003","journal-title":"Archiv Intern Med"},{"issue":"2","key":"2024062008073690200_ocae114-B7","doi-asserted-by":"crossref","first-page":"e004425","DOI":"10.1136\/bmjopen-2013-004425","article-title":"Should patients with acute coronary disease be stratified for management according to their risk? Derivation, external validation and outcomes using the updated GRACE risk score","volume":"4","author":"Fox","year":"2014","journal-title":"BMJ Open"},{"issue":"24","key":"2024062008073690200_ocae114-B8","doi-asserted-by":"crossref","first-page":"e139","DOI":"10.1016\/j.jacc.2014.09.017","article-title":"2014 AHA\/ACC guideline for the management of patients with non-ST-elevation acute coronary syndromes: a report of the American College of Cardiology\/American Heart Association Task Force on Practice Guidelines","volume":"64","author":"Amsterdam","year":"2014","journal-title":"J Am Coll Cardiol"},{"issue":"1","key":"2024062008073690200_ocae114-B9","doi-asserted-by":"crossref","first-page":"12886","DOI":"10.1038\/s41598-021-92362-1","article-title":"Machine learning enhances the performance of short and long-term mortality prediction model in non-ST-segment elevation myocardial infarction","volume":"11","author":"Lee","year":"2021","journal-title":"Sci Rep"},{"issue":"6","key":"2024062008073690200_ocae114-B10","doi-asserted-by":"crossref","first-page":"633","DOI":"10.1001\/jamacardio.2021.0122","article-title":"Use of machine learning models to predict death after acute myocardial infarction","volume":"6","author":"Khera","year":"2021","journal-title":"JAMA Cardiol"},{"key":"2024062008073690200_ocae114-B11","doi-asserted-by":"crossref","first-page":"e073843","DOI":"10.1136\/bmj-2022-073843","article-title":"Effectiveness of GRACE risk score in patients admitted to hospital with non-ST elevation acute coronary syndrome (UKGRIS): parallel group cluster randomised controlled trial","volume":"381","author":"Gale","year":"2023","journal-title":"BMJ"},{"issue":"4","key":"2024062008073690200_ocae114-B12","doi-asserted-by":"crossref","first-page":"681","DOI":"10.1016\/j.jcmg.2018.04.026","article-title":"Predicting survival from large echocardiography and electronic health record datasets: optimization with machine learning","volume":"12","author":"Samad","year":"2019","journal-title":"JACC Cardiovasc Imaging"},{"key":"2024062008073690200_ocae114-B13","author":"Kim","year":"2023"},{"key":"2024062008073690200_ocae114-B14","doi-asserted-by":"crossref","first-page":"52138","DOI":"10.1109\/ACCESS.2018.2870052","article-title":"Peeking inside the black-box: a survey on explainable artificial intelligence (XAI)","volume":"6","author":"Adadi","year":"2018","journal-title":"IEEE Access"},{"issue":"12","key":"2024062008073690200_ocae114-B15","doi-asserted-by":"crossref","first-page":"1636","DOI":"10.1038\/s41562-021-01146-0","article-title":"Understanding, explaining, and utilizing medical artificial intelligence","volume":"5","author":"Cadario","year":"2021","journal-title":"Nat Hum Behav"},{"key":"2024062008073690200_ocae114-B16","doi-asserted-by":"crossref","first-page":"102158","DOI":"10.1016\/j.artmed.2021.102158","article-title":"The three ghosts of medical AI: can the black-box present deliver?","volume":"124","author":"Quinn","year":"2022","journal-title":"Artif Intell Med"},{"key":"2024062008073690200_ocae114-B17","first-page":"295","author":"Zhang","year":"2020"},{"issue":"6","key":"2024062008073690200_ocae114-B18","doi-asserted-by":"crossref","first-page":"e15154","DOI":"10.2196\/15154","article-title":"Artificial intelligence and human trust in healthcare: focus on clinicians","volume":"22","author":"Asan","year":"2020","journal-title":"J Med Internet Res"},{"issue":"1","key":"2024062008073690200_ocae114-B19","doi-asserted-by":"crossref","first-page":"47","DOI":"10.1038\/s41746-020-0254-2","article-title":"Machine intelligence in healthcare\u2014perspectives on trustworthiness, explainability, usability, and transparency","volume":"3","author":"Cutillo","year":"2020","journal-title":"NPJ Digit Med"},{"key":"2024062008073690200_ocae114-B20","doi-asserted-by":"crossref","first-page":"102941","DOI":"10.1016\/j.ijhcs.2022.102941","article-title":"How the different explanation classes impact trust calibration: the case of clinical decision support systems","volume":"169","author":"Naiseh","year":"2023","journal-title":"Int J Hum Comput Stud"},{"key":"2024062008073690200_ocae114-B21","doi-asserted-by":"crossref","first-page":"103655","DOI":"10.1016\/j.jbi.2020.103655","article-title":"The role of explainability in creating trustworthy artificial intelligence for health care: a comprehensive survey of the terminology, design choices, and evaluation strategies","volume":"113","author":"Markus","year":"2021","journal-title":"J Biomed Inform"},{"key":"2024062008073690200_ocae114-B22","first-page":"359","author":"Tonekaboni","year":"2019"},{"issue":"1","key":"2024062008073690200_ocae114-B23","doi-asserted-by":"crossref","first-page":"1","DOI":"10.3904\/kjim.2018.381","article-title":"Current status of acute myocardial infarction in Korea","volume":"34","author":"Kim","year":"2018","journal-title":"Korean J Intern Med"},{"key":"2024062008073690200_ocae114-B24","first-page":"2623","author":"Akiba","year":"2019"},{"issue":"7","key":"2024062008073690200_ocae114-B25","doi-asserted-by":"crossref","first-page":"1173","DOI":"10.1093\/jamia\/ocaa053","article-title":"Explainable artificial intelligence models using real-world electronic health record data: a systematic scoping review","volume":"27","author":"Payrovnaziri","year":"2020","journal-title":"J Am Med Inform Assoc"},{"key":"2024062008073690200_ocae114-B26","first-page":"30","author":"Lundberg","year":"2017"},{"key":"2024062008073690200_ocae114-B27","author":"Das","year":"2020"},{"key":"2024062008073690200_ocae114-B28","first-page":"1","article-title":"Counterfactual explanations and how to find them: literature review and benchmarking","author":"Guidotti","year":"2022","journal-title":"Data Min Knowl Disc"},{"key":"2024062008073690200_ocae114-B29","first-page":"607","author":"Mothilal","year":"2020"},{"key":"2024062008073690200_ocae114-B30","first-page":"353","author":"Karimi","year":"2021"},{"key":"2024062008073690200_ocae114-B31","first-page":"1321","author":"Guo","year":"2017"},{"key":"2024062008073690200_ocae114-B32","first-page":"5998","article-title":"Attention is all you need","volume":"30","author":"Vaswani","year":"2017","journal-title":"Adv Neural Inform Process Syst"},{"key":"2024062008073690200_ocae114-B33","first-page":"18932","volume-title":"Advances in Neural Information Processing Systems","author":"Gorishniy","year":"2021"},{"key":"2024062008073690200_ocae114-B34","first-page":"785","author":"Chen","year":"2016"},{"issue":"1","key":"2024062008073690200_ocae114-B35","doi-asserted-by":"crossref","first-page":"17981","DOI":"10.1038\/s41598-022-22514-4","article-title":"Artificial intelligence-based methods for fusion of electronic health records and imaging data","volume":"12","author":"Mohsen","year":"2022","journal-title":"Sci Rep"},{"key":"2024062008073690200_ocae114-B36","first-page":"2053","author":"Zhi","year":"2022"},{"issue":"9266","key":"2024062008073690200_ocae114-B37","doi-asserted-by":"crossref","first-page":"1385","DOI":"10.1016\/S0140-6736(00)04560-8","article-title":"Effect of carvedilol on outcome after myocardial infarction in patients with left-ventricular dysfunction: the CAPRICORN randomised trial","volume":"357","author":"Investigators","year":"2001","journal-title":"Lancet"},{"issue":"38","key":"2024062008073690200_ocae114-B38","doi-asserted-by":"crossref","first-page":"3720","DOI":"10.1093\/eurheartj\/ehad191","article-title":"2023 ESC guidelines for the management of acute coronary syndromes: developed by the task force on the management of acute coronary syndromes of the European Society of Cardiology (ESC)","volume":"44","author":"Byrne","year":"2023","journal-title":"Eur Heart J"},{"issue":"8","key":"2024062008073690200_ocae114-B39","doi-asserted-by":"crossref","first-page":"e0199347","DOI":"10.1371\/journal.pone.0199347","article-title":"Long-term use of carvedilol in patients with ST-segment elevation myocardial infarction treated with primary percutaneous coronary intervention","volume":"13","author":"Watanabe","year":"2018","journal-title":"PLoS One"},{"issue":"2","key":"2024062008073690200_ocae114-B40","doi-asserted-by":"crossref","first-page":"e21","DOI":"10.1016\/j.jacc.2021.09.006","article-title":"2021 ACC\/AHA\/SCAI guideline for coronary artery revascularization: a report of the American College of Cardiology\/American Heart Association Joint Committee on Clinical Practice Guidelines","volume":"79","author":"Members","year":"2022","journal-title":"J Am Coll Cardiol"},{"issue":"1","key":"2024062008073690200_ocae114-B41","doi-asserted-by":"crossref","first-page":"4329","DOI":"10.1038\/s41598-022-07890-1","article-title":"A hybrid machine learning\/deep learning COVID-19 severity predictive model from CT images and clinical data","volume":"12","author":"Chieregato","year":"2022","journal-title":"Sci Rep"},{"issue":"10","key":"2024062008073690200_ocae114-B42","doi-asserted-by":"crossref","first-page":"e0224502","DOI":"10.1371\/journal.pone.0224502","article-title":"Deep-learning-based risk stratification for mortality of patients with acute myocardial infarction","volume":"14","author":"Kwon","year":"2019","journal-title":"PLoS One"},{"issue":"1","key":"2024062008073690200_ocae114-B43","doi-asserted-by":"crossref","first-page":"70","DOI":"10.1186\/s12911-023-02168-6","article-title":"Machine learning prediction of mortality in acute myocardial infarction","volume":"23","author":"Oliveira","year":"2023","journal-title":"BMC Med Inform Decis Mak"},{"key":"2024062008073690200_ocae114-B44","doi-asserted-by":"crossref","first-page":"104427","DOI":"10.1016\/j.jbi.2023.104427","article-title":"Representation of time-varying and time-invariant EMR data and its application in modeling outcome prediction for heart failure patients","volume":"143","author":"Huang","year":"2023","journal-title":"J Biomed Inform"},{"key":"2024062008073690200_ocae114-B45","doi-asserted-by":"crossref","first-page":"1246746","DOI":"10.3389\/fphys.2023.1246746","article-title":"Deep learning for ECG arrhythmia detection and classification: an overview of progress for period 2017-2023","volume":"14","author":"Ansari","year":"2023","journal-title":"Front Physiol"},{"issue":"6","key":"2024062008073690200_ocae114-B46","doi-asserted-by":"crossref","first-page":"e567","DOI":"10.1016\/j.jtcvs.2023.01.022","article-title":"Clinical utility of a deep-learning mortality prediction model for cardiac surgery decision making","volume":"166","author":"Allou","year":"2023","journal-title":"J Thorac Cardiovasc Surg"},{"key":"2024062008073690200_ocae114-B47","doi-asserted-by":"crossref","first-page":"11795468221133611","DOI":"10.1177\/11795468221133611","article-title":"XGBoost, a novel explainable AI technique, in the prediction of myocardial infarction: a UK Biobank Cohort Study","volume":"16","author":"Moore","year":"2022","journal-title":"Clin Med Insights Cardiol"},{"issue":"4","key":"2024062008073690200_ocae114-B48","doi-asserted-by":"crossref","first-page":"126","DOI":"10.1016\/j.cvdhj.2023.06.001","article-title":"Explainable SHAP-XGBoost models for in-hospital mortality after myocardial infarction","volume":"4","author":"Tarabanis","year":"2023","journal-title":"Cardiovasc Digit Health J"},{"issue":"10065","key":"2024062008073690200_ocae114-B49","doi-asserted-by":"crossref","first-page":"197","DOI":"10.1016\/S0140-6736(16)30677-8","article-title":"Acute myocardial infarction","volume":"389","author":"Reed","year":"2017","journal-title":"Lancet"}],"container-title":["Journal of the American Medical Informatics Association"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/jamia\/article-pdf\/31\/7\/1540\/58243700\/ocae114.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/jamia\/article-pdf\/31\/7\/1540\/58243700\/ocae114.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,6,20]],"date-time":"2024-06-20T08:11:59Z","timestamp":1718871119000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jamia\/article\/31\/7\/1540\/7683735"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,5,28]]},"references-count":49,"journal-issue":{"issue":"7","published-online":{"date-parts":[[2024,5,28]]},"published-print":{"date-parts":[[2024,6,20]]}},"URL":"https:\/\/doi.org\/10.1093\/jamia\/ocae114","relation":{},"ISSN":["1067-5027","1527-974X"],"issn-type":[{"value":"1067-5027","type":"print"},{"value":"1527-974X","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2024,7]]},"published":{"date-parts":[[2024,5,28]]}}}