{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,8]],"date-time":"2026-07-08T20:23:28Z","timestamp":1783542208529,"version":"3.55.0"},"reference-count":50,"publisher":"Oxford University Press (OUP)","issue":"2","license":[{"start":{"date-parts":[[2025,11,11]],"date-time":"2025-11-11T00:00:00Z","timestamp":1762819200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc\/4.0\/"}],"funder":[{"name":"Clinical Excellence Queensland"},{"name":"Queensland Technology Future Fund, Department of Health, Queensland Government"},{"DOI":"10.13039\/501100003550","name":"Queensland Government","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100003550","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Advanced Queensland Industry Research Fellowship"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2026,2,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Objective<\/jats:title>\n                    <jats:p>To introduce a novel, standardised approach to evaluating AI prediction models in balancing effectiveness, efficiency and utility, using a sepsis prediction model case study.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Materials and Methods<\/jats:title>\n                    <jats:p>Retrospective patient data from electronic medical records of 7 public hospitals was used to retrain and evaluate a machine learning sepsis prediction model. Four conventional metrics\u2014area under the receiver operating curve (AUROC), sensitivity, positive predictive value, and specificity\u2014were compared with a novel graphical display integrating metrics of predictive accuracy (effectiveness), alert burden (efficiency) and lead time of alerts relative to clinical events (utility) for different alert thresholds.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>The dataset comprised 977,506 inpatient admissions. The novel methodology produced a plot of four vertically aligned graphs that enables decision-makers to identify an alert threshold that optimally balances effectiveness, efficiency and utility (EEU) at the level of an entire admission, and which differs from that derived using conventional metrics.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Discussion<\/jats:title>\n                    <jats:p>Conventional evaluation metrics do not consider alert timing relative to clinical events and are often applied to different evaluation datasets (sample and admission level), introducing bias and confusion. In contrast, the EEU methodology (i) generates admission level evaluations at different alert thresholds; (ii) measures alert timing relative to clinical events; and (iii) provides a visual display that enables identification of the alert threshold that optimally balances EEU factors.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusion<\/jats:title>\n                    <jats:p>Evaluations of prediction models for adverse events in hospitalised patients should incorporate the EEU approach in assessing model suitability and selecting alert thresholds.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1093\/jamia\/ocaf192","type":"journal-article","created":{"date-parts":[[2025,11,11]],"date-time":"2025-11-11T13:00:13Z","timestamp":1762866013000},"page":"304-315","source":"Crossref","is-referenced-by-count":1,"title":["A novel, standardised approach to balancing effectiveness, efficiency and utility of surveillance AI prediction models for hospitalised patients using sepsis prediction as an exemplar"],"prefix":"10.1093","volume":"33","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5642-5188","authenticated-orcid":false,"given":"Anton H","family":"van der Vegt","sequence":"first","affiliation":[{"name":"Queensland Digital Health Centre, The University of Queensland , Brisbane, QLD, 4006,","place":["Australia"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Victoria K","family":"Campbell","sequence":"additional","affiliation":[{"name":"Intensive Care Unit, Sunshine Coast Hospital and Health Service , Birtinya, QLD, 4575,","place":["Australia"]},{"name":"Clinical Excellence Queensland, Patient Safety and Quality , Herston, QLD, 4006,","place":["Australia"]},{"name":"School of Medicine and Dentistry, Griffith University , Birtinya, QLD, 4575,","place":["Australia"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Robert","family":"Webb","sequence":"additional","affiliation":[{"name":"Clinical Informatics, Metro North Hospital and Health Service , Brisbane, QLD, 4006,","place":["Australia"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Balasubramanian","family":"Venkatesh","sequence":"additional","affiliation":[{"name":"Queensland Sepsis Program, Patient Safety and Quality, Clinical Excellence Queensland , Herston, QLD, 4006,","place":["Australia"]},{"name":"Critical Care Program, The George Institute for Global Health , Barangaroo, NSW, 2000,","place":["Australia"]},{"name":"School of Medicine, Faculty of Health Medicine and Behavioural Sciences, University of Queensland , Brisbane, QLD, 4072,","place":["Australia"]},{"name":"The Gold Coast University Hospital , Southport, QLD, 4215,","place":["Australia"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Paul J","family":"Lane","sequence":"additional","affiliation":[{"name":"Queensland Sepsis Program, Patient Safety and Quality, Clinical Excellence Queensland , Herston, QLD, 4006,","place":["Australia"]},{"name":"Safety Quality and Innovation, The Prince Charles Hospital , Chermside, QLD, 4032,","place":["Australia"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kathryn","family":"Wilks","sequence":"additional","affiliation":[{"name":"Queensland Sepsis Program, Patient Safety and Quality, Clinical Excellence Queensland , Herston, QLD, 4006,","place":["Australia"]},{"name":"Infectious Diseases Unit, Sunshine Coast Hospital and Health Service , Birtinya, QLD, 4575,","place":["Australia"]},{"name":"School of Public Health, Faculty of Health Medicine and Behavioural Sciences, The University of Queensland , Herston, QLD, 2006,","place":["Australia"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Steven","family":"McPhail","sequence":"additional","affiliation":[{"name":"Australian Centre for Health Services Innovation and Centre for Healthcare Transformation, Queensland University of Technology , Kelvin Grove , QLD, 4059,","place":["Australia"]},{"name":"Digital Health and Informatics Directorate, Metro South Health , Brisbane, QLD, 4102,","place":["Australia"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Michael","family":"Rice","sequence":"additional","affiliation":[{"name":"Clinical Excellence Queensland, Patient Safety and Quality , Herston, QLD, 4006,","place":["Australia"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tara","family":"Isaacs","sequence":"additional","affiliation":[{"name":"Queensland Digital Health Centre, The University of Queensland , Brisbane, QLD, 4006,","place":["Australia"]},{"name":"Clinical Excellence Queensland, Patient Safety and Quality , Herston, QLD, 4006,","place":["Australia"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ahmad","family":"Abdel-Hafez","sequence":"additional","affiliation":[{"name":"Clinical and Business Intelligence, eHealth Queensland , Brisbane, QLD, 4006,","place":["Australia"]},{"name":"College of Computing and Information Technology, University of Doha for Science and Technology , Doha, Qatar"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Stephen","family":"Whebell","sequence":"additional","affiliation":[{"name":"Intensive Care Unit, Townsville University Hospital , Douglas, QLD, 4814,","place":["Australia"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8974-6789","authenticated-orcid":false,"given":"Adam","family":"Irwin","sequence":"additional","affiliation":[{"name":"Centre for Clinical Research, The University of Queensland , Brisbane, QLD, 4006,","place":["Australia"]},{"name":"Infection Management and Prevention Service, Queensland Children\u2019s Hospital , Brisbane, QLD, 4101,","place":["Australia"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Rudolf J","family":"Schnetler","sequence":"additional","affiliation":[{"name":"Townsville Institute of Health Research and Innovation, Townsville University Hospital , Douglas, QLD, 4814,","place":["Australia"]},{"name":"School of Information Technology and Electrical Engineering, The University of Queensland , Brisbane, QLD, 4072,","place":["Australia"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Amith","family":"Shetty","sequence":"additional","affiliation":[{"name":"New South Wales Ministry of Health , St Leonards, NSW, 2065,","place":["Australia"]},{"name":"Biomedical Informatics and Digital Informatics Division, University of Sydney , Sydney, NSW, 2006,","place":["Australia"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ian A","family":"Scott","sequence":"additional","affiliation":[{"name":"Queensland Digital Health Centre, The University of Queensland , Brisbane, QLD, 4006,","place":["Australia"]},{"name":"Digital Health and Informatics Directorate, Metro South Health , Brisbane, QLD, 4102,","place":["Australia"]}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"286","published-online":{"date-parts":[[2025,11,11]]},"reference":[{"key":"2026012716175167300_ocaf192-B1","doi-asserted-by":"publisher","first-page":"509","DOI":"10.1093\/jamia\/ocad220","article-title":"Systematic review and longitudinal analysis of implementing Artificial Intelligence to predict clinical deterioration in adult hospitals: What is known and what remains uncertain","volume":"31","author":"Van Der Vegt","year":"2024","journal-title":"J Am Med Inform Assoc"},{"key":"2026012716175167300_ocaf192-B2","doi-asserted-by":"publisher","first-page":"1349","DOI":"10.1093\/jamia\/ocad075","article-title":"Deployment of machine learning algorithms to predict sepsis: systematic review and application of the SALIENT clinical AI implementation framework","volume":"30","author":"Van Der Vegt","year":"2023","journal-title":"J Am Med Inform Assoc"},{"key":"2026012716175167300_ocaf192-B3","doi-asserted-by":"publisher","first-page":"25","DOI":"10.3390\/informatics7030025","article-title":"Clinical implementation of predictive models embedded within electronic health record systems: a systematic review","volume":"7","author":"Lee","year":"2020","journal-title":"Informatics"},{"key":"2026012716175167300_ocaf192-B4","doi-asserted-by":"publisher","first-page":"1198","DOI":"10.1097\/CCM.0000000000005554","article-title":"The impact of health information technology for early detection of patient deterioration on mortality and length of stay in the hospital acute care setting: systematic review and meta-analysis","volume":"50","author":"Herasevich","year":"2022","journal-title":"Crit Care Med"},{"key":"2026012716175167300_ocaf192-B5","doi-asserted-by":"publisher","first-page":"e367","DOI":"10.1016\/S2589-7500(24)00047-5","article-title":"Randomised controlled trials evaluating artificial intelligence in clinical practice: a scoping review","volume":"6","author":"Han","year":"2024","journal-title":"Lancet Digit Health"},{"key":"2026012716175167300_ocaf192-B6","doi-asserted-by":"publisher","first-page":"725","DOI":"10.1136\/bmjqs-2021-014527","article-title":"A scoping review of real-time automated clinical deterioration alerts and evidence of impacts on hospitalised patient outcomes","volume":"31","author":"Blythe","year":"2022","journal-title":"BMJ Qual Saf"},{"key":"2026012716175167300_ocaf192-B7","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3613904.3642343","author":"Zhang","year":"2024"},{"key":"2026012716175167300_ocaf192-B8","doi-asserted-by":"publisher","first-page":"319","DOI":"10.2307\/249008","article-title":"Perceived usefulness, perceived ease of use, and user acceptance of information technology","volume":"13","author":"Davis","year":"1989","journal-title":"Mis Q"},{"key":"2026012716175167300_ocaf192-B9","doi-asserted-by":"crossref","first-page":"425","DOI":"10.2307\/30036540","article-title":"User acceptance of information technology: toward a unified view","volume":"27","author":"Venkatesh","year":"2003","journal-title":"MIS Q. Published Online"},{"key":"2026012716175167300_ocaf192-B10","doi-asserted-by":"publisher","DOI":"10.3233\/SHTI190111","volume-title":"Studies in Health Technology and Informatics","author":"Ammenwerth Elske","year":"2019"},{"key":"2026012716175167300_ocaf192-B11","doi-asserted-by":"publisher","first-page":"e078378","DOI":"10.1136\/bmj-2023-078378","article-title":"TRIPOD+AI statement: updated guidance for reporting clinical prediction models that use regression or machine learning methods","volume":"385","author":"Collins","year":"2024","journal-title":"BMJ"},{"key":"2026012716175167300_ocaf192-B12","doi-asserted-by":"publisher","first-page":"32","DOI":"10.1056\/AIoa2300032","article-title":"Evaluation of sepsis prediction models before onset of treatment","volume":"1","author":"Kamran","year":"2024","journal-title":"Nejm Ai"},{"key":"2026012716175167300_ocaf192-B13","doi-asserted-by":"publisher","first-page":"762","DOI":"10.1001\/jama.2016.0288","article-title":"Assessment of clinical criteria for sepsis for the third international consensus definitions for sepsis and septic shock (sepsis-3)","volume":"315","author":"Seymour","year":"2016","journal-title":"JAMA\u2014J Am Med Assoc"},{"key":"2026012716175167300_ocaf192-B14","author":"Calster"},{"key":"2026012716175167300_ocaf192-B15","doi-asserted-by":"publisher","first-page":"18","DOI":"10.1186\/s41512-019-0064-7","article-title":"A simple, step-by-step guide to interpreting decision curve analysis","volume":"3","author":"Vickers","year":"2019","journal-title":"Diagn Progn Res"},{"key":"2026012716175167300_ocaf192-B16","doi-asserted-by":"publisher","first-page":"580","DOI":"10.1136\/bmjqs-2024-018328","article-title":"False hope of a single generalisable AI sepsis prediction model: bias and proposed mitigation strategies for improving performance based on a retrospective multisite cohort study","volume":"34","author":"Schnetler","year":"2025","journal-title":"BMJ Qual Saf"},{"key":"2026012716175167300_ocaf192-B17","doi-asserted-by":"publisher","first-page":"1065","DOI":"10.1001\/jamainternmed.2021.2626","article-title":"External validation of a widely implemented proprietary sepsis prediction model in hospitalized patients","volume":"181","author":"Wong","year":"2021","journal-title":"JAMA Intern Med"},{"key":"2026012716175167300_ocaf192-B18","doi-asserted-by":"publisher","first-page":"e0046","DOI":"10.1097\/CCE.0000000000000046","article-title":"Retrospective observational study of the clinical performance characteristics of a machine learning approach to early sepsis identification","volume":"1","author":"Topiwala","year":"2019","journal-title":"Crit Care Explor"},{"key":"2026012716175167300_ocaf192-B19","doi-asserted-by":"publisher","first-page":"1485","DOI":"10.1097\/CCM.0000000000003891","article-title":"A machine learning algorithm to predict severe sepsis and septic shock: development, implementation, and impact on clinical practice","volume":"47","author":"Giannini","year":"2019","journal-title":"Crit Care Med"},{"key":"2026012716175167300_ocaf192-B20","doi-asserted-by":"publisher","first-page":"31","DOI":"10.1186\/s12873-016-0095-0","article-title":"Prospective evaluation of an automated method to identify patients with severe sepsis or septic shock in the emergency department","volume":"16","author":"Brown","year":"2016","journal-title":"BMC Emerg Med"},{"key":"2026012716175167300_ocaf192-B21","doi-asserted-by":"publisher","first-page":"238146831989966","DOI":"10.1177\/2381468319899663","article-title":"Development, implementation, and evaluation of an in-hospital optimized early warning score for patient deterioration","volume":"5","author":"O\u2019Brien","year":"2020","journal-title":"MDM Policy Pract"},{"key":"2026012716175167300_ocaf192-B22","doi-asserted-by":"publisher","first-page":"1129","DOI":"10.1513\/AnnalsATS.202006-698OC","article-title":"Evaluating a widely implemented proprietary deterioration index model among hospitalized patients with COVID-19","volume":"18","author":"Singh","year":"2021","journal-title":"Ann Am Thorac Soc"},{"key":"2026012716175167300_ocaf192-B23","doi-asserted-by":"publisher","first-page":"10","DOI":"10.1016\/j.jbi.2016.09.013","article-title":"Development and validation of an electronic medical record-based alert score for detection of inpatient deterioration outside the ICU","volume":"64","author":"Kipnis","year":"2016","journal-title":"J Biomed Inform"},{"key":"2026012716175167300_ocaf192-B24","doi-asserted-by":"publisher","first-page":"649","DOI":"10.1164\/rccm.201406-1022OC","article-title":"Multicenter development and validation of a risk stratification tool for ward patients","volume":"190","author":"Churpek","year":"2014","journal-title":"Am J Respir Crit Care Med"},{"key":"2026012716175167300_ocaf192-B25","doi-asserted-by":"publisher","first-page":"e008678","DOI":"10.1161\/JAHA.118.008678","article-title":"An algorithm based on deep learning for predicting in-hospital cardiac arrest","volume":"7","author":"Kwon","year":"2018","journal-title":"J Am Heart Assoc"},{"key":"2026012716175167300_ocaf192-B26","doi-asserted-by":"publisher","first-page":"e961","DOI":"10.1097\/CCM.0000000000005064","article-title":"A trend-based early warning score can be implemented in a hospital electronic medical record to effectively predict inpatient deterioration","volume":"49","author":"Bell","year":"2021","journal-title":"Crit Care Med"},{"key":"2026012716175167300_ocaf192-B27","doi-asserted-by":"publisher","first-page":"1468","DOI":"10.1097\/CCM.0000000000001716","article-title":"Real-time risk prediction on the wards: a feasibility study","volume":"44","author":"Kang","year":"2016","journal-title":"Crit Care Med"},{"key":"2026012716175167300_ocaf192-B28","doi-asserted-by":"publisher","first-page":"343","DOI":"10.3390\/jcm9020343","article-title":"MEWS++: enhancing the prediction of clinical deterioration in admitted patients through a machine learning model","volume":"9","author":"Kia","year":"2020","journal-title":"J Clin Med"},{"key":"2026012716175167300_ocaf192-B29","doi-asserted-by":"publisher","first-page":"e272","DOI":"10.1097\/CCM.0000000000005318","article-title":"Peripheral oxygen saturation facilitates assessment of respiratory dysfunction in the sequential organ failure assessment score with implications for the sepsis-3 criteria","volume":"50","author":"Valik","year":"2022","journal-title":"Crit Care Med"},{"key":"2026012716175167300_ocaf192-B30","doi-asserted-by":"publisher","first-page":"15","DOI":"10.1186\/s13054-022-04290-9","article-title":"The Sequential Organ Failure Assessment (SOFA) score: Has the time come for an update?","volume":"27","author":"Moreno","year":"2023","journal-title":"Crit Care"},{"key":"2026012716175167300_ocaf192-B31","author":"Ke"},{"key":"2026012716175167300_ocaf192-B32","doi-asserted-by":"publisher","first-page":"276","DOI":"10.1186\/s12911-020-01284-x","article-title":"Validation of a machine learning algorithm for early severe sepsis prediction: a retrospective study predicting severe sepsis up to 48 h in advance using a diverse dataset from 461 US hospitals","volume":"20","author":"Burdick","year":"2020","journal-title":"BMC Med Inform Decis Mak"},{"key":"2026012716175167300_ocaf192-B33","doi-asserted-by":"publisher","first-page":"79","DOI":"10.1016\/j.compbiomed.2019.04.027","article-title":"Evaluation of a machine learning algorithm for up to 48-hour advance prediction of sepsis using six vital signs","volume":"109","author":"Barton","year":"2019","journal-title":"Comput Biol Med"},{"key":"2026012716175167300_ocaf192-B34","doi-asserted-by":"publisher","first-page":"252","DOI":"10.1093\/jamiaopen\/ooaa006","article-title":"Machine learning for early detection of sepsis: an internal and temporal validation study","volume":"3","author":"Bedoya","year":"2020","journal-title":"JAMIA Open"},{"key":"2026012716175167300_ocaf192-B35","author":"Futoma","year":"2017"},{"key":"2026012716175167300_ocaf192-B36","doi-asserted-by":"publisher","first-page":"299ra122","DOI":"10.1126\/SCITRANSLMED.AAB3719\/SUPPL_FILE\/7-299RA122_SM.PDF","article-title":"A targeted real-time early warning score (TREWScore) for septic shock","volume":"7","author":"Henry","year":"2015","journal-title":"Sci Transl Med"},{"key":"2026012716175167300_ocaf192-B37","doi-asserted-by":"publisher","first-page":"166","DOI":"10.1016\/j.mayocp.2014.11.014","article-title":"Developing the surveillance algorithm for detection of failure to recognize and treat severe sepsis","volume":"90","author":"Harrison","year":"2015","journal-title":"Mayo Clin Proc"},{"key":"2026012716175167300_ocaf192-B38","doi-asserted-by":"publisher","first-page":"116","DOI":"10.1038\/s41586-019-1390-1","article-title":"A clinically applicable approach to continuous prediction of future acute kidney injury","volume":"572","author":"Toma\u0161ev","year":"2019","journal-title":"Nature"},{"key":"2026012716175167300_ocaf192-B39","author":"Hyland"},{"key":"2026012716175167300_ocaf192-B40","author":"Wiens"},{"key":"2026012716175167300_ocaf192-B41","doi-asserted-by":"publisher","first-page":"28","DOI":"10.1016\/j.resuscitation.2020.05.027","article-title":"Predicting clinical deterioration with Q-ADDS compared to NEWS, Between the Flags, and eCART track and trigger tools","volume":"153","author":"Campbell","year":"2020","journal-title":"Resuscitation"},{"key":"2026012716175167300_ocaf192-B42","author":"Royal College of Physicians","year":"2017"},{"key":"2026012716175167300_ocaf192-B43","doi-asserted-by":"publisher","first-page":"105084","DOI":"10.1016\/j.ijmedinf.2023.105084","article-title":"Evaluation of machine learning-based models for prediction of clinical deterioration: A systematic literature review","volume":"175","author":"Jahandideh","year":"2023","journal-title":"Int J Med Inform"},{"key":"2026012716175167300_ocaf192-B44","doi-asserted-by":"publisher","first-page":"1207","DOI":"10.1093\/jamia\/ocaa347","article-title":"Using machine learning to improve the accuracy of patient deterioration predictions: Mayo Clinic Early Warning Score (MC-EWS)","volume":"28","author":"Romero-Brufau","year":"2021","journal-title":"J Am Med Inform Assoc"},{"key":"2026012716175167300_ocaf192-B45","doi-asserted-by":"publisher","first-page":"346","DOI":"10.1186\/s13054-023-04609-0","article-title":"Prospective, multicenter validation of the deep learning-based cardiac arrest risk management system for predicting in-hospital cardiac arrest or unplanned intensive care unit transfer in patients admitted to general wards","volume":"27","author":"Cho","year":"2023","journal-title":"Crit Care"},{"key":"2026012716175167300_ocaf192-B46","doi-asserted-by":"publisher","first-page":"370","DOI":"10.1016\/j.jcjq.2022.05.005","article-title":"The Kaiser Permanente Northern California advance alert monitor program: an automated early warning system for adults at risk for in-hospital clinical deterioration","volume":"48","author":"Martinez","year":"2022","journal-title":"Jt Comm J Qual Patient Saf"},{"key":"2026012716175167300_ocaf192-B47","doi-asserted-by":"publisher","first-page":"932123","DOI":"10.3389\/fdgth.2022.932123","article-title":"From compute to care: lessons learned from deploying an early warning system into clinical practice","volume":"4","author":"Pou-Prom","year":"2022","journal-title":"Front Digit Health"},{"key":"2026012716175167300_ocaf192-B48","doi-asserted-by":"publisher","first-page":"99","DOI":"10.1145\/3351095.3372827","volume-title":"Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency","author":"Sendak","year":"2020"},{"key":"2026012716175167300_ocaf192-B49","doi-asserted-by":"publisher","first-page":"e000158","DOI":"10.1136\/bmjoq-2017-000158","article-title":"Reducing patient mortality, length of stay and readmissions through machine learning-based sepsis prediction in the emergency department, intensive care unit and hospital floor units","volume":"6","author":"McCoy","year":"2017","journal-title":"BMJ Open Qual"},{"key":"2026012716175167300_ocaf192-B50","doi-asserted-by":"publisher","first-page":"4","DOI":"10.1186\/s13040-023-00322-4","article-title":"The Matthews correlation coefficient (MCC) should replace the ROC AUC as the standard metric for assessing binary classification","volume":"16","author":"Chicco","year":"2023","journal-title":"BioData Min"}],"container-title":["Journal of the American Medical Informatics Association"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/jamia\/article-pdf\/33\/2\/304\/65268946\/ocaf192.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/jamia\/article-pdf\/33\/2\/304\/65268946\/ocaf192.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,1,27]],"date-time":"2026-01-27T21:18:00Z","timestamp":1769548680000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jamia\/article\/33\/2\/304\/8320456"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,11,11]]},"references-count":50,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2025,11,11]]},"published-print":{"date-parts":[[2026,2,1]]}},"URL":"https:\/\/doi.org\/10.1093\/jamia\/ocaf192","relation":{},"ISSN":["1067-5027","1527-974X"],"issn-type":[{"value":"1067-5027","type":"print"},{"value":"1527-974X","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2026,2]]},"published":{"date-parts":[[2025,11,11]]}}}