{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,6]],"date-time":"2026-05-06T08:38:25Z","timestamp":1778056705293,"version":"3.51.4"},"reference-count":10,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2021,8,10]],"date-time":"2021-08-10T00:00:00Z","timestamp":1628553600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2021,8,10]],"date-time":"2021-08-10T00:00:00Z","timestamp":1628553600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["npj Digit. Med."],"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Advances in medical machine learning are expected to help personalize care, improve outcomes, and reduce wasteful spending. In quantifying potential benefits, it is important to account for constraints arising from clinical workflows. Practice variation is known to influence the accuracy and generalizability of predictive models, but its effects on cost-effectiveness and utilization are less well-described. A simulation-based approach by Mi\u0161i\u0107 and colleagues goes beyond simple performance metrics to evaluate how process variables may influence the impact and financial feasibility of clinical prediction algorithms.<\/jats:p>","DOI":"10.1038\/s41746-021-00495-4","type":"journal-article","created":{"date-parts":[[2021,8,10]],"date-time":"2021-08-10T10:03:10Z","timestamp":1628589790000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["Beyond performance metrics: modeling outcomes and cost for clinical machine learning"],"prefix":"10.1038","volume":"4","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-6134-4339","authenticated-orcid":false,"given":"James A.","family":"Diao","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5493-1762","authenticated-orcid":false,"given":"Leia","family":"Wedlund","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7517-2291","authenticated-orcid":false,"given":"Joseph","family":"Kvedar","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2021,8,10]]},"reference":[{"key":"495_CR1","doi-asserted-by":"publisher","first-page":"k1479","DOI":"10.1136\/bmj.k1479","volume":"361","author":"D Agniel","year":"2018","unstructured":"Agniel, D., Kohane, I. S. & Weber, G. M. Biases in electronic health record data due to processes within the healthcare system: retrospective observational study. BMJ 361, k1479 (2018).","journal-title":"BMJ"},{"key":"495_CR2","doi-asserted-by":"publisher","first-page":"62","DOI":"10.1038\/s41746-021-00426-3","volume":"4","author":"BK Beaulieu-Jones","year":"2021","unstructured":"Beaulieu-Jones, B. K. et al. Machine learning for patient risk stratification: standing on, or looking over, the shoulders of clinicians? NPJ Digit. Med. 4, 62 (2021).","journal-title":"NPJ Digit. Med."},{"key":"495_CR3","doi-asserted-by":"publisher","first-page":"98","DOI":"10.1038\/s41746-021-00468-7","volume":"4","author":"VV Mi\u0161i\u0107","year":"2021","unstructured":"Mi\u0161i\u0107, V. V., Rajaram, K. & Gabel, E. A simulation-based evaluation of machine learning models for clinical decision support: application and analysis using hospital readmission. NPJ Digit Med. 4, 98 (2021).","journal-title":"NPJ Digit Med."},{"key":"495_CR4","doi-asserted-by":"publisher","first-page":"968","DOI":"10.1097\/ALN.0000000000003140","volume":"132","author":"VV Mi\u0161i\u0107","year":"2020","unstructured":"Mi\u0161i\u0107, V. V., Gabel, E., Hofer, I., Rajaram, K. & Mahajan, A. Machine learning prediction of postoperative emergency department hospital readmission. Anesthesiology 132, 968\u2013980 (2020).","journal-title":"Anesthesiology"},{"key":"495_CR5","doi-asserted-by":"publisher","first-page":"975","DOI":"10.1001\/jamainternmed.2017.1136","volume":"177","author":"TK Nuckols","year":"2017","unstructured":"Nuckols, T. K. et al. Economic evaluation of quality improvement interventions designed to prevent hospital readmission: a systematic review and meta-analysis. JAMA Intern. Med. 177, 975\u2013985 (2017).","journal-title":"JAMA Intern. Med."},{"key":"495_CR6","doi-asserted-by":"publisher","first-page":"471","DOI":"10.1146\/annurev-med-022613-090415","volume":"65","author":"S Kripalani","year":"2014","unstructured":"Kripalani, S., Theobald, C. N., Anctil, B. & Vasilevskis, E. E. Reducing hospital readmission rates: current strategies and future directions. Annu. Rev. Med. 65, 471\u2013485 (2014).","journal-title":"Annu. Rev. Med."},{"key":"495_CR7","doi-asserted-by":"publisher","unstructured":"Reyna, M. et al. Early Prediction of Sepsis from Clinical Data: The PhysioNet\/Computing in Cardiology Challenge 2019. 2019 Computing in Cardiology Conference (CinC) (2019) https:\/\/doi.org\/10.22489\/cinc.2019.412.","DOI":"10.22489\/cinc.2019.412"},{"key":"495_CR8","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/s13054-019-2563-x","volume":"23","author":"M Flechet","year":"2019","unstructured":"Flechet, M. et al. Machine learning versus physicians\u2019 prediction of acute kidney injury in critically ill adults: a prospective evaluation of the AKIpredictor. Crit. Care 23, 1\u201310 (2019).","journal-title":"Crit. Care"},{"key":"495_CR9","doi-asserted-by":"publisher","first-page":"92","DOI":"10.1038\/s41746-021-00449-w","volume":"4","author":"M Nikolova-Simons","year":"2021","unstructured":"Nikolova-Simons, M. et al. A randomized trial examining the effect of predictive analytics and tailored interventions on the cost of care. NPJ Digit. Med. 4, 92 (2021).","journal-title":"NPJ Digit. Med"},{"key":"495_CR10","doi-asserted-by":"publisher","first-page":"685","DOI":"10.1056\/NEJM198703123161109","volume":"316","author":"WB Schwartz","year":"1987","unstructured":"Schwartz, W. B., Patil, R. S. & Szolovits, P. Artificial intelligence in medicine. Where do we stand? N. Engl. J. Med. 316, 685\u2013688 (1987).","journal-title":"N. Engl. J. Med."}],"container-title":["npj Digital Medicine"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.nature.com\/articles\/s41746-021-00495-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41746-021-00495-4","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41746-021-00495-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,12,3]],"date-time":"2022-12-03T18:56:58Z","timestamp":1670093818000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.nature.com\/articles\/s41746-021-00495-4"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,8,10]]},"references-count":10,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2021,12]]}},"alternative-id":["495"],"URL":"https:\/\/doi.org\/10.1038\/s41746-021-00495-4","relation":{},"ISSN":["2398-6352"],"issn-type":[{"value":"2398-6352","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,8,10]]},"assertion":[{"value":"11 June 2021","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"27 July 2021","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"10 August 2021","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"J.K. is the Editor-in-Chief of <i>npj Digital Medicine<\/i>. J.A.D. and L.W. declare no competing interests.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"119"}}