{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,13]],"date-time":"2026-03-13T05:11:51Z","timestamp":1773378711564,"version":"3.50.1"},"reference-count":35,"publisher":"Oxford University Press (OUP)","issue":"3","license":[{"start":{"date-parts":[[2025,12,25]],"date-time":"2025-12-25T00:00:00Z","timestamp":1766620800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/pages\/standard-publication-reuse-rights"}],"funder":[{"DOI":"10.13039\/100000002","name":"National Institutes of Health","doi-asserted-by":"publisher","award":["F31 NS115447"],"award-info":[{"award-number":["F31 NS115447"]}],"id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2026,3,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Objective<\/jats:title>\n                    <jats:p>To understand the heterogeneous treatment effects of electronic alerts for acute kidney injury (AKI).<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Materials and Methods<\/jats:title>\n                    <jats:p>Secondary analysis of individual patient data from 3 randomized controlled trials. Our outcome measure was 14-day all-cause mortality. Data from the ELAIA-1 trial were used to predict the individualized effect of alerts on mortality based on patients\u2019 phenotype. Results were internally validated on a holdout dataset and externally validated using data from 2 additional trials: UPenn and ELAIA-2. We used machine learning-based methods and performed a meta-analysis on individual patient data to identify patient subgroups whose risk of mortality was associated with alerts. In addition, provider actions following alerts were examined to explain how alerts impacted patient mortality.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>Compared to patients who were predicted to be harmed by an alert, patients predicted to benefit had a lower risk of death in both the internal validation cohort (n\u2009=\u20091809 patients; Pinteraction\u2009=\u2009.045) and both external validation cohorts (n\u2009=\u20097453 patients; Pinteraction\u2009&amp;lt;\u2009.0001). In external cohorts, 43 deaths may have been preventable if alerts were restricted to likely beneficiaries. Machine-learning based meta-analysis identified reduced mortality with alerts among patients with higher blood pressures (BP) and lower predicted risk, but increased mortality in non-urban and non-teaching hospitals. Provider responses to alerts differed across subgroups.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Discussion<\/jats:title>\n                    <jats:p>Our findings indicate substantial heterogeneity in the effects of AKI alerts on patient mortality. Tailoring alert delivery based on predicted benefit may mitigate harm and enhance clinical outcomes.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusion<\/jats:title>\n                    <jats:p>Individualizing automated alerts may reduce all-cause mortality. A prospective trial of individualized alerts is needed to confirm these results.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Trial registration<\/jats:title>\n                    <jats:p>https:\/\/clinicaltrials.gov\/ct2\/show\/NCT02753751 and https:\/\/clinicaltrials.gov\/ct2\/show\/NCT02771977.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1093\/jamia\/ocaf222","type":"journal-article","created":{"date-parts":[[2025,12,8]],"date-time":"2025-12-08T12:33:43Z","timestamp":1765197223000},"page":"653-662","source":"Crossref","is-referenced-by-count":0,"title":["Heterogenous effect of automated alerts on mortality"],"prefix":"10.1093","volume":"33","author":[{"given":"Benjamin D","family":"Wissel","sequence":"first","affiliation":[{"name":"Division of Biomedical Informatics, Cincinnati Children\u2019s Hospital Medical Center , Cincinnati, OH 45229,","place":["United States"]},{"name":"Department of Neurosurgery, Duke University , Durham, NC 27710,","place":["United States"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2314-8118","authenticated-orcid":false,"given":"Zana","family":"Percy","sequence":"additional","affiliation":[{"name":"Department of Environmental and Public Health Sciences, University of Cincinnati College of Medicine , Cincinnati, OH 45267,","place":["United States"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Tanner J","family":"Zachem","sequence":"additional","affiliation":[{"name":"Department of Neurosurgery, Duke University , Durham, NC 27710,","place":["United States"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Brett","family":"Beaulieu-Jones","sequence":"additional","affiliation":[{"name":"Section of Biomedical Data Science, Department of Medicine, University of Chicago , Chicago, IL 60637,","place":["United States"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Isaac S","family":"Kohane","sequence":"additional","affiliation":[{"name":"Department of Biomedical Informatics, Harvard Medical School , Boston, MA 02115,","place":["United States"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Stuart L","family":"Goldstein","sequence":"additional","affiliation":[{"name":"Department of Pediatrics, University of Cincinnati College of Medicine , Cincinnati, OH 45229,","place":["United States"]},{"name":"Center for Acute Care Nephrology, Cincinnati Children\u2019s Hospital Medical Center , Cincinnati, OH 45229,","place":["United States"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Emrah","family":"Gecili","sequence":"additional","affiliation":[{"name":"Department of Pediatrics, University of Cincinnati College of Medicine , Cincinnati, OH 45229,","place":["United States"]},{"name":"Division of Biostatistics and Epidemiology, Cincinnati Children\u2019s Hospital Medical Center , Cincinnati, OH 45229,","place":["United States"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Judith W","family":"Dexheimer","sequence":"additional","affiliation":[{"name":"Department of Pediatrics, University of Cincinnati College of Medicine , Cincinnati, OH 45229,","place":["United States"]},{"name":"Division of Emergency Medicine, Cincinnati Children\u2019s Hospital Medical Center , Cincinnati, OH 45229,","place":["United States"]}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"286","published-online":{"date-parts":[[2025,12,25]]},"reference":[{"key":"2026031216454400500_ocaf222-B1","doi-asserted-by":"crossref","first-page":"1949","DOI":"10.1016\/S0140-6736(19)32563-2","article-title":"Acute kidney injury","volume":"394","author":"Ronco","year":"2019","journal-title":"Lancet"},{"key":"2026031216454400500_ocaf222-B2","doi-asserted-by":"crossref","first-page":"1411","DOI":"10.1007\/s00134-015-3934-7","article-title":"Epidemiology of acute kidney injury in critically ill patients: the multinational AKI-EPI study","volume":"41","author":"Hoste","year":"2015","journal-title":"Intensive Care Med"},{"key":"2026031216454400500_ocaf222-B3","doi-asserted-by":"crossref","first-page":"1482","DOI":"10.2215\/CJN.00710113","article-title":"World incidence of AKI: a meta-analysis","volume":"8","author":"Susantitaphong","year":"2013","journal-title":"Clin J Am Soc Nephrol"},{"key":"2026031216454400500_ocaf222-B4","author":"Stewart","year":"2009"},{"key":"2026031216454400500_ocaf222-B5","doi-asserted-by":"crossref","first-page":"m4786","DOI":"10.1136\/bmj.m4786","article-title":"Electronic health record alerts for acute kidney injury: multicenter, randomized clinical trial","volume":"372","author":"Wilson","year":"2021","journal-title":"BMJ"},{"key":"2026031216454400500_ocaf222-B6","doi-asserted-by":"crossref","first-page":"109","DOI":"10.7861\/clinmedicine.19-2-109","article-title":"The impact of the NHS electronic-alert system on the recognition and management of acute kidney injury in acute medicine","volume":"19","author":"West Midlands Acute Medicine Collaborative","year":"2019","journal-title":"Clin Med"},{"key":"2026031216454400500_ocaf222-B7","doi-asserted-by":"crossref","first-page":"265","DOI":"10.1093\/ndt\/gfw424","article-title":"Association between e-alert implementation for detection of acute kidney injury and outcomes: a systematic review","volume":"32","author":"Lachance","year":"2017","journal-title":"Nephrol Dial Transplant."},{"key":"2026031216454400500_ocaf222-B8","doi-asserted-by":"crossref","first-page":"1966","DOI":"10.1016\/S0140-6736(15)60266-5","article-title":"Automated, electronic alerts for acute kidney injury: a single-blind, parallel-group, randomised controlled trial","volume":"385","author":"Wilson","year":"2015","journal-title":"Lancet"},{"key":"2026031216454400500_ocaf222-B9","doi-asserted-by":"crossref","first-page":"2826","DOI":"10.1038\/s41467-023-38532-3","article-title":"A randomized clinical trial assessing the effect of automated medication-targeted alerts on acute kidney injury outcomes","volume":"14","author":"Wilson","year":"2023","journal-title":"Nat Commun."},{"key":"2026031216454400500_ocaf222-B10","doi-asserted-by":"crossref","first-page":"e025117","DOI":"10.1136\/bmjopen-2018-025117","article-title":"Electronic Alerts for Acute Kidney Injury Amelioration (ELAIA-1): a completely electronic, multicentre, randomised controlled trial: design and rationale","volume":"9","author":"Mutter","year":"2019","journal-title":"BMJ Open."},{"key":"2026031216454400500_ocaf222-B11","first-page":"1","article-title":"Kidney disease: improving global outcomes (KDIGO) acute kidney injury work group. KDIGO clinical practice guideline for acute kidney injury","volume":"2","author":"Kellum","year":"2012","journal-title":"Kidney Int Suppl (2011)."},{"key":"2026031216454400500_ocaf222-B12","doi-asserted-by":"crossref","first-page":"2011","DOI":"10.1093\/jamia\/ocaa088","article-title":"MINIMAR (MINimum Information for Medical AI Reporting): Developing reporting standards for artificial intelligence in health care","volume":"27","author":"Hernandez-Boussard","year":"2020","journal-title":"J Am Med Inform Assoc."},{"key":"2026031216454400500_ocaf222-B13","doi-asserted-by":"crossref","first-page":"112","DOI":"10.1093\/bioinformatics\/btr597","article-title":"MissForest\u2014non-parametric missing value imputation for mixed-type data","volume":"28","author":"Stekhoven","year":"2012","journal-title":"Bioinformatics."},{"key":"2026031216454400500_ocaf222-B14","doi-asserted-by":"crossref","first-page":"e796","DOI":"10.1016\/S2589-7500(22)00170-4","article-title":"Individualising intensive systolic blood pressure reduction in hypertension using computational trial phenomaps and machine learning: a post-hoc analysis of randomised clinical trials","volume":"4","author":"Oikonomou","year":"2022","journal-title":"Lancet Digit Health."},{"key":"2026031216454400500_ocaf222-B15","doi-asserted-by":"crossref","first-page":"2536","DOI":"10.1093\/eurheartj\/ehab223","article-title":"A phenomapping-derived tool to personalize the selection of anatomical vs functional testing in evaluating chest pain (ASSIST)","volume":"42","author":"Oikonomou","year":"2021","journal-title":"Eur Heart J"},{"key":"2026031216454400500_ocaf222-B16","doi-asserted-by":"crossref","first-page":"965","DOI":"10.2337\/dc21-1765","article-title":"Phenomapping-derived tool to individualize the effect of canagliflozin on cardiovascular risk in type 2 diabetes","volume":"45","author":"Oikonomou","year":"2022","journal-title":"Diabetes Care."},{"key":"2026031216454400500_ocaf222-B17","doi-asserted-by":"crossref","first-page":"2473","DOI":"10.1002\/sim.3623","article-title":"The estimation of average hazard ratios by weighted Cox regression","volume":"28","author":"Schemper","year":"2009","journal-title":"Stat Med"},{"key":"2026031216454400500_ocaf222-B18","doi-asserted-by":"crossref","first-page":"436","DOI":"10.1038\/nature14539","article-title":"Deep learning","volume":"521","author":"LeCun","year":"2015","journal-title":"Nature."},{"key":"2026031216454400500_ocaf222-B19","first-page":"785","author":"Chen","year":"2016"},{"key":"2026031216454400500_ocaf222-B20","author":"Lundberg","year":"2017"},{"key":"2026031216454400500_ocaf222-B21","doi-asserted-by":"crossref","first-page":"1657","DOI":"10.1001\/jama.2015.3656","article-title":"Preferred reporting items for a systematic review and meta-analysis of individual participant data: the PRISMA-IPD statement","volume":"313","author":"Stewart","year":"2015","journal-title":"JAMA."},{"key":"2026031216454400500_ocaf222-B22","doi-asserted-by":"crossref","first-page":"l4898","DOI":"10.1136\/bmj.l4898","article-title":"RoB 2: a revised tool for assessing risk of bias in randomised trials","volume":"366","author":"Sterne","year":"2019","journal-title":"BMJ"},{"key":"2026031216454400500_ocaf222-B23","author":"Therneau"},{"key":"2026031216454400500_ocaf222-B24","doi-asserted-by":"crossref","first-page":"1539","DOI":"10.1002\/sim.1186","article-title":"Quantifying heterogeneity in a meta-analysis","volume":"21","author":"Higgins","year":"2002","journal-title":"Stat Med"},{"key":"2026031216454400500_ocaf222-B25","doi-asserted-by":"crossref","first-page":"1","DOI":"10.18637\/jss.v036.i03","article-title":"Conducting meta-analyses in R with the metafor package","volume":"36","author":"Viechtbauer","year":"2010","journal-title":"J Stat Soft."},{"key":"2026031216454400500_ocaf222-B26","doi-asserted-by":"crossref","first-page":"4278579","DOI":"10.1155\/2016\/4278579","article-title":"Hospital mortality in the United States following acute kidney injury","volume":"2016","author":"Brown","year":"2016","journal-title":"Biomed Res Int."},{"key":"2026031216454400500_ocaf222-B27","doi-asserted-by":"crossref","first-page":"657","DOI":"10.1093\/ndt\/gfz246","article-title":"The acute kidney outreach to prevent deterioration and death trial: a large pilot study for a cluster-randomized trial","volume":"36","author":"Thomas","year":"2021","journal-title":"Nephrol Dialysis Transplant"},{"key":"2026031216454400500_ocaf222-B28","doi-asserted-by":"crossref","first-page":"118","DOI":"10.1038\/s41390-019-0550-1","article-title":"Acute kidney injury risk-based screening in pediatric inpatients: a pragmatic randomized trial","volume":"87","author":"Van Driest","year":"2020","journal-title":"Pediatr Res"},{"key":"2026031216454400500_ocaf222-B29","doi-asserted-by":"crossref","first-page":"1164","DOI":"10.1097\/CCM.0b013e3182387a6b","article-title":"Impact of real-time electronic alerting of acute kidney injury on therapeutic intervention and progression of RIFLE class","volume":"40","author":"Colpaert","year":"2012","journal-title":"Crit Care Med"},{"key":"2026031216454400500_ocaf222-B30","doi-asserted-by":"crossref","first-page":"1483","DOI":"10.1007\/s11255-018-1836-7","article-title":"Value of electronic alerts for acute kidney injury in high-risk wards: a pilot randomized controlled trial","volume":"50","author":"Wu","year":"2018","journal-title":"Int Urol Nephrol"},{"key":"2026031216454400500_ocaf222-B31","doi-asserted-by":"crossref","first-page":"1905","DOI":"10.1016\/S0140-6736(21)00768-6","article-title":"Effects of nurse-to-patient ratio legislation on nurse staffing and patient mortality, readmissions, and length of stay: a prospective study in a panel of hospitals","volume":"397","author":"McHugh","year":"2021","journal-title":"Lancet"},{"key":"2026031216454400500_ocaf222-B32","doi-asserted-by":"crossref","first-page":"1037","DOI":"10.1056\/NEJMsa1001025","article-title":"Nurse staffing and inpatient hospital mortality","volume":"364","author":"Needleman","year":"2011","journal-title":"N Engl J Med"},{"key":"2026031216454400500_ocaf222-B33","doi-asserted-by":"crossref","first-page":"58","DOI":"10.1056\/NEJMra1214243","article-title":"Acute kidney injury and chronic kidney disease as interconnected syndromes","volume":"371","author":"Chawla","year":"2014","journal-title":"N Engl J Med"},{"key":"2026031216454400500_ocaf222-B34","doi-asserted-by":"crossref","first-page":"1723","DOI":"10.2215\/CJN.02430315","article-title":"False-positive rate of AKI using consensus creatinine-based criteria","volume":"10","author":"Lin","year":"2015","journal-title":"Clin J Am Soc Nephrol"},{"key":"2026031216454400500_ocaf222-B35","doi-asserted-by":"crossref","first-page":"1223","DOI":"10.1001\/jama.293.10.1223","article-title":"Effects of computerized clinical decision support systems on practitioner performance and patient outcomes: a systematic review","volume":"293","author":"Garg","year":"2005","journal-title":"JAMA."}],"container-title":["Journal of the American Medical Informatics Association"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/jamia\/advance-article-pdf\/doi\/10.1093\/jamia\/ocaf222\/66126745\/ocaf222.pdf","content-type":"application\/pdf","content-version":"am","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/jamia\/article-pdf\/33\/3\/653\/66126745\/ocaf222.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/jamia\/article-pdf\/33\/3\/653\/66126745\/ocaf222.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,3,12]],"date-time":"2026-03-12T20:45:55Z","timestamp":1773348355000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jamia\/article\/33\/3\/653\/8404606"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,12,25]]},"references-count":35,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2025,12,25]]},"published-print":{"date-parts":[[2026,3,1]]}},"URL":"https:\/\/doi.org\/10.1093\/jamia\/ocaf222","relation":{},"ISSN":["1067-5027","1527-974X"],"issn-type":[{"value":"1067-5027","type":"print"},{"value":"1527-974X","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2026,3]]},"published":{"date-parts":[[2025,12,25]]}}}