{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,13]],"date-time":"2026-04-13T17:31:10Z","timestamp":1776101470320,"version":"3.50.1"},"reference-count":71,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2022,7,19]],"date-time":"2022-07-19T00:00:00Z","timestamp":1658188800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2022,7,19]],"date-time":"2022-07-19T00:00:00Z","timestamp":1658188800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["npj Digit. Med."],"abstract":"<jats:title>Abstract<\/jats:title><jats:p>There is a large body of evidence showing that delayed initiation of sepsis bundle is associated with adverse clinical outcomes in patients with sepsis. However, it is controversial whether electronic automated alerts can help improve clinical outcomes of sepsis. Electronic databases are searched from inception to December 2021 for comparative effectiveness studies comparing automated alerts versus usual care for the management of sepsis. A total of 36 studies are eligible for analysis, including 6 randomized controlled trials and 30 non-randomized studies. There is significant heterogeneity in these studies concerning the study setting, design, and alerting methods. The Bayesian meta-analysis by using pooled effects of non-randomized studies as priors shows a beneficial effect of the alerting system (relative risk [RR]: 0.71; 95% credible interval: 0.62 to 0.81) in reducing mortality. The automated alerting system shows less beneficial effects in the intensive care unit (RR: 0.90; 95% CI: 0.73\u20131.11) than that in the emergency department (RR: 0.68; 95% CI: 0.51\u20130.90) and ward (RR: 0.71; 95% CI: 0.61\u20130.82). Furthermore, machine learning-based prediction methods can reduce mortality by a larger magnitude (RR: 0.56; 95% CI: 0.39\u20130.80) than rule-based methods (RR: 0.73; 95% CI: 0.63\u20130.85). The study shows a statistically significant beneficial effect of using the automated alerting system in the management of sepsis. Interestingly, machine learning monitoring systems coupled with better early interventions show promise, especially for patients outside of the intensive care unit.<\/jats:p>","DOI":"10.1038\/s41746-022-00650-5","type":"journal-article","created":{"date-parts":[[2022,7,19]],"date-time":"2022-07-19T19:36:54Z","timestamp":1658259414000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":53,"title":["Effectiveness of automated alerting system compared to usual care for the management of sepsis"],"prefix":"10.1038","volume":"5","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-2336-5323","authenticated-orcid":false,"given":"Zhongheng","family":"Zhang","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Lin","family":"Chen","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ping","family":"Xu","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Qing","family":"Wang","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jianjun","family":"Zhang","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Kun","family":"Chen","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Casey M.","family":"Clements","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Leo Anthony","family":"Celi","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0214-0651","authenticated-orcid":false,"given":"Vitaly","family":"Herasevich","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yucai","family":"Hong","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2022,7,19]]},"reference":[{"key":"650_CR1","doi-asserted-by":"publisher","first-page":"740","DOI":"10.1177\/0885066617711882","volume":"34","author":"R Herr\u00e1n-Monge","year":"2019","unstructured":"Herr\u00e1n-Monge, R. et al. Epidemiology and changes in mortality of sepsis after the implementation of surviving sepsis campaign guidelines. J. Intensive Care Med. 34, 740\u2013750 (2019).","journal-title":"J. Intensive Care Med."},{"key":"650_CR2","doi-asserted-by":"publisher","DOI":"10.1186\/s13054-021-03774-4","volume":"25","author":"Y Yu","year":"2021","unstructured":"Yu, Y. et al. Effectiveness of anisodamine for the treatment of critically ill patients with septic shock: a multicentre randomized controlled trial. Crit. Care 25, 349 (2021).","journal-title":"Crit. Care"},{"key":"650_CR3","doi-asserted-by":"publisher","first-page":"1694","DOI":"10.1097\/CCM.0000000000005054","volume":"49","author":"X Han","year":"2021","unstructured":"Han, X. et al. Identifying high-risk subphenotypes and associated harms from delayed antibiotic orders and delivery. Crit. Care Med. 49, 1694\u20131705 (2021).","journal-title":"Crit. Care Med."},{"key":"650_CR4","doi-asserted-by":"publisher","first-page":"759","DOI":"10.1097\/CCM.0000000000002264","volume":"45","author":"CW Seymour","year":"2017","unstructured":"Seymour, C. W. et al. Delays from first medical contact to antibiotic administration for sepsis. Crit. Care Med. 45, 759\u2013765 (2017).","journal-title":"Crit. Care Med."},{"key":"650_CR5","doi-asserted-by":"publisher","DOI":"10.1186\/s13054-021-03682-7","volume":"25","author":"P Ma","year":"2021","unstructured":"Ma, P. et al. Individualized resuscitation strategy for septic shock formalized by finite mixture modeling and dynamic treatment regimen. Crit. Care 25, 243 (2021).","journal-title":"Crit. Care"},{"key":"650_CR6","doi-asserted-by":"publisher","first-page":"302","DOI":"10.1016\/j.chest.2018.03.025","volume":"154","author":"X Han","year":"2018","unstructured":"Han, X. et al. Implications of centers for medicare & medicaid services severe sepsis and septic shock early management bundle and initial lactate measurement on the management of sepsis. Chest 154, 302\u2013308 (2018).","journal-title":"Chest"},{"key":"650_CR7","doi-asserted-by":"publisher","unstructured":"Evans, L. et al. Surviving sepsis campaign: international guidelines for management of sepsis and septic shock 2021. Crit. Care Med. https:\/\/doi.org\/10.1097\/CCM.0000000000005337 (2021).","DOI":"10.1097\/CCM.0000000000005337"},{"key":"650_CR8","doi-asserted-by":"publisher","first-page":"547","DOI":"10.1097\/CCM.0000000000002936","volume":"46","author":"S Nemati","year":"2018","unstructured":"Nemati, S. et al. An interpretable machine learning model for accurate prediction of sepsis in the ICU. Crit. Care Med. 46, 547\u2013553 (2018).","journal-title":"Crit. Care Med."},{"key":"650_CR9","doi-asserted-by":"publisher","first-page":"689","DOI":"10.1007\/s10096-019-03781-y","volume":"39","author":"H Diktas","year":"2020","unstructured":"Diktas, H. et al. A novel id-iri score: development and internal validation of the multivariable community acquired sepsis clinical risk prediction model. Eur. J. Clin. Microbiol Infect. Dis. 39, 689\u2013701 (2020).","journal-title":"Eur. J. Clin. Microbiol Infect. Dis."},{"key":"650_CR10","doi-asserted-by":"crossref","unstructured":"Shakeri, E., Mohammed, E. A., Shakeri H. A., Z. & Far, B. Exploring features contributing to the early prediction of sepsis using machine learning. Annu. Int. Conf. IEEE Eng. Med. Biol. Soc. 2021, 2472\u20132475 (2021).","DOI":"10.1109\/EMBC46164.2021.9630317"},{"key":"650_CR11","doi-asserted-by":"crossref","unstructured":"Zhou, A., Raheem, B. & Kamaleswaran, R. OnAI-Comp: an online ai experts competing framework for early sepsis detection. IEEE\/ACM Trans. Comput. Biol. Bioinform. PP, (2021).","DOI":"10.1109\/TCBB.2021.3122405"},{"key":"650_CR12","doi-asserted-by":"publisher","first-page":"396","DOI":"10.1002\/jhm.2347","volume":"10","author":"AN Makam","year":"2015","unstructured":"Makam, A. N., Nguyen, O. K. & Auerbach, A. D. Diagnostic accuracy and effectiveness of automated electronic sepsis alert systems: a systematic review. J. Hosp. Med. 10, 396\u2013402 (2015).","journal-title":"J. Hosp. Med."},{"key":"650_CR13","first-page":"CD012404","volume":"6","author":"S Warttig","year":"2018","unstructured":"Warttig, S. et al. Automated monitoring compared to standard care for the early detection of sepsis in critically ill patients. Cochrane Database Syst. Rev. 6, CD012404 (2018).","journal-title":"Cochrane Database Syst. Rev."},{"key":"650_CR14","doi-asserted-by":"publisher","first-page":"373","DOI":"10.1016\/j.jss.2018.05.078","volume":"231","author":"AD Jung","year":"2018","unstructured":"Jung, A. D. et al. Sooner is better: use of a real-time automated bedside dashboard improves sepsis care. J. Surg. Res. 231, 373\u2013379 (2018).","journal-title":"J. Surg. Res."},{"key":"650_CR15","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-020-69433-w","volume":"10","author":"NK Tran","year":"2020","unstructured":"Tran, N. K. et al. Novel application of an automated-machine learning development tool for predicting burn sepsis: proof of concept. Sci. Rep. 10, 12354 (2020).","journal-title":"Sci. Rep."},{"key":"650_CR16","doi-asserted-by":"publisher","first-page":"e43","DOI":"10.1055\/s-0039-1695717","volume":"58","author":"A Wulff","year":"2019","unstructured":"Wulff, A., Montag, S., Marschollek, M. & Jack, T. Clinical decision-support systems for detection of systemic inflammatory response syndrome, sepsis, and septic shock in critically Ill patients: a systematic review. Methods Inf. Med. 58, e43\u2013e57 (2019).","journal-title":"Methods Inf. Med."},{"key":"650_CR17","doi-asserted-by":"publisher","first-page":"305","DOI":"10.1016\/j.jhin.2017.05.005","volume":"96","author":"L Alberto","year":"2017","unstructured":"Alberto, L., Marshall, A. P., Walker, R. & Aitken, L. M. Screening for sepsis in general hospitalized patients: a systematic review. J. Hosp. Infect. 96, 305\u2013315 (2017).","journal-title":"J. Hosp. Infect."},{"key":"650_CR18","doi-asserted-by":"publisher","first-page":"e15166","DOI":"10.2196\/15166","volume":"21","author":"M Joshi","year":"2019","unstructured":"Joshi, M. et al. Digital alerting and outcomes in patients with sepsis: systematic review and meta-analysis. J. Med. Internet Res. 21, e15166 (2019).","journal-title":"J. Med. Internet Res."},{"key":"650_CR19","doi-asserted-by":"publisher","first-page":"1201","DOI":"10.5811\/westjem.2020.5.46010","volume":"21","author":"MI Hwang","year":"2020","unstructured":"Hwang, M. I., Bond, W. F. & Powell, E. S. Sepsis alerts in emergency departments: a systematic review of accuracy and quality measure impact. West J. Emerg. Med. 21, 1201\u20131210 (2020).","journal-title":"West J. Emerg. Med."},{"key":"650_CR20","doi-asserted-by":"publisher","unstructured":"Tarabichi, Y. et al. Improving timeliness of antibiotic administration using a provider and pharmacist facing sepsis early warning system in the emergency department setting: a randomized controlled quality improvement initiative. Critical Care Med. https:\/\/doi.org\/10.1097\/CCM.0000000000005267 (2021).","DOI":"10.1097\/CCM.0000000000005267"},{"key":"650_CR21","doi-asserted-by":"publisher","first-page":"762","DOI":"10.1136\/bmjqs-2018-008765","volume":"28","author":"NL Downing","year":"2019","unstructured":"Downing, N. L. et al. Electronic health record-based clinical decision support alert for severe sepsis: a randomised evaluation. BMJ Qual. Saf. 28, 762\u2013768 (2019).","journal-title":"BMJ Qual. Saf."},{"key":"650_CR22","doi-asserted-by":"publisher","first-page":"e000234","DOI":"10.1136\/bmjresp-2017-000234","volume":"4","author":"DW Shimabukuro","year":"2017","unstructured":"Shimabukuro, D. W., Barton, C. W., Feldman, M. D., Mataraso, S. J. & Das, R. Effect of a machine learning-based severe sepsis prediction algorithm on patient survival and hospital length of stay: a randomised clinical trial. BMJ Open Respir. Res 4, e000234 (2017).","journal-title":"BMJ Open Respir. Res"},{"key":"650_CR23","doi-asserted-by":"publisher","first-page":"2096","DOI":"10.1097\/CCM.0b013e318250a887","volume":"40","author":"MH Hooper","year":"2012","unstructured":"Hooper, M. H. et al. Randomized trial of automated, electronic monitoring to facilitate early detection of sepsis in the intensive care unit*. Crit. Care Med. 40, 2096\u20132101 (2012).","journal-title":"Crit. Care Med."},{"key":"650_CR24","doi-asserted-by":"publisher","first-page":"e10802","DOI":"10.2196\/10802","volume":"20","author":"C Downey","year":"2018","unstructured":"Downey, C., Randell, R., Brown, J. & Jayne, D. G. Continuous versus intermittent vital signs monitoring using a wearable, wireless patch in patients admitted to surgical wards: pilot cluster randomized controlled trial. J. Med. Internet Res. 20, e10802 (2018).","journal-title":"J. Med. Internet Res."},{"key":"650_CR25","doi-asserted-by":"publisher","first-page":"1595","DOI":"10.1097\/CCM.0000000000001020","volume":"43","author":"MW Semler","year":"2015","unstructured":"Semler, M. W. et al. An electronic tool for the evaluation and treatment of sepsis in the ICU: a randomized controlled trial. Crit. Care Med 43, 1595\u20131602 (2015).","journal-title":"Crit. Care Med"},{"key":"650_CR26","doi-asserted-by":"publisher","first-page":"e000158","DOI":"10.1136\/bmjoq-2017-000158","volume":"6","author":"A McCoy","year":"2017","unstructured":"McCoy, A. & Das, R. Reducing patient mortality, length of stay and readmissions through machine learning-based sepsis prediction in the emergency department, intensive care unit and hospital floor units. BMJ Open Qual. 6, e000158 (2017).","journal-title":"BMJ Open Qual."},{"key":"650_CR27","doi-asserted-by":"crossref","unstructured":"Burdick, H. et al. Effect of a sepsis prediction algorithm on patient mortality, length of stay and readmission: a prospective multicentre clinical outcomes evaluation of real-world patient data from US hospitals. BMJ Health Care Inf. 27, (2020).","DOI":"10.1136\/bmjhci-2019-100109"},{"key":"650_CR28","doi-asserted-by":"publisher","first-page":"787","DOI":"10.1136\/bmjqs-2014-003552","volume":"24","author":"MO Gatewood","year":"2015","unstructured":"Gatewood, M. O., Wemple, M., Greco, S., Kritek, P. A. & Durvasula, R. A quality improvement project to improve early sepsis care in the emergency department. BMJ Qual. Saf. 24, 787\u2013795 (2015).","journal-title":"BMJ Qual. Saf."},{"key":"650_CR29","doi-asserted-by":"publisher","first-page":"185","DOI":"10.1016\/j.ajem.2015.10.005","volume":"34","author":"N Narayanan","year":"2016","unstructured":"Narayanan, N., Gross, A. K., Pintens, M., Fee, C. & MacDougall, C. Effect of an electronic medical record alert for severe sepsis among ED patients. Am. J. Emerg. Med. 34, 185\u2013188 (2016).","journal-title":"Am. J. Emerg. Med."},{"key":"650_CR30","doi-asserted-by":"publisher","first-page":"1485","DOI":"10.1097\/CCM.0000000000003891","volume":"47","author":"HM Giannini","year":"2019","unstructured":"Giannini, H. M. et al. A machine learning algorithm to predict severe sepsis and septic shock: development, implementation, and impact on clinical practice. Crit. Care Med. 47, 1485\u20131492 (2019).","journal-title":"Crit. Care Med."},{"key":"650_CR31","doi-asserted-by":"publisher","first-page":"26","DOI":"10.1002\/jhm.2259","volume":"10","author":"CA Umscheid","year":"2015","unstructured":"Umscheid, C. A. et al. Development, implementation, and impact of an automated early warning and response system for sepsis. J. Hosp. Med. 10, 26\u201331 (2015).","journal-title":"J. Hosp. Med."},{"key":"650_CR32","doi-asserted-by":"publisher","DOI":"10.1186\/s13613-017-0280-7","volume":"7","author":"YM Arabi","year":"2017","unstructured":"Arabi, Y. M. et al. The impact of a multifaceted intervention including sepsis electronic alert system and sepsis response team on the outcomes of patients with sepsis and septic shock. Ann. intensive care 7, 57 (2017).","journal-title":"Ann. intensive care"},{"key":"650_CR33","doi-asserted-by":"publisher","first-page":"523","DOI":"10.1093\/jamia\/ocx072","volume":"25","author":"JS Austrian","year":"2018","unstructured":"Austrian, J. S., Jamin, C. T., Doty, G. R. & Blecker, S. Impact of an emergency department electronic sepsis surveillance system on patient mortality and length of stay. J. Am. Med. Inform. Assoc.: JAMIA 25, 523\u2013529 (2018).","journal-title":"J. Am. Med. Inform. Assoc.: JAMIA"},{"key":"650_CR34","doi-asserted-by":"publisher","first-page":"108","DOI":"10.1097\/DCC.0000000000000046","volume":"33","author":"L Benson","year":"2014","unstructured":"Benson, L., Hasenau, S., O\u2019Connor, N. & Burgermeister, D. The impact of a nurse practitioner rapid response team on systemic inflammatory response syndrome outcomes. Dimens Crit. Care Nurs. 33, 108\u2013115 (2014).","journal-title":"Dimens Crit. Care Nurs."},{"key":"650_CR35","doi-asserted-by":"publisher","first-page":"394","DOI":"10.4338\/ACI-2010-09-RA-0054","volume":"1","author":"T Berger","year":"2010","unstructured":"Berger, T., Birnbaum, A., Bijur, P., Kuperman, G. & Gennis, P. A computerized alert screening for severe sepsis in emergency department patients increases lactate testing but does not improve inpatient mortality. Appl Clin. Inf. 1, 394\u2013407 (2010).","journal-title":"Appl Clin. Inf."},{"key":"650_CR36","doi-asserted-by":"publisher","first-page":"508","DOI":"10.1016\/j.eimc.2015.01.002","volume":"33","author":"JM Ferreras","year":"2015","unstructured":"Ferreras, J. M. et al. Implementation of an automatic alarms system for early detection of patients with severe sepsis. Enferm. Infecc. Microbiol Clin. 33, 508\u2013515 (2015).","journal-title":"Enferm. Infecc. Microbiol Clin."},{"key":"650_CR37","doi-asserted-by":"publisher","first-page":"296","DOI":"10.1016\/j.jcrc.2017.04.005","volume":"40","author":"FW Guirgis","year":"2017","unstructured":"Guirgis, F. W. et al. Managing sepsis: electronic recognition, rapid response teams, and standardized care save lives. J. Crit. care 40, 296\u2013302 (2017).","journal-title":"J. Crit. care"},{"key":"650_CR38","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/j.ajem.2015.08.039","volume":"34","author":"GE Hayden","year":"2016","unstructured":"Hayden, G. E. et al. Triage sepsis alert and sepsis protocol lower times to fluids and antibiotics in the ED. Am. J. Emerg. Med 34, 1\u20139 (2016).","journal-title":"Am. J. Emerg. Med"},{"key":"650_CR39","doi-asserted-by":"publisher","first-page":"88","DOI":"10.1093\/jamia\/ocw056","volume":"24","author":"S Manaktala","year":"2017","unstructured":"Manaktala, S. & Claypool, S. R. Evaluating the impact of a computerized surveillance algorithm and decision support system on sepsis mortality. J. Am. Med. Inform. Assoc.: JAMIA 24, 88\u201395 (2017).","journal-title":"J. Am. Med. Inform. Assoc.: JAMIA"},{"key":"650_CR40","doi-asserted-by":"crossref","unstructured":"Mathews, K., Budde, J., Glasser, A., Lorin, S. & Powell, C. 972: Impact of an in-patient electronic clinical decision support tool on sepsis-related mortality. Critic. Care Med. 42, (2014).","DOI":"10.1097\/01.ccm.0000458469.63789.ed"},{"key":"650_CR41","doi-asserted-by":"publisher","first-page":"546","DOI":"10.1016\/j.hrtlng.2014.05.009","volume":"43","author":"L McRee","year":"2014","unstructured":"McRee, L., Thanavaro, J. L., Moore, K., Goldsmith, M. & Pasvogel, A. The impact of an electronic medical record surveillance program on outcomes for patients with sepsis. Heart Lung 43, 546\u2013549 (2014).","journal-title":"Heart Lung"},{"key":"650_CR42","doi-asserted-by":"publisher","first-page":"469","DOI":"10.1097\/CCM.0b013e318205df85","volume":"39","author":"AM Sawyer","year":"2011","unstructured":"Sawyer, A. M. et al. Implementation of a real-time computerized sepsis alert in nonintensive care unit patients. Crit. Care Med. 39, 469\u2013473 (2011).","journal-title":"Crit. Care Med."},{"key":"650_CR43","first-page":"47","volume":"8","author":"BL Westra","year":"2017","unstructured":"Westra, B. L., Landman, S., Yadav, P. & Steinbach, M. Secondary analysis of an electronic surveillance system combined with multi-focal interventions for early detection of sepsis. Appl. Clin. Inform. 8, 47\u201366 (2017).","journal-title":"Appl. Clin. Inform."},{"key":"650_CR44","doi-asserted-by":"publisher","first-page":"399","DOI":"10.1111\/1742-6723.12581","volume":"28","author":"M Idrees","year":"2016","unstructured":"Idrees, M., Macdonald, S. P. & Kodali, K. Sepsis Early Alert Tool: Early recognition and timely management in the emergency department. Emerg. Med. Australas.: EMA 28, 399\u2013403 (2016).","journal-title":"Emerg. Med. Australas.: EMA"},{"key":"650_CR45","doi-asserted-by":"publisher","first-page":"202","DOI":"10.1177\/1357633X17691862","volume":"24","author":"SM Machado","year":"2018","unstructured":"Machado, S. M., Wilson, E. H., Elliott, J. O. & Jordan, K. Impact of a telemedicine eICU cart on sepsis management in a community hospital emergency department. J. Telemed. telecare 24, 202\u2013208 (2018).","journal-title":"J. Telemed. telecare"},{"key":"650_CR46","doi-asserted-by":"crossref","unstructured":"Song, J. et al. The effect of the intelligent sepsis management system on outcomes among patients with sepsis and septic shock diagnosed according to the sepsis-3 definition in the emergency department. J. Clin. Med. 8, (2019).","DOI":"10.3390\/jcm8111800"},{"key":"650_CR47","doi-asserted-by":"publisher","first-page":"1745","DOI":"10.1016\/j.ajem.2018.01.060","volume":"36","author":"T Shah","year":"2018","unstructured":"Shah, T., Sterk, E. & Rech, M. A. Emergency department sepsis screening tool decreases time to antibiotics in patients with sepsis. Am. J. Emerg. Med. 36, 1745\u20131748 (2018).","journal-title":"Am. J. Emerg. Med."},{"key":"650_CR48","doi-asserted-by":"publisher","first-page":"355","DOI":"10.4103\/apjon.apjon_32_20","volume":"7","author":"MZ Bader","year":"2020","unstructured":"Bader, M. Z., Obaid, A. T., Al-Khateb, H. M., Eldos, Y. T. & Elaya, M. M. Developing adult sepsis protocol to reduce the time to initial antibiotic dose and improve outcomes among patients with cancer in emergency department. Asia-Pac. J. Oncol. Nurs. 7, 355\u2013360 (2020).","journal-title":"Asia-Pac. J. Oncol. Nurs."},{"key":"650_CR49","doi-asserted-by":"publisher","first-page":"690","DOI":"10.1016\/j.jen.2019.05.005","volume":"45","author":"WR Moore","year":"2019","unstructured":"Moore, W. R., Vermuelen, A., Taylor, R., Kihara, D. & Wahome, E. Improving 3-hour sepsis bundled care outcomes: implementation of a nurse-driven sepsis protocol in the emergency department. J. Emerg. Nurs. 45, 690\u2013698 (2019).","journal-title":"J. Emerg. Nurs."},{"key":"650_CR50","doi-asserted-by":"publisher","first-page":"135","DOI":"10.1097\/NCQ.0000000000000430","volume":"35","author":"DL Threatt","year":"2019","unstructured":"Threatt, D. L. Improving sepsis bundle implementation times: a nursing process improvement approach. J. Nurs. care Qual. 35, 135\u2013139 (2019).","journal-title":"J. Nurs. care Qual."},{"key":"650_CR51","doi-asserted-by":"publisher","first-page":"311","DOI":"10.1097\/TA.0000000000000121","volume":"76","author":"CA Croft","year":"2014","unstructured":"Croft, C. A. et al. Computer versus paper system for recognition and management of sepsis in surgical intensive care. J. Trauma Acute Care Surg. 76, 311\u2013317 (2014). discussion 318-319.","journal-title":"J. Trauma Acute Care Surg."},{"key":"650_CR52","doi-asserted-by":"publisher","first-page":"378","DOI":"10.1016\/j.ajem.2021.09.086","volume":"51","author":"K Lipatov","year":"2022","unstructured":"Lipatov, K. et al. Implementation and evaluation of sepsis surveillance and decision support in medical ICU and emergency department. Am. J. Emerg. Med. 51, 378\u2013383 (2022).","journal-title":"Am. J. Emerg. Med."},{"key":"650_CR53","doi-asserted-by":"publisher","first-page":"274","DOI":"10.1093\/jamia\/ocz186","volume":"27","author":"K Honeyford","year":"2020","unstructured":"Honeyford, K. et al. Evaluating a digital sepsis alert in a London multisite hospital network: a natural experiment using electronic health record data. J. Am. Med Inf. Assoc. 27, 274\u2013283 (2020).","journal-title":"J. Am. Med Inf. Assoc."},{"key":"650_CR54","doi-asserted-by":"publisher","DOI":"10.1186\/s40560-021-00588-y","volume":"9","author":"SJ Na","year":"2021","unstructured":"Na, S. J., Ko, R.-E., Ko, M. G. & Jeon, K. Automated alert and activation of medical emergency team using early warning score. J. Intensive Care 9, 73 (2021).","journal-title":"J. Intensive Care"},{"key":"650_CR55","doi-asserted-by":"publisher","DOI":"10.1186\/s13054-021-03883-0","volume":"26","author":"Y Im","year":"2022","unstructured":"Im, Y. et al. Time-to-antibiotics and clinical outcomes in patients with sepsis and septic shock: a prospective nationwide multicenter cohort study. Crit. Care 26, 19 (2022).","journal-title":"Crit. Care"},{"key":"650_CR56","doi-asserted-by":"publisher","first-page":"1907","DOI":"10.1097\/CCM.0000000000001142","volume":"43","author":"SA Sterling","year":"2015","unstructured":"Sterling, S. A., Miller, W. R., Pryor, J., Puskarich, M. A. & Jones, A. E. The impact of timing of antibiotics on outcomes in severe sepsis and septic shock: a systematic review and meta-analysis. Crit. Care Med 43, 1907\u20131915 (2015).","journal-title":"Crit. Care Med"},{"key":"650_CR57","doi-asserted-by":"publisher","first-page":"1290","DOI":"10.1097\/CCM.0000000000003892","volume":"47","author":"DJ Pepper","year":"2019","unstructured":"Pepper, D. J. et al. Antibiotic- and fluid-focused bundles potentially improve sepsis management, but high-quality evidence is lacking for the specificity required in the centers for medicare and medicaid service\u2019s sepsis bundle (SEP-1). Crit. Care Med 47, 1290\u20131300 (2019).","journal-title":"Crit. Care Med"},{"key":"650_CR58","doi-asserted-by":"publisher","first-page":"495","DOI":"10.1038\/nrd3501","volume":"10","author":"H-G Eichler","year":"2011","unstructured":"Eichler, H.-G. et al. Bridging the efficacy-effectiveness gap: a regulator\u2019s perspective on addressing variability of drug response. Nat. Rev. Drug Disco. 10, 495\u2013506 (2011).","journal-title":"Nat. Rev. Drug Disco."},{"key":"650_CR59","first-page":"CD005529","volume":"11","author":"J McGaughey","year":"2021","unstructured":"McGaughey, J., Fergusson, D. A., Van Bogaert, P. & Rose, L. Early warning systems and rapid response systems for the prevention of patient deterioration on acute adult hospital wards. Cochrane Database Syst. Rev. 11, CD005529 (2021).","journal-title":"Cochrane Database Syst. Rev."},{"key":"650_CR60","doi-asserted-by":"publisher","first-page":"164","DOI":"10.1186\/s13049-021-00979-y","volume":"29","author":"S-H You","year":"2021","unstructured":"You, S.-H. et al. Incorporating a real-time automatic alerting system based on electronic medical records could improve rapid response systems: a retrospective cohort study. Scand. J. Trauma Resusc. Emerg. Med. 29, 164 (2021).","journal-title":"Scand. J. Trauma Resusc. Emerg. Med."},{"key":"650_CR61","doi-asserted-by":"publisher","first-page":"370","DOI":"10.21037\/atm.2016.06.20","volume":"4","author":"Z Zhang","year":"2016","unstructured":"Zhang, Z. A gentle introduction to artificial neural networks. Ann. Transl. Med. 4, 370 (2016).","journal-title":"Ann. Transl. Med."},{"key":"650_CR62","doi-asserted-by":"publisher","unstructured":"Greener, J. G., Kandathil, S. M., Moffat, L. & Jones, D. T. A guide to machine learning for biologists. Nat. Rev. Mol. Cell Biol. https:\/\/doi.org\/10.1038\/s41580-021-00407-0 (2021).","DOI":"10.1038\/s41580-021-00407-0"},{"key":"650_CR63","doi-asserted-by":"publisher","DOI":"10.1186\/s13063-021-05562-5","volume":"22","author":"YM Arabi","year":"2021","unstructured":"Arabi, Y. M. et al. Electronic early notification of sepsis in hospitalized ward patients: a study protocol for a stepped-wedge cluster randomized controlled trial. Trials 22, 695 (2021).","journal-title":"Trials"},{"key":"650_CR64","doi-asserted-by":"publisher","DOI":"10.1038\/s41746-022-00611-y","volume":"5","author":"J Feng","year":"2022","unstructured":"Feng, J. et al. Clinical artificial intelligence quality improvement: towards continual monitoring and updating of AI algorithms in healthcare. npj Digital Med. 5, 66 (2022).","journal-title":"npj Digital Med."},{"key":"650_CR65","doi-asserted-by":"publisher","first-page":"d5928","DOI":"10.1136\/bmj.d5928","volume":"343","author":"JPT Higgins","year":"2011","unstructured":"Higgins, J. P. T. et al. The Cochrane Collaboration\u2019s tool for assessing risk of bias in randomised trials. BMJ 343, d5928 (2011).","journal-title":"BMJ"},{"key":"650_CR66","doi-asserted-by":"publisher","first-page":"i4919","DOI":"10.1136\/bmj.i4919","volume":"355","author":"JA Sterne","year":"2016","unstructured":"Sterne, J. A. et al. ROBINS-I: a tool for assessing risk of bias in non-randomised studies of interventions. BMJ 355, i4919 (2016).","journal-title":"BMJ"},{"key":"650_CR67","doi-asserted-by":"publisher","first-page":"153","DOI":"10.1136\/ebmental-2019-300117","volume":"22","author":"S Balduzzi","year":"2019","unstructured":"Balduzzi, S., R\u00fccker, G. & Schwarzer, G. How to perform a meta-analysis with R: a practical tutorial. Evid. Based Ment. Health 22, 153\u2013160 (2019).","journal-title":"Evid. Based Ment. Health"},{"key":"650_CR68","doi-asserted-by":"publisher","first-page":"55","DOI":"10.2307\/2530643","volume":"41","author":"S Greenland","year":"1985","unstructured":"Greenland, S. & Robins, J. M. Estimation of a common effect parameter from sparse follow-up data. Biometrics 41, 55\u201368 (1985).","journal-title":"Biometrics"},{"key":"650_CR69","doi-asserted-by":"publisher","unstructured":"Sarri, G. et al. Framework for the synthesis of non-randomised studies and randomised controlled trials: a guidance on conducting a systematic review and meta-analysis for healthcare decision making. BMJ EBM bmjebm-2020-111493 https:\/\/doi.org\/10.1136\/bmjebm-2020-111493 (2020).","DOI":"10.1136\/bmjebm-2020-111493"},{"key":"650_CR70","doi-asserted-by":"publisher","first-page":"991","DOI":"10.1016\/j.jclinepi.2007.11.010","volume":"61","author":"JL Peters","year":"2008","unstructured":"Peters, J. L., Sutton, A. J., Jones, D. R., Abrams, K. R. & Rushton, L. Contour-enhanced meta-analysis funnel plots help distinguish publication bias from other causes of asymmetry. J. Clin. Epidemiol. 61, 991\u2013996 (2008).","journal-title":"J. Clin. Epidemiol."},{"key":"650_CR71","doi-asserted-by":"publisher","first-page":"666","DOI":"10.1177\/1745691614553988","volume":"9","author":"U Simonsohn","year":"2014","unstructured":"Simonsohn, U., Nelson, L. D. & Simmons, J. P. p-Curve and effect size: correcting for publication bias using only significant results. Perspect. Psychol. Sci. 9, 666\u2013681 (2014).","journal-title":"Perspect. Psychol. Sci."}],"container-title":["npj Digital Medicine"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.nature.com\/articles\/s41746-022-00650-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41746-022-00650-5","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41746-022-00650-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,11,25]],"date-time":"2022-11-25T08:09:36Z","timestamp":1669363776000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.nature.com\/articles\/s41746-022-00650-5"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,7,19]]},"references-count":71,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2022,12]]}},"alternative-id":["650"],"URL":"https:\/\/doi.org\/10.1038\/s41746-022-00650-5","relation":{},"ISSN":["2398-6352"],"issn-type":[{"value":"2398-6352","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,7,19]]},"assertion":[{"value":"27 April 2022","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"4 July 2022","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"19 July 2022","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"The authors declare no competing interests.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"101"}}