{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,23]],"date-time":"2026-10-23T05:59:01Z","timestamp":1792735141309,"version":"4.5.0"},"reference-count":61,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2022,1,3]],"date-time":"2022-01-03T00:00:00Z","timestamp":1641168000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2022,1,3]],"date-time":"2022-01-03T00:00:00Z","timestamp":1641168000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Anesthesiol"],"published-print":{"date-parts":[[2022,12]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Background<\/jats:title>\n                    <jats:p>Accurate, pragmatic risk stratification for postoperative delirium (POD) is necessary to target preventative resources toward high-risk patients. Machine learning (ML) offers a novel approach to leveraging electronic health record (EHR) data for POD prediction. We sought to develop and internally validate a ML-derived POD risk prediction model using preoperative risk features, and to compare its performance to models developed with traditional logistic regression.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>This was a retrospective analysis of preoperative EHR data from 24,885 adults undergoing a procedure requiring anesthesia care, recovering in the main post-anesthesia care unit, and staying in the hospital at least overnight between December 2016 and December 2019 at either of two hospitals in a tertiary care health system. One hundred fifteen preoperative risk features including demographics, comorbidities, nursing assessments, surgery type, and other preoperative EHR data were used to predict postoperative delirium (POD), defined as any instance of Nursing Delirium Screening Scale \u22652 or positive Confusion Assessment Method for the Intensive Care Unit within the first 7 postoperative days. Two ML models (Neural Network and XGBoost), two traditional logistic regression models (\u201cclinician-guided\u201d and \u201cML hybrid\u201d), and a previously described delirium risk stratification tool (AWOL-S) were evaluated using the area under the receiver operating characteristic curve (AUC-ROC), sensitivity, specificity, positive likelihood ratio, and positive predictive value. Model calibration was assessed with a calibration curve. Patients with no POD assessments charted or at least 20% of input variables missing were excluded.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>\n                      POD incidence was 5.3%. The AUC-ROC for Neural Net was 0.841 [95% CI 0. 816\u20130.863] and for XGBoost was 0.851 [95% CI 0.827\u20130.874], which was significantly better than the clinician-guided (AUC-ROC 0.763 [0.734\u20130.793],\n                      <jats:italic>p<\/jats:italic>\n                      \u2009&lt;\u20090.001) and ML hybrid (AUC-ROC 0.824 [0.800\u20130.849],\n                      <jats:italic>p<\/jats:italic>\n                      \u2009&lt;\u20090.001) regression models and AWOL-S (AUC-ROC 0.762 [95% CI 0.713\u20130.812],\n                      <jats:italic>p<\/jats:italic>\n                      \u2009&lt;\u20090.001). Neural Net, XGBoost, and ML hybrid models demonstrated excellent calibration, while calibration of the clinician-guided and AWOL-S models was moderate; they tended to overestimate delirium risk in those already at highest risk.\n                    <\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusion<\/jats:title>\n                    <jats:p>Using pragmatically collected EHR data, two ML models predicted POD in a broad perioperative population with high discrimination. Optimal application of the models would provide automated, real-time delirium risk stratification to improve perioperative management of surgical patients at risk for POD.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1186\/s12871-021-01543-y","type":"journal-article","created":{"date-parts":[[2022,1,3]],"date-time":"2022-01-03T02:03:20Z","timestamp":1641175400000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":109,"title":["Postoperative delirium prediction using machine learning models and preoperative electronic health record data"],"prefix":"10.1186","volume":"22","author":[{"given":"Andrew","family":"Bishara","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Catherine","family":"Chiu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Elizabeth L.","family":"Whitlock","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Vanja C.","family":"Douglas","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sei","family":"Lee","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Atul J.","family":"Butte","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jacqueline M.","family":"Leung","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Anne L.","family":"Donovan","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2022,1,3]]},"reference":[{"key":"1543_CR1","doi-asserted-by":"publisher","unstructured":"American Geriatrics Society Expert Panel on Postoperative Delirium in Older Adults. American Geriatrics Society abstracted clinical practice guideline for postoperative delirium in older adults. J Am Geriatr Soc. 2015;63(1):142\u201350. https:\/\/doi.org\/10.1111\/jgs.13281. PMID: 25495432; PMCID: PMC5901697.","DOI":"10.1111\/jgs.13281"},{"key":"1543_CR2","doi-asserted-by":"publisher","first-page":"1134","DOI":"10.1001\/jamasurg.2015.2606","volume":"150","author":"LJ Gleason","year":"2015","unstructured":"Gleason LJ, Schmitt EM, Kosar CM, Tabloski P, Saczynski JS, Robinson T, et al. Effect of delirium and other major complications on outcomes after elective surgery in older adults. JAMA Surg. 2015;150:1134\u201340. https:\/\/doi.org\/10.1001\/jamasurg.2015.2606.","journal-title":"JAMA Surg"},{"key":"1543_CR3","doi-asserted-by":"publisher","first-page":"471","DOI":"10.1213\/ANE.0b013e3182973650","volume":"117","author":"KJ Neufeld","year":"2013","unstructured":"Neufeld KJ, Leoutsakos J-MS, Sieber FE, Wanamaker BL, Gibson Chambers JJ, Rao V, et al. Outcomes of early delirium diagnosis after general anesthesia in the elderly. Anesth Analg. 2013;117:471\u20138. https:\/\/doi.org\/10.1213\/ANE.0b013e3182973650.","journal-title":"Anesth Analg"},{"key":"1543_CR4","doi-asserted-by":"publisher","first-page":"2101","DOI":"10.1111\/jgs.14434","volume":"64","author":"CH Brown 4th","year":"2016","unstructured":"Brown CH 4th, LaFlam A, Max L, Wyrobek J, Neufeld KJ, Kebaish KM, et al. Delirium after spine surgery in older adults: incidence, risk factors, and outcomes. J Am Geriatr Soc. 2016;64:2101\u20138. https:\/\/doi.org\/10.1111\/jgs.14434.","journal-title":"J Am Geriatr Soc"},{"key":"1543_CR5","doi-asserted-by":"publisher","first-page":"643","DOI":"10.1111\/j.1532-5415.2010.02762.x","volume":"58","author":"JL Rudolph","year":"2010","unstructured":"Rudolph JL, Inouye SK, Jones RN, Yang FM, Fong TG, Levkoff SE, et al. Delirium: an independent predictor of functional decline after cardiac surgery. J Am Geriatr Soc. 2010;58:643\u20139. https:\/\/doi.org\/10.1111\/j.1532-5415.2010.02762.x.","journal-title":"J Am Geriatr Soc"},{"key":"1543_CR6","doi-asserted-by":"publisher","first-page":"R257","DOI":"10.1186\/cc13084","volume":"17","author":"FJ Abelha","year":"2013","unstructured":"Abelha FJ, Lu\u00eds C, Veiga D, Parente D, Fernandes V, Santos P, et al. Outcome and quality of life in patients with postoperative delirium during an ICU stay following major surgery. Crit Care Lond Engl. 2013;17:R257. https:\/\/doi.org\/10.1186\/cc13084.","journal-title":"Crit Care Lond Engl"},{"key":"1543_CR7","doi-asserted-by":"publisher","first-page":"30","DOI":"10.1056\/NEJMoa1112923","volume":"367","author":"JS Saczynski","year":"2012","unstructured":"Saczynski JS, Marcantonio ER, Quach L, Fong TG, Gross A, Inouye SK, et al. Cognitive trajectories after postoperative delirium. N Engl J Med. 2012;367:30\u20139. https:\/\/doi.org\/10.1056\/NEJMoa1112923.","journal-title":"N Engl J Med"},{"key":"1543_CR8","doi-asserted-by":"publisher","first-page":"766","DOI":"10.1016\/j.jalz.2016.03.005","volume":"12","author":"SK Inouye","year":"2016","unstructured":"Inouye SK, Marcantonio ER, Kosar CM, Tommet D, Schmitt EM, Travison TG, et al. The short-term and long-term relationship between delirium and cognitive trajectory in older surgical patients. Alzheimers Dement J Alzheimers Assoc. 2016;12:766\u201375. https:\/\/doi.org\/10.1016\/j.jalz.2016.03.005.","journal-title":"Alzheimers Dement J Alzheimers Assoc"},{"key":"1543_CR9","doi-asserted-by":"publisher","first-page":"406","DOI":"10.1097\/ALN.0000000000002253","volume":"129","author":"CH Brown 4th","year":"2018","unstructured":"Brown CH 4th, Probert J, Healy R, Parish M, Nomura Y, Yamaguchi A, et al. Cognitive decline after delirium in patients undergoing cardiac surgery. Anesthesiology. 2018;129:406\u201316. https:\/\/doi.org\/10.1097\/ALN.0000000000002253.","journal-title":"Anesthesiology."},{"key":"1543_CR10","doi-asserted-by":"publisher","first-page":"512","DOI":"10.1001\/jamainternmed.2014.7779","volume":"175","author":"TT Hshieh","year":"2015","unstructured":"Hshieh TT, Yue J, Oh E, Puelle M, Dowal S, Travison T, et al. Effectiveness of multicomponent nonpharmacological delirium interventions: a meta-analysis. JAMA Intern Med. 2015;175:512\u201320. https:\/\/doi.org\/10.1001\/jamainternmed.2014.7779.","journal-title":"JAMA Intern Med"},{"key":"1543_CR11","doi-asserted-by":"publisher","first-page":"1015","DOI":"10.1016\/j.jagp.2018.06.007","volume":"26","author":"TT Hshieh","year":"2018","unstructured":"Hshieh TT, Yang T, Gartaganis SL, Yue J, Inouye SK. Hospital elder life program: systematic review and meta-analysis of effectiveness. Am J Geriatr Psychiatry Off J Am Assoc Geriatr Psychiatry. 2018;26:1015\u201333. https:\/\/doi.org\/10.1016\/j.jagp.2018.06.007.","journal-title":"Am J Geriatr Psychiatry Off J Am Assoc Geriatr Psychiatry"},{"key":"1543_CR12","doi-asserted-by":"publisher","first-page":"516","DOI":"10.1046\/j.1532-5415.2001.49108.x","volume":"49","author":"ER Marcantonio","year":"2001","unstructured":"Marcantonio ER, Flacker JM, Wright RJ, Resnick NM. Reducing delirium after hip fracture: a randomized trial. J Am Geriatr Soc. 2001;49:516\u201322. https:\/\/doi.org\/10.1046\/j.1532-5415.2001.49108.x.","journal-title":"J Am Geriatr Soc"},{"key":"1543_CR13","doi-asserted-by":"publisher","first-page":"259","DOI":"10.1111\/anae.12539","volume":"69","author":"Z Moyce","year":"2014","unstructured":"Moyce Z, Rodseth RN, Biccard BM. The efficacy of peri-operative interventions to decrease postoperative delirium in non-cardiac surgery: a systematic review and meta-analysis. Anaesthesia. 2014;69:259\u201369. https:\/\/doi.org\/10.1111\/anae.12539.","journal-title":"Anaesthesia."},{"key":"1543_CR14","doi-asserted-by":"publisher","first-page":"1911","DOI":"10.1213\/ANE.0000000000005223","volume":"131","author":"AL Donovan","year":"2020","unstructured":"Donovan AL, Braehler MR, Robinowitz DL, Lazar AA, Finlayson E, Rogers S, et al. An implementation-effectiveness study of a perioperative delirium prevention initiative for older adults. Anesth Analg. 2020;131:1911\u201322. https:\/\/doi.org\/10.1213\/ANE.0000000000005223.","journal-title":"Anesth Analg"},{"key":"1543_CR15","doi-asserted-by":"publisher","first-page":"1901","DOI":"10.1213\/ANE.0000000000005085","volume":"131","author":"EL Whitlock","year":"2020","unstructured":"Whitlock EL, Braehler MR, Kaplan JA, Finlayson E, Rogers SE, Douglas V, et al. Derivation, validation, sustained performance, and clinical impact of an electronic medical record-based perioperative delirium risk stratification tool. Anesth Analg. 2020;131:1901\u201310. https:\/\/doi.org\/10.1213\/ANE.0000000000005085.","journal-title":"Anesth Analg"},{"key":"1543_CR16","doi-asserted-by":"publisher","first-page":"1572","DOI":"10.1213\/ANE.0000000000004641","volume":"130","author":"CG Hughes","year":"2020","unstructured":"Hughes CG, Boncyk CS, Culley DJ, Fleisher LA, Leung JM, McDonagh DL, et al. American Society for Enhanced Recovery and Perioperative Quality Initiative Joint Consensus Statement on Postoperative Delirium Prevention. Anesth Analg. 2020;130:1572\u201390. https:\/\/doi.org\/10.1213\/ANE.0000000000004641.","journal-title":"Anesth Analg"},{"key":"1543_CR17","doi-asserted-by":"publisher","DOI":"10.1001\/jamanetworkopen.2018.1018","volume":"1","author":"A Wong","year":"2018","unstructured":"Wong A, Young AT, Liang AS, Gonzales R, Douglas VC, Hadley D. Development and validation of an electronic health record-based machine learning model to estimate delirium risk in newly hospitalized patients without known cognitive impairment. JAMA Netw Open. 2018;1:e181018. https:\/\/doi.org\/10.1001\/jamanetworkopen.2018.1018.","journal-title":"JAMA Netw Open"},{"key":"1543_CR18","doi-asserted-by":"publisher","DOI":"10.2196\/14993","volume":"7","author":"HN Mufti","year":"2019","unstructured":"Mufti HN, Hirsch GM, Abidi SR, Abidi SSR. Exploiting machine learning algorithms and methods for the prediction of agitated delirium after cardiac surgery: models development and validation study. JMIR Med Inform. 2019;7:e14993. https:\/\/doi.org\/10.2196\/14993.","journal-title":"JMIR Med Inform"},{"key":"1543_CR19","doi-asserted-by":"publisher","first-page":"1052","DOI":"10.1001\/jama.2020.0592","volume":"323","author":"M Wijnberge","year":"2020","unstructured":"Wijnberge M, Geerts BF, Hol L, Lemmers N, Mulder MP, Berge P, et al. Effect of a machine learning-derived early warning system for intraoperative hypotension vs standard care on depth and duration of intraoperative hypotension during elective noncardiac surgery: the HYPE randomized clinical trial. JAMA. 2020;323:1052\u201360. https:\/\/doi.org\/10.1001\/jama.2020.0592.","journal-title":"JAMA."},{"key":"1543_CR20","doi-asserted-by":"publisher","first-page":"749","DOI":"10.1038\/s41551-018-0304-0","volume":"2","author":"SM Lundberg","year":"2018","unstructured":"Lundberg SM, Nair B, Vavilala MS, Horibe M, Eisses MJ, Adams T, et al. Explainable machine-learning predictions for the prevention of hypoxaemia during surgery. Nat Biomed Eng. 2018;2:749\u201360. https:\/\/doi.org\/10.1038\/s41551-018-0304-0.","journal-title":"Nat Biomed Eng"},{"key":"1543_CR21","doi-asserted-by":"publisher","first-page":"877","DOI":"10.1016\/j.bja.2019.07.030","volume":"123","author":"BL Hill","year":"2019","unstructured":"Hill BL, Brown R, Gabel E, Rakocz N, Lee C, Cannesson M, et al. An automated machine learning-based model predicts postoperative mortality using readily-extractable preoperative electronic health record data. Br J Anaesth. 2019;123:877\u201386. https:\/\/doi.org\/10.1016\/j.bja.2019.07.030.","journal-title":"Br J Anaesth"},{"key":"1543_CR22","doi-asserted-by":"publisher","first-page":"379","DOI":"10.1097\/ALN.0000000000002960","volume":"132","author":"DA Hashimoto","year":"2020","unstructured":"Hashimoto DA, Witkowski E, Gao L, Meireles O, Rosman G. Artificial intelligence in anesthesiology: current techniques, clinical applications, and limitations. Anesthesiology. 2020;132:379\u201394. https:\/\/doi.org\/10.1097\/ALN.0000000000002960.","journal-title":"Anesthesiology."},{"key":"1543_CR23","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0113946","volume":"9","author":"CJ Jansen","year":"2014","unstructured":"Jansen CJ, Absalom AR, de Bock GH, van Leeuwen BL, Izaks GJ. Performance and agreement of risk stratification instruments for postoperative delirium in persons aged 50 years or older. PLoS One. 2014;9:e113946. https:\/\/doi.org\/10.1371\/journal.pone.0113946.","journal-title":"PLoS One"},{"key":"1543_CR24","doi-asserted-by":"publisher","first-page":"2383","DOI":"10.1111\/jgs.13138","volume":"62","author":"LCC van Meenen","year":"2014","unstructured":"van Meenen LCC, van Meenen DMP, de Rooij SE, ter Riet G. Risk prediction models for postoperative delirium: a systematic review and meta-analysis. J Am Geriatr Soc. 2014;62:2383\u201390. https:\/\/doi.org\/10.1111\/jgs.13138.","journal-title":"J Am Geriatr Soc"},{"key":"1543_CR25","doi-asserted-by":"publisher","first-page":"60","DOI":"10.1093\/ageing\/afv177","volume":"45","author":"ST Pendlebury","year":"2016","unstructured":"Pendlebury ST, Lovett N, Smith SC, Cornish E, Mehta Z, Rothwell PM. Delirium risk stratification in consecutive unselected admissions to acute medicine: validation of externally derived risk scores. Age Ageing. 2016;45:60\u20135. https:\/\/doi.org\/10.1093\/ageing\/afv177.","journal-title":"Age Ageing"},{"key":"1543_CR26","doi-asserted-by":"publisher","first-page":"606","DOI":"10.1164\/rccm.201404-0716CP","volume":"190","author":"MR Pinsky","year":"2014","unstructured":"Pinsky MR, Dubrawski A. Gleaning knowledge from data in the intensive care unit. Am J Respir Crit Care Med. 2014;190:606\u201310. https:\/\/doi.org\/10.1164\/rccm.201404-0716CP.","journal-title":"Am J Respir Crit Care Med"},{"key":"1543_CR27","doi-asserted-by":"publisher","DOI":"10.1136\/bmj.g7594","volume":"350","author":"GS Collins","year":"2015","unstructured":"Collins GS, Reitsma JB, Altman DG, Moons KGM. Transparent reporting of a multivariable prediction model for individual prognosis or diagnosis (TRIPOD): the TRIPOD statement. BMJ. 2015;350:g7594. https:\/\/doi.org\/10.1136\/bmj.g7594.","journal-title":"BMJ."},{"key":"1543_CR28","doi-asserted-by":"publisher","first-page":"368","DOI":"10.1016\/j.jpainsymman.2004.07.009","volume":"29","author":"J-D Gaudreau","year":"2005","unstructured":"Gaudreau J-D, Gagnon P, Harel F, Tremblay A, Roy M-A. Fast, systematic, and continuous delirium assessment in hospitalized patients: the nursing delirium screening scale. J Pain Symptom Manag. 2005;29:368\u201375. https:\/\/doi.org\/10.1016\/j.jpainsymman.2004.07.009.","journal-title":"J Pain Symptom Manag"},{"key":"1543_CR29","doi-asserted-by":"publisher","first-page":"1370","DOI":"10.1097\/00003246-200107000-00012","volume":"29","author":"EW Ely","year":"2001","unstructured":"Ely EW, Margolin R, Francis J, May L, Truman B, Dittus R, et al. Evaluation of delirium in critically ill patients: validation of the Confusion Assessment Method for the Intensive Care Unit (CAM-ICU). Crit Care Med. 2001;29:1370\u20139. https:\/\/doi.org\/10.1097\/00003246-200107000-00012.","journal-title":"Crit Care Med"},{"key":"1543_CR30","doi-asserted-by":"publisher","unstructured":"LaHue SC, Maselli J, Rogers S, Casatta J, Chao J, Croci R, Gonzales R, Holt B, Josephson SA, Lama S, Lau C, McCulloch C, Newman JC, Terrelonge M, Yeager J, Douglas VC. Outcomes Following Implementation of a Hospital-Wide, Multicomponent Delirium Care Pathway. J Hosp Med. 2021;16(7):397\u2013403. https:\/\/doi.org\/10.12788\/jhm.3604. PMID: 34197303.","DOI":"10.12788\/jhm.3604"},{"key":"1543_CR31","doi-asserted-by":"publisher","first-page":"157","DOI":"10.2147\/CLEP.S129785","volume":"9","author":"AB Pedersen","year":"2017","unstructured":"Pedersen AB, Mikkelsen EM, Cronin-Fenton D, Kristensen NR, Pham TM, Pedersen L, et al. Missing data and multiple imputation in clinical epidemiological research. Clin Epidemiol. 2017;9:157\u201366. https:\/\/doi.org\/10.2147\/CLEP.S129785.","journal-title":"Clin Epidemiol"},{"key":"1543_CR32","volume-title":"A language and environment for statistical computing","author":"R Core Team. R","year":"2013","unstructured":"R Core Team. R. A language and environment for statistical computing. Vienna: R Foundation for Statistical Computing; 2013. Available: http:\/\/www.R-project.org\/"},{"key":"1543_CR33","volume-title":"A unified approach to interpreting model predictions. ArXiv170507874 Cs Stat","author":"S Lundberg","year":"2017","unstructured":"Lundberg S, Lee S-I. A unified approach to interpreting model predictions. ArXiv170507874 Cs Stat. 2017 [cited 1 Sep 2020]. Available: http:\/\/arxiv.org\/abs\/1705.07874."},{"key":"1543_CR34","unstructured":"Abadi M, Barham P, Chen J, Chen Z, Davis A, Dean J, et al. TensorFlow: A system for large-scale machine learning. 2016. Available at: https:\/\/www.usenix.org\/system\/files\/conference\/osdi16\/osdi16-abadi.pdf. Accessed 22 Dec 2021."},{"key":"1543_CR35","doi-asserted-by":"publisher","first-page":"12","DOI":"10.1016\/j.jclinepi.2019.02.004","volume":"110","author":"E Christodoulou","year":"2019","unstructured":"Christodoulou E, Ma J, Collins GS, Steyerberg EW, Verbakel JY, Van Calster B. A systematic review shows no performance benefit of machine learning over logistic regression for clinical prediction models. J Clin Epidemiol. 2019;110:12\u201322. https:\/\/doi.org\/10.1016\/j.jclinepi.2019.02.004.","journal-title":"J Clin Epidemiol"},{"key":"1543_CR36","doi-asserted-by":"publisher","first-page":"56","DOI":"10.1016\/j.jclinepi.2020.03.002","volume":"122","author":"S Nusinovici","year":"2020","unstructured":"Nusinovici S, Tham YC, Chak Yan MY, Wei Ting DS, Li J, Sabanayagam C, et al. Logistic regression was as good as machine learning for predicting major chronic diseases. J Clin Epidemiol. 2020;122:56\u201369. https:\/\/doi.org\/10.1016\/j.jclinepi.2020.03.002.","journal-title":"J Clin Epidemiol"},{"key":"1543_CR37","doi-asserted-by":"publisher","first-page":"93","DOI":"10.1097\/SLA.0000000000002436","volume":"268","author":"JR Berian","year":"2018","unstructured":"Berian JR, Zhou L, Russell MM, Hornor MA, Cohen ME, Finlayson E, et al. Postoperative delirium as a target for surgical quality improvement. Ann Surg. 2018;268:93\u20139. https:\/\/doi.org\/10.1097\/SLA.0000000000002436.","journal-title":"Ann Surg"},{"key":"1543_CR38","doi-asserted-by":"publisher","first-page":"837","DOI":"10.2307\/2531595","volume":"44","author":"ER DeLong","year":"1988","unstructured":"DeLong ER, DeLong DM, Clarke-Pearson DL. Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approach. Biometrics. 1988;44:837\u201345.","journal-title":"Biometrics."},{"key":"1543_CR39","doi-asserted-by":"publisher","first-page":"1389","DOI":"10.1109\/LSP.2014.2337313","volume":"21","author":"X Sun","year":"2014","unstructured":"Sun X, Xu W. Fast implementation of DeLong\u2019s algorithm for comparing the areas under correlated receiver operating characteristic curves. IEEE Signal Process Lett. 2014;21:1389\u201393. https:\/\/doi.org\/10.1109\/LSP.2014.2337313.","journal-title":"IEEE Signal Process Lett"},{"key":"1543_CR40","doi-asserted-by":"publisher","unstructured":"Lee H-C, Yoon SB, Yang S-M, Kim WH, Ryu H-G, Jung C-W, et al. Prediction of acute kidney injury after liver transplantation: machine learning approaches vs. logistic regression model. J Clin Med. 2018;7. https:\/\/doi.org\/10.3390\/jcm7110428.","DOI":"10.3390\/jcm7110428"},{"key":"1543_CR41","doi-asserted-by":"publisher","first-page":"368","DOI":"10.1097\/CCM.0000000000001571","volume":"44","author":"MM Churpek","year":"2016","unstructured":"Churpek MM, Yuen TC, Winslow C, Meltzer DO, Kattan MW, Edelson DP. Multicenter comparison of machine learning methods and conventional regression for predicting clinical deterioration on the wards. Crit Care Med. 2016;44:368\u201374. https:\/\/doi.org\/10.1097\/CCM.0000000000001571.","journal-title":"Crit Care Med"},{"key":"1543_CR42","doi-asserted-by":"publisher","first-page":"476","DOI":"10.1016\/j.wneu.2017.09.149","volume":"109","author":"JT Senders","year":"2018","unstructured":"Senders JT, Staples PC, Karhade AV, Zaki MM, Gormley WB, Broekman MLD, et al. Machine learning and neurosurgical outcome prediction: a systematic review. World Neurosurg. 2018;109:476\u2013486.e1. https:\/\/doi.org\/10.1016\/j.wneu.2017.09.149.","journal-title":"World Neurosurg"},{"key":"1543_CR43","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pmed.1002701","volume":"15","author":"KM Corey","year":"2018","unstructured":"Corey KM, Kashyap S, Lorenzi E, Lagoo-Deenadayalan SA, Heller K, Whalen K, et al. Development and validation of machine learning models to identify high-risk surgical patients using automatically curated electronic health record data (Pythia): a retrospective, single-site study. PLoS Med. 2018;15:e1002701. https:\/\/doi.org\/10.1371\/journal.pmed.1002701.","journal-title":"PLoS Med"},{"key":"1543_CR44","doi-asserted-by":"publisher","first-page":"213","DOI":"10.1007\/s40266-018-0526-6","volume":"35","author":"GM Kassie","year":"2018","unstructured":"Kassie GM, Nguyen TA, Kalisch Ellett LM, Pratt NL, Roughead EE. Do risk prediction models for postoperative delirium consider patients\u2019 preoperative medication use? Drugs Aging. 2018;35:213\u201322. https:\/\/doi.org\/10.1007\/s40266-018-0526-6.","journal-title":"Drugs Aging"},{"key":"1543_CR45","doi-asserted-by":"publisher","first-page":"668","DOI":"10.1097\/ACO.0000000000000907","volume":"33","author":"MS Curtis","year":"2020","unstructured":"Curtis MS, Forman NA, Donovan AL, Whitlock EL. Postoperative delirium: why, what, and how to confront it at your institution. Curr Opin Anaesthesiol. 2020;33:668\u201373. https:\/\/doi.org\/10.1097\/ACO.0000000000000907.","journal-title":"Curr Opin Anaesthesiol"},{"key":"1543_CR46","doi-asserted-by":"publisher","first-page":"192","DOI":"10.1097\/EJA.0000000000000594","volume":"34","author":"C Aldecoa","year":"2017","unstructured":"Aldecoa C, Bettelli G, Bilotta F, Sanders RD, Audisio R, Borozdina A, et al. European Society of Anaesthesiology evidence-based and consensus-based guideline on postoperative delirium. Eur J Anaesthesiol. 2017;34:192\u2013214. https:\/\/doi.org\/10.1097\/EJA.0000000000000594.","journal-title":"Eur J Anaesthesiol"},{"key":"1543_CR47","doi-asserted-by":"publisher","first-page":"930","DOI":"10.1016\/j.jamcollsurg.2015.12.026","volume":"222","author":"S Mohanty","year":"2016","unstructured":"Mohanty S, Rosenthal RA, Russell MM, Neuman MD, Ko CY, Esnaola NF. Optimal perioperative management of the geriatric patient: a best practices guideline from the American College of Surgeons NSQIP and the American Geriatrics Society. J Am Coll Surg. 2016;222:930\u201347. https:\/\/doi.org\/10.1016\/j.jamcollsurg.2015.12.026.","journal-title":"J Am Coll Surg"},{"key":"1543_CR48","doi-asserted-by":"publisher","first-page":"1406","DOI":"10.1213\/ANE.0000000000003841","volume":"127","author":"M Berger","year":"2018","unstructured":"Berger M, Schenning KJ, Brown CH 4th, Deiner SG, Whittington RA, Eckenhoff RG, et al. Best practices for postoperative brain health: recommendations from the fifth international perioperative neurotoxicity working group. Anesth Analg. 2018;127:1406\u201313. https:\/\/doi.org\/10.1213\/ANE.0000000000003841.","journal-title":"Anesth Analg"},{"key":"1543_CR49","doi-asserted-by":"publisher","first-page":"198","DOI":"10.1093\/jamia\/ocw042","volume":"24","author":"BA Goldstein","year":"2017","unstructured":"Goldstein BA, Navar AM, Pencina MJ, Ioannidis JPA. Opportunities and challenges in developing risk prediction models with electronic health records data: a systematic review. J Am Med Inform Assoc JAMIA. 2017;24:198\u2013208. https:\/\/doi.org\/10.1093\/jamia\/ocw042.","journal-title":"J Am Med Inform Assoc JAMIA"},{"key":"1543_CR50","doi-asserted-by":"publisher","first-page":"584","DOI":"10.1016\/j.cmi.2019.09.009","volume":"26","author":"N Peiffer-Smadja","year":"2020","unstructured":"Peiffer-Smadja N, Rawson TM, Ahmad R, Buchard A, Georgiou P, Lescure F-X, et al. Machine learning for clinical decision support in infectious diseases: a narrative review of current applications. Clin Microbiol Infect Off Publ Eur Soc Clin Microbiol Infect Dis. 2020;26:584\u201395. https:\/\/doi.org\/10.1016\/j.cmi.2019.09.009.","journal-title":"Clin Microbiol Infect Off Publ Eur Soc Clin Microbiol Infect Dis"},{"key":"1543_CR51","doi-asserted-by":"publisher","first-page":"1578","DOI":"10.1111\/j.1532-5415.2006.00893.x","volume":"54","author":"M Dasgupta","year":"2006","unstructured":"Dasgupta M, Dumbrell AC. Preoperative risk assessment for delirium after noncardiac surgery: a systematic review. J Am Geriatr Soc. 2006;54:1578\u201389. https:\/\/doi.org\/10.1111\/j.1532-5415.2006.00893.x.","journal-title":"J Am Geriatr Soc"},{"key":"1543_CR52","doi-asserted-by":"publisher","first-page":"173","DOI":"10.1097\/SLA.0b013e31818e4776","volume":"249","author":"TN Robinson","year":"2009","unstructured":"Robinson TN, Raeburn CD, Tran ZV, Angles EM, Brenner LA, Moss M. Postoperative delirium in the elderly: risk factors and outcomes. Ann Surg. 2009;249:173\u20138. https:\/\/doi.org\/10.1097\/SLA.0b013e31818e4776.","journal-title":"Ann Surg"},{"key":"1543_CR53","doi-asserted-by":"publisher","first-page":"911","DOI":"10.1016\/S0140-6736(13)60688-1","volume":"383","author":"SK Inouye","year":"2014","unstructured":"Inouye SK, Westendorp RGJ, Saczynski JS. Delirium in elderly people. Lancet Lond Engl. 2014;383:911\u201322. https:\/\/doi.org\/10.1016\/S0140-6736(13)60688-1.","journal-title":"Lancet Lond Engl"},{"key":"1543_CR54","doi-asserted-by":"publisher","DOI":"10.1016\/j.archger.2020.104207","volume":"91","author":"V DeClercq","year":"2020","unstructured":"DeClercq V, Duhamel TA, Theou O, Kehler S. Association between lifestyle behaviors and frailty in Atlantic Canadian males and females. Arch Gerontol Geriatr. 2020;91:104207. https:\/\/doi.org\/10.1016\/j.archger.2020.104207.","journal-title":"Arch Gerontol Geriatr"},{"key":"1543_CR55","doi-asserted-by":"publisher","first-page":"2331","DOI":"10.1111\/jgs.16082","volume":"67","author":"T Wang","year":"2019","unstructured":"Wang T, Sun S, Li S, Sun Y, Sun Y, Zhang D, et al. Alcohol consumption and functional limitations in older men: does muscle strength mediate them? J Am Geriatr Soc. 2019;67:2331\u20137. https:\/\/doi.org\/10.1111\/jgs.16082.","journal-title":"J Am Geriatr Soc"},{"key":"1543_CR56","doi-asserted-by":"publisher","first-page":"612","DOI":"10.1093\/bja\/aet167","volume":"111","author":"KJ Neufeld","year":"2013","unstructured":"Neufeld KJ, Leoutsakos JS, Sieber FE, Joshi D, Wanamaker BL, Rios-Robles J, et al. Evaluation of two delirium screening tools for detecting post-operative delirium in the elderly. Br J Anaesth. 2013;111:612\u20138. https:\/\/doi.org\/10.1093\/bja\/aet167.","journal-title":"Br J Anaesth"},{"key":"1543_CR57","doi-asserted-by":"publisher","first-page":"487","DOI":"10.1007\/s00268-009-0376-9","volume":"34","author":"FM Radtke","year":"2010","unstructured":"Radtke FM, Franck M, Schust S, Boehme L, Pascher A, Bail HJ, et al. A comparison of three scores to screen for delirium on the surgical ward. World J Surg. 2010;34:487\u201394. https:\/\/doi.org\/10.1007\/s00268-009-0376-9.","journal-title":"World J Surg"},{"key":"1543_CR58","doi-asserted-by":"publisher","unstructured":"Racine AM, Tommet D, D\u2019Aquila ML, Fong TG, Gou Y, Tabloski PA, et al. Machine learning to develop and internally validate a predictive model for post-operative delirium in a prospective, observational clinical cohort study of older surgical patients. J Gen Intern Med. 2020. https:\/\/doi.org\/10.1007\/s11606-020-06238-7.","DOI":"10.1007\/s11606-020-06238-7"},{"key":"1543_CR59","doi-asserted-by":"publisher","first-page":"941","DOI":"10.7326\/0003-4819-113-12-941","volume":"113","author":"SK Inouye","year":"1990","unstructured":"Inouye SK, van Dyck CH, Alessi CA, Balkin S, Siegal AP, Horwitz RI. Clarifying confusion: the confusion assessment method. A new method for detection of delirium. Ann Intern Med. 1990;113:941\u20138. https:\/\/doi.org\/10.7326\/0003-4819-113-12-941.","journal-title":"Ann Intern Med"},{"key":"1543_CR60","doi-asserted-by":"publisher","first-page":"8","DOI":"10.1186\/1472-6947-12-8","volume":"12","author":"RL Figueroa","year":"2012","unstructured":"Figueroa RL, Zeng-Treitler Q, Kandula S, Ngo LH. Predicting sample size required for classification performance. BMC Med Inform Decis Mak. 2012;12:8. https:\/\/doi.org\/10.1186\/1472-6947-12-8.","journal-title":"BMC Med Inform Decis Mak"},{"key":"1543_CR61","doi-asserted-by":"publisher","first-page":"137","DOI":"10.1186\/1471-2288-14-137","volume":"14","author":"T van der Ploeg","year":"2014","unstructured":"van der Ploeg T, Austin PC, Steyerberg EW. Modern modelling techniques are data hungry: a simulation study for predicting dichotomous endpoints. BMC Med Res Methodol. 2014;14:137. https:\/\/doi.org\/10.1186\/1471-2288-14-137.","journal-title":"BMC Med Res Methodol"}],"container-title":["BMC Anesthesiology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12871-021-01543-y.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s12871-021-01543-y\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12871-021-01543-y.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,1,3]],"date-time":"2022-01-03T14:03:31Z","timestamp":1641218611000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmcanesthesiol.biomedcentral.com\/articles\/10.1186\/s12871-021-01543-y"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,1,3]]},"references-count":61,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2022,12]]}},"alternative-id":["1543"],"URL":"https:\/\/doi.org\/10.1186\/s12871-021-01543-y","relation":{},"ISSN":["1471-2253"],"issn-type":[{"value":"1471-2253","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,1,3]]},"assertion":[{"value":"19 May 2021","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"9 December 2021","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"3 January 2022","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"Approval for a retrospective review of the EHR was obtained by our institution\u2019s Institutional Review Board (IRB #18-26109) and the requirement for written informed consent was waived.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Not applicable.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"1.AB is a co-founder of Bezel Health, a company building software to measure and improve healthcare quality interventions.\n2.AJB is a co-founder and consultant to Personalis and NuMedii; consultant to Samsung, Mango Tree Corporation, and in the recent past, 10x Genomics, Helix, Pathway Genomics, and Verinata (Illumina); has served on paid advisory panels or boards for Geisinger Health, Regenstrief Institute, Gerson Lehman Group, AlphaSights, Covance, Novartis, Genentech, and Merck, and Roche; is a shareholder in Personalis and NuMedii; is a minor shareholder in Apple, Facebook, Alphabet (Google), Microsoft, Amazon, Snap, 10x Genomics, Illumina, CVS, Nuna Health, Assay Depot, Vet24seven, Regeneron, Sanofi, Royalty Pharma, AstraZeneca, Moderna, Biogen, and Sutro, and several other non-health related companies and mutual funds; and has received honoraria and travel reimbursement for invited talks from Johnson and Johnson, Roche, Genentech, Pfizer, Merck, Lilly, Takeda, Varian, Mars, Siemens, Optum, Abbott, Celgene, AstraZeneca, AbbVie, Westat, and many academic institutions, medical or disease specific foundations and associations, and health systems. Atul Butte receives royalty payments through Stanford University, for several patents and other disclosures licensed to NuMedii and Personalis. Atul Butte\u2019s research has been funded by NIH, Northrup Grumman (as the prime on an NIH contract), Genentech, Johnson and Johnson, FDA, Robert Wood Johnson Foundation, Leon Lowenstein Foundation, Intervalien Foundation, Priscilla Chan and Mark Zuckerberg, the Barbara and Gerson Bakar Foundation, and in the recent past, the March of Dimes, Juvenile Diabetes Research Foundation, California Governor\u2019s Office of Planning and Research, California Institute for Regenerative Medicine, L\u2019Oreal, and Progenity.\n3.The above organizations had no direct involvement in study design; in the collection, analysis, and interpretation of data; in the writing of the report; or in the decision to submit the article for publication.\n4.The remainder of authors declare no conflicts of interest.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"8"}}