{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,7]],"date-time":"2026-08-07T17:23:13Z","timestamp":1786123393799,"version":"build-2736575974"},"reference-count":17,"publisher":"Ovid Technologies (Wolters Kluwer Health)","issue":"6","content-domain":{"domain":["lww.com","ovid.com"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2020,12]]},"abstract":"<jats:sec>\n                    <jats:title>BACKGROUND:<\/jats:title>\n                    <jats:p>Postoperative delirium is an important problem for surgical inpatients and was the target of a multidisciplinary quality improvement project at our institution. We developed and tested a semiautomated delirium risk stratification instrument, Age, WORLD backwards, Orientation, iLlness severity, Surgery-specific risk (AWOL-S), in 3 independent cohorts from our tertiary care hospital and describe its performance characteristics and impact on clinical care.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>METHODS:<\/jats:title>\n                    <jats:p>The risk stratification instrument was derived with elective surgical patients who were admitted at least overnight and received at least 1 postoperative delirium screen (Nursing Delirium Screening Scale [NuDESC] or Confusion Assessment Method for the Intensive Care Unit [CAM-ICU]) and preoperative cognitive screening tests (orientation to place and ability to spell WORLD backward). Using data pragmatically collected between December 7, 2016, and June 15, 2017, we derived a logistic regression model predicting probability of delirium in the first 7 postoperative hospital days. A priori predictors included age, cognitive screening, illness severity or American Society of Anesthesiologists physical status, and surgical delirium risk. We applied model odds ratios to 2 subsequent cohorts (\u201cvalidation\u201d and \u201csustained performance\u201d) and assessed performance using area under the receiver operator characteristic curves (AUC-ROC). A post hoc sensitivity analysis assessed performance in emergency and preadmitted patients. Finally, we retrospectively evaluated the use of benzodiazepines and anticholinergic medications in patients who screened at high risk for delirium.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>RESULTS:<\/jats:title>\n                    <jats:p>The logistic regression model used to derive odds ratios for the risk prediction tool included 2091 patients. Model AUC-ROC was 0.71 (0.67\u20130.75), compared with 0.65 (0.58\u20130.72) in the validation (n = 908) and 0.75 (0.71\u20130.78) in the sustained performance (n = 3168) cohorts. Sensitivity was approximately 75% in the derivation and sustained performance cohorts; specificity was approximately 59%. The AUC-ROC for emergency and preadmitted patients was 0.71 (0.67\u20130.75; n = 1301). After AWOL-S was implemented clinically, patients at high risk for delirium (n = 3630) had 21% (3%\u201336%) lower relative risk of receiving an anticholinergic medication perioperatively after controlling for secular trends.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>CONCLUSIONS:<\/jats:title>\n                    <jats:p>The AWOL-S delirium risk stratification tool has moderate accuracy for delirium prediction in a cohort of elective surgical patients, and performance is largely unchanged in emergent\/preadmitted surgical patients. Using AWOL-S risk stratification as a part of a multidisciplinary delirium reduction intervention was associated with significantly lower rates of perioperative anticholinergic but not benzodiazepine, medications in those at high risk for delirium. AWOL-S offers a feasible starting point for electronic medical record\u2013based postoperative delirium risk stratification and may serve as a useful paradigm for other institutions.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1213\/ane.0000000000005085","type":"journal-article","created":{"date-parts":[[2020,10,27]],"date-time":"2020-10-27T19:03:23Z","timestamp":1603825403000},"page":"1901-1910","update-policy":"https:\/\/doi.org\/10.1097\/lww.0000000000001000","source":"Crossref","is-referenced-by-count":30,"title":["Derivation, Validation, Sustained Performance, and Clinical Impact of an Electronic Medical Record\u2013Based Perioperative Delirium Risk Stratification Tool"],"prefix":"10.1213","volume":"131","author":[{"given":"Elizabeth L.","family":"Whitlock","sequence":"first","affiliation":[{"name":"Department of Anesthesia and Perioperative Care"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Matthias R.","family":"Braehler","sequence":"additional","affiliation":[{"name":"Department of Anesthesia and Perioperative Care"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jennifer A.","family":"Kaplan","sequence":"additional","affiliation":[{"name":"Department of Surgery"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Emily","family":"Finlayson","sequence":"additional","affiliation":[{"name":"Department of Surgery"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Stephanie E.","family":"Rogers","sequence":"additional","affiliation":[{"name":"Division of Geriatrics, Department of Medicine"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Vanja","family":"Douglas","sequence":"additional","affiliation":[{"name":"Department of Neurology"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Anne L.","family":"Donovan","sequence":"additional","affiliation":[{"name":"Division of Critical Care Medicine, Department of Anesthesia and Perioperative Care, University of California, San Francisco, San Francisco, California."}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"276","published-online":{"date-parts":[[2020,10,22]]},"reference":[{"key":"R1-20250227","doi-asserted-by":"crossref","first-page":"1572","DOI":"10.1213\/ANE.0000000000004641","article-title":"American society for enhanced recovery and perioperative quality initiative joint consensus statement on postoperative delirium prevention.","volume":"130","author":"Hughes","year":"2020","journal-title":"Anesth Analg"},{"key":"R2-20250227","doi-asserted-by":"crossref","first-page":"1015","DOI":"10.1016\/j.jagp.2018.06.007","article-title":"Hospital elder life program: systematic review and meta-analysis of effectiveness.","volume":"26","author":"Hshieh","year":"2018","journal-title":"Am J Geriatr Psychiatry"},{"key":"R3-20250227","doi-asserted-by":"crossref","first-page":"e113946","DOI":"10.1371\/journal.pone.0113946","article-title":"Performance and agreement of risk stratification instruments for postoperative delirium in persons aged 50 years or older.","volume":"9","author":"Jansen","year":"2014","journal-title":"PLoS One"},{"key":"R4-20250227","doi-asserted-by":"crossref","first-page":"2383","DOI":"10.1111\/jgs.13138","article-title":"Risk prediction models for postoperative delirium: a systematic review and meta-analysis.","volume":"62","author":"van Meenen","year":"2014","journal-title":"J Am Geriatr Soc"},{"key":"R5-20250227","doi-asserted-by":"crossref","first-page":"915","DOI":"10.1007\/s11096-016-0312-7","article-title":"The development of an automated ward independent delirium risk prediction model.","volume":"38","author":"de Wit","year":"2016","journal-title":"Int J Clin Pharm"},{"key":"R6-20250227","doi-asserted-by":"crossref","first-page":"e3072","DOI":"10.1097\/MD.0000000000003072","article-title":"DELirium prediction based on hospital information (Delphi) in general surgery patients.","volume":"95","author":"Kim","year":"2016","journal-title":"Medicine (Baltimore)"},{"key":"R7-20250227","doi-asserted-by":"crossref","first-page":"683","DOI":"10.1016\/j.ejso.2016.09.018","article-title":"Development of a nomogram for predicting the probability of postoperative delirium in patients undergoing free flap reconstruction for head and neck cancer.","volume":"43","author":"Choi","year":"2017","journal-title":"Eur J Surg Oncol"},{"key":"R8-20250227","doi-asserted-by":"crossref","first-page":"493","DOI":"10.1002\/jhm.2062","article-title":"The AWOL tool: derivation and validation of a delirium prediction rule.","volume":"8","author":"Douglas","year":"2013","journal-title":"J Hosp Med"},{"key":"R9-20250227","doi-asserted-by":"crossref","first-page":"368","DOI":"10.1016\/j.jpainsymman.2004.07.009","article-title":"Fast, systematic, and continuous delirium assessment in hospitalized patients: the nursing delirium screening scale.","volume":"29","author":"Gaudreau","year":"2005","journal-title":"J Pain Symptom Manage"},{"key":"R10-20250227","doi-asserted-by":"crossref","first-page":"1370","DOI":"10.1097\/00003246-200107000-00012","article-title":"Evaluation of delirium in critically ill patients: validation of the Confusion Assessment Method for the Intensive Care Unit (CAM-ICU).","volume":"29","author":"Ely","year":"2001","journal-title":"Crit Care Med"},{"key":"R11-20250227","doi-asserted-by":"crossref","first-page":"612","DOI":"10.1093\/bja\/aet167","article-title":"Evaluation of two delirium screening tools for detecting post-operative delirium in the elderly.","volume":"111","author":"Neufeld","year":"2013","journal-title":"Br J Anaesth"},{"key":"R12-20250227","doi-asserted-by":"crossref","first-page":"1911","DOI":"10.1213\/ANE.0000000000005223","article-title":"An implementation-effectiveness study of a perioperative delirium prevention initiative for older adults.","volume":"2020","author":"Donovan","year":"2020","journal-title":"Anesth Analg"},{"key":"R13-20250227","doi-asserted-by":"crossref","first-page":"93","DOI":"10.1097\/SLA.0000000000002436","article-title":"Postoperative delirium as a target for surgical quality improvement.","volume":"268","author":"Berian","year":"2018","journal-title":"Ann Surg"},{"key":"R15-20250227","first-page":"S458486","article-title":"PMCALPLOT: Stata module to produce calibration plot of prediction model performance.","author":"Ensor","year":"2018","journal-title":"Stat Software Compon, Boston College Depart Economic"},{"key":"R16-20250227","doi-asserted-by":"crossref","first-page":"567","DOI":"10.1016\/j.gerinurse.2017.04.006","article-title":"Predicting inpatient delirium: the AWOL delirium risk-stratification score in clinical practice.","volume":"38","author":"Brown","year":"2017","journal-title":"Geriatr Nurs"},{"key":"R17-20250227","doi-asserted-by":"crossref","first-page":"244","DOI":"10.1016\/j.jamda.2015.10.020","article-title":"Validation of a delirium risk assessment using electronic medical record information.","volume":"17","author":"Rudolph","year":"2016","journal-title":"J Am Med Dir Assoc"},{"key":"R18-20250227","doi-asserted-by":"crossref","first-page":"487","DOI":"10.1007\/s00268-009-0376-9","article-title":"A comparison of three scores to screen for delirium on the surgical ward.","volume":"34","author":"Radtke","year":"2010","journal-title":"World J Surg"}],"container-title":["Anesthesia &amp; Analgesia"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.ovid.com\/10.1213\/ANE.0000000000005085","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,8,7]],"date-time":"2026-08-07T14:35:08Z","timestamp":1786113308000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.ovid.com\/10.1213\/ANE.0000000000005085"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,10,22]]},"references-count":17,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2020]]}},"URL":"https:\/\/doi.org\/10.1213\/ane.0000000000005085","relation":{},"ISSN":["0003-2999"],"issn-type":[{"value":"0003-2999","type":"print"}],"subject":[],"published":{"date-parts":[[2020,10,22]]}}}