{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,21]],"date-time":"2026-09-21T12:12:14Z","timestamp":1789992734408,"version":"4.0.1"},"reference-count":27,"publisher":"Ovid Technologies (Wolters Kluwer Health)","issue":"12","content-domain":{"domain":["lww.com","ovid.com"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2025,12]]},"abstract":"<jats:sec>\n                    <jats:title>Objectives:<\/jats:title>\n                    <jats:p>Delirium is common and harmful in the ICU. The Intensive Care Delirium Screening Checklist (ICDSC) and Confusion Assessment Method for the ICU (CAM-ICU) are validated tools recommended for delirium identification. However, the accuracy of bedside nurse-documented delirium assessments in the ICU is inconsistent, limiting utility in clinical research. We sought to evaluate and optimize agreement between bedside nurse-documented and trained researcher delirium assessments.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Design, Setting, and Patients:<\/jats:title>\n                    <jats:p>Critically ill adults with acute respiratory failure or sepsis in ICUs in large academic hospitals in a southwestern Pennsylvania health system were assessed daily for delirium by bedside nurses (using the ICDSC) and trained researchers (using the CAM-ICU). Using matched nurse-to-researcher delirium assessments, we categorized delirium status using validated cutoffs and evaluated agreement using Cohen\u2019s kappa. We derived and compared logistic regression models that used ICDSC documentation, mechanical ventilation status, and admission Sequential Organ Failure Assessment to predict delirium in noncomatose patients, using researcher CAM-ICU assessments as the reference standard. We internally validated models using ten-fold cross-validation.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Interventions:<\/jats:title>\n                    <jats:p>None.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Measurements and Main Results:<\/jats:title>\n                    <jats:p>From a sample of 1535 matched assessments of 279 patients, there was moderate agreement between bedside nurse assessments using the established ICDSC delirium\/normal cutoff (ICDSC \u2265 4) and trained researcher assessments using the CAM-ICU (Cohen\u2019s kappa = 0.42). A logistic regression model informed by individual ICDSC components and clinical data predicted a positive research CAM-ICU with good discrimination (area under the curve = 0.87) and performed well in cross-validation (F1 score = 0.72). In sensitivity analyses, models with more limited ICDSC information demonstrated fair to good discriminatory ability (F1 = 0.60\u20130.70), with the validated cutoff model having the lowest performance.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusions:<\/jats:title>\n                    <jats:p>A delirium model informed by bedside nurse ICDSC findings and clinical variables improves accuracy of delirium detected in the ICU and can be used in future pragmatic research that leverages large clinical datasets to advance understanding of delirium mechanisms, trajectories, and outcomes.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1097\/ccm.0000000000006879","type":"journal-article","created":{"date-parts":[[2025,9,19]],"date-time":"2025-09-19T14:00:55Z","timestamp":1758290455000},"page":"e2516-e2525","update-policy":"https:\/\/doi.org\/10.1097\/lww.0000000000001000","source":"Crossref","is-referenced-by-count":4,"title":["Optimizing Agreement Between Bedside Nurse-Documented and Trained Researcher Delirium Assessments in the ICU"],"prefix":"10.1097","volume":"53","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-7737-2070","authenticated-orcid":false,"given":"Kelly M.","family":"Toth","sequence":"first","affiliation":[{"name":"Center for Research, Investigation, and Systems Modeling of Acute Illness (CRISMA), Department of Critical Care Medicine, University of Pittsburgh, Pittsburgh, PA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zahra","family":"Aghababa","sequence":"additional","affiliation":[{"name":"Center for Research, Investigation, and Systems Modeling of Acute Illness (CRISMA), Department of Critical Care Medicine, University of Pittsburgh, Pittsburgh, PA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jason N.","family":"Kennedy","sequence":"additional","affiliation":[{"name":"Center for Research, Investigation, and Systems Modeling of Acute Illness (CRISMA), Department of Critical Care Medicine, University of Pittsburgh, Pittsburgh, PA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chukwudi","family":"Onyemekwu","sequence":"additional","affiliation":[{"name":"Center for Research, Investigation, and Systems Modeling of Acute Illness (CRISMA), Department of Critical Care Medicine, University of Pittsburgh, Pittsburgh, PA"},{"name":"Division of Pulmonary, Allergy, Critical Care, and Sleep Medicine, Department of Medicine, University of Pittsburgh, Pittsburgh, PA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Niall T.","family":"Prendergast","sequence":"additional","affiliation":[{"name":"Division of Pulmonary, Allergy, Critical Care, and Sleep Medicine, Department of Medicine, University of Pittsburgh, Pittsburgh, PA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Christopher A.","family":"Franz","sequence":"additional","affiliation":[{"name":"Division of Pulmonary, Allergy, Critical Care, and Sleep Medicine, Department of Medicine, University of Pittsburgh, Pittsburgh, PA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Michael E.","family":"Reznik","sequence":"additional","affiliation":[{"name":"Center for Research, Investigation, and Systems Modeling of Acute Illness (CRISMA), Department of Critical Care Medicine, University of Pittsburgh, Pittsburgh, PA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Brian","family":"Jiang","sequence":"additional","affiliation":[{"name":"Center for Research, Investigation, and Systems Modeling of Acute Illness (CRISMA), Department of Critical Care Medicine, University of Pittsburgh, Pittsburgh, PA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Brett","family":"Curtis","sequence":"additional","affiliation":[{"name":"Center for Research, Investigation, and Systems Modeling of Acute Illness (CRISMA), Department of Critical Care Medicine, University of Pittsburgh, Pittsburgh, PA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Faraaz","family":"Shah","sequence":"additional","affiliation":[{"name":"Division of Pulmonary, Allergy, Critical Care, and Sleep Medicine, Department of Medicine, University of Pittsburgh, Pittsburgh, PA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Georgios D.","family":"Kitsios","sequence":"additional","affiliation":[{"name":"Division of Pulmonary, Allergy, Critical Care, and Sleep Medicine, Department of Medicine, University of Pittsburgh, Pittsburgh, PA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Bryan J.","family":"McVerry","sequence":"additional","affiliation":[{"name":"Division of Pulmonary, Allergy, Critical Care, and Sleep Medicine, Department of Medicine, University of Pittsburgh, Pittsburgh, PA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Timothy D.","family":"Girard","sequence":"additional","affiliation":[{"name":"Center for Research, Investigation, and Systems Modeling of Acute Illness (CRISMA), Department of Critical Care Medicine, University of Pittsburgh, Pittsburgh, PA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"276","published-online":{"date-parts":[[2025,9,19]]},"reference":[{"key":"R1-20251204","doi-asserted-by":"crossref","first-page":"90","DOI":"10.1038\/s41572-020-00223-4","article-title":"Delirium.","volume":"6","author":"Wilson","year":"2020","journal-title":"Nat Rev Dis Primers"},{"key":"R2-20251204","doi-asserted-by":"crossref","first-page":"369","DOI":"10.1097\/CCM.0b013e3182a645bd","article-title":"Delirium in the ICU and subsequent long-term disability among survivors of mechanical ventilation.","volume":"42","author":"Brummel","year":"2014","journal-title":"Crit Care Med"},{"key":"R3-20251204","doi-asserted-by":"crossref","first-page":"42","DOI":"10.1016\/j.jcrc.2017.08.028","article-title":"Risk factors and outcomes of critically ill patients with acute brain failure: A novel end point.","volume":"43","author":"Singh","year":"2018","journal-title":"J Crit Care"},{"key":"R4-20251204","doi-asserted-by":"crossref","first-page":"1306","DOI":"10.1056\/NEJMoa1301372","article-title":"Long-term cognitive impairment after critical illness.","volume":"369","author":"Pandharipande","year":"2013","journal-title":"N Engl J Med"},{"key":"R5-20251204","doi-asserted-by":"crossref","first-page":"859","DOI":"10.1007\/s001340100909","article-title":"Intensive Care Delirium Screening Checklist: Evaluation of a new screening tool.","volume":"27","author":"Bergeron","year":"2001","journal-title":"Intensive Care Med"},{"key":"R6-20251204","doi-asserted-by":"crossref","first-page":"2703","DOI":"10.1001\/jama.286.21.2703","article-title":"Delirium in mechanically ventilated patients: Validity and reliability of the confusion assessment method for the intensive care unit (CAM-ICU).","volume":"286","author":"Ely","year":"2001","journal-title":"JAMA"},{"key":"R7-20251204","doi-asserted-by":"crossref","first-page":"R115","DOI":"10.1186\/cc11407","article-title":"The confusion assessment method for the intensive care unit (CAM-ICU) and intensive care delirium screening checklist (ICDSC) for the diagnosis of delirium: A systematic review and meta-analysis of clinical studies.","volume":"16","author":"Gusmao-Flores","year":"2012","journal-title":"Crit Care"},{"key":"R8-20251204","doi-asserted-by":"crossref","first-page":"103782","DOI":"10.1016\/j.ijnurstu.2020.103782","article-title":"Diagnostic accuracy of the CAM-ICU and ICDSC in detecting intensive care unit delirium: A bivariate meta-analysis.","volume":"113","author":"Chen","year":"2021","journal-title":"Int J Nurs Stud"},{"key":"R9-20251204","doi-asserted-by":"crossref","first-page":"e51010","DOI":"10.1371\/journal.pone.0051010","article-title":"CAM-ICU and ICDSC agreement in medical and surgical ICU patients is influenced by disease severity.","volume":"7","author":"Fagundes","year":"2012","journal-title":"PLoS One"},{"key":"R10-20251204","doi-asserted-by":"crossref","first-page":"340","DOI":"10.1164\/rccm.201101-0065OC","article-title":"Routine use of the confusion assessment method for the intensive care unit: A multicenter study.","volume":"184","author":"van Eijk","year":"2011","journal-title":"Am J Respir Crit Care Med"},{"key":"R11-20251204","doi-asserted-by":"crossref","first-page":"344","DOI":"10.1016\/j.jclinepi.2007.11.008","article-title":"The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) statement: Guidelines for reporting observational studies.","volume":"61","author":"von Elm","year":"2008","journal-title":"J Clin Epidemiol"},{"key":"R12-20251204","doi-asserted-by":"crossref","first-page":"1325","DOI":"10.1097\/00003246-199907000-00022","article-title":"Prospective evaluation of the Sedation-Agitation Scale for adult critically ill patients.","volume":"27","author":"Riker","year":"1999","journal-title":"Crit Care Med"},{"key":"R13-20251204","doi-asserted-by":"crossref","first-page":"1338","DOI":"10.1164\/rccm.2107138","article-title":"The Richmond Agitation-Sedation Scale: Validity and reliability in adult intensive care unit patients.","volume":"166","author":"Sessler","year":"2002","journal-title":"Am J Respir Crit Care Med"},{"key":"R14-20251204","doi-asserted-by":"crossref","first-page":"1359","DOI":"10.2147\/NDT.S49520","article-title":"Confusion assessment method: A systematic review and meta-analysis of diagnostic accuracy.","volume":"9","author":"Shi","year":"2013","journal-title":"Neuropsychiatr Dis Treat"},{"key":"R15-20251204","doi-asserted-by":"crossref","first-page":"1204","DOI":"10.1111\/nicc.12982","article-title":"Validity and predictability of the confusion assessment method for the intensive care unit for delirium among critically ill patients in the intensive care unit: A systematic review and meta-analysis.","volume":"29","author":"Zhang","year":"2023","journal-title":"Nurs Crit Care"},{"key":"R16-20251204","doi-asserted-by":"crossref","first-page":"707","DOI":"10.1007\/BF01709751","article-title":"The SOFA (Sepsis-related Organ Failure Assessment) score to describe organ dysfunction\/failure. On behalf of the Working Group on Sepsis-Related Problems of the European Society of Intensive Care Medicine.","volume":"22","author":"Vincent","year":"1996","journal-title":"Intensive Care Med"},{"key":"R17-20251204","doi-asserted-by":"crossref","first-page":"764","DOI":"10.1093\/aje\/kwt312","article-title":"Comparison of random forest and parametric imputation models for imputing missing data using MICE: A CALIBER study.","volume":"179","author":"Shah","year":"2014","journal-title":"Am J Epidemiol"},{"key":"R18-20251204","doi-asserted-by":"crossref","first-page":"e825","DOI":"10.1097\/CCM.0000000000003299","article-title":"Clinical practice guidelines for the prevention and management of pain, agitation\/sedation, delirium, immobility, and sleep disruption in adult patients in the ICU.","volume":"46","author":"Devlin","year":"2018","journal-title":"Crit Care Med"},{"key":"R19-20251204","doi-asserted-by":"crossref","first-page":"21","DOI":"10.1186\/s12912-020-00415-z","article-title":"Psychometric properties of the intensive care delirium screening checklist when used by bedside nurses in clinical practice: A prospective descriptive study.","volume":"19","author":"Detroyer","year":"2020","journal-title":"BMC Nurs"},{"key":"R20-20251204","doi-asserted-by":"crossref","first-page":"s12877-022-03573-8","DOI":"10.1186\/s12877-022-03573-8","article-title":"Nurses\u2019 competence in recognition and management of delirium in older patients: Development and piloting of a self-assessment tool.","volume":"22","author":"Hoch","year":"2022","journal-title":"BMC Geriatr"},{"key":"R21-20251204","doi-asserted-by":"crossref","first-page":"2467","DOI":"10.1001\/archinte.161.20.2467","article-title":"Nurses\u2019 recognition of delirium and its symptoms: Comparison of nurse and researcher ratings.","volume":"161","author":"Inouye","year":"2001","journal-title":"Arch Intern Med"},{"key":"R22-20251204","doi-asserted-by":"crossref","first-page":"1027","DOI":"10.1111\/jgs.16987","article-title":"Adaptation and validation of a chart-based delirium detection tool for the ICU (CHART-DEL-ICU).","volume":"69","author":"Krewulak","year":"2021","journal-title":"J Am Geriatr Soc"},{"key":"R23-20251204","doi-asserted-by":"crossref","first-page":"e2249950","DOI":"10.1001\/jamanetworkopen.2022.49950","article-title":"Predisposing and precipitating factors associated with delirium: A systematic review.","volume":"6","author":"Ormseth","year":"2023","journal-title":"JAMA Netw Open"},{"key":"R24-20251204","doi-asserted-by":"crossref","first-page":"973","DOI":"10.5498\/wjp.v13.i12.973","article-title":"Risk factors, preventive interventions, overlapping symptoms, and clinical measures of delirium in elderly patients.","volume":"13","author":"Mei","year":"2023","journal-title":"World J Psychiatry"},{"issue":"Suppl 2","key":"R25-20251204","first-page":"S249","article-title":"Delirium and sedation recognition using validated instruments: Reliability of bedside ICU nursing assessments from 2007 to 2010.","volume":"59","author":"Vasilevskis","year":"2011","journal-title":"J Am Geriatr Soc"},{"key":"R26-20251204","doi-asserted-by":"crossref","first-page":"e1111","DOI":"10.1097\/CCM.0000000000002640","article-title":"Worldwide survey of the \u201cassessing pain, both spontaneous awakening and breathing trials, choice of drugs, delirium monitoring\/management, early exercise\/mobility, and family empowerment\u201d (ABCDEF) bundle.","volume":"45","author":"Morandi","year":"2017","journal-title":"Crit Care Med"},{"key":"R27-20251204","doi-asserted-by":"crossref","first-page":"2185","DOI":"10.1038\/s41598-022-06106-w","article-title":"Current status of delirium assessment tools in the intensive care unit: A prospective multicenter observational survey.","volume":"12","author":"Ishii","year":"2022","journal-title":"Sci Rep"}],"container-title":["Critical Care Medicine"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.lww.com\/10.1097\/CCM.0000000000006879","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,12,4]],"date-time":"2025-12-04T16:01:31Z","timestamp":1764864091000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.lww.com\/10.1097\/CCM.0000000000006879"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,9,19]]},"references-count":27,"journal-issue":{"issue":"12","published-print":{"date-parts":[[2025]]}},"URL":"https:\/\/doi.org\/10.1097\/ccm.0000000000006879","relation":{},"ISSN":["0090-3493","1530-0293"],"issn-type":[{"value":"0090-3493","type":"print"},{"value":"1530-0293","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,9,19]]}}}