{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,11,6]],"date-time":"2026-11-06T14:59:24Z","timestamp":1793977164828,"version":"4.8.0"},"reference-count":19,"publisher":"Ovid Technologies (Wolters Kluwer Health)","issue":"1","content-domain":{"domain":["lww.com","ovid.com"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2023,1]]},"abstract":"<jats:p>Delirium is known to be underdiagnosed and underdocumented. Delirium detection in retrospective studies occurs mostly by clinician diagnosis or nursing documentation. This study aims to assess the effectiveness of natural language processing-confusion assessment method (NLP-CAM) algorithm when compared to conventional modalities of delirium detection. A multicenter retrospective study analyzed 4351 COVID-19 hospitalized patient records to identify delirium occurrence utilizing three different delirium detection modalities namely clinician diagnosis, nursing documentation, and the NLP-CAM algorithm. Delirium detection by any of the 3 methods is considered positive for delirium occurrence as a comparison. NLP-CAM captured 80% of overall delirium, followed by clinician diagnosis at 55%, and nursing flowsheet documentation at 43%. Increase in age, Charlson comorbidity score, and length of hospitalization had increased delirium detection odds regardless of the detection method. Artificial intelligence-based NLP-CAM algorithm, compared to conventional methods, improved delirium detection from electronic health records and holds promise in delirium diagnostics.<\/jats:p>","DOI":"10.1097\/jmq.0000000000000090","type":"journal-article","created":{"date-parts":[[2022,10,25]],"date-time":"2022-10-25T16:03:44Z","timestamp":1666713824000},"page":"17-22","update-policy":"https:\/\/doi.org\/10.1097\/lww.0000000000001000","source":"Crossref","is-referenced-by-count":22,"title":["Natural Language Processing CAM Algorithm Improves Delirium Detection Compared With Conventional Methods"],"prefix":"10.1097","volume":"38","author":[{"given":"Sandeep R.","family":"Pagali","sequence":"first","affiliation":[{"name":"Department of Medicine, Division of Hospital Internal Medicine, Mayo Clinic, Rochester, MN"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Rakesh","family":"Kumar","sequence":"additional","affiliation":[{"name":"Department of Psychiatry, Mayo Clinic, Rochester, MN"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sunyang","family":"Fu","sequence":"additional","affiliation":[{"name":"Department of Artificial Intelligence and Informatics, Mayo Clinic, Rochester, MN"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sunghwan","family":"Sohn","sequence":"additional","affiliation":[{"name":"Department of Artificial Intelligence and Informatics, Mayo Clinic, Rochester, MN"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mohammed","family":"Yousufuddin","sequence":"additional","affiliation":[{"name":"Department of Medicine, Division of Hospital Internal Medicine, Mayo Clinic Health System, Austin, MN"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"276","published-online":{"date-parts":[[2022,10,26]]},"reference":[{"key":"R1-20250806","doi-asserted-by":"crossref","first-page":"2703","DOI":"10.1001\/jama.286.21.2703","article-title":"Delirium in mechanically ventilated patients: validity and reliability of the confusion assessment method for the intensive care unit (CAM-ICU).","volume":"286","author":"Ely","year":"2001","journal-title":"JAMA"},{"key":"R2-20250806","doi-asserted-by":"crossref","first-page":"210","DOI":"10.1038\/nrneurol.2009.24","article-title":"Delirium in elderly adults: diagnosis, prevention and treatment.","volume":"5","author":"Fong","year":"2009","journal-title":"Nat Rev Neurol"},{"issue":"sup1","key":"R3-20250806","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1080\/21548331.2019.1709359","article-title":"Delirium in hospitalized older adults.","volume":"48","author":"Rieck","year":"2020","journal-title":"Hosp Pract (1995)"},{"key":"R4-20250806","doi-asserted-by":"crossref","first-page":"1229","DOI":"10.1016\/j.mayocp.2020.08.049","article-title":"Predicting delirium risk using an automated mayo delirium prediction tool: development and validation of a risk-stratification model.","volume":"96","author":"Pagali","year":"2021","journal-title":"Mayo Clin Proc"},{"key":"R5-20250806","doi-asserted-by":"crossref","first-page":"e019223","DOI":"10.1136\/bmjopen-2017-019223","article-title":"Systematic review of prediction models for delirium in the older adult inpatient.","volume":"8","author":"Lindroth","year":"2018","journal-title":"BMJ Open"},{"key":"R6-20250806","doi-asserted-by":"crossref","first-page":"268","DOI":"10.1111\/psyg.12324","article-title":"Underdiagnosis of delirium in the elderly in acute care hospital settings: lessons not learned.","volume":"18","author":"Ritter","year":"2018","journal-title":"Psychogeriatrics"},{"key":"R7-20250806","doi-asserted-by":"crossref","first-page":"524","DOI":"10.1093\/gerona\/glaa275","article-title":"Ascertainment of delirium status using natural language processing from electronic health records.","volume":"77","author":"Fu","year":"2022","journal-title":"J Gerontol A Biol Sci Med Sci"},{"key":"R9-20250806","doi-asserted-by":"crossref","first-page":"1105","DOI":"10.1017\/S104161022100106X","article-title":"Delirium occurrence and association with outcomes in hospitalized COVID-19 patients.","volume":"33","author":"Pagali","year":"2021","journal-title":"Int Psychogeriatr"},{"key":"R10-20250806","doi-asserted-by":"crossref","first-page":"457","DOI":"10.1016\/j.annemergmed.2013.05.003","article-title":"Diagnosing delirium in older emergency department patients: validity and reliability of the delirium triage screen and the brief confusion assessment method.","volume":"62","author":"Han","year":"2013","journal-title":"Ann Emerg Med"},{"key":"R11-20250806","doi-asserted-by":"crossref","first-page":"1251","DOI":"10.1111\/acem.13449","article-title":"Validation of the brief confusion assessment method for screening delirium in elderly medical patients in a German emergency department.","volume":"25","author":"Baten","year":"2018","journal-title":"Acad Emerg Med"},{"key":"R12-20250806","doi-asserted-by":"crossref","first-page":"16","DOI":"10.1097\/NOR.0000000000000726","article-title":"Delirium triage screen\/brief confusion assessment method in adult orthopaedic and hematological patients: a validation study.","volume":"40","author":"Sederstrom","year":"2021","journal-title":"Orthop Nurs"},{"key":"R13-20250806","doi-asserted-by":"crossref","first-page":"159","DOI":"10.2307\/2529310","article-title":"The measurement of observer agreement for categorical data.","volume":"33","author":"Landis","year":"1977","journal-title":"Biometrics"},{"key":"R14-20250806","doi-asserted-by":"crossref","first-page":"172","DOI":"10.1001\/archpsyc.1987.01800140084013","article-title":"Quantification of agreement in psychiatric diagnosis revisited.","volume":"44","author":"Shrout","year":"1987","journal-title":"Arch Gen Psychiatry"},{"key":"R15-20250806","doi-asserted-by":"crossref","first-page":"1015","DOI":"10.1016\/j.jagp.2018.06.007","article-title":"Hospital elder life program: systematic review and meta-analysis of effectiveness.","volume":"26","author":"Hshieh","year":"2018","journal-title":"Am J Geriatr Psychiatry"},{"key":"R16-20250806","doi-asserted-by":"crossref","first-page":"512","DOI":"10.1001\/jamainternmed.2014.7779","article-title":"Effectiveness of multicomponent nonpharmacological delirium interventions: a meta-analysis [published correction appears in JAMA Intern Med. 2015 Apr;175(4):659].","volume":"175","author":"Hshieh","year":"2015","journal-title":"JAMA Intern Med"},{"key":"R17-20250806","doi-asserted-by":"crossref","first-page":"afab214","DOI":"10.1093\/ageing\/afab214","article-title":"Prevalence, management and outcomes of unrecognized delirium in a national sample of 1,493 older emergency department patients: how many were sent home and what happened to them?","volume":"51","author":"Lee","year":"2022","journal-title":"Age Ageing"},{"key":"R18-20250806","doi-asserted-by":"crossref","first-page":"941","DOI":"10.7326\/0003-4819-113-12-941","article-title":"Clarifying confusion: the confusion assessment method. A new method for detection of delirium.","volume":"113","author":"Inouye","year":"1990","journal-title":"Ann Intern Med"},{"key":"R19-20250806","doi-asserted-by":"crossref","first-page":"73","DOI":"10.1176\/appi.psy.49.1.73","article-title":"Clinical utility and use of DSM-IV and ICD-10 criteria and the memorial delirium assessment scale in establishing a diagnosis of delirium after cardiac surgery.","volume":"49","author":"Kazmierski","year":"2008","journal-title":"Psychosomatics"},{"key":"R20-20250806","doi-asserted-by":"crossref","first-page":"1471","DOI":"10.1111\/j.1532-5415.2012.04066.x","article-title":"Diagnosing delirium in older hospitalized adults with dementia: adapting the confusion assessment method to international classification of diseases, tenth revision, diagnostic criteria.","volume":"60","author":"Thomas","year":"2012","journal-title":"J Am Geriatr Soc"}],"container-title":["American Journal of Medical Quality"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.lww.com\/10.1097\/JMQ.0000000000000090","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,8,6]],"date-time":"2025-08-06T12:03:36Z","timestamp":1754481816000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.lww.com\/10.1097\/JMQ.0000000000000090"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,10,26]]},"references-count":19,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2023]]}},"URL":"https:\/\/doi.org\/10.1097\/jmq.0000000000000090","relation":{},"ISSN":["1062-8606"],"issn-type":[{"value":"1062-8606","type":"print"}],"subject":[],"published":{"date-parts":[[2022,10,26]]}}}