{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,28]],"date-time":"2026-09-28T01:28:24Z","timestamp":1790558904942,"version":"4.1.0"},"reference-count":31,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2022,10,4]],"date-time":"2022-10-04T00:00:00Z","timestamp":1664841600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2022,10,4]],"date-time":"2022-10-04T00:00:00Z","timestamp":1664841600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"National Clinical Research Center for Geriatrics, West China Hospital, Sichuan University","award":["Z20192014"],"award-info":[{"award-number":["Z20192014"]}]},{"name":"Sichuan Science and Technology Program","award":["2021YFS0139"],"award-info":[{"award-number":["2021YFS0139"]}]},{"name":"Sichuan Science and Technology Program","award":["2022ZDZX0021"],"award-info":[{"award-number":["2022ZDZX0021"]}]},{"name":"West China Nursing Discipline Development Special Fund Project, Sichuan University","award":["HXHL20014"],"award-info":[{"award-number":["HXHL20014"]}]},{"name":"1.3.5 project for disciplines of excellence, West China Hospital, Sichuan University","award":["ZYJC21005"],"award-info":[{"award-number":["ZYJC21005"]}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Geriatr"],"abstract":"<jats:title>Abstract<\/jats:title><jats:sec>\n                <jats:title>Background<\/jats:title>\n                <jats:p>Delirium is frequently unrecognized due to the absence of regular screening. In addition to validated bedside tools, the computer-assisted instrument based on clinical notes from electronic medical records may be useful.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Aims<\/jats:title>\n                <jats:p>To assess the psychometric properties of a Chinese-chart-based keyword instrument for semiautomatically screening delirium using Natural language processing (NLP) based on clinical notes from electronic medical records.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Methods<\/jats:title>\n                <jats:p>The patients were admitted to West China Hospital from January 2015 to December 2017. Grouping patients based on the medical notes, those with accessible physician documents but no nurse documents were classified as the physician &amp; no-nurse (PNN) group, while those with accessible physician and nurse documents were classified as the physician &amp; nurse (PN) group. The psychometric properties, test\u2013retest reliability, internal consistency reliability (Cronbach's \u03b1), and criterion validity were calculated. Using receiver operating characteristic (ROC) analysis, the criterion validity of delirium was evaluated in comparison to the results of the Diagnostic and Statistical Manual of Mental Disorders, Fifth Edition.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Results<\/jats:title>\n                <jats:p>A total of 779 patients were enrolled in the study. Their ages ranged from 65 to 103\u00a0years (82.5\u2009\u00b1\u20096.5), with men accounting for 71.9% of the total. A total of 312 patients had access to only physician documents in the physician &amp; no-nurse (PNN) group, whereas 467 patients had access to both physician and nurse documents in the physician &amp; nurse (PN) group. All 779 patients had a Cronbach's alpha of 0.728 in terms of reliability, with 100% test\u2013retest reliability. The area under the ROC curve (AUC) values of the delirium screening instrument for criterion validity were 0.76 (all patients, <jats:italic>n<\/jats:italic>\u2009=\u2009779), 0.72 (PNN, <jats:italic>n<\/jats:italic>\u2009=\u2009312), and 0.79 (PN, <jats:italic>n<\/jats:italic>\u2009=\u2009467), respectively.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Conclusion<\/jats:title>\n                <jats:p>A delirium screening instrument composed of Chinese keywords that can be easily and quickly obtained from electronic medical records was developed, which improved delirium detection in older people.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Trial registration<\/jats:title>\n                <jats:p>Not applicable.<\/jats:p>\n              <\/jats:sec>","DOI":"10.1186\/s12877-022-03474-w","type":"journal-article","created":{"date-parts":[[2022,10,4]],"date-time":"2022-10-04T02:02:54Z","timestamp":1664848974000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":11,"title":["A novel semiautomatic Chinese keywords instrument screening delirium based on electronic medical records"],"prefix":"10.1186","volume":"22","author":[{"given":"Ling","family":"Chen","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Nan","family":"Li","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yuxia","family":"Zheng","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Langli","family":"Gao","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ning","family":"Ge","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Dongmei","family":"Xie","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jirong","family":"Yue","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2022,10,4]]},"reference":[{"key":"3474_CR1","doi-asserted-by":"publisher","first-page":"278","DOI":"10.1016\/0002-9343(94)90011-6","volume":"97","author":"SK Inouye","year":"1994","unstructured":"Inouye SK. The dilemma of delirium: clinical and research controversies regarding diagnosis and evaluation of delirium in hospitalized elderly medical patients. Am J Med. 1994;97:278\u201388.","journal-title":"Am J Med"},{"key":"3474_CR2","doi-asserted-by":"publisher","first-page":"911","DOI":"10.1016\/S0140-6736(13)60688-1","volume":"383","author":"SK Inouye","year":"2014","unstructured":"Inouye SK, Westendorp RGJ, Saczynski JS. Delirium in elderly people. The Lancet. 2014;383:911\u201322.","journal-title":"The Lancet"},{"key":"3474_CR3","doi-asserted-by":"publisher","first-page":"779","DOI":"10.1001\/jama.2010.1182","volume":"304","author":"CL Wong","year":"2010","unstructured":"Wong CL, Holroyd-Leduc J, Simel DL, Straus SE. Does this patient have delirium?: value of bedside instruments. JAMA. 2010;304:779\u201386.","journal-title":"JAMA"},{"key":"3474_CR4","doi-asserted-by":"publisher","first-page":"193","DOI":"10.1111\/j.1553-2712.2008.00339.x","volume":"16","author":"JH Han","year":"2009","unstructured":"Han JH, Zimmerman EE, Cutler N, Schnelle J, Morandi A, Dittus RS, Storrow AB, Ely EW. Delirium in older emergency department patients: recognition, risk factors, and psychomotor subtypes. Acad Emerg Med Off J Soc Acad Emerg Med. 2009;16:193\u2013200.","journal-title":"Acad Emerg Med Off J Soc Acad Emerg Med"},{"key":"3474_CR5","doi-asserted-by":"publisher","first-page":"168","DOI":"10.1016\/j.jcrc.2016.05.028","volume":"35","author":"A Luetz","year":"2016","unstructured":"Luetz A, Weiss B, Boettcher S, Burmeister J, Wernecke KD, Spies C. Routine delirium monitoring is independently associated with a reduction of hospital mortality in critically ill surgical patients: A prospective, observational cohort study. J Crit Care. 2016;35:168\u201373.","journal-title":"J Crit Care"},{"key":"3474_CR6","doi-asserted-by":"publisher","first-page":"165","DOI":"10.1111\/j.1440-172X.2008.00681.x","volume":"14","author":"P Voyer","year":"2008","unstructured":"Voyer P, Cole MG, McCusker J, St-Jacques S, Laplante J. Accuracy of nurse documentation of delirium symptoms in medical charts. Int J Nurs Pract. 2008;14:165\u201377.","journal-title":"Int J Nurs Pract"},{"key":"3474_CR7","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0111823","volume":"9","author":"E Kuhn","year":"2014","unstructured":"Kuhn E, Du X, McGrath K, Coveney S, O\u2019Regan N, Richardson S, Teodorczuk A, Allan L, Wilson D, Inouye SK, MacLullich AM, Meagher D, Brayne C, Timmons S, Davis D. Validation of a consensus method for identifying delirium from hospital records. PLoS ONE. 2014;9: e111823.","journal-title":"PLoS ONE"},{"key":"3474_CR8","first-page":"1066","volume":"2014","author":"J Spuhl","year":"2014","unstructured":"Spuhl J, Doing-Harris K, Nelson S, Estrada N, Del Fiol G, Weir C. Concordance of Electronic Health Record (EHR) data describing delirium at a VA hospital. AMIA Annu Symp Proc. 2014;2014:1066\u201371.","journal-title":"AMIA Annu Symp Proc."},{"key":"3474_CR9","doi-asserted-by":"publisher","first-page":"312","DOI":"10.1111\/j.1532-5415.2005.53120.x","volume":"53","author":"SK Inouye","year":"2005","unstructured":"Inouye SK, Leo-Summers L, Zhang Y, Bogardus ST Jr, Leslie DL, Agostini JV. A chart-based method for identification of delirium: validation compared with interviewer ratings using the confusion assessment method. J Am Geriatr Soc. 2005;53:312\u20138.","journal-title":"J Am Geriatr Soc"},{"key":"3474_CR10","doi-asserted-by":"publisher","first-page":"34","DOI":"10.3928\/00989134-20150723-01","volume":"41","author":"MR Puelle","year":"2015","unstructured":"Puelle MR, Kosar CM, Xu G, Schmitt E, Jones RN, Marcantonio ER, Cooper Z, Inouye SK, Saczynski JS. The Language of delirium: keywords for identifying delirium from medical records. J Gerontol Nurs. 2015;41:34\u201342.","journal-title":"J Gerontol Nurs"},{"key":"3474_CR11","doi-asserted-by":"publisher","first-page":"176","DOI":"10.1148\/rg.2016150080","volume":"36","author":"T Cai","year":"2016","unstructured":"Cai T, Giannopoulos AA, Yu S, Kelil T, Ripley B, Kumamaru KK, Rybicki FJ, Mitsouras D. Natural language processing technologies in radiology research and clinical applications. Radiographics. 2016;36:176\u201391.","journal-title":"Radiographics."},{"key":"3474_CR12","doi-asserted-by":"publisher","DOI":"10.2196\/16816","volume":"22","author":"J Wang","year":"2020","unstructured":"Wang J, Deng H, Liu B, Hu A, Liang J, Fan L, Zheng X, Wang T, Lei J. Systematic evaluation of research progress on natural language processing in medicine over the past 20 years: bibliometric study on pubMed. J Med Internet Res. 2020;22: e16816.","journal-title":"J Med Internet Res"},{"key":"3474_CR13","doi-asserted-by":"publisher","DOI":"10.2196\/13039","volume":"7","author":"T Chen","year":"2019","unstructured":"Chen T, Dredze M, Weiner JP, Hernandez L, Kimura J, Kharrazi H. Extraction of geriatric syndromes from electronic health record clinical notes: assessment of statistical natural language processing methods. JMIR Med Inform. 2019;7: e13039.","journal-title":"JMIR Med Inform"},{"key":"3474_CR14","doi-asserted-by":"publisher","first-page":"941","DOI":"10.7326\/0003-4819-113-12-941","volume":"113","author":"SK Inouye","year":"1990","unstructured":"Inouye SK, van Dyck CH, Alessi CA, Balkin S, Siegal AP, Horwitz RI. Clarifying confusion: the confusion assessment method. a new method for detection of delirium. Ann Intern Med. 1990;113:941\u20138.","journal-title":"Ann Intern Med."},{"key":"3474_CR15","doi-asserted-by":"publisher","first-page":"554","DOI":"10.7326\/M14-0865","volume":"161","author":"ER Marcantonio","year":"2014","unstructured":"Marcantonio ER, Ngo LH, O\u2019Connor M, Jones RN, Crane PK, Metzger ED, Inouye SK. 3D-CAM: derivation and validation of a 3-minute diagnostic interview for CAM-defined delirium: a cross-sectional diagnostic test study. Ann Intern Med. 2014;161:554\u201361.","journal-title":"Ann Intern Med"},{"key":"3474_CR16","first-page":"3","volume":"13","author":"L Juan","year":"2003","unstructured":"Juan L, Zhouyi Z, Feng F, Yuying T. Reversion of CAM for assisting the evaluation and diagnosis of delirium. J Clin Psychiatry. 2003;13:3.","journal-title":"J Clin Psychiatry"},{"key":"3474_CR17","doi-asserted-by":"publisher","first-page":"14","DOI":"10.1177\/002383099200500103","volume":"5","author":"MS Albert","year":"1992","unstructured":"Albert MS, Levkoff SE, Reilly C, Liptzin B, Pilgrim D, Cleary PD, Evans D, Rowe JW. The delirium symptom interview: an interview for the detection of delirium symptoms in hospitalized patients. J Geriatr Psychiatry Neurol. 1992;5:14\u201321.","journal-title":"J Geriatr Psychiatry Neurol"},{"key":"3474_CR18","doi-asserted-by":"publisher","first-page":"31","DOI":"10.1891\/rtnp.17.1.31.53169","volume":"17","author":"MJ Schuurmans","year":"2003","unstructured":"Schuurmans MJ, Shortridge-Baggett LM, Duursma SA. The delirium observation screening scale: a screening instrument for delirium. Res Theory Nurs Pract. 2003;17:31\u201350.","journal-title":"Res Theory Nurs Pract"},{"key":"3474_CR19","doi-asserted-by":"publisher","first-page":"89","DOI":"10.1016\/0165-1781(88)90037-6","volume":"23","author":"PT Trzepacz","year":"1988","unstructured":"Trzepacz PT, Baker RW, Greenhouse J. A symptom rating scale for delirium. Psychiatry Res. 1988;23:89\u201397.","journal-title":"Psychiatry Res"},{"key":"3474_CR20","doi-asserted-by":"publisher","first-page":"229","DOI":"10.1176\/jnp.13.2.229","volume":"13","author":"PT Trzepacz","year":"2001","unstructured":"Trzepacz PT, Mittal D, Torres R, Kanary K, Norton J, Jimerson N. Validation of the delirium rating scale-revised-98: comparison with the delirium rating scale and the cognitive test for delirium. J Neuropsychiatry Clin Neurosci. 2001;13:229\u201342.","journal-title":"J Neuropsychiatry Clin Neurosci"},{"key":"3474_CR21","doi-asserted-by":"publisher","first-page":"859","DOI":"10.1007\/s001340100909","volume":"27","author":"N Bergeron","year":"2001","unstructured":"Bergeron N, Dubois MJ, Dumont M, Dial S, Skrobik Y. Intensive care delirium screening checklist: evaluation of a new screening tool. Intensive Care Med. 2001;27:859\u201364.","journal-title":"Intensive Care Med"},{"key":"3474_CR22","doi-asserted-by":"publisher","first-page":"128","DOI":"10.1016\/S0885-3924(96)00316-8","volume":"13","author":"W Breitbart","year":"1997","unstructured":"Breitbart W, Rosenfeld B, Roth A, Smith MJ, Cohen K, Passik S. The memorial delirium assessment scale. J Pain Symptom Manage. 1997;13:128\u201337.","journal-title":"J Pain Symptom Manage"},{"key":"3474_CR23","doi-asserted-by":"publisher","first-page":"4","DOI":"10.1034\/j.1601-5215.2002.51002.x","volume":"51","author":"ER Marcantonio","year":"2003","unstructured":"Marcantonio ER, Simon SE, Bergmann MA, Jones RN, Murphy KM, Morris JN. Delirium symptoms in post-acute care: prevalent, persistent, and associated with poor functional recovery. J Am Geriatr Soc. 2003;51:4\u20139.","journal-title":"J Am Geriatr Soc"},{"key":"3474_CR24","doi-asserted-by":"publisher","first-page":"324","DOI":"10.1097\/00006199-199611000-00002","volume":"45","author":"VJ Neelon","year":"1996","unstructured":"Neelon VJ, Champagne MT, Carlson JR, Funk SG. The NEECHAM confusion scale: construction, validation, and clinical testing. Nurs Res. 1996;45:324\u201330.","journal-title":"Nurs Res"},{"key":"3474_CR25","doi-asserted-by":"publisher","first-page":"98","DOI":"10.1055\/s-2008-1060551","volume":"43","author":"A L\u00fctz","year":"2008","unstructured":"L\u00fctz A, Radtke FM, Franck M, Seeling M, Gaudreau JD, Kleinw\u00e4chter R, Kork F, Zieb A, Heymann A, Spies CD. The nursing delirium screening scale (NU-DESC). Anasthesiologie, Intensivmedizin, Notfallmedizin, Schmerztherapie\u202f: AINS. 2008;43:98\u2013102.","journal-title":"Anasthesiologie, Intensivmedizin, Notfallmedizin, Schmerztherapie : AINS"},{"key":"3474_CR26","unstructured":"Association AP. Diagnostic and Statistical Manual of Mental Disorders: DSM-5. 5th ed. Washington DC: American Psychiatric Association; 2013"},{"key":"3474_CR27","unstructured":"Organization WH. The ICD-10 Classification of Mental and Behavioural Disorders: Clinical Descriptions and Diagnostic Guidelines. Geneva: World Health Organization; 1992."},{"key":"3474_CR28","doi-asserted-by":"publisher","first-page":"183","DOI":"10.1016\/j.cger.2019.11.001","volume":"36","author":"TT Hshieh","year":"2020","unstructured":"Hshieh TT, Inouye SK, Oh ES. Delirium in the elderly. Clin Geriatr Med. 2020;36:183\u201399.","journal-title":"Clin Geriatr Med"},{"key":"3474_CR29","first-page":"4","volume":"33","author":"Z Yanli","year":"2020","unstructured":"Yanli Z, Ling C, Dongmei X, Nan L, Langli G, Jirong Y. Developing an automatic scale to delirium detection based on the electronic medical record system. J Med Postgrad. 2020;33:4.","journal-title":"J Med Postgrad"},{"key":"3474_CR30","doi-asserted-by":"crossref","unstructured":"Cronbach L. Coefficient alpha and the internal structure of tests. Psychometrika. 1951;16:297\u2013334.","DOI":"10.1007\/BF02310555"},{"key":"3474_CR31","doi-asserted-by":"publisher","first-page":"701","DOI":"10.3390\/neurolint13040067","volume":"13","author":"MG Ceppi","year":"2021","unstructured":"Ceppi MG, Rauch MS, S\u00e1ndor PS, Gantenbein AR, Krishnakumar S, Albert M, Meier CR. Detecting incident delirium within routinely collected inpatient rehabilitation data: validation of a chart-based method. Neurol Int. 2021;13:701\u201311.","journal-title":"Neurol Int"}],"container-title":["BMC Geriatrics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12877-022-03474-w.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s12877-022-03474-w\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12877-022-03474-w.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,10,4]],"date-time":"2022-10-04T02:04:00Z","timestamp":1664849040000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmcgeriatr.biomedcentral.com\/articles\/10.1186\/s12877-022-03474-w"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,10,4]]},"references-count":31,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2022,12]]}},"alternative-id":["3474"],"URL":"https:\/\/doi.org\/10.1186\/s12877-022-03474-w","relation":{},"ISSN":["1471-2318"],"issn-type":[{"value":"1471-2318","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,10,4]]},"assertion":[{"value":"13 April 2022","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"20 September 2022","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"4 October 2022","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"This retrospective chart review study involving human participants was conducted following the institutional and national research committee's ethical standards, as well as the 1964 Helsinki Declaration and its subsequent amendments or comparable ethical standards. This study and exemption from informed consent were approved by the Ethics Committee on Biomedical Research at Sichuan University's West China Hospital.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Not applicable.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"The authors declare that they have no competing interests.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"779"}}