{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,16]],"date-time":"2026-01-16T18:12:50Z","timestamp":1768587170828,"version":"3.49.0"},"reference-count":32,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2023,9,13]],"date-time":"2023-09-13T00:00:00Z","timestamp":1694563200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,9,13]],"date-time":"2023-09-13T00:00:00Z","timestamp":1694563200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/100000002","name":"National Institutes of Health","doi-asserted-by":"publisher","award":["R33AG062884"],"award-info":[{"award-number":["R33AG062884"]}],"id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000002","name":"National Institutes of Health","doi-asserted-by":"publisher","award":["R33AG062884"],"award-info":[{"award-number":["R33AG062884"]}],"id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Med Inform Decis Mak"],"abstract":"<jats:title>Abstract<\/jats:title><jats:sec>\n                <jats:title>Background<\/jats:title>\n                <jats:p>Prognostic models of hospital-induced delirium, that include potential predisposing and precipitating factors, may be used to identify vulnerable patients and inform the implementation of tailored preventive interventions. It is recommended that, in prediction model development studies, candidate predictors are selected on the basis of existing knowledge, including knowledge from clinical practice. The purpose of this article is to describe the process of identifying and operationalizing candidate predictors of hospital-induced delirium for application in a prediction model development study using a practice-based approach.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Methods<\/jats:title>\n                <jats:p>This study is part of a larger, retrospective cohort study that is developing prognostic models of hospital-induced delirium for medical-surgical older adult patients using structured data from administrative and electronic health records. First, we conducted a review of the literature to identify clinical concepts that had been used as candidate predictors in prognostic model development-and-validation studies of hospital-induced delirium. Then, we consulted a multidisciplinary task force of nine members who independently judged whether each clinical concept was associated with hospital-induced delirium. Finally, we mapped the clinical concepts to the administrative and electronic health records and operationalized our candidate predictors.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Results<\/jats:title>\n                <jats:p>In the review of 34 studies, we identified 504 unique clinical concepts. Two-thirds of the clinical concepts (337\/504) were used as candidate predictors only once. The most common clinical concepts included age (31\/34), sex (29\/34), and alcohol use (22\/34). 96% of the clinical concepts (484\/504) were judged to be associated with the development of hospital-induced delirium by at least two members of the task force. All of the task force members agreed that 47 or 9% of the 504 clinical concepts were associated with hospital-induced delirium.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Conclusions<\/jats:title>\n                <jats:p>Heterogeneity among candidate predictors of hospital-induced delirium in the literature suggests a still evolving list of factors that contribute to the development of this complex phenomenon. We demonstrated a practice-based approach to variable selection for our model development study of hospital-induced delirium. Expert judgement of variables enabled us to categorize the variables based on the amount of agreement among the experts and plan for the development of different models, including an expert-model and data-driven model.<\/jats:p>\n              <\/jats:sec>","DOI":"10.1186\/s12911-023-02278-1","type":"journal-article","created":{"date-parts":[[2023,9,13]],"date-time":"2023-09-13T14:02:33Z","timestamp":1694613753000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["Application of a practice-based approach in variable selection for a prediction model development study of hospital-induced delirium"],"prefix":"10.1186","volume":"23","author":[{"given":"Urszula A.","family":"Snigurska","sequence":"first","affiliation":[]},{"given":"Sarah E.","family":"Ser","sequence":"additional","affiliation":[]},{"given":"Laurence M.","family":"Solberg","sequence":"additional","affiliation":[]},{"given":"Mattia","family":"Prosperi","sequence":"additional","affiliation":[]},{"given":"Tanja","family":"Magoc","sequence":"additional","affiliation":[]},{"given":"Zhaoyi","family":"Chen","sequence":"additional","affiliation":[]},{"given":"Jiang","family":"Bian","sequence":"additional","affiliation":[]},{"given":"Ragnhildur I.","family":"Bjarnadottir","sequence":"additional","affiliation":[]},{"given":"Robert J.","family":"Lucero","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2023,9,13]]},"reference":[{"issue":"1","key":"2278_CR1","doi-asserted-by":"publisher","first-page":"27","DOI":"10.1001\/archinternmed.2007.4","volume":"168","author":"DL Leslie","year":"2008","unstructured":"Leslie DL, Marcantonio ER, Zhang Y, Leo-Summers L, Inouye SK. One-year health care costs associated with delirium in the elderly population. Arch Intern Med. 2008;168(1):27\u201332. https:\/\/doi.org\/10.1001\/archinternmed.2007.4.","journal-title":"Arch Intern Med"},{"key":"2278_CR2","doi-asserted-by":"publisher","unstructured":"American Psychiatric Association. Neurocognitive disorders. In: Diagnostic and Statistical Manual of Mental Disorders. 5th ed., text rev. American Psychiatric Association;2022. Accessed January 24., 2023. https:\/\/doi.org\/10.1176\/appi.books.9780890425787.","DOI":"10.1176\/appi.books.9780890425787"},{"issue":"9920","key":"2278_CR3","doi-asserted-by":"publisher","first-page":"911","DOI":"10.1016\/S0140-6736(13)60688-1","volume":"383","author":"SK Inouye","year":"2014","unstructured":"Inouye SK, Westendorp RG, Saczynski JS. Delirium in elderly people. Lancet. 2014;383(9920):911\u201322. https:\/\/doi.org\/10.1016\/S0140-6736(13)60688-1.","journal-title":"Lancet"},{"issue":"1","key":"2278_CR4","doi-asserted-by":"publisher","first-page":"325","DOI":"10.1186\/s12877-020-01723-4","volume":"20","author":"MZ Aung Thein","year":"2020","unstructured":"Aung Thein MZ, Pereira JV, Nitchingham A, Caplan GA. A call to action for delirium research: Meta-analysis and regression of delirium associated mortality. BMC Geriatr. 2020;20(1):325. https:\/\/doi.org\/10.1186\/s12877-020-01723-4. Published 2020 Sep 7.","journal-title":"BMC Geriatr"},{"issue":"9","key":"2278_CR5","doi-asserted-by":"publisher","first-page":"669","DOI":"10.1056\/NEJM199903043400901","volume":"340","author":"SK Inouye","year":"1999","unstructured":"Inouye SK, Bogardus ST Jr, Charpentier PA, et al. A multicomponent intervention to prevent delirium in hospitalized older patients. N Engl J Med. 1999;340(9):669\u201376. https:\/\/doi.org\/10.1056\/NEJM199903043400901.","journal-title":"N Engl J Med"},{"issue":"3","key":"2278_CR6","doi-asserted-by":"publisher","first-page":"346","DOI":"10.1093\/ageing\/aft141","volume":"43","author":"MP Carrasco","year":"2014","unstructured":"Carrasco MP, Villarroel L, Andrade M, Calder\u00f3n J, Gonz\u00e1lez M. Development and validation of a delirium predictive score in older people. Age Ageing. 2014;43(3):346\u201351. https:\/\/doi.org\/10.1093\/ageing\/aft141.","journal-title":"Age Ageing"},{"issue":"4","key":"2278_CR7","doi-asserted-by":"publisher","first-page":"915","DOI":"10.1007\/s11096-016-0312-7","volume":"38","author":"HA de Wit","year":"2016","unstructured":"de Wit HA, Winkens B, Mestres Gonzalvo C, et al. The development of an automated ward independent delirium risk prediction model. Int J Clin Pharm. 2016;38(4):915\u201323. https:\/\/doi.org\/10.1007\/s11096-016-0312-7.","journal-title":"Int J Clin Pharm"},{"issue":"6","key":"2278_CR8","doi-asserted-by":"publisher","first-page":"474","DOI":"10.7326\/0003-4819-119-6-199309150-00005","volume":"119","author":"SK Inouye","year":"1993","unstructured":"Inouye SK, Viscoli CM, Horwitz RI, Hurst LD, Tinetti ME. A predictive model for delirium in hospitalized elderly medical patients based on admission characteristics. Ann Intern Med. 1993;119(6):474\u201381. https:\/\/doi.org\/10.7326\/0003-4819-119-6-199309150-00005.","journal-title":"Ann Intern Med"},{"issue":"11","key":"2278_CR9","doi-asserted-by":"publisher","first-page":"852","DOI":"10.1001\/jama.1996.03530350034031","volume":"275","author":"SK Inouye","year":"1996","unstructured":"Inouye SK, Charpentier PA. Precipitating factors for delirium in hospitalized elderly persons. Predictive model and interrelationship with baseline vulnerability. JAMA. 1996;275(11):852\u20137.","journal-title":"JAMA"},{"issue":"4","key":"2278_CR10","first-page":"424","volume":"22","author":"MT Ji","year":"2018","unstructured":"Ji MT, Xing SP, Yang Y. Pathophysiological factors of delirium among critically ill elders after non-cardiac surgery based on artificial neural networks: a pilot study. Anaesth Pain & Intensive care. 2018;22(4):424\u201330.","journal-title":"Anaesth Pain & Intensive care"},{"issue":"6","key":"2278_CR11","doi-asserted-by":"publisher","first-page":"320","DOI":"10.1177\/0891988716666380","volume":"29","author":"RN Jones","year":"2016","unstructured":"Jones RN, Marcantonio ER, Saczynski JS, et al. Preoperative cognitive performance dominates risk for delirium among older adults. J Geriatr Psychiatry Neurol. 2016;29(6):320\u20137. https:\/\/doi.org\/10.1177\/0891988716666380.","journal-title":"J Geriatr Psychiatry Neurol"},{"issue":"12","key":"2278_CR12","doi-asserted-by":"publisher","first-page":"e3072","DOI":"10.1097\/MD.0000000000003072","volume":"95","author":"MY Kim","year":"2016","unstructured":"Kim MY, Park UJ, Kim HT, Cho WH. Delirium prediction based on hospital information (Delphi) in general surgery patients. Med (Baltim). 2016;95(12):e3072. https:\/\/doi.org\/10.1097\/MD.0000000000003072.","journal-title":"Med (Baltim)"},{"issue":"3","key":"2278_CR13","doi-asserted-by":"publisher","first-page":"406","DOI":"10.1097\/01.anes.0000278905.07899.df","volume":"107","author":"JM Leung","year":"2007","unstructured":"Leung JM, Sands LP, Wang Y, et al. Apolipoprotein E e4 allele increases the risk of early postoperative delirium in older patients undergoing noncardiac surgery. Anesthesiology. 2007;107(3):406\u201311. https:\/\/doi.org\/10.1097\/01.anes.0000278905.07899.df.","journal-title":"Anesthesiology"},{"issue":"12","key":"2278_CR14","doi-asserted-by":"publisher","first-page":"1099","DOI":"10.1111\/j.1532-5415.1988.tb04396.x","volume":"36","author":"SE Levkoff","year":"1988","unstructured":"Levkoff SE, Safran C, Cleary PD, Gallop J, Phillips RS. Identification of factors associated with the diagnosis of delirium in elderly hospitalized patients. J Am Geriatr Soc. 1988;36(12):1099\u2013104. https:\/\/doi.org\/10.1111\/j.1532-5415.1988.tb04396.x.","journal-title":"J Am Geriatr Soc"},{"issue":"4","key":"2278_CR15","doi-asserted-by":"publisher","first-page":"317","DOI":"10.1093\/ageing\/25.4.317","volume":"25","author":"ST O\u2019Keeffe","year":"1996","unstructured":"O\u2019Keeffe ST, Lavan JN. Predicting delirium in elderly patients: development and validation of a risk-stratification model. Age Ageing. 1996;25(4):317\u201321. https:\/\/doi.org\/10.1093\/ageing\/25.4.317.","journal-title":"Age Ageing"},{"issue":"15","key":"2278_CR16","doi-asserted-by":"publisher","first-page":"1629","DOI":"10.1001\/archinte.167.15.1629","volume":"167","author":"MA Pisani","year":"2007","unstructured":"Pisani MA, Murphy TE, Van Ness PH, Araujo KL, Inouye SK. Characteristics associated with delirium in older patients in a medical intensive care unit. Arch Intern Med. 2007;167(15):1629\u201334. https:\/\/doi.org\/10.1001\/archinte.167.15.1629.","journal-title":"Arch Intern Med"},{"issue":"8","key":"2278_CR17","doi-asserted-by":"publisher","first-page":"809","DOI":"10.1111\/j.1532-5415.1994.tb06551.x","volume":"42","author":"P Pompei","year":"1994","unstructured":"Pompei P, Foreman M, Rudberg MA, Inouye SK, Braund V, Cassel CK. Delirium in hospitalized older persons: outcomes and predictors. J Am Geriatr Soc. 1994;42(8):809\u201315. https:\/\/doi.org\/10.1111\/j.1532-5415.1994.tb06551.x.","journal-title":"J Am Geriatr Soc"},{"issue":"4","key":"2278_CR18","doi-asserted-by":"publisher","first-page":"598","DOI":"10.1016\/j.ejvs.2019.11.029","volume":"59","author":"JP Roijers","year":"2020","unstructured":"Roijers JP, Rakk\u00e9 YS, Hopmans CJ, et al. Incidence and risk factors for delirium in elderly patients with critical limb ischaemia. Eur J Vasc Endovasc Surg. 2020;59(4):598\u2013605. https:\/\/doi.org\/10.1016\/j.ejvs.2019.11.029.","journal-title":"Eur J Vasc Endovasc Surg"},{"issue":"2","key":"2278_CR19","doi-asserted-by":"publisher","first-page":"229","DOI":"10.1161\/CIRCULATIONAHA.108.795260","volume":"119","author":"JL Rudolph","year":"2009","unstructured":"Rudolph JL, Jones RN, Levkoff SE, et al. Derivation and validation of a preoperative prediction rule for delirium after cardiac surgery. Circulation. 2009;119(2):229\u201336. https:\/\/doi.org\/10.1161\/CIRCULATIONAHA.108.795260.","journal-title":"Circulation"},{"key":"2278_CR20","doi-asserted-by":"publisher","first-page":"e127","DOI":"10.1016\/j.wneu.2020.03.160","volume":"139","author":"L Zhan","year":"2020","unstructured":"Zhan L, Wang XQ, Zhang LX. Nomogram model for predicting risk of postoperative delirium after deep brain stimulation surgery in patients older than 50 years with Parkinson disease. World Neurosurg. 2020;139:e127\u201335. https:\/\/doi.org\/10.1016\/j.wneu.2020.03.160.","journal-title":"World Neurosurg"},{"issue":"4","key":"2278_CR21","doi-asserted-by":"publisher","first-page":"e019223","DOI":"10.1136\/bmjopen-2017-019223","volume":"8","author":"H Lindroth","year":"2018","unstructured":"Lindroth H, Bratzke L, Purvis S, et al. Systematic review of prediction models for delirium in the older adult inpatient. BMJ Open. 2018;8(4):e019223. https:\/\/doi.org\/10.1136\/bmjopen-2017-019223. Published 2018 Apr 28.","journal-title":"BMJ Open"},{"issue":"1","key":"2278_CR22","doi-asserted-by":"publisher","first-page":"W1","DOI":"10.7326\/M18-1377","volume":"170","author":"KGM Moons","year":"2019","unstructured":"Moons KGM, Wolff RF, Riley RD, et al. PROBAST: a tool to assess risk of bias and applicability of prediction model studies: explanation and elaboration. Ann Intern Med. 2019;170(1):W1\u2013W33. https:\/\/doi.org\/10.7326\/M18-1377.","journal-title":"Ann Intern Med"},{"issue":"1","key":"2278_CR23","doi-asserted-by":"publisher","first-page":"e000262","DOI":"10.1136\/fmch-2019-000262","volume":"8","author":"MZI Chowdhury","year":"2020","unstructured":"Chowdhury MZI, Turin TC. Variable selection strategies and its importance in clinical prediction modelling. Fam Med Community Health. 2020;8(1):e000262. https:\/\/doi.org\/10.1136\/fmch-2019-000262. Published 2020 Feb 16.","journal-title":"Fam Med Community Health"},{"issue":"1","key":"2278_CR24","doi-asserted-by":"publisher","first-page":"W1","DOI":"10.7326\/M14-0698","volume":"162","author":"KG Moons","year":"2015","unstructured":"Moons KG, Altman DG, Reitsma JB, et al. Transparent reporting of a multivariable prediction model for individual prognosis or diagnosis (TRIPOD): explanation and elaboration. Ann Intern Med. 2015;162(1):W1\u2013W73. https:\/\/doi.org\/10.7326\/M14-0698.","journal-title":"Ann Intern Med"},{"key":"2278_CR25","doi-asserted-by":"publisher","unstructured":"Moons KG, de Groot JA, Bouwmeester W et al. Critical appraisal and data extraction for systematic reviews of prediction modelling studies: The CHARMS Checklist. PLoS Med. 2014;11(10):e1001744. Published 2014 Oct 14. https:\/\/doi.org\/10.1371\/journal.pmed.1001744.","DOI":"10.1371\/journal.pmed.1001744"},{"issue":"1","key":"2278_CR26","doi-asserted-by":"publisher","first-page":"149","DOI":"10.1097\/01.sla.0000077920.38307.5f","volume":"238","author":"H B\u00f6hner","year":"2003","unstructured":"B\u00f6hner H, Hummel TC, Habel U, et al. Predicting delirium after vascular surgery: a model based on pre- and intraoperative data. Ann Surg. 2003;238(1):149\u201356. https:\/\/doi.org\/10.1097\/01.sla.0000077920.38307.5f.","journal-title":"Ann Surg"},{"key":"2278_CR27","first-page":"901","volume":"2012","author":"J Sun","year":"2012","unstructured":"Sun J, Hu J, Luo D, et al. Combining knowledge and data driven insights for identifying risk factors using electronic health records. AMIA Annu Symp Proc. 2012;2012:901\u201310.","journal-title":"AMIA Annu Symp Proc"},{"issue":"3","key":"2278_CR28","doi-asserted-by":"publisher","first-page":"652","DOI":"10.1111\/j.1365-2648.2010.05525.x","volume":"67","author":"L Kelly","year":"2011","unstructured":"Kelly L, Vincent D. The dimensions of nursing surveillance: a concept analysis. J Adv Nurs. 2011;67(3):652\u201361. https:\/\/doi.org\/10.1111\/j.1365-2648.2010.05525.x.","journal-title":"J Adv Nurs"},{"key":"2278_CR29","doi-asserted-by":"crossref","unstructured":"Hosmer DW, Lemeshow S. Assessing the fit of the model. In: Hosmer DW, Lemeshow S, editors. Applied Logistic Regression. 2nd ed. John Wiley & Sons; 2000. pp. 143\u2013202.","DOI":"10.1002\/0471722146"},{"key":"2278_CR30","doi-asserted-by":"publisher","first-page":"103932","DOI":"10.1016\/j.ijnurstu.2021.103932","volume":"119","author":"G Nakagami","year":"2021","unstructured":"Nakagami G, Yokota S, Kitamura A, et al. Supervised machine learning-based prediction for in-hospital pressure injury development using electronic health records: a retrospective observational cohort study in a university hospital in Japan. Int J Nurs Stud. 2021;119:103932. https:\/\/doi.org\/10.1016\/j.ijnurstu.2021.103932.","journal-title":"Int J Nurs Stud"},{"key":"2278_CR31","doi-asserted-by":"publisher","unstructured":"Capurro D, Yetisgen M, van Eaton E, Black R, Tarczy-Hornoch P. Availability of structured and unstructured clinical data for comparative effectiveness research and quality improvement: A multisite assessment. EGEMS (Wash DC). 2014;2(1):1079. Published 2014 Jul 11. https:\/\/doi.org\/10.13063\/2327-9214.1079.","DOI":"10.13063\/2327-9214.1079"},{"issue":"1","key":"2278_CR32","doi-asserted-by":"publisher","first-page":"21","DOI":"10.5334\/egems.237","volume":"6","author":"RI Bjarnadottir","year":"2018","unstructured":"Bjarnadottir RI, Lucero RJ. What can we learn about fall risk factors from EHR nursing notes? A text mining study. EGEMS (Wash DC). 2018;6(1):21. https:\/\/doi.org\/10.5334\/egems.237. Published 2018 Sep 20.","journal-title":"EGEMS (Wash DC)"}],"container-title":["BMC Medical Informatics and Decision Making"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12911-023-02278-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s12911-023-02278-1\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12911-023-02278-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,11,17]],"date-time":"2023-11-17T23:12:30Z","timestamp":1700262750000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmcmedinformdecismak.biomedcentral.com\/articles\/10.1186\/s12911-023-02278-1"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,9,13]]},"references-count":32,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2023,12]]}},"alternative-id":["2278"],"URL":"https:\/\/doi.org\/10.1186\/s12911-023-02278-1","relation":{},"ISSN":["1472-6947"],"issn-type":[{"value":"1472-6947","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,9,13]]},"assertion":[{"value":"8 May 2023","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"30 August 2023","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"13 September 2023","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"All of the procedures were performed in accordance with relevant guidelines and regulations as described in the protocol that was approved by the University of Florida Institutional Review Board (UF IRB #201900208). Informed consent was waived for all participants according to the United States federal law for secondary research (45 CFR). The findings reflect domain expertise of co-investigators covered under UF IRB #201900208.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Not applicable.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"M.P. is an Editorial Board Member of BMC Medical Informatics and Decision Making. All of the other authors declare that they have no competing interests.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}},{"value":"For more background information about this and the larger UF-ECLIPSE study, go to the National Institutes of Health RePORTER.","order":5,"name":"Ethics","group":{"name":"EthicsHeading","label":"Authors\u2019 information (optional)"}}],"article-number":"181"}}