{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,13]],"date-time":"2026-08-13T10:28:57Z","timestamp":1786616937755,"version":"build-2736575974"},"reference-count":42,"publisher":"MDPI AG","issue":"16","license":[{"start":{"date-parts":[[2026,8,13]],"date-time":"2026-08-13T00:00:00Z","timestamp":1786579200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Diagnostics"],"abstract":"<jats:p>Background\/Objectives: Delirium is prevalent among intensive care unit (ICU) patients and is associated with prolonged ventilation, longer ICU stays, increased mortality, and post-discharge cognitive impairment. Because most current prediction tools were developed using European cohorts, their transportability to other ICU settings remains unclear. The device support burden has received limited attention, and preprocessing data leakage remains a secondary methodological concern. Methods: This prospective study enrolled consecutive adults from the Internal Medicine ICU of Ankara Etlik City Hospital. Fifty predictors from electronic health records were documented at ICU admission or within the first 24 h. Device support variables were assessed as a distinct domain using ablation analysis. We developed an elastic net regularized logistic regression model and validated it using 5 \u00d7 4-fold nested cross-validation. Preprocessing was restricted to the training folds, and gradient boosting was used as a comparison method. We also evaluated a fixed exploratory 11-predictor reduced model. Results: Delirium was detected in 50.8% of patients. The full regularized model achieved an area under the receiver operating characteristic curve (AUROC) of 0.696 (95% CI: 0.613\u20130.767). The fixed exploratory reduced model had a higher apparent AUROC of 0.756 (95% CI: 0.684\u20130.819) than the other models. This apparent advantage was absent when feature selection was repeated within each outer training fold (nested reduced model AUROC 0.700). The full-model calibration slope was 0.741 (95% CI: 0.345\u20131.265). This confidence interval was wide and included the value of 1.0. The fixed reduced-model slope was 0.235 (95% CI: 0.068\u20130.886), indicating that the predicted probabilities were too extreme. Ablation analysis showed that device support variables added predictive value to clinical and laboratory variables, whereas environmental variables alone did not significantly discriminate between the two groups. Conclusions: In this single-center Turkish ICU cohort, regularized logistic regression showed moderate performance in predicting delirium. Nested feature selection did not reproduce the fixed reduced model\u2019s apparent discrimination advantage. Device support variables are best interpreted as markers of care complexity rather than direct causal factors. External validation and recalibration are required before clinical use. Because delirium onset and device support start times were unavailable, the model estimated delirium risk across the ICU stay from predictors documented at ICU admission or within the first 24 h and was not time-anchored.<\/jats:p>","DOI":"10.3390\/diagnostics16162554","type":"journal-article","created":{"date-parts":[[2026,8,13]],"date-time":"2026-08-13T09:31:09Z","timestamp":1786613469000},"page":"2554","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Predicting ICU Delirium with a Regularized Logistic Regression Model: Device-Support Burden as an Informative Predictor Domain in a Turkish Cohort"],"prefix":"10.3390","volume":"16","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-0298-8011","authenticated-orcid":false,"given":"Muhammed Sezai","family":"Bazna","sequence":"first","affiliation":[{"name":"Department of Intensive Care Unit, Ankara Etlik City Hospital, Ankara 06170, T\u00fcrkiye"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3046-9558","authenticated-orcid":false,"given":"Fatih","family":"Okumu\u015f","sequence":"additional","affiliation":[{"name":"Department of Software Engineering, Inonu University, Malatya 44280, T\u00fcrkiye"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2026,8,13]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"American Psychiatric Association Diagnostic and Statistical Manual of Mental Disorders (2013). Diagnostic and Statistical Manual of Mental Disorders, American Psychiatric Association.","DOI":"10.1176\/appi.books.9780890425596"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"h2538","DOI":"10.1136\/bmj.h2538","article-title":"Outcome of Delirium in Critically Ill Patients: Systematic Review and Meta-Analysis","volume":"350","author":"Salluh","year":"2015","journal-title":"BMJ"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"653","DOI":"10.1111\/nicc.12857","article-title":"Incidence, Prevalence and Risk Factors of Delirium in ICU Patients: A Systematic Review and Meta-Analysis","volume":"28","author":"Wu","year":"2023","journal-title":"Nurs. Crit. Care"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"2703","DOI":"10.1001\/jama.286.21.2703","article-title":"Delirium in Mechanically Ventilated Patients: Validity and Reliability of the Confusion Assessment Method for the Intensive Care Unit (CAM-ICU)","volume":"286","author":"Ely","year":"2001","journal-title":"JAMA"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"859","DOI":"10.1007\/s001340100909","article-title":"Intensive Care Delirium Screening Checklist: Evaluation of a New Screening Tool","volume":"27","author":"Bergeron","year":"2001","journal-title":"Intensive Care Med."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"1753","DOI":"10.1001\/jama.291.14.1753","article-title":"Delirium as a Predictor of Mortality in Mechanically Ventilated Patients in the Intensive Care Unit","volume":"291","author":"Ely","year":"2004","journal-title":"JAMA"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"624","DOI":"10.1378\/chest.06-1795","article-title":"The Importance of Diagnosing and Managing ICU Delirium","volume":"132","author":"Pun","year":"2007","journal-title":"Chest"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"1892","DOI":"10.1007\/s00134-001-1132-2","article-title":"The Impact of Delirium in the Intensive Care Unit on Hospital Length of Stay","volume":"27","author":"Ely","year":"2001","journal-title":"Intensive Care Med."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"1306","DOI":"10.1056\/NEJMoa1301372","article-title":"Long-Term Cognitive Impairment after Critical Illness","volume":"369","author":"Pandharipande","year":"2013","journal-title":"N. Engl. J. Med."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"1092","DOI":"10.1164\/rccm.200904-0537OC","article-title":"Days of Delirium Are Associated with 1-Year Mortality in an Older Intensive Care Unit Population","volume":"180","author":"Pisani","year":"2009","journal-title":"Am. J. Respir. Crit. Care Med."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"955","DOI":"10.1097\/01.CCM.0000119429.16055.92","article-title":"Costs Associated with Delirium in Mechanically Ventilated Patients","volume":"32","author":"Milbrandt","year":"2004","journal-title":"Crit. Care Med."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"225","DOI":"10.1016\/j.ccc.2016.12.005","article-title":"The ABCDEF Bundle in Critical Care","volume":"33","author":"Marra","year":"2017","journal-title":"Crit. Care Clin."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"E825","DOI":"10.1097\/CCM.0000000000003299","article-title":"Clinical Practice Guidelines for the Prevention and Management of Pain, Agitation\/Sedation, Delirium, Immobility, and Sleep Disruption in Adult Patients in the ICU","volume":"46","author":"Devlin","year":"2018","journal-title":"Crit. Care Med."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1097\/CCM.0000000000003482","article-title":"Caring for Critically Ill Patients with the ABCDEF Bundle: Results of the ICU Liberation Collaborative in Over 15,000 Adults","volume":"47","author":"Pun","year":"2019","journal-title":"Crit. Care Med."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"171","DOI":"10.1097\/CCM.0000000000002149","article-title":"Improving Hospital Survival and Reducing Brain Dysfunction at Seven California Community Hospitals: Implementing PAD Guidelines Via the ABCDEF Bundle in 6,064 Patients","volume":"45","author":"Phillips","year":"2017","journal-title":"Crit. Care Med."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"e420","DOI":"10.1136\/bmj.e420","article-title":"Development and Validation of PRE-DELIRIC (PREdiction of DELIRium in ICu Patients) Delirium Prediction Model for Intensive Care Patients: Observational Multicentre Study","volume":"344","author":"Pickkers","year":"2012","journal-title":"BMJ"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"361","DOI":"10.1007\/s00134-013-3202-7","article-title":"Recalibration of the Delirium Prediction Model for ICU Patients (PRE-DELIRIC): A Multinational Observational Study","volume":"40","author":"Schoonhoven","year":"2014","journal-title":"Intensive Care Med."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"E827","DOI":"10.1097\/CCM.0000000000003911","article-title":"External Validation of Two Models to Predict Delirium in Critically Ill Adults Using Either the Confusion Assessment Method-ICU or the Intensive Care Delirium Screening Checklist for Delirium Assessment","volume":"47","author":"Wassenaar","year":"2019","journal-title":"Crit. Care Med."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"102784","DOI":"10.1016\/j.iccn.2019.102784","article-title":"Diagnostic Test Accuracy Meta-Analysis of PRE-DELIRIC (PREdiction of DELIRium in ICu Patients): A Delirium Prediction Model in Intensive Care Practice","volume":"57","author":"Ho","year":"2020","journal-title":"Intensive Crit. Care Nurs."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"1048","DOI":"10.1007\/s00134-015-3777-2","article-title":"Multinational Development and Validation of an Early Prediction Model for Delirium in ICU Patients","volume":"41","author":"Wassenaar","year":"2015","journal-title":"Intensive Care Med."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"e23401","DOI":"10.2196\/23401","article-title":"A Machine Learning-Based Algorithm for the Prediction of Intensive Care Unit Delirium (PRIDE): Retrospective Study","volume":"9","author":"Hur","year":"2021","journal-title":"JMIR Med. Inform."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"100804","DOI":"10.1016\/j.patter.2023.100804","article-title":"Leakage and the Reproducibility Crisis in Machine-Learning-Based Science","volume":"4","author":"Kapoor","year":"2023","journal-title":"Patterns"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"162","DOI":"10.4274\/tybd.galenos.2022.48243","article-title":"An Evaluation of the PRE-DELIRIC (PREdiction of DELIRium in ICu Patients) Delirium Prediction Model in Intensive Care Units in T\u00fcrkiye","volume":"21","author":"Tosun","year":"2023","journal-title":"Turk. J. Intensive Care"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"40","DOI":"10.1097\/CCM.0000000000000625","article-title":"A Systematic Review of Risk Factors for Delirium in the ICU","volume":"43","author":"Zaal","year":"2015","journal-title":"Crit. Care Med."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"66","DOI":"10.1007\/s00134-006-0399-8","article-title":"Incidence, Risk Factors and Consequences of ICU Delirium","volume":"33","author":"Ouimet","year":"2007","journal-title":"Intensive Care Med."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"R77","DOI":"10.1186\/cc7892","article-title":"Risk Factors for Delirium in Intensive Care Patients: A Prospective Cohort Study","volume":"13","author":"Elseviers","year":"2009","journal-title":"Crit. Care"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"372","DOI":"10.1016\/j.jcrc.2006.09.001","article-title":"Risk Factors for the Development of Early-Onset Delirium and the Subsequent Clinical Outcome in Mechanically Ventilated Patients","volume":"23","author":"Lin","year":"2008","journal-title":"J. Crit. Care"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"1577","DOI":"10.3390\/clinpract13060138","article-title":"Evaluating Nutritional Risk Factors for Delirium in Intensive-Care-Unit Patients: Present Insights and Prospects for Future Research","volume":"13","author":"Piccirillo","year":"2023","journal-title":"Clin. Pract."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"12697","DOI":"10.1038\/s41598-023-38650-4","article-title":"Development of a Machine Learning-Based Prediction Model for Sepsis-Associated Delirium in the Intensive Care Unit","volume":"13","author":"Zhang","year":"2023","journal-title":"Sci. Rep."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"111121","DOI":"10.1016\/j.jclinane.2023.111121","article-title":"Early Prediction of Delirium upon Intensive Care Unit Admission: Model Development, Validation, and Deployment","volume":"88","author":"Wang","year":"2023","journal-title":"J. Clin. Anesth."},{"key":"ref_31","first-page":"E0296","article-title":"ICU Delirium-Prediction Models: A Systematic Review","volume":"2","author":"Ruppert","year":"2020","journal-title":"Crit. Care Explor."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Chen, W.-H., Ding, L., Sha, Y., Lu, G., Qian, K., Wang, B., and Wang, H. (2025). Risk Prediction Models for Delirium in ICU Patients: A Systematic Review and Critical Appraisal. BMC Anesthesiol., 26.","DOI":"10.1186\/s12871-025-03562-5"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"1373","DOI":"10.1016\/S0895-4356(96)00236-3","article-title":"A Simulation Study of the Number of Events per Variable in Logistic Regression Analysis","volume":"49","author":"Peduzzi","year":"1996","journal-title":"J. Clin. Epidemiol."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"m441","DOI":"10.1136\/bmj.m441","article-title":"Calculating the Sample Size Required for Developing a Clinical Prediction Model","volume":"368","author":"Riley","year":"2020","journal-title":"BMJ"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"R115","DOI":"10.1186\/cc11407","article-title":"The Confusion Assessment Method for the Intensive Care Unit (CAM-ICU) and Intensive Care Delirium Screening Checklist (ICDSC) for the Diagnosis of Delirium: A Systematic Review and Meta-Analysis of Clinical Studies","volume":"16","author":"Chalhub","year":"2012","journal-title":"Crit. Care"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"301","DOI":"10.1111\/j.1467-9868.2005.00503.x","article-title":"Regularization and Variable Selection Via the Elastic Net","volume":"67","author":"Zou","year":"2005","journal-title":"J. R. Stat. Soc. Ser. B Stat. Methodol."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"1043","DOI":"10.1080\/03610928008827941","article-title":"Goodness of Fit Tests for the Multiple Logistic Regression Model","volume":"9","author":"Hosmer","year":"1980","journal-title":"Commun. Stat. Theory Methods"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Efron, B., and Tibshirani, R.J. (1993). An Introduction to the Bootstrap, Chapman & Hall\/CRC.","DOI":"10.1007\/978-1-4899-4541-9"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"837","DOI":"10.2307\/2531595","article-title":"Comparing the Areas under Two or More Correlated Receiver Operating Characteristic Curves: A Nonparametric Approach","volume":"44","author":"DeLong","year":"1988","journal-title":"Biometrics"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"565","DOI":"10.1177\/0272989X06295361","article-title":"Decision Curve Analysis: A Novel Method for Evaluating Prediction Models","volume":"26","author":"Vickers","year":"2006","journal-title":"Med. Decis. Mak."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"148","DOI":"10.1136\/bmj.g7594","article-title":"Transparent Reporting of a Multivariable Prediction Model for Individual Prognosis or Diagnosis (TRIPOD): The TRIPOD Statement","volume":"350","author":"Collins","year":"2015","journal-title":"BMJ"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"e078378","DOI":"10.1136\/bmj-2023-078378","article-title":"TRIPOD+AI Statement: Updated Guidance for Reporting Clinical Prediction Models That Use Regression or Machine Learning Methods","volume":"385","author":"Collins","year":"2024","journal-title":"BMJ"}],"container-title":["Diagnostics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2075-4418\/16\/16\/2554\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,8,13]],"date-time":"2026-08-13T09:40:46Z","timestamp":1786614046000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2075-4418\/16\/16\/2554"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,8,13]]},"references-count":42,"journal-issue":{"issue":"16","published-online":{"date-parts":[[2026,8]]}},"alternative-id":["diagnostics16162554"],"URL":"https:\/\/doi.org\/10.3390\/diagnostics16162554","relation":{},"ISSN":["2075-4418"],"issn-type":[{"value":"2075-4418","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,8,13]]}}}