{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,1]],"date-time":"2026-10-01T09:08:06Z","timestamp":1790845686697,"version":"4.1.0"},"reference-count":37,"publisher":"MDPI AG","issue":"18","license":[{"start":{"date-parts":[[2024,9,16]],"date-time":"2024-09-16T00:00:00Z","timestamp":1726444800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100008005","name":"Yonsei University College of Medicine","doi-asserted-by":"publisher","award":["6-2020-0068"],"award-info":[{"award-number":["6-2020-0068"]}],"id":[{"id":"10.13039\/501100008005","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["JCM"],"abstract":"<jats:p>Background: Delirium affects up to 50% of patients following high-risk surgeries and is associated with poor long-term prognosis. This study employed machine learning to predict delirium using polysomnography (PSG) and sleep-disorder questionnaire data, and aimed to identify key sleep-related factors for improved interventions and patient outcomes. Methods: We studied 912 adults who underwent surgery under general anesthesia at a tertiary hospital (2013\u20132024) and had PSG within 5 years of surgery. Delirium was assessed via clinical diagnoses, antipsychotic prescriptions, and psychiatric consultations within 14 days postoperatively. Sleep-related data were collected using PSG and questionnaires. Machine learning predictions were performed to identify postoperative delirium, focusing on model accuracy and feature importance. Results: This study divided the 912 patients into an internal training set (700) and an external test set (212). Univariate analysis identified significant delirium risk factors: midazolam use, prolonged surgery duration, and hypoalbuminemia. Sleep-related variables such as fewer rapid eye movement (REM) episodes and higher daytime sleepiness were also linked to delirium. An extreme gradient-boosting-based classification task achieved an AUC of 0.81 with clinical variables, 0.60 with PSG data alone, and 0.84 with both, demonstrating the added value of PSG data. Analysis of Shapley additive explanations values highlighted important predictors: surgery duration, age, midazolam use, PSG-derived oxygen saturation nadir, periodic limb movement index, and REM episodes, demonstrating the relationship between sleep patterns and the risk of delirium. Conclusions: The artificial intelligence model integrates clinical and sleep variables and reliably identifies postoperative delirium, demonstrating that sleep-related factors contribute to its identification. Predicting patients at high risk of developing postoperative delirium and closely monitoring them could reduce the costs and complications associated with delirium.<\/jats:p>","DOI":"10.3390\/jcm13185485","type":"journal-article","created":{"date-parts":[[2024,9,16]],"date-time":"2024-09-16T11:36:37Z","timestamp":1726486597000},"page":"5485","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":9,"title":["Development and Validation of Machine Learning Models to Predict Postoperative Delirium Using Clinical Features and Polysomnography Variables"],"prefix":"10.3390","volume":"13","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-1188-449X","authenticated-orcid":false,"given":"Woo-Seok","family":"Ha","sequence":"first","affiliation":[{"name":"Department of Neurology, Severance Hospital, Yonsei University College of Medicine, Seoul 03722, Republic of Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0796-4043","authenticated-orcid":false,"given":"Bo-Kyu","family":"Choi","sequence":"additional","affiliation":[{"name":"Department of Neurology, Severance Hospital, Yonsei University College of Medicine, Seoul 03722, Republic of Korea"},{"name":"Department of Biomedical Systems Informatics, Yonsei University College of Medicine, Seoul 03722, Republic of Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jungyeon","family":"Yeom","sequence":"additional","affiliation":[{"name":"Department of Neurology, Severance Hospital, Yonsei University College of Medicine, Seoul 03722, Republic of Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Seungwon","family":"Song","sequence":"additional","affiliation":[{"name":"Department of Neurology, Severance Hospital, Yonsei University College of Medicine, Seoul 03722, Republic of Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4723-8975","authenticated-orcid":false,"given":"Soomi","family":"Cho","sequence":"additional","affiliation":[{"name":"Department of Neurology, Severance Hospital, Yonsei University College of Medicine, Seoul 03722, Republic of Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Min-Kyung","family":"Chu","sequence":"additional","affiliation":[{"name":"Department of Neurology, Severance Hospital, Yonsei University College of Medicine, Seoul 03722, Republic of Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5850-010X","authenticated-orcid":false,"given":"Won-Joo","family":"Kim","sequence":"additional","affiliation":[{"name":"Department of Neurology, Gangnam Severance Hospital, Yonsei University College of Medicine, Seoul 06273, Republic of Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kyoung","family":"Heo","sequence":"additional","affiliation":[{"name":"Department of Neurology, Severance Hospital, Yonsei University College of Medicine, Seoul 03722, Republic of Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0261-1687","authenticated-orcid":false,"given":"Kyung-Min","family":"Kim","sequence":"additional","affiliation":[{"name":"Department of Neurology, Severance Hospital, Yonsei University College of Medicine, Seoul 03722, Republic of Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2024,9,16]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"911","DOI":"10.1016\/S0140-6736(13)60688-1","article-title":"Delirium in elderly people","volume":"383","author":"Inouye","year":"2014","journal-title":"Lancet"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"e2249950","DOI":"10.1001\/jamanetworkopen.2022.49950","article-title":"Predisposing and Precipitating Factors Associated with Delirium: A Systematic Review","volume":"6","author":"Ormseth","year":"2023","journal-title":"JAMA Netw. Open"},{"key":"ref_3","first-page":"448","article-title":"Postoperative delirium","volume":"77","author":"Whitlock","year":"2011","journal-title":"Minerva Anestesiol."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1753","DOI":"10.1001\/jama.291.14.1753","article-title":"Delirium as a predictor of mortality in mechanically ventilated patients in the intensive care unit","volume":"291","author":"Ely","year":"2004","journal-title":"JAMA"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"579","DOI":"10.1038\/s41582-022-00698-7","article-title":"The inter-relationship between delirium and dementia: The importance of delirium prevention","volume":"18","author":"Fong","year":"2022","journal-title":"Nat. Rev. Neurol."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"1539","DOI":"10.1046\/j.1532-5415.2003.51509.x","article-title":"Does delirium increase hospital stay?","volume":"51","author":"McCusker","year":"2003","journal-title":"J. Am. Geriatr. Soc."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"105","DOI":"10.1016\/B978-0-444-53702-7.00007-5","article-title":"Effects of sleep deprivation on cognition","volume":"185","author":"Killgore","year":"2010","journal-title":"Prog. Brain Res."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"1137","DOI":"10.2147\/NSS.S275698","article-title":"Atypical Sleep and Postoperative Delirium in the Cardiothoracic Surgical Intensive Care Unit: A Pilot Prospective Study","volume":"12","author":"Chen","year":"2020","journal-title":"Nat. Sci. Sleep"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"300060521990502","DOI":"10.1177\/0300060521990502","article-title":"Sleep and circadian rhythm disturbances in intensive care unit (ICU)-acquired delirium: A case-control study","volume":"49","author":"Sun","year":"2021","journal-title":"J. Int. Med. Res."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"136","DOI":"10.1007\/s40675-020-00174-y","article-title":"Sleep and Delirium in Older Adults","volume":"6","author":"Farasat","year":"2020","journal-title":"Curr. Sleep Med. Rep."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"977","DOI":"10.1016\/j.chest.2019.12.003","article-title":"Sleep and Delirium in Adults Who Are Critically Ill: A Contemporary Review","volume":"157","author":"Pisani","year":"2020","journal-title":"Chest"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"317","DOI":"10.1097\/JGP.0b013e3182487680","article-title":"Sleep quality and its association with delirium among veterans enrolled in hospice","volume":"20","author":"Slatore","year":"2012","journal-title":"Am. J. Geriatr. Psychiatry"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Zheng, J., Wang, L., Wang, W., Zhang, H., Yao, F., Chen, J., and Wang, Q. (2023). Association and prediction of subjective sleep quality and postoperative delirium during major non-cardiac surgery: A prospective observational study. BMC Anesthesiol., 23.","DOI":"10.1186\/s12871-023-02267-x"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"61","DOI":"10.1016\/j.sleep.2023.03.015","article-title":"Sleep Loss the night before surgery and incidence of postoperative delirium in adults 65-95 years of age","volume":"105","author":"Leung","year":"2023","journal-title":"Sleep Med."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"e13322","DOI":"10.1111\/jsr.13322","article-title":"A polysomnography study examining the association between sleep and postoperative delirium in older hospitalized cardiac surgical patients","volume":"30","author":"Ibala","year":"2021","journal-title":"J. Sleep Res."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"e13920","DOI":"10.1111\/jsr.13920","article-title":"Preoperative slow-wave sleep is associated with postoperative delirium after heart valve surgery: A prospective pilot study","volume":"32","author":"Lin","year":"2023","journal-title":"J. Sleep Res."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"477","DOI":"10.1186\/s13054-014-0477-1","article-title":"Sleep-disordered breathing is a risk factor for delirium after cardiac surgery: A prospective cohort study","volume":"18","author":"Roggenbach","year":"2014","journal-title":"Crit. Care"},{"key":"ref_18","unstructured":"Berry, R., Quan, S., and Abreu, A. (2020). The AASM Manual for the Scoring of Sleep and Associated Events: Rules, Terminology and Technical Specifications, Version 2.6., American Academy of Sleep Medicine."},{"key":"ref_19","unstructured":"Iber, C., Ancoli-Israel, S., Chesson, A.L., and Quan, S. (2007). The AASM Manual for the Scoring of Sleep and Associated Events: Rules, Terminology and Technical Specifications, American Academy of Sleep Medicine."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"193","DOI":"10.1016\/0165-1781(89)90047-4","article-title":"The Pittsburgh Sleep Quality Index: A new instrument for psychiatric practice and research","volume":"28","author":"Buysse","year":"1989","journal-title":"Psychiatry Res."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"601","DOI":"10.1093\/sleep\/34.5.601","article-title":"The Insomnia Severity Index: Psychometric indicators to detect insomnia cases and evaluate treatment response","volume":"34","author":"Morin","year":"2011","journal-title":"Sleep"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"540","DOI":"10.1093\/sleep\/14.6.540","article-title":"A new method for measuring daytime sleepiness: The Epworth sleepiness scale","volume":"14","author":"Johns","year":"1991","journal-title":"Sleep"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"631","DOI":"10.1378\/chest.15-0903","article-title":"STOP-Bang Questionnaire: A Practical Approach to Screen for Obstructive Sleep Apnea","volume":"149","author":"Chung","year":"2016","journal-title":"Chest"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"427","DOI":"10.5664\/jcsm.6496","article-title":"Using the Berlin Questionnaire to Predict Obstructive Sleep Apnea in the General Population","volume":"13","author":"Tan","year":"2017","journal-title":"J. Clin. Sleep Med."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"573","DOI":"10.3349\/ymj.2023.0047","article-title":"A Radiomics-Based Model for Potentially More Accurate Identification of Subtypes of Breast Cancer Brain Metastases","volume":"64","author":"Cho","year":"2023","journal-title":"Yonsei Med. J."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1109\/RBME.2022.3185953","article-title":"Explainable Artificial Intelligence Methods in Combating Pandemics: A Systematic Review","volume":"16","author":"Giuste","year":"2023","journal-title":"IEEE Rev. Biomed. Eng."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"afac200","DOI":"10.1093\/ageing\/afac200","article-title":"How do predisposing factors differ between delirium motor subtypes? A systematic review and meta-analysis","volume":"51","author":"Ghezzi","year":"2022","journal-title":"Age Ageing"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"273","DOI":"10.1002\/bjs.6843","article-title":"Risk factors and incidence of postoperative delirium in elderly patients after elective and emergency surgery","volume":"97","author":"Ansaloni","year":"2010","journal-title":"Br. J. Surg."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"1064","DOI":"10.1016\/j.ijnurstu.2012.03.008","article-title":"The association between nurse-administered midazolam following cardiac surgery and incident delirium: An observational study","volume":"49","author":"Taipale","year":"2012","journal-title":"Int. J. Nurs. Stud."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"181","DOI":"10.1080\/23279095.2022.2110871","article-title":"Anesthesia and dementia: An up-to-date review of the existing literature","volume":"31","author":"Tsolaki","year":"2024","journal-title":"Appl. Neuropsychol. Adult"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"1542","DOI":"10.1111\/anae.14855","article-title":"The relationship between obstructive sleep apnoea and postoperative delirium and pain: An observational study of a surgical cohort","volume":"74","author":"Strutz","year":"2019","journal-title":"Anaesthesia"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"1819","DOI":"10.1093\/brain\/121.10.1819","article-title":"Complex visual hallucinations. Clinical and neurobiological insights","volume":"121","author":"Manford","year":"1998","journal-title":"Brain"},{"key":"ref_33","first-page":"604","article-title":"Sleep disturbances in the critically ill patients: Role of delirium and sedative agents","volume":"77","author":"Trompeo","year":"2011","journal-title":"Minerva Anestesiol."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Joo, H.J., Joo, J.H., Kwon, J., Jang, B.N., and Park, E.C. (2021). Association between quality and duration of sleep and subjective cognitive decline: A cross-sectional study in South Korea. Sci. Rep., 11.","DOI":"10.1038\/s41598-021-96453-x"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"104340","DOI":"10.1016\/j.ijnurstu.2022.104340","article-title":"Prediction models for postoperative delirium after cardiac surgery: Systematic review and critical appraisal","volume":"136","author":"Cai","year":"2022","journal-title":"Int. J. Nurs. Stud."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"712","DOI":"10.3349\/ymj.2023.0113","article-title":"Clinical Features of Delirium among Patients in the Intensive Care Unit According to Motor Subtype Classification: A Retrospective Longitudinal Study","volume":"64","author":"Kim","year":"2023","journal-title":"Yonsei Med. J."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"101843","DOI":"10.1016\/j.smrv.2023.101843","article-title":"Multi-night measurement for diagnosis and simplified monitoring of obstructive sleep apnoea","volume":"72","author":"Lechat","year":"2023","journal-title":"Sleep Med. Rev."}],"container-title":["Journal of Clinical Medicine"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2077-0383\/13\/18\/5485\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T15:57:14Z","timestamp":1760111834000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2077-0383\/13\/18\/5485"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,9,16]]},"references-count":37,"journal-issue":{"issue":"18","published-online":{"date-parts":[[2024,9]]}},"alternative-id":["jcm13185485"],"URL":"https:\/\/doi.org\/10.3390\/jcm13185485","relation":{},"ISSN":["2077-0383"],"issn-type":[{"value":"2077-0383","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,9,16]]}}}