{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,21]],"date-time":"2026-08-21T13:33:51Z","timestamp":1787319231849,"version":"build-2736575974"},"reference-count":26,"publisher":"JMIR Publications Inc.","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["JMIR Med Inform"],"abstract":"Abstract<\/jats:title>\n \n Background<\/jats:title>\n Agitation and sedation management is critical in intensive care as it affects patient safety. Traditional nursing assessments suffer from low frequency and subjectivity. Automating these assessments can boost intensive care unit (ICU) efficiency, treatment capacity, and patient safety.<\/jats:p>\n <\/jats:sec>\n \n Objectives<\/jats:title>\n The aim of this study was to develop a machine-learning based assessment of agitation and sedation.<\/jats:p>\n <\/jats:sec>\n \n Methods<\/jats:title>\n Using data from the Taichung Veterans General Hospital ICU database (2020), an ensemble learning model was developed for classifying the levels of agitation and sedation. Different ensemble learning model sequences were compared. In addition, an interpretable artificial intelligence approach, SHAP (Shapley additive explanations), was employed for explanatory analysis.<\/jats:p>\n <\/jats:sec>\n \n Results<\/jats:title>\n With 20 features and 121,303 data points, the random forest model achieved high area under the curve values across all models (sedation classification: 0.97; agitation classification: 0.88). The ensemble learning model enhanced agitation sensitivity (0.82) while maintaining high AUC values across all categories (all >0.82). The model explanations aligned with clinical experience.<\/jats:p>\n <\/jats:sec>\n \n Conclusions<\/jats:title>\n This study proposes an ICU agitation-sedation assessment automation using machine learning, enhancing efficiency and safety. Ensemble learning improves agitation sensitivity while maintaining accuracy. Real-time monitoring and future digital integration have the potential for advancements in intensive care.<\/jats:p>\n <\/jats:sec>","DOI":"10.2196\/63601","type":"journal-article","created":{"date-parts":[[2025,2,26]],"date-time":"2025-02-26T15:32:56Z","timestamp":1740583976000},"page":"e63601-e63601","source":"Crossref","is-referenced-by-count":3,"title":["Predicting Agitation-Sedation Levels in Intensive Care Unit Patients: Development of an Ensemble Model"],"prefix":"10.2196","volume":"13","author":[{"ORCID":"https:\/\/orcid.org\/0009-0003-3528-5691","authenticated-orcid":false,"given":"Pei-Yu","family":"Dai","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0002-0117-4240","authenticated-orcid":false,"given":"Pei-Yi","family":"Lin","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3014-8095","authenticated-orcid":false,"given":"Ruey-Kai","family":"Sheu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0006-1637-6899","authenticated-orcid":false,"given":"Shu-Fang","family":"Liu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0005-4311-9954","authenticated-orcid":false,"given":"Yu-Cheng","family":"Wu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5322-7426","authenticated-orcid":false,"given":"Chieh-Liang","family":"Wu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0004-6307-2172","authenticated-orcid":false,"given":"Wei-Lin","family":"Chen","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0007-8147-8653","authenticated-orcid":false,"given":"Chien-Chung","family":"Huang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0003-1414-5462","authenticated-orcid":false,"given":"Guan-Yin","family":"Lin","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8449-7872","authenticated-orcid":false,"given":"Lun-Chi","family":"Chen","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1010","published-online":{"date-parts":[[2025,2,26]]},"reference":[{"key":"R1","doi-asserted-by":"publisher","DOI":"10.1097\/00003246-200201000-00020","article-title":"Clinical practice guidelines for the sustained use of sedatives and analgesics in the critically ill adult","volume":"30","author":"Jacobi","journal-title":"Crit Care Med"},{"issue":"6","key":"R2","doi-asserted-by":"publisher","first-page":"1691","DOI":"10.1097\/01.CCM.0000218416.62457.56","article-title":"Impact of systematic evaluation of pain and agitation in an intensive care unit","volume":"34","author":"Chanques","journal-title":"Crit Care Med"},{"issue":"1","key":"R3","doi-asserted-by":"publisher","first-page":"75","DOI":"10.1592\/phco.20.1.75.34663","article-title":"Frequency, severity, and treatment of agitation in young versus elderly patients in the ICU","volume":"20","author":"Fraser","journal-title":"Pharmacotherapy"},{"issue":"2","key":"R4","doi-asserted-by":"publisher","first-page":"119","DOI":"10.1097\/ACO.0b013e32808255b4","article-title":"Sedation and analgesia in the critically ill adult","volume":"20","author":"Fraser","journal-title":"Curr Opin Anaesthesiol"},{"issue":"1","key":"R5","doi-asserted-by":"publisher","first-page":"S97","DOI":"10.1097\/00003246-200201002-00001","article-title":"Management of the agitated intensive care unit patient","volume":"30","author":"Cohen","journal-title":"Crit Care Med"},{"issue":"22","key":"R6","doi-asserted-by":"publisher","first-page":"2983","DOI":"10.1001\/jama.289.22.2983","article-title":"Monitoring sedation status over time in ICU patients: reliability and validity of the Richmond Agitation-Sedation Scale (RASS)","volume":"289","author":"Ely","journal-title":"JAMA"},{"issue":"1","key":"R7","doi-asserted-by":"publisher","first-page":"e12","DOI":"10.4037\/ajcc2012735","article-title":"Implications of objective vs subjective delirium assessment in surgical intensive care patients","volume":"21","author":"Guenther","journal-title":"Am J Crit Care"},{"issue":"10","key":"R8","doi-asserted-by":"publisher","first-page":"1338","DOI":"10.1164\/rccm.2107138","article-title":"The Richmond Agitation-Sedation Scale: validity and reliability in adult intensive care unit patients","volume":"166","author":"Sessler","journal-title":"Am J Respir Crit Care Med"},{"issue":"3","key":"R9","doi-asserted-by":"publisher","first-page":"e52","DOI":"10.1016\/j.hrtlng.2009.12.013","article-title":"Actigraphy: analyzing patient movement","volume":"40","author":"Grap","journal-title":"Heart Lung"},{"issue":"6","key":"R10","doi-asserted-by":"publisher","first-page":"1066","DOI":"10.1007\/s00134-004-2193-9","article-title":"Severe agitation among ventilated medical intensive care unit patients: frequency, characteristics and outcomes","volume":"30","author":"Woods","journal-title":"Intensive Care Med"},{"issue":"3","key":"R11","doi-asserted-by":"publisher","first-page":"239","DOI":"10.1016\/S2213-2600(21)00047-3","article-title":"COVID-19 Intensive Care International Study Group. Prevalence and risk factors for delirium in critically ill patients with COVID-19 (COVID-D): a multicentre cohort study","volume":"9","author":"Pun","journal-title":"Lancet Respir Med"},{"issue":"9","key":"R12","doi-asserted-by":"publisher","first-page":"1383","DOI":"10.1093\/jamia\/ocaa113","article-title":"Risk prediction of delirium in hospitalized patients using machine learning: an implementation and prospective evaluation study","volume":"27","author":"Jauk","journal-title":"J Am Med Inform Assoc"},{"issue":"4","key":"R13","doi-asserted-by":"publisher","DOI":"10.1001\/jamanetworkopen.2018.1018","article-title":"Development and validation of an electronic health record-based machine learning model to estimate delirium risk in newly hospitalized patients without known cognitive impairment","volume":"1","author":"Wong","journal-title":"JAMA Netw Open"},{"issue":"1","key":"R14","doi-asserted-by":"publisher","DOI":"10.3390\/informatics8010016","article-title":"Application of machine learning in intensive care unit (ICU) settings using MIMIC dataset: systematic review","volume":"8","author":"Syed","journal-title":"Informatics (MDPI)"},{"key":"R15","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijmedinf.2019.02.002","article-title":"Predicting in-hospital mortality of patients with acute kidney injury in the ICU using random forest model","volume":"125","author":"Lin","journal-title":"Int J Med Inform"},{"key":"R16","doi-asserted-by":"publisher","DOI":"10.3389\/fmed.2020.00445","article-title":"A machine learning-based prediction of hospital mortality in patients with postoperative sepsis","volume":"7","author":"Yao","journal-title":"Front Med"},{"key":"R17","doi-asserted-by":"publisher","DOI":"10.3389\/fmed.2021.676343","article-title":"Development and validation of a machine-learning model for prediction of extubation failure in intensive care units","volume":"8","author":"Zhao","journal-title":"Front Med (Lausanne)"},{"issue":"3","key":"R18","doi-asserted-by":"publisher","first-page":"e279","DOI":"10.1097\/CCM.0000000000004821","article-title":"Derivation and validation of an ensemble model for the prediction of agitation in mechanically ventilated patients maintained under light sedation","volume":"49","author":"Zhang","journal-title":"Crit Care Med"},{"issue":"2","key":"R19","doi-asserted-by":"publisher","first-page":"131","DOI":"10.1016\/j.cmpb.2004.03.005","article-title":"Quantifying agitation in sedated ICU patients using digital imaging","volume":"76","author":"Chase","journal-title":"Comput Methods Programs Biomed"},{"issue":"2","key":"R20","doi-asserted-by":"publisher","first-page":"138","DOI":"10.1016\/j.cmpb.2007.05.005","article-title":"Measuring facial grimacing for quantifying patient agitation in critical care","volume":"87","author":"Becouze","journal-title":"Comput Methods Programs Biomed"},{"issue":"1","key":"R21","doi-asserted-by":"publisher","DOI":"10.1186\/s12911-024-02479-2","article-title":"An automated ICU agitation monitoring system for video streaming using deep learning classification","volume":"24","author":"Dai","journal-title":"BMC Med Inform Decis Mak"},{"key":"R22","doi-asserted-by":"publisher","DOI":"10.1136\/bmj.l886","article-title":"Clinical applications of machine learning algorithms: beyond the black box","volume":"364","author":"Watson","journal-title":"BMJ"},{"issue":"6","key":"R23","doi-asserted-by":"publisher","first-page":"517","DOI":"10.1001\/jama.2017.7797","article-title":"Unintended consequences of machine learning in medicine","volume":"318","author":"Cabitza","journal-title":"JAMA"},{"key":"R24","doi-asserted-by":"publisher","DOI":"10.1016\/j.inffus.2021.07.016","article-title":"Unbox the black-box for the medical explainable AI via multi-modal and multi-centre data fusion: a mini-review, two showcases and beyond","volume":"77","author":"Yang","journal-title":"Inf Fusion"},{"issue":"1","key":"R25","doi-asserted-by":"publisher","first-page":"19","DOI":"10.11622\/smedj.2019055","article-title":"Singapore SPICE: sedation practices in intensive care evaluation in Singapore - a prospective cohort study of the public healthcare system","volume":"61","author":"Ng","journal-title":"Singapore Med J"},{"issue":"9","key":"R26","doi-asserted-by":"publisher","first-page":"1099","DOI":"10.1111\/aas.14119","article-title":"Sedative polypharmacy mediates the effect of mechanical ventilation on delirium in critically ill COVID-19 patients: a retrospective cohort study","volume":"66","author":"Bose","journal-title":"Acta Anaesthesiol Scand"}],"container-title":["JMIR Medical Informatics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/medinform.jmir.org\/2025\/1\/e63601","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,7,31]],"date-time":"2026-07-31T22:30:57Z","timestamp":1785537057000},"score":1,"resource":{"primary":{"URL":"https:\/\/medinform.jmir.org\/2025\/1\/e63601"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,2,26]]},"references-count":26,"URL":"https:\/\/doi.org\/10.2196\/63601","relation":{},"ISSN":["2291-9694"],"issn-type":[{"value":"2291-9694","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,2,26]]},"article-number":"v13i6e63601"}}