{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,24]],"date-time":"2026-01-24T15:18:24Z","timestamp":1769267904278,"version":"3.49.0"},"reference-count":24,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2024,3,18]],"date-time":"2024-03-18T00:00:00Z","timestamp":1710720000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,3,18]],"date-time":"2024-03-18T00:00:00Z","timestamp":1710720000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/100020595","name":"National Science and Technology Council","doi-asserted-by":"publisher","award":["NSTC 111-2634-F-A49-014-1"],"award-info":[{"award-number":["NSTC 111-2634-F-A49-014-1"]}],"id":[{"id":"10.13039\/100020595","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Med Inform Decis Mak"],"abstract":"<jats:title>Abstract<\/jats:title><jats:sec>\n                <jats:title>Objective<\/jats:title>\n                <jats:p>To address the challenge of assessing sedation status in critically ill patients in the intensive care unit (ICU), we aimed to develop a non-contact automatic classifier of agitation using artificial intelligence and deep learning.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Methods<\/jats:title>\n                <jats:p>We collected the video recordings of ICU patients and cut them into 30-second (30-s) and 2-second (2-s) segments. All of the segments were annotated with the status of agitation as \u201cAttention\u201d and \u201cNon-attention\u201d. After transforming the video segments into movement quantification, we constructed the models of agitation classifiers with Threshold, Random Forest, and LSTM and evaluated their performances.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Results<\/jats:title>\n                <jats:p>The video recording segmentation yielded 427 30-s and 6405 2-s segments from 61 patients for model construction. The LSTM model achieved remarkable accuracy (ACC 0.92, AUC 0.91), outperforming other methods.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Conclusion<\/jats:title>\n                <jats:p>Our study proposes an advanced monitoring system combining LSTM and image processing to ensure mild patient sedation in ICU care. LSTM proves to be the optimal choice for accurate monitoring. Future efforts should prioritize expanding data collection and enhancing system integration for practical application.<\/jats:p>\n              <\/jats:sec>","DOI":"10.1186\/s12911-024-02479-2","type":"journal-article","created":{"date-parts":[[2024,3,18]],"date-time":"2024-03-18T11:02:04Z","timestamp":1710759724000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":4,"title":["An automated ICU agitation monitoring system for video streaming using deep learning classification"],"prefix":"10.1186","volume":"24","author":[{"ORCID":"https:\/\/orcid.org\/0009-0003-3528-5691","authenticated-orcid":false,"given":"Pei-Yu","family":"Dai","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yu-Cheng","family":"Wu","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3014-8095","authenticated-orcid":false,"given":"Ruey-Kai","family":"Sheu","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5322-7426","authenticated-orcid":false,"given":"Chieh-Liang","family":"Wu","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0006-1637-6899","authenticated-orcid":false,"given":"Shu-Fang","family":"Liu","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0002-0117-4240","authenticated-orcid":false,"given":"Pei-Yi","family":"Lin","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Wei-Lin","family":"Cheng","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Guan-Yin","family":"Lin","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Huang-Chien","family":"Chung","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8449-7872","authenticated-orcid":false,"given":"Lun-Chi","family":"Chen","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2024,3,18]]},"reference":[{"issue":"2","key":"2479_CR1","doi-asserted-by":"publisher","first-page":"92","DOI":"10.1007\/s40140-021-00446-5","volume":"11","author":"V Page","year":"2021","unstructured":"Page V, McKenzie C. Sedation in the Intensive Care Unit. Curr Anesthesiology Rep. 2021;11(2):92\u2013100.","journal-title":"Curr Anesthesiology Rep"},{"issue":"6","key":"2479_CR2","doi-asserted-by":"publisher","first-page":"R204","DOI":"10.1186\/cc8212","volume":"13","author":"DL Jackson","year":"2009","unstructured":"Jackson DL, et al. The incidence of sub-optimal sedation in the ICU: a systematic review. Crit Care. 2009;13(6):R204.","journal-title":"Crit Care"},{"issue":"9","key":"2479_CR3","doi-asserted-by":"publisher","first-page":"e825","DOI":"10.1097\/CCM.0000000000003299","volume":"46","author":"JW Devlin","year":"2018","unstructured":"Devlin JW, et al. Clinical practice guidelines for the Prevention and Management of Pain, Agitation\/Sedation, Delirium, Immobility, and sleep disruption in adult patients in the ICU. Crit Care Med. 2018;46(9):e825\u201373.","journal-title":"Crit Care Med"},{"issue":"10","key":"2479_CR4","doi-asserted-by":"publisher","first-page":"1338","DOI":"10.1164\/rccm.2107138","volume":"166","author":"CN Sessler","year":"2002","unstructured":"Sessler CN, et al. The Richmond agitation\u2013sedation scale. Am J Respir Crit Care Med. 2002;166(10):1338\u201344.","journal-title":"Am J Respir Crit Care Med"},{"issue":"22","key":"2479_CR5","doi-asserted-by":"publisher","first-page":"2983","DOI":"10.1001\/jama.289.22.2983","volume":"289","author":"EW Ely","year":"2003","unstructured":"Ely EW, et al. Monitoring sedation Status Over Time in ICU patients. JAMA. 2003;289(22):2983.","journal-title":"JAMA"},{"issue":"7","key":"2479_CR6","doi-asserted-by":"publisher","first-page":"1325","DOI":"10.1097\/00003246-199907000-00022","volume":"27","author":"RR Riker","year":"1999","unstructured":"Riker RR, Picard JT, Fraser GL. Prospective evaluation of the sedation-agitation scale for adult critically ill patients. Crit Care Med. 1999;27(7):1325\u20139.","journal-title":"Crit Care Med"},{"issue":"2","key":"2479_CR7","doi-asserted-by":"publisher","first-page":"193","DOI":"10.1016\/j.jpha.2021.12.006","volume":"12","author":"U Saeed","year":"2022","unstructured":"Saeed U, et al. Machine learning empowered COVID-19 patient monitoring using non-contact sensing: an extensive review. J Pharm Anal. 2022;12(2):193\u2013204.","journal-title":"J Pharm Anal"},{"issue":"21","key":"2479_CR8","doi-asserted-by":"publisher","first-page":"6307","DOI":"10.3390\/s20216307","volume":"20","author":"P Jakkaew","year":"2020","unstructured":"Jakkaew P, Onoye T. Non-contact respiration monitoring and body movements detection for Sleep using Thermal Imaging. Sens (Basel). 2020;20(21):6307. https:\/\/doi.org\/10.3390\/s20216307. PMID: 33167556; PMCID: PMC7663997.","journal-title":"Sens (Basel)"},{"issue":"1","key":"2479_CR9","doi-asserted-by":"publisher","first-page":"e0190466","DOI":"10.1371\/journal.pone.0190466","volume":"13","author":"M Hu","year":"2018","unstructured":"Hu M, et al. Combination of near-infrared and thermal imaging techniques for the remote and simultaneous measurements of breathing and heart rates under sleep situation. PLoS ONE. 2018;13(1):e0190466.","journal-title":"PLoS ONE"},{"issue":"4","key":"2479_CR10","doi-asserted-by":"publisher","first-page":"e0154335","DOI":"10.1371\/journal.pone.0154335","volume":"11","author":"VAJ Block","year":"2016","unstructured":"Block VAJ, et al. Remote physical activity monitoring in neurological disease: a systematic review. PLoS ONE. 2016;11(4):e0154335.","journal-title":"PLoS ONE"},{"key":"2479_CR11","doi-asserted-by":"publisher","first-page":"98","DOI":"10.3389\/fpsyg.2018.00098","volume":"9","author":"J Wei","year":"2018","unstructured":"Wei J, et al. Transdermal Optical Imaging reveal basal stress via heart rate variability analysis: a novel methodology comparable to Electrocardiography. Front Psychol. 2018;9:98.","journal-title":"Front Psychol"},{"key":"2479_CR12","doi-asserted-by":"crossref","unstructured":"Fang CY, Hsieh HH, Chen SW. A Vision-Based Infant Respiratory Frequency Detection System. in 2015 International Conference on Digital Image Computing: Techniques and Applications (DICTA). 2015.","DOI":"10.1109\/DICTA.2015.7371224"},{"key":"2479_CR13","doi-asserted-by":"publisher","first-page":"103672","DOI":"10.1016\/j.scs.2022.103672","volume":"79","author":"I Ahmed","year":"2022","unstructured":"Ahmed I, et al. Internet of health things driven deep learning-based system for non-invasive patient discomfort detection using time frame rules and pairwise keypoints distance feature. Sustainable Cities Soc. 2022;79:103672.","journal-title":"Sustainable Cities Soc"},{"key":"2479_CR14","doi-asserted-by":"publisher","first-page":"7992","DOI":"10.3390\/s22207992","volume":"22","author":"G G\u00fcney","year":"2022","unstructured":"G\u00fcney G, Jansen TS, Dill S, Schulz JB, Dafotakis M, Hoog Antink C, Braczynski AK. Video-Based Hand Movement Analysis of Parkinson Patients before and after medication using high-frame-rate videos and MediaPipe. Sensors. 2022;22:7992. https:\/\/doi.org\/10.3390\/s22207992.","journal-title":"Sensors"},{"key":"2479_CR15","doi-asserted-by":"publisher","unstructured":"Hustinawaty T, Rumambi, Hermita M, Motion Detection Application to Measure Straight Leg Raise ROM Using MediaPipe Pose,. 2022 4th International Conference on Cybernetics and Intelligent System (ICORIS), Prapat, Indonesia, 2022, pp. 1\u20135, https:\/\/doi.org\/10.1109\/ICORIS56080.2022.10031299.","DOI":"10.1109\/ICORIS56080.2022.10031299"},{"key":"2479_CR16","unstructured":"OpenCV. Background Subtraction. https:\/\/docs.opencv.org\/3.4\/de\/df4\/tutorial_js_bg_subtraction.html(2023). Accessed 21 Feb 2023."},{"key":"2479_CR17","doi-asserted-by":"crossref","unstructured":"Shrivastava D, et al. Bone cancer detection using machine learning techniques. Smart Healthcare for Disease diagnosis and Prevention. Academic; 2020. pp. 175\u201383.","DOI":"10.1016\/B978-0-12-817913-0.00017-1"},{"key":"2479_CR18","doi-asserted-by":"publisher","unstructured":"Sessler CN, Gosnell MS, Grap MJ, Brophy GM, O\u2019Neal PV, Keane KA, Tesoro EP, Elswick RK. The Richmond Agitation-Sedation Scale: validity and reliability in adult intensive care unit patients. Am J Respir Crit Care Med. 2002;166(10):1338-44. https:\/\/doi.org\/10.1164\/rccm.2107138. PMID: 12421743.","DOI":"10.1164\/rccm.2107138"},{"key":"2479_CR19","doi-asserted-by":"publisher","unstructured":"Grap MJ, Hamilton VA, Ann McNallen JM, Ketchum AM, Best, Nyimas Y, Isti Arief PA. Wetzel, Actigraphy: Analyzing patient movement, Heart &Lung, Volume40, Issue3, 2011, Pagese52e59, ISSN 01479563 https:\/\/doi.org\/10.1016\/j.hrtlng.2009.12.013.","DOI":"10.1016\/j.hrtlng.2009.12.013"},{"key":"2479_CR20","doi-asserted-by":"crossref","unstructured":"Chase J, Geoffrey et al. Quantifying agitation in sedated ICU patients using digital imaging. Computer methods and programs in biomedicine 76.2 (2004): 131\u201341.","DOI":"10.1016\/j.cmpb.2004.03.005"},{"issue":"2","key":"2479_CR21","doi-asserted-by":"publisher","first-page":"138","DOI":"10.1016\/j.cmpb.2007.05.005","volume":"87","author":"P Becouze","year":"2007","unstructured":"Becouze P, Pierrick, et al. Measuring facial grimacing for quantifying patient agitation in critical care. Comput Methods Programs Biomed. 2007;87(2):138\u201347.","journal-title":"Comput Methods Programs Biomed"},{"key":"2479_CR22","unstructured":"Martinez M, Stiefelhagen R. Automated multi-camera system for long term behavioral monitor ing in intensive care units, in MVA, pp. 97\u2013100, 2013."},{"key":"2479_CR23","doi-asserted-by":"publisher","first-page":"8827","DOI":"10.1038\/s41598-021-88226-3","volume":"11","author":"D Shung","year":"2021","unstructured":"Shung D, Huang J, Castro E, et al. Neural network predicts need for red blood cell transfusion for patients with acute gastrointestinal bleeding admitted to the intensive care unit. Sci Rep. 2021;11:8827. https:\/\/doi.org\/10.1038\/s41598-021-88226-3.","journal-title":"Sci Rep"},{"key":"2479_CR24","unstructured":"Lipton Z, Chase DC, Kale. Charles Peter Elkan and Randall C. Wetzel. Learning to Diagnose with LSTM Recurrent Neural Networks. CoRR abs\/1511.03677 (2015): n. pag."}],"container-title":["BMC Medical Informatics and Decision Making"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12911-024-02479-2.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s12911-024-02479-2\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12911-024-02479-2.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,3,18]],"date-time":"2024-03-18T11:04:27Z","timestamp":1710759867000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmcmedinformdecismak.biomedcentral.com\/articles\/10.1186\/s12911-024-02479-2"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,3,18]]},"references-count":24,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2024,12]]}},"alternative-id":["2479"],"URL":"https:\/\/doi.org\/10.1186\/s12911-024-02479-2","relation":{},"ISSN":["1472-6947"],"issn-type":[{"value":"1472-6947","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,3,18]]},"assertion":[{"value":"19 December 2023","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"11 March 2024","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"18 March 2024","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The study was approved by the Institutional Review Board (IRB) of Taichung Veterans General Hospital (IRB No. CG21307B). The video recordings of consented individuals for human trials, include patients admitted to the adult intensive care unit at Taichung Veterans General Hospital from December 1, 2022, to December 31, 2023. All procedures were conducted in accordance with the Declaration of Helsinki of 1964 and its further modifications. Participants were informed of the study\u2019s purpose, the data\u2019s confidentiality, and the voluntary nature of their participation. All participants gave informed consent forms.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval"}},{"value":"Not applicable.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"The authors declare that they have no competing interests.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"77"}}