{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,7]],"date-time":"2026-05-07T15:27:28Z","timestamp":1778167648019,"version":"3.51.4"},"reference-count":54,"publisher":"MDPI AG","issue":"18","license":[{"start":{"date-parts":[[2022,9,17]],"date-time":"2022-09-17T00:00:00Z","timestamp":1663372800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Severance Hospital Research fund for Clinical excellence","award":["C-2019-0005"],"award-info":[{"award-number":["C-2019-0005"]}]},{"name":"Severance Hospital Research fund for Clinical excellence","award":["C-2022-0010"],"award-info":[{"award-number":["C-2022-0010"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Intermittent manual measurement of vital signs may not rapidly predict sepsis development in febrile patients admitted to the emergency department (ED). We aimed to evaluate the predictive performance of a wireless monitoring device that continuously measures heart rate (HR) and respiratory rate (RR) and a machine learning analysis in febrile but stable patients in the ED. We analysed 468 patients (age, \u226518 years; training set, n = 277; validation set, n = 93; test set, n = 98) having fever (temperature &gt;38 \u00b0C) and admitted to the isolation care unit of the ED. The AUROC of the fragmented model with device data was 0.858 (95% confidence interval [CI], 0.809\u20130.908), and that with manual data was 0.841 (95% CI, 0.789\u20130.893). The AUROC of the accumulated model with device data was 0.861 (95% CI, 0.811\u20130.910), and that with manual data was 0.853 (95% CI, 0.803\u20130.903). Fragmented and accumulated models with device data detected clinical deterioration in febrile patients at risk of septic shock 9 h and 5 h 30 min earlier, respectively, than those with manual data. Continuous vital sign monitoring using a wearable device could accurately predict clinical deterioration and reduce the time to recognise potential clinical deterioration in stable ED patients with fever.<\/jats:p>","DOI":"10.3390\/s22187054","type":"journal-article","created":{"date-parts":[[2022,9,19]],"date-time":"2022-09-19T04:49:22Z","timestamp":1663562962000},"page":"7054","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":30,"title":["Advantage of Vital Sign Monitoring Using a Wireless Wearable Device for Predicting Septic Shock in Febrile Patients in the Emergency Department: A Machine Learning-Based Analysis"],"prefix":"10.3390","volume":"22","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-0262-3370","authenticated-orcid":false,"given":"Arom","family":"Choi","sequence":"first","affiliation":[{"name":"Department of Emergency Medicine, Yonsei University College of Medicine, 50 Yonsei-ro, Seodaemun-gu, Seoul 03722, Korea"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1604-8730","authenticated-orcid":false,"given":"Kyungsoo","family":"Chung","sequence":"additional","affiliation":[{"name":"Division of Pulmonary and Critical Care Medicine, Department of Internal Medicine, Yonsei University College of Medicine, 50 Yonsei-ro, Seodaemun-gu, Seoul 03722, Korea"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3074-011X","authenticated-orcid":false,"given":"Sung Phil","family":"Chung","sequence":"additional","affiliation":[{"name":"Department of Emergency Medicine, Yonsei University College of Medicine, 50 Yonsei-ro, Seodaemun-gu, Seoul 03722, Korea"}]},{"given":"Kwanhyung","family":"Lee","sequence":"additional","affiliation":[{"name":"AITRICS, 28 Hyoryeong-ro 77-gil, Seocho-gu, Seoul 06627, Korea"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1249-7945","authenticated-orcid":false,"given":"Heejung","family":"Hyun","sequence":"additional","affiliation":[{"name":"AITRICS, 28 Hyoryeong-ro 77-gil, Seocho-gu, Seoul 06627, Korea"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0070-9568","authenticated-orcid":false,"given":"Ji Hoon","family":"Kim","sequence":"additional","affiliation":[{"name":"Department of Emergency Medicine, Yonsei University College of Medicine, 50 Yonsei-ro, Seodaemun-gu, Seoul 03722, Korea"}]}],"member":"1968","published-online":{"date-parts":[[2022,9,17]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"1136","DOI":"10.3349\/ymj.2021.62.12.1136","article-title":"Changes in Clinical Characteristics among Febrile Patients Visiting the Emergency Department before and after the COVID-19 Outbreak","volume":"62","author":"Lee","year":"2021","journal-title":"Yonsei Med. J."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"e1091","DOI":"10.1097\/CCM.0000000000004550","article-title":"An Explainable Artificial Intelligence Predictor for Early Detection of Sepsis","volume":"48","author":"Yang","year":"2020","journal-title":"Crit. Care Med."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"e285","DOI":"10.1097\/CCM.0000000000004236","article-title":"Detecting Patient Deterioration Using Artificial Intelligence in a Rapid Response System","volume":"48","author":"Cho","year":"2020","journal-title":"Crit. Care Med."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"547","DOI":"10.1097\/CCM.0000000000002936","article-title":"An Interpretable Machine Learning Model for Accurate Prediction of Sepsis in the ICU","volume":"46","author":"Nemati","year":"2018","journal-title":"Crit. Care Med."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"137","DOI":"10.1016\/j.resuscitation.2004.03.005","article-title":"Association between clinically abnormal observations and subsequent in-hospital mortality: A prospective study","volume":"62","author":"Buist","year":"2004","journal-title":"Resuscitation"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"402","DOI":"10.1097\/01.CCM.0000254826.10520.87","article-title":"Can physiological variables and early warning scoring systems allow early recognition of the deteriorating surgical patient?","volume":"35","author":"Cuthbertson","year":"2007","journal-title":"Crit. Care Med."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"e28","DOI":"10.2196\/medinform.5909","article-title":"Prediction of Sepsis in the Intensive Care Unit With Minimal Electronic Health Record Data: A Machine Learning Approach","volume":"4","author":"Desautels","year":"2016","journal-title":"JMIR Med. Inform."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"954","DOI":"10.1097\/CCM.0b013e3182772adb","article-title":"Dynamic data during hypotensive episode improves mortality predictions among patients with sepsis and hypotension","volume":"41","author":"Mayaud","year":"2013","journal-title":"Crit. Care Med."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"33","DOI":"10.52964\/AMJA.0229","article-title":"Assessment of clinical risk in the out of hours hospital prior to the introduction of Hospital at Night","volume":"8","author":"Beckett","year":"2009","journal-title":"Acute Med."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"325","DOI":"10.1016\/j.resuscitation.2008.01.009","article-title":"Incidence, staff awareness and mortality of patients at risk on general wards","volume":"77","author":"Fuhrmann","year":"2008","journal-title":"Resuscitation"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"31","DOI":"10.1016\/j.resuscitation.2009.09.026","article-title":"The impact of Rapid Response System on delayed emergency team activation patient characteristics and outcomes\u2014A follow-up study","volume":"81","author":"Calzavacca","year":"2010","journal-title":"Resuscitation"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"421","DOI":"10.1097\/ALN.0b013e318219d633","article-title":"A review of current and emerging approaches to address failure-to-rescue","volume":"115","author":"Taenzer","year":"2011","journal-title":"Anesthesiology"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"375","DOI":"10.1016\/j.resuscitation.2009.12.008","article-title":"\u201cIdentifying the hospitalised patient in crisis\u201d\u2014A consensus conference on the afferent limb of rapid response systems","volume":"81","author":"DeVita","year":"2010","journal-title":"Resuscitation"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"352","DOI":"10.1097\/NCQ.0b013e31825a8e2f","article-title":"Rapid response teams and failure to rescue: One community\u2019s experience","volume":"27","author":"Hammer","year":"2012","journal-title":"J. Nurs. Care Qual."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"47","DOI":"10.1016\/j.resuscitation.2019.01.017","article-title":"Wireless and continuous monitoring of vital signs in patients at the general ward","volume":"136","author":"Weenk","year":"2019","journal-title":"Resuscitation"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"e039177","DOI":"10.1136\/bmjopen-2020-039177","article-title":"Identifying the effects of an upgraded \u2018fever clinic\u2019 on COVID-19 control and the workload of emergency department: Retrospective study in a tertiary hospital in China","volume":"10","author":"Wang","year":"2020","journal-title":"BMJ Open"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Choi, A., Kim, H.Y., Cho, A., Noh, J., Park, I., and Chung, H.S. (2021). Efficacy of a four-tier infection response system in the emergency department during the coronavirus disease-2019 outbreak. PLoS ONE, 16.","DOI":"10.1371\/journal.pone.0256116"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"S97","DOI":"10.1016\/j.injury.2019.11.018","article-title":"Are current wireless monitoring systems capable of detecting adverse events in high-risk surgical patients? A descriptive study","volume":"51","author":"Breteler","year":"2020","journal-title":"Injury"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"e10802","DOI":"10.2196\/10802","article-title":"Continuous Versus Intermittent Vital Signs Monitoring Using a Wearable, Wireless Patch in Patients Admitted to Surgical Wards: Pilot Cluster Randomized Controlled Trial","volume":"20","author":"Downey","year":"2018","journal-title":"J. Med. Internet Res."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"217","DOI":"10.1177\/0141076820925436","article-title":"Clinical impact of multi-parameter continuous non-invasive monitoring in hospital wards: A systematic review and meta-analysis","volume":"113","author":"Sun","year":"2020","journal-title":"J. R. Soc. Med."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"194","DOI":"10.1186\/s13054-019-2485-7","article-title":"Automated continuous noninvasive ward monitoring: Future directions and challenges","volume":"23","author":"Khanna","year":"2019","journal-title":"Crit. Care"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"424","DOI":"10.1097\/ALN.0000000000003029","article-title":"Vital Signs Monitoring with Wearable Sensors in High-risk Surgical Patients: A Clinical Validation Study","volume":"132","author":"Breteler","year":"2020","journal-title":"Anesthesiology"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Youssef Ali Amer, A., Wouters, F., Vranken, J., de Korte-de Boer, D., Smit-Fun, V., Duflot, P., Beaupain, M.H., Vandervoort, P., Luca, S., and Aerts, J.M. (2020). Vital Signs Prediction and Early Warning Score Calculation Based on Continuous Monitoring of Hospitalised Patients Using Wearable Technology. Sensors, 20.","DOI":"10.3390\/s20226593"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"e18636","DOI":"10.2196\/18636","article-title":"Current Evidence for Continuous Vital Signs Monitoring by Wearable Wireless Devices in Hospitalized Adults: Systematic Review","volume":"22","author":"Leenen","year":"2020","journal-title":"J. Med. Internet Res."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"e15471","DOI":"10.2196\/15471","article-title":"Continuous Monitoring of Vital Signs in the General Ward Using Wearable Devices: Randomized Controlled Trial","volume":"22","author":"Weenk","year":"2020","journal-title":"J. Med. Internet Res."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"255","DOI":"10.1126\/science.aaa8415","article-title":"Machine learning: Trends, perspectives, and prospects","volume":"349","author":"Jordan","year":"2015","journal-title":"Science"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"e25187","DOI":"10.2196\/25187","article-title":"Machine Learning-Based Early Warning Systems for Clinical Deterioration: Systematic Scoping Review","volume":"23","author":"Muralitharan","year":"2021","journal-title":"J. Med. Internet Res."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"88","DOI":"10.1007\/s10916-021-01762-3","article-title":"Machine Learning in Medical Emergencies: A Systematic Review and Analysis","volume":"45","author":"Mendo","year":"2021","journal-title":"J. Med. Syst."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Brekke, I.J., Puntervoll, L.H., Pedersen, P.B., Kellett, J., and Brabrand, M. (2019). The value of vital sign trends in predicting and monitoring clinical deterioration: A systematic review. PLoS ONE, 14.","DOI":"10.1371\/journal.pone.0210875"},{"key":"ref_30","first-page":"34","article-title":"Applications of Machine Learning Approaches in Emergency Medicine; a Review Article","volume":"7","author":"Shafaf","year":"2019","journal-title":"Arch. Acad. Emerg. Med."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"870","DOI":"10.1111\/1742-6723.13145","article-title":"Artificial intelligence and machine learning in emergency medicine","volume":"30","author":"Stewart","year":"2018","journal-title":"Emerg. Med. Australas."},{"key":"ref_32","unstructured":"U.S. Food and Drug Administration Center for Devices and Radiological Health (2020, February 19). Content of Premarket Submissions for Management of Cybersecurity in Medical Devices, Available online: https:\/\/www.fda.gov\/regulatory-information\/search-fda-guidance-documents\/content-premarket-submissions-management-cybersecurity-medical-devices."},{"key":"ref_33","unstructured":"International Medical Device Regulators Forum (2020). Principles and Practices for Medical Device Cybersecurity, International Medical Device Regulators Forum. Available online: https:\/\/www.imdrf.org\/sites\/default\/files\/docs\/imdrf\/final\/technical\/imdrf-tech-200318-pp-mdc-n60.pdf."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"73","DOI":"10.1016\/j.compbiomed.2015.01.015","article-title":"New real-time heartbeat detection method using the angle of a single-lead electrocardiogram","volume":"59","author":"Song","year":"2015","journal-title":"Comput. Biol. Med."},{"key":"ref_35","unstructured":"(2008, October 01). An Introductory Resource Guide for Implementing the HIPAA Security Rule, Available online: https:\/\/csrc.nist.gov\/publications\/detail\/sp\/800-66\/rev-1\/final."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"094001","DOI":"10.1088\/1361-6579\/aad7e6","article-title":"Optimized breath detection algorithm in electrical impedance tomography","volume":"39","author":"Khodadad","year":"2018","journal-title":"Physiol. Meas."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"611","DOI":"10.1007\/s13244-018-0639-9","article-title":"Convolutional neural networks: An overview and application in radiology","volume":"9","author":"Yamashita","year":"2018","journal-title":"Insights Imaging"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Muraki, R., Teramoto, A., Sugimoto, K., Sugimoto, K., Yamada, A., and Watanabe, E. (2022). Automated detection scheme for acute myocardial infarction using convolutional neural network and long short-term memory. PLoS ONE, 17.","DOI":"10.1371\/journal.pone.0264002"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"801","DOI":"10.1001\/jama.2016.0287","article-title":"The Third International Consensus Definitions for Sepsis and Septic Shock (Sepsis-3)","volume":"315","author":"Singer","year":"2016","journal-title":"JAMA"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"5561","DOI":"10.3390\/s110605561","article-title":"Wearable and implantable wireless sensor network solutions for healthcare monitoring","volume":"11","author":"Darwish","year":"2011","journal-title":"Sensors"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Majumder, S., Mondal, T., and Deen, M.J. (2017). Wearable Sensors for Remote Health Monitoring. Sensors, 17.","DOI":"10.3390\/s17010130"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"31","DOI":"10.1093\/bja\/aex140","article-title":"Digital innovations and emerging technologies for enhanced recovery programmes","volume":"119","author":"Michard","year":"2017","journal-title":"Br. J. Anaesth."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"149","DOI":"10.3389\/fphys.2015.00149","article-title":"Electrocardiographic patch devices and contemporary wireless cardiac monitoring","volume":"6","author":"Fung","year":"2015","journal-title":"Front. Physiol."},{"key":"ref_44","first-page":"175","article-title":"Wireless Monitoring Through Wearable Devices in the ICU: Are We Close?","volume":"272","author":"Diomidous","year":"2020","journal-title":"Stud. Health Technol. Inform."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"106","DOI":"10.1016\/j.ijnurstu.2017.09.003","article-title":"Strengths and limitations of early warning scores: A systematic review and narrative synthesis","volume":"76","author":"Downey","year":"2017","journal-title":"Int. J. Nurs. Stud."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"722","DOI":"10.1109\/JBHI.2013.2293059","article-title":"Predictive monitoring of mobile patients by combining clinical observations with data from wearable sensors","volume":"18","author":"Clifton","year":"2014","journal-title":"IEEE J. Biomed. Health Inform."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"28","DOI":"10.1186\/2049-3258-72-28","article-title":"Smart wearable body sensors for patient self-assessment and monitoring","volume":"72","author":"Appelboom","year":"2014","journal-title":"Arch. Public Health"},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"39","DOI":"10.1016\/j.apnr.2018.09.002","article-title":"What are the patterns of compliance with Early Warning Track and Trigger Tools: A narrative review","volume":"44","author":"Credland","year":"2018","journal-title":"Appl. Nurs. Res."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"51","DOI":"10.3109\/03091900903336902","article-title":"Wireless technology in the evolution of patient monitoring on general hospital wards","volume":"34","author":"Sahandi","year":"2010","journal-title":"J. Med. Eng. Technol."},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"163","DOI":"10.1016\/j.jcrc.2019.09.024","article-title":"Machine learning for prediction of septic shock at initial triage in emergency department","volume":"55","author":"Kim","year":"2020","journal-title":"J. Crit. Care"},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"e15932","DOI":"10.2196\/15932","article-title":"Prediction of Cardiac Arrest in the Emergency Department Based on Machine Learning and Sequential Characteristics: Model Development and Retrospective Clinical Validation Study","volume":"8","author":"Hong","year":"2020","journal-title":"JMIR Med. Inform."},{"key":"ref_52","doi-asserted-by":"crossref","unstructured":"Kim, J.H., Han, S.G., Cho, A., Shin, H.J., and Baek, S.E. (2021). Effect of deep learning-based assistive technology use on chest radiograph interpretation by emergency department physicians: A prospective interventional simulation-based study. BMC Med. Inform. Decis. Mak., 21.","DOI":"10.1186\/s12911-021-01679-4"},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"1360","DOI":"10.1111\/jocn.14238","article-title":"Clinical deterioration: A concept analysis","volume":"27","author":"Padilla","year":"2018","journal-title":"J. Clin. Nurs."},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"564","DOI":"10.1016\/j.resuscitation.2012.09.024","article-title":"Predicting clinical deterioration in the hospital: The impact of outcome selection","volume":"84","author":"Churpek","year":"2013","journal-title":"Resuscitation"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/18\/7054\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T00:33:40Z","timestamp":1760142820000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/18\/7054"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,9,17]]},"references-count":54,"journal-issue":{"issue":"18","published-online":{"date-parts":[[2022,9]]}},"alternative-id":["s22187054"],"URL":"https:\/\/doi.org\/10.3390\/s22187054","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,9,17]]}}}