{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,17]],"date-time":"2026-02-17T04:05:12Z","timestamp":1771301112140,"version":"3.50.1"},"reference-count":42,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2020,11,13]],"date-time":"2020-11-13T00:00:00Z","timestamp":1605225600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2020,11,13]],"date-time":"2020-11-13T00:00:00Z","timestamp":1605225600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["npj Digit. Med."],"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Impaired sleep for hospital patients is an all too common reality. Sleep disruptions due to unnecessary overnight vital sign monitoring are associated with delirium, cognitive impairment, weakened immunity, hypertension, increased stress, and mortality. It is also one of the most common complaints of hospital patients while imposing additional burdens on healthcare providers. Previous efforts to forgo overnight vital sign measurements and improve patient sleep used providers\u2019 subjective stability assessment or utilized an expanded, thus harder to retrieve, set of vitals and laboratory results to predict overnight clinical risk. Here, we present a model that incorporates past values of a small set of vital signs and predicts overnight stability for any given patient-night. Using data obtained from a multi-hospital health system between 2012 and 2019, a recurrent deep neural network was trained and evaluated using ~2.3 million admissions and 26 million vital sign assessments. The algorithm is agnostic to patient location, condition, and demographics, and relies only on sequences of five vital sign measurements, a calculated Modified Early Warning Score, and patient age. We achieved an area under the receiver operating characteristic curve of 0.966 (95% confidence interval [CI] 0.956\u20130.967) on the retrospective testing set, and 0.971 (95% CI 0.965\u20130.974) on the prospective set to predict overnight patient stability. The model enables safe avoidance of overnight monitoring for ~50% of patient-nights, while only misclassifying 2 out of 10,000 patient-nights as stable. Our approach is straightforward to deploy, only requires regularly obtained vital signs, and delivers easily actionable clinical predictions for a peaceful sleep in hospitals.<\/jats:p>","DOI":"10.1038\/s41746-020-00355-7","type":"journal-article","created":{"date-parts":[[2020,11,13]],"date-time":"2020-11-13T11:02:55Z","timestamp":1605265375000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":21,"title":["Let Sleeping Patients Lie, avoiding unnecessary overnight vitals monitoring using a clinically based deep-learning model"],"prefix":"10.1038","volume":"3","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-3730-1400","authenticated-orcid":false,"given":"Viktor","family":"T\u00f3th","sequence":"first","affiliation":[]},{"given":"Marsha","family":"Meytlis","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2135-0224","authenticated-orcid":false,"given":"Douglas P.","family":"Barnaby","sequence":"additional","affiliation":[]},{"given":"Kevin R.","family":"Bock","sequence":"additional","affiliation":[]},{"given":"Michael I.","family":"Oppenheim","sequence":"additional","affiliation":[]},{"given":"Yousef","family":"Al-Abed","sequence":"additional","affiliation":[]},{"given":"Thomas","family":"McGinn","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9162-477X","authenticated-orcid":false,"given":"Karina W.","family":"Davidson","sequence":"additional","affiliation":[]},{"given":"Lance B.","family":"Becker","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9571-1275","authenticated-orcid":false,"given":"Jamie S.","family":"Hirsch","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9204-9551","authenticated-orcid":false,"given":"Theodoros P.","family":"Zanos","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2020,11,13]]},"reference":[{"key":"355_CR1","first-page":"146","volume":"169","author":"HH Meissner","year":"1998","unstructured":"Meissner, H. H. et al. Failure of physician documentation of sleep complaints in hospitalized patients. West. J. Med. 169, 146\u2013149 (1998).","journal-title":"West. J. Med."},{"key":"355_CR2","doi-asserted-by":"publisher","first-page":"309","DOI":"10.1080\/20009666.2017.1374108","volume":"7","author":"A Ho","year":"2017","unstructured":"Ho, A., Raja, B., Waldhorn, R., Baez, V. & Mohammed, I. New onset of insomnia in hospitalized patients in general medical wards: incidence, causes, and resolution rate. J. Community Hosp. Intern. Med. Perspect. 7, 309\u2013313 (2017).","journal-title":"J. Community Hosp. Intern. Med. Perspect."},{"key":"355_CR3","doi-asserted-by":"publisher","first-page":"473","DOI":"10.1002\/jhm.372","volume":"3","author":"KA Hardin","year":"2008","unstructured":"Hardin, K. A., Bourgeois, J. A., Young, J. S., Young, J. S. & Hilty, D. M. Sleep in hospitalized medical patients, Part 1: factors affecting sleep. J. Hosp. Med. 3, 473\u2013482 (2008).","journal-title":"J. Hosp. Med."},{"key":"355_CR4","doi-asserted-by":"publisher","first-page":"911","DOI":"10.1016\/S0140-6736(13)60688-1","volume":"383","author":"SK Inouye","year":"2014","unstructured":"Inouye, S. K., Westendorp, R. G. & Saczynski, J. S. Delirium in elderly people. Lancet 383, 911\u2013922 (2014).","journal-title":"Lancet"},{"key":"355_CR5","doi-asserted-by":"publisher","first-page":"17","DOI":"10.1186\/1477-7525-2-17","volume":"2","author":"L Frighetto","year":"2004","unstructured":"Frighetto, L. et al. An assessment of quality of sleep and the use of drugs with sedating properties in hospitalized adult patients. Health Qual. Life Outcomes 2, 17 (2004).","journal-title":"Health Qual. Life Outcomes"},{"key":"355_CR6","doi-asserted-by":"publisher","first-page":"102","DOI":"10.4037\/ajcc2004.13.2.102","volume":"13","author":"LM Tamburri","year":"2004","unstructured":"Tamburri, L. M., DiBrienza, R., Zozula, R. & Redeker, N. S. Nocturnal care interactions with patients in critical care units. Am. J. Crit. Care 13, 102\u2013113 (2004).","journal-title":"Am. J. Crit. Care"},{"key":"355_CR7","doi-asserted-by":"crossref","unstructured":"Dobing, S., Frolova, N., McAlister, F. & Ringrose, J. Sleep quality and factors influencing self-reported sleep duration and quality in the general internal medicine inpatient population. PLoS ONE 11, e0156735 (2016).","DOI":"10.1371\/journal.pone.0156735"},{"key":"355_CR8","doi-asserted-by":"publisher","first-page":"1554","DOI":"10.1001\/jamainternmed.2013.7791","volume":"173","author":"JC Yoder","year":"2013","unstructured":"Yoder, J. C., Yuen, T. C., Churpek, M. M., Arora, V. M. & Edelson, D. P. A prospective study of nighttime vital sign monitoring frequency and risk of clinical deterioration. JAMA Intern. Med. 173, 1554\u20131555 (2013).","journal-title":"JAMA Intern. Med."},{"key":"355_CR9","unstructured":"Dang, D. & Dearholt, S. L. Johns Hopkins Nursing Evidence-Based Practice, Third Edition: Model and Guidelines (Sigma Theta Tau, 2017)."},{"key":"355_CR10","doi-asserted-by":"crossref","unstructured":"Mokhlesi, B., Arora, V. M. & Arora, V. M. Effectiveness of SIESTA on objective and subjective metrics of nighttime hospital sleep disruptors. J. Hosp. Med. 14 38-41 (2019).","DOI":"10.12788\/jhm.3091"},{"key":"355_CR11","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0210875","volume":"14","author":"IJ Brekke","year":"2019","unstructured":"Brekke, I. J., Puntervoll, L. H., Pedersen, P. B., Kellett, J. & Brabrand, M. The value of vital sign trends in predicting and monitoring clinical deterioration: a systematic review. PLoS ONE 14, e0210875 (2019).","journal-title":"PLoS ONE"},{"key":"355_CR12","doi-asserted-by":"publisher","first-page":"2283","DOI":"10.1097\/CCM.0000000000002105","volume":"44","author":"MM Churpek","year":"2016","unstructured":"Churpek, M. M. & Edelson, D. P. Moving beyond single-parameter early warning scores for rapid response system activation*. Crit. Care Med. 44, 2283\u20132285 (2016).","journal-title":"Crit. Care Med."},{"key":"355_CR13","doi-asserted-by":"publisher","first-page":"521","DOI":"10.1093\/qjmed\/94.10.521","volume":"94","author":"CP Subbe","year":"2001","unstructured":"Subbe, C. P., Kruger, M., Rutherford, P. & Gemmel, L. Validation of a modified early warning score in medical admissions. QJM Int. J. Med. 94, 521\u2013526 (2001).","journal-title":"QJM Int. J. Med."},{"key":"355_CR14","doi-asserted-by":"publisher","first-page":"10","DOI":"10.1016\/j.jbi.2016.09.013","volume":"64","author":"P Kipnis","year":"2016","unstructured":"Kipnis, P. et al. Development and validation of an electronic medical record-based alert score for detection of inpatient deterioration outside the ICU. J. Biomed. Inform. 64, 10\u201319 (2016).","journal-title":"J. Biomed. Inform."},{"key":"355_CR15","unstructured":"Edelson, D. (eds) et al. Acuity-based nighttime vital sign assessments: a randomized controlled trial. SHM Abstracts (SHM, 2019)."},{"key":"355_CR16","doi-asserted-by":"crossref","unstructured":"Grossman Mila, N. et al. Awakenings? Patient and hospital staff perceptions of nighttime disruptions and their effect on patient sleep. J. Clin. Sleep Med. 13, 301\u2013306 (2017).","DOI":"10.5664\/jcsm.6468"},{"key":"355_CR17","doi-asserted-by":"publisher","first-page":"1201","DOI":"10.1001\/jamainternmed.2018.2669","volume":"178","author":"HM Wesselius","year":"2018","unstructured":"Wesselius, H. M. et al. Quality and quantity of sleep and factors associated with sleep disturbance in hospitalized patients. JAMA Intern. Med. 178, 1201\u20131208 (2018).","journal-title":"JAMA Intern. Med."},{"key":"355_CR18","doi-asserted-by":"crossref","unstructured":"Delaney, L. J., Currie, M. J., Huang, H.-C. C., Lopez, V. & Van Haren, F. \u201cThey can rest at home\u201d: an observational study of patients\u2019 quality of sleep in an Australian hospital. BMC Health Serv. Res. 18, 524 (2018).","DOI":"10.1186\/s12913-018-3201-z"},{"key":"355_CR19","doi-asserted-by":"publisher","first-page":"127","DOI":"10.1016\/j.jsmc.2017.09.012","volume":"13","author":"VM Arora","year":"2018","unstructured":"Arora, V. M. & Stewart, N. Sleep in hospitalized older adults. Sleep Med. Clin. 13, 127\u2013135 (2018).","journal-title":"Sleep Med. Clin."},{"key":"355_CR20","doi-asserted-by":"publisher","first-page":"82","DOI":"10.1016\/j.smrv.2017.08.001","volume":"39","author":"EF Afolalu","year":"2018","unstructured":"Afolalu, E. F., Ramlee, F. & Tang, N. K. Y. Effects of sleep changes on pain-related health outcomes in the general population: a systematic review of longitudinal studies with exploratory meta-analysis. Sleep Med. Rev. 39, 82\u201397 (2018).","journal-title":"Sleep Med. Rev."},{"key":"355_CR21","doi-asserted-by":"publisher","first-page":"833","DOI":"10.1161\/01.HYP.0000217362.34748.e0","volume":"47","author":"E Gangwisch James","year":"2006","unstructured":"Gangwisch James, E. et al. Short sleep duration as a risk factor for hypertension. Hypertension 47, 833\u2013839 (2006).","journal-title":"Hypertension"},{"key":"355_CR22","doi-asserted-by":"publisher","first-page":"521","DOI":"10.1046\/j.1365-2796.2001.00913.x","volume":"250","author":"PM Nilsson","year":"2001","unstructured":"Nilsson, P. M., Nilsson, J. A., Hedblad, B. & Berglund, G. Sleep disturbance in association with elevated pulse rate for prediction of mortality\u2013consequences of mental strain? J. Intern. Med. 250, 521\u2013529 (2001).","journal-title":"J. Intern. Med."},{"key":"355_CR23","first-page":"348","volume":"2018","author":"S Collins","year":"2018","unstructured":"Collins, S. et al. Quantifying and visualizing nursing flowsheet documentation burden in acute and critical care. AMIA Annu. Symp. Proc. 2018, 348\u2013357 (2018).","journal-title":"AMIA Annu. Symp. Proc."},{"key":"355_CR24","doi-asserted-by":"publisher","first-page":"717","DOI":"10.1093\/jamia\/ocw186","volume":"24","author":"D Wong","year":"2017","unstructured":"Wong, D. et al. A ward-based time study of paper and electronic documentation for recording vital sign observations. J. Am. Med. Inform. Assoc. 24, 717\u2013721 (2017).","journal-title":"J. Am. Med. Inform. Assoc."},{"key":"355_CR25","doi-asserted-by":"publisher","first-page":"75","DOI":"10.1016\/j.resuscitation.2018.09.021","volume":"133","author":"OC Redfern","year":"2018","unstructured":"Redfern, O. C. et al. Predicting in-hospital mortality and unanticipated admissions to the intensive care unit using routinely collected blood tests and vital signs: development and validation of a multivariable model. Resuscitation 133, 75\u201381 (2018).","journal-title":"Resuscitation"},{"key":"355_CR26","doi-asserted-by":"publisher","first-page":"9","DOI":"10.1016\/j.ijnurstu.2015.12.007","volume":"56","author":"M Cardona-Morrell","year":"2016","unstructured":"Cardona-Morrell, M. et al. Vital signs monitoring and nurse\u2013patient interaction: a qualitative observational study of hospital practice. Int. J. Nurs. Stud. 56, 9\u201316 (2016).","journal-title":"Int. J. Nurs. Stud."},{"key":"355_CR27","doi-asserted-by":"publisher","first-page":"1860","DOI":"10.1111\/jocn.14234","volume":"27","author":"J Hope","year":"2018","unstructured":"Hope, J. et al. A fundamental conflict of care: nurses\u2019 accounts of balancing patients\u2019 sleep with taking vital sign observations at night. J. Clin. Nurs. 27, 1860\u20131871 (2018).","journal-title":"J. Clin. Nurs."},{"key":"355_CR28","doi-asserted-by":"publisher","first-page":"36","DOI":"10.1186\/s12873-017-0147-0","volume":"17","author":"JA Petersen","year":"2017","unstructured":"Petersen, J. A., Rasmussen, L. S. & Rydahl-Hansen, S. Barriers and facilitating factors related to use of early warning score among acute care nurses: a qualitative study. BMC Emerg. Med. 17, 36 (2017).","journal-title":"BMC Emerg. Med."},{"key":"355_CR29","doi-asserted-by":"publisher","first-page":"2102","DOI":"10.1097\/CCM.0b013e318250aa5a","volume":"40","author":"MM Churpek","year":"2012","unstructured":"Churpek, M. M. et al. Derivation of a cardiac arrest prediction model using ward vital signs. Crit. Care Med. 40, 2102\u20132108 (2012).","journal-title":"Crit. Care Med."},{"key":"355_CR30","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/j.resuscitation.2016.02.005","volume":"102","author":"MM Churpek","year":"2016","unstructured":"Churpek, M. M., Adhikari, R. & Edelson, D. P. The value of vital sign trends for detecting clinical deterioration on the wards. Resuscitation 102, 1\u20135 (2016).","journal-title":"Resuscitation"},{"key":"355_CR31","doi-asserted-by":"publisher","first-page":"1518","DOI":"10.1109\/JBHI.2014.2311325","volume":"18","author":"G Sannino","year":"2014","unstructured":"Sannino, G., De Falco, I. & De Pietro, G. An automatic rules extraction approach to support OSA events detection in an mHealth system. IEEE J. Biomed. Health Inform. 18, 1518\u20131524 (2014).","journal-title":"IEEE J. Biomed. Health Inform."},{"key":"355_CR32","doi-asserted-by":"publisher","first-page":"475","DOI":"10.1007\/s11760-018-1372-z","volume":"13","author":"I Sadek","year":"2019","unstructured":"Sadek, I. & Biswas, J. Nonintrusive heart rate measurement using ballistocardiogram signals: a comparative study. Signal Image Video Process. 13, 475\u2013482 (2019).","journal-title":"Signal Image Video Process."},{"key":"355_CR33","doi-asserted-by":"publisher","first-page":"94","DOI":"10.7861\/futurehosp.6-2-94","volume":"6","author":"T Davenport","year":"2019","unstructured":"Davenport, T. & Kalakota, R. The potential for artificial intelligence in healthcare. Fut. Healthc J. 6, 94\u201398 (2019).","journal-title":"Fut. Healthc J."},{"key":"355_CR34","doi-asserted-by":"publisher","first-page":"55","DOI":"10.7326\/M14-0697","volume":"162","author":"GS Collins","year":"2015","unstructured":"Collins, G. S., Reitsma, J. B., Altman, D. G. & Moons, K. G. M. Transparent Reporting of a multivariable prediction model for Individual Prognosis Or Diagnosis (TRIPOD): the TRIPOD Statement. Ann. Intern. Med. 162, 55 (2015).","journal-title":"Ann. Intern. Med."},{"key":"355_CR35","doi-asserted-by":"publisher","first-page":"e019268","DOI":"10.1136\/bmjopen-2017-019268","volume":"7","author":"S Gerry","year":"2017","unstructured":"Gerry, S. et al. Early warning scores for detecting deterioration in adult hospital patients: a systematic review protocol. BMJ Open 7, e019268 (2017).","journal-title":"BMJ Open"},{"key":"355_CR36","doi-asserted-by":"crossref","unstructured":"Bilben, B., Grandal, L. & S\u00f8vik, S. National Early Warning Score (NEWS) as an emergency department predictor of disease severity and 90-day survival in the acutely dyspneic patient\u2014a prospective observational study. Scand. J. Trauma Resusc. Emerg. Med. 24, 80 (2016).","DOI":"10.1186\/s13049-016-0273-9"},{"key":"355_CR37","doi-asserted-by":"publisher","first-page":"331","DOI":"10.1016\/0010-4825(94)90002-7","volume":"24","author":"G Hripcsak","year":"1994","unstructured":"Hripcsak, G. Writing Arden Syntax medical logic modules. Comput. Biol. Med. 24, 331\u2013363 (1994).","journal-title":"Comput. Biol. Med."},{"key":"355_CR38","doi-asserted-by":"publisher","first-page":"2673","DOI":"10.1109\/78.650093","volume":"45","author":"M Schuster","year":"1997","unstructured":"Schuster, M. & Paliwal, K. K. Bidirectional recurrent neural networks. IEEE Trans. Signal. Process. 45, 2673\u20132681 (1997).","journal-title":"IEEE Trans. Signal. Process."},{"key":"355_CR39","unstructured":"Appleyard, J., Kocisky, T. & Blunsom, P. Optimizing performance of recurrent neural networks on GPUs. Preprint at http:\/\/arxiv.org\/abs\/1604.01946 (2016)."},{"key":"355_CR40","unstructured":"Hinton, G. E., Srivastava, N., Krizhevsky, A., Sutskever, I. & Salakhutdinov, R. R. Improving neural networks by preventing co-adaptation of feature detectors. Preprint at http:\/\/arxiv.org\/abs\/1207.0580 (2012)."},{"key":"355_CR41","unstructured":"Ioffe, S. & Szegedy, C. Batch normalization: accelerating deep network training by reducing internal covariate shift. Preprint at https:\/\/arxiv.org\/abs\/1502.03167 (2015)."},{"key":"355_CR42","unstructured":"Abadi, M. et al. TensorFlow: large-scale machine learning on heterogeneous distributed systems. Preprint at https:\/\/arxiv.org\/abs\/1603.04467 (2016)."}],"container-title":["npj Digital Medicine"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.nature.com\/articles\/s41746-020-00355-7.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41746-020-00355-7","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41746-020-00355-7.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,12,7]],"date-time":"2022-12-07T01:26:23Z","timestamp":1670376383000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.nature.com\/articles\/s41746-020-00355-7"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,11,13]]},"references-count":42,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2020,12]]}},"alternative-id":["355"],"URL":"https:\/\/doi.org\/10.1038\/s41746-020-00355-7","relation":{},"ISSN":["2398-6352"],"issn-type":[{"value":"2398-6352","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,11,13]]},"assertion":[{"value":"18 March 2020","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"20 October 2020","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"13 November 2020","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"The authors declare no competing interests.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"149"}}