{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,25]],"date-time":"2026-04-25T15:28:31Z","timestamp":1777130911276,"version":"3.51.4"},"reference-count":48,"publisher":"MDPI AG","issue":"16","license":[{"start":{"date-parts":[[2021,8,18]],"date-time":"2021-08-18T00:00:00Z","timestamp":1629244800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Surveillance of sleeping posture is essential for bed-ridden patients or individuals at-risk of falling out of bed. Existing sleep posture monitoring and classification systems may not be able to accommodate the covering of a blanket, which represents a barrier to conducting pragmatic studies. The objective of this study was to develop an unobtrusive sleep posture classification that could accommodate the use of a blanket. The system uses an infrared depth camera for data acquisition and a convolutional neural network to classify sleeping postures. We recruited 66 participants (40 men and 26 women) to perform seven major sleeping postures (supine, prone (head left and right), log (left and right) and fetal (left and right)) under four blanket conditions (thick, medium, thin, and no blanket). Data augmentation was conducted by affine transformation and data fusion, generating additional blanket conditions with the original dataset. Coarse-grained (four-posture) and fine-grained (seven-posture) classifiers were trained using two fully connected network layers. For the coarse classification, the log and fetal postures were merged into a side-lying class and the prone class (head left and right) was pooled. The results show a drop of overall F1-score by 8.2% when switching to the fine-grained classifier. In addition, compared to no blanket, a thick blanket reduced the overall F1-scores by 3.5% and 8.9% for the coarse- and fine-grained classifiers, respectively; meanwhile, the lowest performance was seen in classifying the log (right) posture under a thick blanket, with an F1-score of 72.0%. In conclusion, we developed a system that can classify seven types of common sleeping postures under blankets and achieved an F1-score of 88.9%.<\/jats:p>","DOI":"10.3390\/s21165553","type":"journal-article","created":{"date-parts":[[2021,8,18]],"date-time":"2021-08-18T22:51:00Z","timestamp":1629327060000},"page":"5553","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":45,"title":["A Blanket Accommodative Sleep Posture Classification System Using an Infrared Depth Camera: A Deep Learning Approach with Synthetic Augmentation of Blanket Conditions"],"prefix":"10.3390","volume":"21","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-6563-8177","authenticated-orcid":false,"given":"Andy Yiu-Chau","family":"Tam","sequence":"first","affiliation":[{"name":"Department of Biomedical Engineering, Faculty of Engineering, The Hong Kong Polytechnic University, Hong Kong, China"}]},{"given":"Bryan Pak-Hei","family":"So","sequence":"additional","affiliation":[{"name":"Department of Biomedical Engineering, Faculty of Engineering, The Hong Kong Polytechnic University, Hong Kong, China"}]},{"given":"Tim Tin-Chun","family":"Chan","sequence":"additional","affiliation":[{"name":"Department of Biomedical Engineering, Faculty of Engineering, The Hong Kong Polytechnic University, Hong Kong, China"}]},{"given":"Alyssa Ka-Yan","family":"Cheung","sequence":"additional","affiliation":[{"name":"Department of Biomedical Engineering, Faculty of Engineering, The Hong Kong Polytechnic University, Hong Kong, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8805-1157","authenticated-orcid":false,"given":"Duo Wai-Chi","family":"Wong","sequence":"additional","affiliation":[{"name":"Department of Biomedical Engineering, Faculty of Engineering, The Hong Kong Polytechnic University, Hong Kong, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7446-0569","authenticated-orcid":false,"given":"James Chung-Wai","family":"Cheung","sequence":"additional","affiliation":[{"name":"Department of Biomedical Engineering, Faculty of Engineering, The Hong Kong Polytechnic University, Hong Kong, China"},{"name":"Research Institute for Smart Ageing, The Hong Kong Polytechnic University, Hong Kong, China"}]}],"member":"1968","published-online":{"date-parts":[[2021,8,18]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"189","DOI":"10.1109\/TBCAS.2016.2541680","article-title":"SleepSense: A noncontact and cost-effective sleep monitoring system","volume":"11","author":"Lin","year":"2016","journal-title":"IEEE Trans. Biomed. Circuits Syst."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"108035","DOI":"10.1016\/j.diabres.2020.108035","article-title":"The association between sleep and diabetes outcomes\u2014A systematic review","volume":"161","author":"Khalil","year":"2020","journal-title":"Diabetes Res. Clin. Pract."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"25","DOI":"10.1001\/archinte.165.1.25","article-title":"Overweight and obese patients in a primary care population report less sleep than patients with a normal body mass index","volume":"165","author":"Vorona","year":"2005","journal-title":"Arch. Intern. Med."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"2008","DOI":"10.1152\/japplphysiol.00660.2005","article-title":"Sleep loss: A novel risk factor for insulin resistance and Type 2 diabetes","volume":"99","author":"Spiegel","year":"2005","journal-title":"J. Appl. Physiol."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"101311","DOI":"10.1016\/j.smrv.2020.101311","article-title":"The relationship between sleep duration and mood in adolescents: A systematic review and meta-analysis","volume":"52","author":"Short","year":"2020","journal-title":"Sleep Med. Rev."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"116","DOI":"10.1016\/j.psychres.2018.07.009","article-title":"Prevalence and correlates of sleep disorder symptoms in psychiatric disorders","volume":"279","author":"Hombali","year":"2019","journal-title":"Psychiatry Res."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Liang, M., Guo, L., Huo, J., and Zhou, G. (2021). Prevalence of sleep disturbances in Chinese adolescents: A systematic review and meta-analysis. PLoS ONE, 16.","DOI":"10.1371\/journal.pone.0247333"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Liu, J., Chen, X., Chen, S., Liu, X., Wang, Y., and Chen, L. (May, January 29). TagSheet: Sleeping posture recognition with an unobtrusive passive tag matrix. Proceedings of the IEEE INFOCOM 2019-IEEE Conference on Computer Communications, Paris, France.","DOI":"10.1109\/INFOCOM.2019.8737599"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"833","DOI":"10.1016\/j.jbiomech.2015.12.038","article-title":"Estimation of loads on human lumbar spine: A review of in vivo and computational model studies","volume":"49","author":"Dreischarf","year":"2016","journal-title":"J. Biomech."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"1021","DOI":"10.1589\/jpts.29.1021","article-title":"Effect of sleep posture on neck muscle activity","volume":"29","author":"Lee","year":"2017","journal-title":"J. Phys. Ther. Sci."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"254","DOI":"10.1080\/10705500802365466","article-title":"Sleeping problems as a risk factor for subsequent musculoskeletal pain and the role of job strain: Results from a one-year follow-up of the Malm\u00f6 Shoulder Neck Study Cohort","volume":"15","author":"Canivet","year":"2008","journal-title":"Int. J. Behav. Med."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"e027633","DOI":"10.1136\/bmjopen-2018-027633","article-title":"Identifying relationships between sleep posture and non-specific spinal symptoms in adults: A scoping review","volume":"9","author":"Cary","year":"2019","journal-title":"BMJ Open"},{"key":"ref_13","first-page":"1000173","article-title":"Examining the relationship between sleep posture and morning spinal symptoms in the habitual environment using infrared cameras","volume":"5","author":"Cary","year":"2016","journal-title":"J. Sleep Disord. Treat. Care"},{"key":"ref_14","first-page":"1231","article-title":"Implement the system of the Position Change for Obstructive sleep apnea patient","volume":"21","author":"Ye","year":"2017","journal-title":"J. Korea Inst. Inf. Commun. Eng."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"169","DOI":"10.1046\/j.1365-2869.2002.00297.x","article-title":"Situational factors affecting sleep paralysis and associated hallucinations: Position and timing effects","volume":"11","author":"Cheyne","year":"2002","journal-title":"J. Sleep Res."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"1914","DOI":"10.1111\/j.1572-0241.2005.00285.x","article-title":"Effect of esomeprazole on nighttime heartburn and sleep quality in patients with GERD: A randomized, placebo-controlled trial","volume":"100","author":"Johnson","year":"2005","journal-title":"Am. J. Gastroenterol."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Waltisberg, D., Arnrich, B., and Tr\u00f6ster, G. (2014). Sleep quality monitoring with the smart bed. Pervasive Health, Springer.","DOI":"10.1007\/978-1-4471-6413-5_9"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"203","DOI":"10.1682\/JRRD.2010.05.0102","article-title":"Assessing evidence supporting redistribution of pressure for pressure ulcer prevention: A review","volume":"48","author":"Sprigle","year":"2011","journal-title":"J. Rehabil. Res. Dev."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"17","DOI":"10.1007\/s11673-018-9892-3","article-title":"Two-Hourly Repositioning for Prevention of Pressure Ulcers in the Elderly: Patient Safety or Elder Abuse?","volume":"16","author":"Sharp","year":"2019","journal-title":"J. Bioethical Inq."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Cheung, J.C.-W., Tam, E.W.-C., Mak, A.H.-Y., Chan, T.T.-C., Lai, W.P.-Y., and Zheng, Y.-P. (2021). Night-time monitoring system (eNightLog) for elderly wandering behavior. Sensors, 21.","DOI":"10.3390\/s21030704"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"183","DOI":"10.1046\/j.1446-9235.2003.00040.x","article-title":"Characteristic features of the nocturnal sleeping posture of healthy men","volume":"1","author":"Kubota","year":"2003","journal-title":"Sleep Biol. Rhythm."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"119","DOI":"10.3390\/iot2010007","article-title":"CNN-Based Smart Sleep Posture Recognition System","volume":"2","author":"Tang","year":"2021","journal-title":"IoT"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"1274","DOI":"10.1109\/TITB.2012.2214786","article-title":"A posture recognition-based fall detection system for monitoring an elderly person in a smart home environment","volume":"16","author":"Yu","year":"2012","journal-title":"IEEE Trans. Inf. Technol. Biomed."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"341","DOI":"10.1016\/j.softx.2018.10.001","article-title":"Sleep monitor: A tool for monitoring and categorical scoring of lying position using 3D camera data","volume":"7","author":"Masek","year":"2018","journal-title":"SoftwareX"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Hoque, E., Dickerson, R.F., and Stankovic, J.A. (2010, January 5\u20137). Monitoring body positions and movements during sleep using wisps. Proceedings of the Wireless Health 2010, WH 2010, San Diego, CA, USA.","DOI":"10.1145\/1921081.1921088"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"217","DOI":"10.1109\/TMC.2019.2939791","article-title":"Smars: Sleep monitoring via ambient radio signals","volume":"20","author":"Zhang","year":"2019","journal-title":"IEEE Trans. Mobile Comput."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Liu, J.J., Xu, W., Huang, M.-C., Alshurafa, N., Sarrafzadeh, M., Raut, N., and Yadegar, B. (2013, January 18\u201322). A dense pressure sensitive bedsheet design for unobtrusive sleep posture monitoring. Proceedings of the 2013 IEEE International Conference on Pervasive Computing and Communications (PerCom), San Diego, CA, USA.","DOI":"10.1109\/PerCom.2013.6526734"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Pino, E.J., De la Paz, A.D., Aqueveque, P., Ch\u00e1vez, J.A., and Mor\u00e1n, A.A. (2013, January 3\u20137). Contact pressure monitoring device for sleep studies. Proceedings of the 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), Osaka, Japan.","DOI":"10.1109\/EMBC.2013.6610461"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"8266","DOI":"10.1021\/nn4037514","article-title":"Triboelectric active sensor array for self-powered static and dynamic pressure detection and tactile imaging","volume":"7","author":"Lin","year":"2013","journal-title":"ACS Nano"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"101","DOI":"10.1109\/JBHI.2019.2899070","article-title":"Artificial neural network for in-bed posture classification using bed-sheet pressure sensors","volume":"24","author":"Matar","year":"2019","journal-title":"IEEE J. Biomed. Health Inform."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Liu, Z., Mingliang, S., and Lu, K. (2019, January 12\u201314). A Method to Recognize Sleeping Position Using an CNN Model Based on Human Body Pressure Image. Proceedings of the 2019 IEEE International Conference on Power, Intelligent Computing and Systems (ICPICS), Shenyang, China.","DOI":"10.1109\/ICPICS47731.2019.8942566"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"93907","DOI":"10.1109\/ACCESS.2020.2994593","article-title":"Self-supervised learning from multi-sensor data for sleep recognition","volume":"8","author":"Zhao","year":"2020","journal-title":"IEEE Access"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Byeon, Y.-H., Lee, J.-Y., Kim, D.-H., and Kwak, K.-C. (2020). Posture Recognition Using Ensemble Deep Models under Various Home Environments. Appl. Sci., 10.","DOI":"10.3390\/app10041287"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Viriyavit, W., and Sornlertlamvanich, V. (2020). Bed Position Classification by a Neural Network and Bayesian Network Using Noninvasive Sensors for Fall Prevention. J. Sens., 2020.","DOI":"10.1155\/2020\/5689860"},{"key":"ref_35","first-page":"1550147720911892","article-title":"A novel multi-label classification algorithm based on K-nearest neighbor and random walk","volume":"16","author":"Wang","year":"2020","journal-title":"Int. J. Distrib. Sens. Netw."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"142421","DOI":"10.1109\/ACCESS.2019.2944801","article-title":"Computational sleep behavior analysis: A survey","volume":"7","author":"Fallmann","year":"2019","journal-title":"IEEE Access"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Buslaev, A., Iglovikov, V.I., Khvedchenya, E., Parinov, A., Druzhinin, M., and Kalinin, A.A. (2020). Albumentations: Fast and flexible image augmentations. Information, 11.","DOI":"10.3390\/info11020125"},{"key":"ref_38","unstructured":"Tan, M., and Le, Q. (2019, January 9\u201315). Efficientnet: Rethinking model scaling for convolutional neural networks. Proceedings of the International Conference on Machine Learning, Long Beach, CA, USA."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Xie, Q., Luong, M.-T., Hovy, E., and Le, Q.V. (2020, January 13\u201319). Self-training with noisy student improves imagenet classification. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.01070"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"555","DOI":"10.1162\/coli.07-034-R2","article-title":"Inter-coder agreement for computational linguistics","volume":"34","author":"Artstein","year":"2008","journal-title":"Comput. Linguist."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Ren, A., Dong, B., Lv, X., Zhu, T., Hu, F., and Yang, X. (2016, January 14\u201317). A non-contact sleep posture sensing strategy considering three dimensional human body models. Proceedings of the 2016 2nd IEEE International Conference on Computer and Communications (ICCC), Chengdu, China.","DOI":"10.1109\/CompComm.2016.7924734"},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Grimm, T., Martinez, M., Benz, A., and Stiefelhagen, R. (2016, January 4\u20138). Sleep position classification from a depth camera using bed aligned maps. Proceedings of the 2016 23rd International Conference on Pattern Recognition (ICPR), Cancun, Mexico.","DOI":"10.1109\/ICPR.2016.7899653"},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Fallmann, S., Van Veen, R., Chen, L., Walker, D., Chen, F., and Pan, C. (2017, January 12\u201315). Wearable accelerometer based extended sleep position recognition. Proceedings of the 2017 IEEE 19th International Conference on e-Health Networking, Applications and Services (Healthcom), Dalian, China.","DOI":"10.1109\/HealthCom.2017.8210806"},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Yousefi, R., Ostadabbas, S., Faezipour, M., Farshbaf, M., Nourani, M., Tamil, L., and Pompeo, M. (September, January 30). Bed posture classification for pressure ulcer prevention. Proceedings of the 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society, Boston, MA, USA.","DOI":"10.1109\/IEMBS.2011.6091813"},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Mohammadi, S.M., Alnowami, M., Khan, S., Dijk, D.-J., Hilton, A., and Wells, K. (2018, January 18\u201321). Sleep posture classification using a convolutional neural network. Proceedings of the 2018 40th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), Honolulu, HI, USA.","DOI":"10.1109\/EMBC.2018.8513009"},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Ostadabbas, S., Pouyan, M.B., Nourani, M., and Kehtarnavaz, N. (2014, January 22\u201324). In-bed posture classification and limb identification. Proceedings of the 2014 IEEE Biomedical Circuits and Systems Conference (BioCAS) Proceedings, Lausanne, Switzerland.","DOI":"10.1109\/BioCAS.2014.6981663"},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"e2397","DOI":"10.7717\/peerj.2397","article-title":"Effect of pillow height on the biomechanics of the head-neck complex: Investigation of the cranio-cervical pressure and cervical spine alignment","volume":"4","author":"Ren","year":"2016","journal-title":"PeerJ"},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"e6364","DOI":"10.7717\/peerj.6364","article-title":"Sleeping mattress determinants and evaluation: A biomechanical review and critique","volume":"7","author":"Wong","year":"2019","journal-title":"PeerJ"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/16\/5553\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T06:46:28Z","timestamp":1760165188000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/16\/5553"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,8,18]]},"references-count":48,"journal-issue":{"issue":"16","published-online":{"date-parts":[[2021,8]]}},"alternative-id":["s21165553"],"URL":"https:\/\/doi.org\/10.3390\/s21165553","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,8,18]]}}}