{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,12]],"date-time":"2026-06-12T16:19:35Z","timestamp":1781281175681,"version":"3.54.1"},"reference-count":47,"publisher":"MDPI AG","issue":"15","license":[{"start":{"date-parts":[[2024,7,25]],"date-time":"2024-07-25T00:00:00Z","timestamp":1721865600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Guangdong Province","award":["2022B1515130009"],"award-info":[{"award-number":["2022B1515130009"]}]},{"name":"Guangdong Province","award":["2023B03J0172"],"award-info":[{"award-number":["2023B03J0172"]}]},{"name":"Special Subject on Agriculture and Social Development","award":["2022B1515130009"],"award-info":[{"award-number":["2022B1515130009"]}]},{"name":"Special Subject on Agriculture and Social Development","award":["2023B03J0172"],"award-info":[{"award-number":["2023B03J0172"]}]},{"name":"Ministry of Science and Technology of China","award":["2022B1515130009"],"award-info":[{"award-number":["2022B1515130009"]}]},{"name":"Ministry of Science and Technology of China","award":["2023B03J0172"],"award-info":[{"award-number":["2023B03J0172"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Sleep quality is heavily influenced by sleep posture, with research indicating that a supine posture can worsen obstructive sleep apnea (OSA) while lateral postures promote better sleep. For patients confined to beds, regular changes in posture are crucial to prevent the development of ulcers and bedsores. This study presents a novel sparse sensor-based spatiotemporal convolutional neural network (S3CNN) for detecting sleep posture. This S3CNN holistically incorporates a pair of spatial convolution neural networks to capture cardiorespiratory activity maps and a pair of temporal convolution neural networks to capture the heart rate and respiratory rate. Sleep data were collected in actual sleep conditions from 22 subjects using a sparse sensor array. The S3CNN was then trained to capture the spatial pressure distribution from the cardiorespiratory activity and temporal cardiopulmonary variability from the heart and respiratory data. Its performance was evaluated using three rounds of 10 fold cross-validation on the 8583 data samples collected from the subjects. The results yielded 91.96% recall, 92.65% precision, and 93.02% accuracy, which are comparable to the state-of-the-art methods that use significantly more sensors for marginally enhanced accuracy. Hence, the proposed S3CNN shows promise for sleep posture monitoring using sparse sensors, demonstrating potential for a more cost-effective approach.<\/jats:p>","DOI":"10.3390\/s24154833","type":"journal-article","created":{"date-parts":[[2024,7,25]],"date-time":"2024-07-25T11:43:44Z","timestamp":1721907824000},"page":"4833","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":17,"title":["Smart Sleep Monitoring: Sparse Sensor-Based Spatiotemporal CNN for Sleep Posture Detection"],"prefix":"10.3390","volume":"24","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-8290-7957","authenticated-orcid":false,"given":"Dikun","family":"Hu","sequence":"first","affiliation":[{"name":"School of Information and Communication Engineering, Beijing University of Posts and Telecommunications (BUPT), No. 10 Xitucheng Road, Haidian District, Beijing 100876, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9360-4561","authenticated-orcid":false,"given":"Weidong","family":"Gao","sequence":"additional","affiliation":[{"name":"School of Information and Communication Engineering, Beijing University of Posts and Telecommunications (BUPT), No. 10 Xitucheng Road, Haidian District, Beijing 100876, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3053-6311","authenticated-orcid":false,"given":"Kai Keng","family":"Ang","sequence":"additional","affiliation":[{"name":"Institute for Infocomm Research, Agency for Science, Technology and Research (A*STAR), 1 Fusionopolis Way, #21-01 Connexis (South Tower), Singapore 138632, Singapore"},{"name":"College of Computing and Data Science, Nanyang Technological University, 50 Nanyang Ave., Singapore 639798, Singapore"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2086-5517","authenticated-orcid":false,"given":"Mengjiao","family":"Hu","sequence":"additional","affiliation":[{"name":"Institute for Infocomm Research, Agency for Science, Technology and Research (A*STAR), 1 Fusionopolis Way, #21-01 Connexis (South Tower), Singapore 138632, Singapore"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Gang","family":"Chuai","sequence":"additional","affiliation":[{"name":"School of Information and Communication Engineering, Beijing University of Posts and Telecommunications (BUPT), No. 10 Xitucheng Road, Haidian District, Beijing 100876, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Rong","family":"Huang","sequence":"additional","affiliation":[{"name":"Department of Respiratory and Critical Care Medicine, Peking Union Medical College Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, No. 1 Shuaifuyuan Wangfujing, Beijing 100730, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2024,7,25]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"A163","DOI":"10.1093\/sleep\/zsab072.410","article-title":"411 REM predominance of OSA: Associated with supine position, but not with CPAP adherence","volume":"44","author":"Schecter","year":"2021","journal-title":"Sleep"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"4069","DOI":"10.1109\/JSEN.2022.3225290","article-title":"Human Sleeping Posture Recognition Based on Sleeping Pressure Image","volume":"23","author":"Wan","year":"2023","journal-title":"IEEE Sens. J."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"101313","DOI":"10.1016\/j.smrv.2020.101313","article-title":"Reinventing polysomnography in the age of precision medicine","volume":"52","author":"Lim","year":"2020","journal-title":"Sleep Med. Rev."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Doheny, E.P., and Lowery, M.M. (2020, January 20\u201324). Estimation of respiration rate and sleeping position using a wearable accelerometer. Proceedings of the 2020 42nd Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC), Virtual Conference.","DOI":"10.1109\/EMBC44109.2020.9176573"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Abdulsadig, R.S., and Singh, S. (2022, January 11\u201315). Sleep Posture Detection Using an Accelerometer Placed on the Neck. Proceedings of the 2022 44th Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC), Glasgow, UK.","DOI":"10.1109\/EMBC48229.2022.9871300"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"2008701","DOI":"10.1002\/adma.202008701","article-title":"A Wearable Body Condition Sensor System with Wireless Feedback Alarm Functions","volume":"33","author":"Xu","year":"2021","journal-title":"Adv. Mater."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"2664","DOI":"10.1109\/ACCESS.2018.2886205","article-title":"A Non-Invasive Sleep Analysis Approach Based on a Fuzzy Inference System and a Finite State Machine","volume":"7","author":"Ye","year":"2019","journal-title":"IEEE Access"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Zhang, Y., and Xiao, A. (2022). The Relationship between Sleeping Position and Sleep Quality: A Flexible Sensor-Based Study. Sensors, 22.","DOI":"10.3390\/s22166220"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"1305","DOI":"10.1109\/JBHI.2020.3025900","article-title":"SleepPoseNet: Multi-View Learning for Sleep Postural Transition Recognition Using UWB","volume":"25","author":"Piriyajitakonkij","year":"2021","journal-title":"IEEE J. Biomed. Health Inform."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"7433","DOI":"10.1109\/JSEN.2020.2979191","article-title":"Improving heart rate estimation on consumer grade wrist-worn device using post-calibration approach","volume":"20","author":"Choksatchawathi","year":"2020","journal-title":"IEEE Sens. J."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Tam, A.Y.-C., and Zha, L.-W. (2022). Depth-Camera-Based Under-Blanket Sleep Posture Classification Using Anatomical Landmark-Guided Deep Learning Model. Int. J. Environ. Res. Public Health, 19.","DOI":"10.3390\/ijerph192013491"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"72826","DOI":"10.1109\/ACCESS.2019.2920025","article-title":"Automated Non-Contact Detection of Head and Body Positions During Sleep","volume":"7","author":"Akbarian","year":"2019","journal-title":"IEEE Access"},{"key":"ref_13","first-page":"1","article-title":"Multimodal Polysomnography-Based Automatic Sleep Stage Classification via Multiview Fusion Network","volume":"73","author":"Lin","year":"2024","journal-title":"IEEE Trans. Instrum. Meas."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"13399","DOI":"10.1109\/JSEN.2023.3273533","article-title":"Human Sleep Posture Recognition Method Based on Interactive Learning of Ultra-Long Short-Term Information","volume":"23","author":"Luo","year":"2023","journal-title":"IEEE Sens. J."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"2071","DOI":"10.1109\/JIOT.2018.2822818","article-title":"Monitoring Vital Signs and Postures During Sleep Using WiFi Signals","volume":"5","author":"Liu","year":"2018","journal-title":"IEEE Internet Things J."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Lai, D.K.-H., and Yu, Z.-H. (2023). Vision Transformers (ViT) for Blanket-Penetrating Sleep Posture Recognition Using a Triple Ultra-Wideband (UWB) Radar System. Sensors, 23.","DOI":"10.3390\/s23052475"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"36181","DOI":"10.1109\/ACCESS.2021.3062385","article-title":"Sleep Posture Recognition with a Dual-Frequency Cardiopulmonary Doppler Radar","volume":"9","author":"Kiriazi","year":"2021","journal-title":"IEEE Access"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"24060","DOI":"10.1109\/JSEN.2021.3134823","article-title":"A Piezoresistive Array-Based Force Sensing Technique for Sleeping Posture and Respiratory Rate Detection for SAS Patients","volume":"23","author":"Wang","year":"2023","journal-title":"IEEE Sens. J."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Mineharu, A., and Kuwahara, A. (2015, January 15\u201318). A Study of Automatic Classification of Sleeping Position by a Pressure-Sensitive Sensor. Proceedings of the 2015 International Conference on Informatics, Electronics & Vision (ICIEV), Fukuoka, Japan.","DOI":"10.1109\/ICIEV.2015.7334059"},{"key":"ref_20","unstructured":"Georgios, G., and Papangelis, A. (2011, January 25\u201327). Recognition of Sleep Patterns Using a Bed Pressure Mat. Proceedings of the 4th ACM International Conference on PErvasive Technologies Related to Assistive Environments, Heraklion, Greece."},{"key":"ref_21","unstructured":"Hsia, C.-C., and Hung, Y.-W. (2008, January 7\u20139). Bayesian Classification for Bed Posture Detection Based on Kurtosis and Skewness Estimation. Proceedings of the 10th International Conference on e-Health Networking, Applications and Services, Singapore."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"101","DOI":"10.1109\/JBHI.2019.2899070","article-title":"Artificial Neural Network for in-Bed Posture Classification Using Bed-Sheet Pressure Sensors","volume":"24","author":"Matar","year":"2020","journal-title":"IEEE J. Biomed. Health Inform."},{"key":"ref_23","first-page":"718","article-title":"Data Augmentation to Build High Performance DNN for in-Bed Posture Classification","volume":"26","author":"Enokibori","year":"2018","journal-title":"J. Inf. Process."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Heydarzadeh, M., and Nourani, M. (2016, January 16\u201320). In-bed Posture Classification Using Deep Autoencoders. Proceedings of the 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), Orlando, FL, USA.","DOI":"10.1109\/EMBC.2016.7591565"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"1023","DOI":"10.1109\/TBCAS.2016.2543686","article-title":"Body-Earth Mover\u2019s Distance: A Matching-Based Approach for Sleep Posture Recognition","volume":"10","author":"Xu","year":"2016","journal-title":"IEEE Trans. Biomed. Circuits Syst."},{"key":"ref_26","unstructured":"Ostadabbas, Y., and Faezipour, M. (September, January 30). Bed Posture Classification for Pressure Ulcer Prevention. Proceedings of the 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society, Boston, MA, USA."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"11084","DOI":"10.1038\/s41598-024-61267-0","article-title":"A Dual Fusion Recognition Model for Sleep Posture Based on Air Mattress Pressure Detection","volume":"14","author":"Li","year":"2024","journal-title":"Sci. Rep."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"6869","DOI":"10.1109\/JSEN.2020.3043416","article-title":"A Real-Time Patient-Specific Sleeping Posture Recognition System Using Pressure Sensitive Conductive Sheet and Transfer Learning","volume":"21","author":"Hu","year":"2020","journal-title":"IEEE Sens. J."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"111","DOI":"10.1109\/TBCAS.2021.3053602","article-title":"Deep Residual Networks for Sleep Posture Recognition With Unobtrusive Miniature Scale Smart Mat System","volume":"15","author":"Diao","year":"2021","journal-title":"IEEE Trans. Biomed. Circuits Syst."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"10428","DOI":"10.1109\/JSEN.2021.3059681","article-title":"Remote Recognition of In-Bed Postures Using a Thermopile Array Sensor With Machine Learning","volume":"21","author":"Chen","year":"2021","journal-title":"IEEE Sens. J."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"9739","DOI":"10.1109\/JSEN.2023.3262747","article-title":"Pressure-Sensor-Based Sleep Status and Quality Evaluation System","volume":"23","author":"Kau","year":"2023","journal-title":"IEEE Sens. J."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"96","DOI":"10.1016\/j.bspc.2016.02.002","article-title":"An Algorithm for Beat-to-Beat Heart Rate Detection from the BCG Based on the Continuous Spline Wavelet Transform","volume":"27","year":"2016","journal-title":"Biomed. Signal Process. Control"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Borovkova, E.I., and Ponomarenko, V.I. (2023). Method of Extracting the Instantaneous Phases and Frequencies of Respiration from the Signal of a Photoplethysmogram. Mathematics, 11.","DOI":"10.3390\/math11244903"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"3720","DOI":"10.1109\/JBHI.2022.3162396","article-title":"Non-Contact Heartbeat Detection Based on Ballistocardiogram Using UNet and Bidirectional Long Short-Term Memory","volume":"26","author":"Mai","year":"2022","journal-title":"IEEE J. Biomed. Health Inform."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"1115","DOI":"10.1109\/TBME.2020.3010864","article-title":"A Unified Approach to Wearable Ballistocardiogram Gating and Wave Localization","volume":"68","author":"Shin","year":"2021","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"2634","DOI":"10.1109\/TBME.2018.2812602","article-title":"Multiple Instance Dictionary Learning for Beat-to-Beat Heart Rate Monitoring From Ballistocardiograms","volume":"65","author":"Jiao","year":"2018","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"4172","DOI":"10.1109\/JSEN.2017.2707061","article-title":"Improved Pre-Ejection Period Estimation From Ballistocardiogram and Electrocardiogram Signals by Fusing Multiple Timing Interval Features","volume":"17","author":"Bicen","year":"2017","journal-title":"IEEE Sens. J."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"19669","DOI":"10.1016\/j.ceramint.2020.03.210","article-title":"A Flexible Piezoelectric Pressure Sensor Based on PVDF Nanocomposite Fibers Doped with PZT Particles for Energy Harvesting Applications","volume":"46","author":"Chamankar","year":"2020","journal-title":"Ceram. Int."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"9309","DOI":"10.1039\/D1TC01894A","article-title":"Coupling Piezoelectric and Piezoresistive Effects in Flexible Pressure Sensors for Human Motion Detection from Zero to High Frequency","volume":"9","author":"Lu","year":"2021","journal-title":"J. Mater. Chem. C"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"6798","DOI":"10.1109\/JSEN.2017.2750241","article-title":"Designing, Manufacturing and Testing of a Piezoelectric Polymer Film In-Sole Sensor for Plantar Pressure Distribution Measurements","volume":"17","author":"Rajala","year":"2017","journal-title":"IEEE Sens. J."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"176","DOI":"10.2307\/3214801","article-title":"The MacLaurin Series for the GI\/G\/1 Queue","volume":"29","author":"Gong","year":"1992","journal-title":"J. Appl. Probab."},{"key":"ref_42","unstructured":"Dikun, H., Weidong, G., Keng, K.A., and Mengjiao, H. (2024, January 15\u201319). STConvSleepNet: A Spatiotemporal Convolutional Network for Sleep Posture Detection (Accepted). Proceedings of the 2024 46th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), Orlando, FL, USA."},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Tam, A.Y.-C., and So, B.P.-H. (2021). A Deep Learning Approach with Synthetic Augmentation of Blanket Conditions. Sensors, 21.","DOI":"10.3390\/s21165553"},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Mahvash Mohammadi, S., and Kouchaki, S. (2019, January 23\u201327). Two-Step Deep Learning for Estimating Human Sleep Pose Occluded by Bed Covers. Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, Berlin, Germany.","DOI":"10.1109\/EMBC.2019.8856873"},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"11175","DOI":"10.1109\/JIOT.2023.3328866","article-title":"PosMonitor: Fine-Grained Sleep Posture Recognition with mmWave Radar","volume":"11","author":"Liu","year":"2023","journal-title":"IEEE Internet Things J."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"104","DOI":"10.1007\/s42979-023-02426-4","article-title":"Monitoring and Classification of Human Sleep Postures, Seizures, and Falls From Bed Using Three-Axis Acceleration Signals and Machine Learning","volume":"5","author":"Intongkum","year":"2023","journal-title":"SN Comput. Sci."},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Chen, P.-J., and Hu, T.-H. (2022). Raspberry Pi-Based Sleep Posture Recognition System Using AIoT Technique. Healthcare, 10.","DOI":"10.3390\/healthcare10030513"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/24\/15\/4833\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T15:23:21Z","timestamp":1760109801000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/24\/15\/4833"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,7,25]]},"references-count":47,"journal-issue":{"issue":"15","published-online":{"date-parts":[[2024,8]]}},"alternative-id":["s24154833"],"URL":"https:\/\/doi.org\/10.3390\/s24154833","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,7,25]]}}}