{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,14]],"date-time":"2026-05-14T01:45:23Z","timestamp":1778723123184,"version":"3.51.4"},"reference-count":29,"publisher":"MDPI AG","issue":"12","license":[{"start":{"date-parts":[[2021,6,19]],"date-time":"2021-06-19T00:00:00Z","timestamp":1624060800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Insufficient physical activity is common in modern society. By estimating the energy expenditure (EE) of different physical activities, people can develop suitable exercise plans to improve their lifestyle quality. However, several limitations still exist in the related works. Therefore, the aim of this study is to propose an accurate EE estimation model based on depth camera data with physical activity classification to solve the limitations in the previous research. To decide the best location and amount of cameras of the EE estimation, three depth cameras were set at three locations, namely the side, rear side, and rear views, to obtain the kinematic data and EE estimation. Support vector machine was used for physical activity classification. Three EE estimation models, namely linear regression, multilayer perceptron (MLP), and convolutional neural network (CNN) models, were compared and determined the model with optimal performance in different experimental settings. The results have shown that if only one depth camera is available, optimal EE estimation can be obtained using the side view and MLP model. The mean absolute error (MAE), mean square error (MSE), and root MSE (RMSE) of the classification results under the aforementioned settings were 0.55, 0.66, and 0.81, respectively. If higher accuracy is required, two depth cameras can be set at the side and rear views, the CNN model can be used for light-to-moderate activities, and the MLP model can be used for vigorous activities. The RMSEs for estimating the EEs of standing, walking, and running were 0.19, 0.57, and 0.96, respectively. By applying the different models on different amounts of cameras, the optimal performance can be obtained, and this is also the first study to discuss the issue.<\/jats:p>","DOI":"10.3390\/s21124216","type":"journal-article","created":{"date-parts":[[2021,6,20]],"date-time":"2021-06-20T21:50:15Z","timestamp":1624225815000},"page":"4216","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":8,"title":["Depth-Camera Based Energy Expenditure Estimation System for Physical Activity Using Posture Classification Algorithm"],"prefix":"10.3390","volume":"21","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-0498-3190","authenticated-orcid":false,"given":"Bor-Shing","family":"Lin","sequence":"first","affiliation":[{"name":"Department of Computer Science and Information Engineering, National Taipei University, New Taipei City 237303, Taiwan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3722-8194","authenticated-orcid":false,"given":"I-Jung","family":"Lee","sequence":"additional","affiliation":[{"name":"Department of Computer Science and Information Engineering, National Taipei University, New Taipei City 237303, Taiwan"},{"name":"College of Electrical Engineering and Computer Science, National Taipei University, New Taipei City 237303, Taiwan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Chin-Shyurng","family":"Fahn","sequence":"additional","affiliation":[{"name":"Department of Computer Science and Information Engineering, National Taiwan University of Science and Technology, Taipei 106335, Taiwan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yi-Fang","family":"Lee","sequence":"additional","affiliation":[{"name":"Department of Computer Science and Information Engineering, National Taiwan University of Science and Technology, Taipei 106335, Taiwan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Wei-Jen","family":"Chou","sequence":"additional","affiliation":[{"name":"Department of Computer Science and Information Engineering, National Taipei University, New Taipei City 237303, Taiwan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Meng-Luen","family":"Wu","sequence":"additional","affiliation":[{"name":"Department of Computer Science and Information Engineering, Tamkang University, New Taipei City 251301, Taiwan"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2021,6,19]]},"reference":[{"key":"ref_1","unstructured":"(2021, May 24). World Health Organization: Physical Activity. Available online: https:\/\/www.who.int\/news-room\/fact-sheets\/detail\/physical-activity."},{"key":"ref_2","unstructured":"(2021, May 24). Causes of Death\u2014Our World in Data. Available online: https:\/\/ourworldindata.org\/causes-of-death."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"280","DOI":"10.1055\/s-2001-13816","article-title":"Validation of the COSMED K4b2 portable metabolic system","volume":"22","author":"McLaughlin","year":"2001","journal-title":"Int. J. Sports Med."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"219","DOI":"10.1109\/JBHI.2014.2313039","article-title":"Estimating energy expenditure using body-worn accelerometers: A comparison of methods, sensors number and positioning","volume":"19","author":"Altini","year":"2015","journal-title":"IEEE J. Biomed. Health Inform."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"1081","DOI":"10.1109\/JBHI.2015.2432911","article-title":"Estimating Energy Expenditure with Multiple Models Using Different Wearable Sensors","volume":"20","year":"2016","journal-title":"IEEE J. Biomed. Health Inform."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Park, H., Dong, S.Y., Lee, M., and Youn, I. (2017). The Role of Heart-Rate Variability Parameters in Activity Recognition and Energy-Expenditure Estimation Using Wearable Sensors. Sensors, 17.","DOI":"10.3390\/s17071698"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"13","DOI":"10.1016\/j.medengphy.2019.10.006","article-title":"Prediction of energy expenditure during activities of daily living by a wearable set of inertial sensors","volume":"75","author":"Hedegaard","year":"2020","journal-title":"Med. Eng. Phys."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"1560","DOI":"10.1109\/ACCESS.2016.2547948","article-title":"Application of Micro-Doppler Signatures for Estimation of Total Energy Expenditure in Humans for Walking\/Running Activities","volume":"4","author":"Kim","year":"2016","journal-title":"IEEE Access"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"8263","DOI":"10.1109\/JSEN.2016.2519906","article-title":"Remote Quantification of Workout Energy Expenditure with a Cell Phone Camera","volume":"16","author":"Yang","year":"2016","journal-title":"IEEE Sens. J."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Koporec, G., Vu\u010dkovi\u0107, G., Mili\u0107, R., and Per\u0161, J. (2018). Quantitative contact-less estimation of energy expenditure from video and 3D imagery. Sensors, 18.","DOI":"10.3390\/s18082435"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"106216","DOI":"10.1016\/j.buildenv.2019.106216","article-title":"Development of a human metabolic rate prediction model based on the use of Kinect-camera generated visual data-driven approaches","volume":"160","author":"Na","year":"2019","journal-title":"Build. Environ."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"1086","DOI":"10.1109\/JBHI.2018.2840834","article-title":"Depth-Camera-Based System for Estimating Energy Expenditure of Physical Activities in Gyms","volume":"23","author":"Lin","year":"2019","journal-title":"IEEE J. Biomed. Health Inform."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"611","DOI":"10.1007\/s13244-018-0639-9","article-title":"Convolutional neural networks: An overview and application in radiology","volume":"9","author":"Yamashita","year":"2018","journal-title":"Insights Imaging"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"136","DOI":"10.1016\/j.apmr.2008.07.014","article-title":"Metabolic and mechanical energy costs of reducing vertical center of mass movement during gait","volume":"90","author":"Gordon","year":"2009","journal-title":"Arch. Phys. Med. Rehabil."},{"key":"ref_15","first-page":"42","article-title":"Human Action Recognition based on MSVM and Depth Images","volume":"11","author":"Taha","year":"2014","journal-title":"Int. J. Comput. Sci."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Livingston, M.A., Sebastian, J., Ai, Z., and Decker, J.W. (2012, January 4\u20138). Performance measurements for the Microsoft Kinect skeleton. Proceedings of the 2012 IEEE Virtual Reality Workshops (VRW), Costa Mesa, CA, USA.","DOI":"10.1109\/VR.2012.6180911"},{"key":"ref_17","unstructured":"Chou, Y.L. (1975). Statistical Analysis: With Business and Economic Applications, Holt McDougal."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"181","DOI":"10.1109\/TNSRE.2019.2953707","article-title":"Multivariate Analysis of Joint Motion Data by Kinect: Application to Parkinson\u2019s Disease","volume":"28","author":"Ren","year":"2020","journal-title":"IEEE Trans. Neural Syst. Rehabil. Eng."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"1437","DOI":"10.3390\/s120201437","article-title":"Accuracy and Resolution of Kinect Depth Data for Indoor Mapping Applications","volume":"12","author":"Khoshelham","year":"2012","journal-title":"Sensors"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Winter, D.A. (2009). Biomechanics and Motor Control of Human Movement, John Wiley & Sons, Inc.. [4th ed.].","DOI":"10.1002\/9780470549148"},{"key":"ref_21","unstructured":"Shlens, J.A. (2014). A Tutorial on Principal Component Analysis. arXiv."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/1961189.1961199","article-title":"LIBSVM: A library for support vector machines","volume":"2","author":"Chang","year":"2011","journal-title":"ACM Trans. Intell. Syst. Technol."},{"key":"ref_23","unstructured":"Hagan, M.T., Demuth, H.B., and Beale, M.H. (2014). Neural Network Design, Martin Hagan."},{"key":"ref_24","first-page":"40","article-title":"Deep Convolutional Neural Networks: Structure, Feature Extraction and Training","volume":"20","year":"2018","journal-title":"Inf. Technol. Manag. Sci."},{"key":"ref_25","unstructured":"Arora, R., Basu, A., Mianjy, P., and Mukherjee, A. (May, January 30). Understanding deep neural networks with rectified linear units. Proceedings of the 6th International Conference on Learning Representations 2018 (ICLR 2018), Vancouver, BC, Canada."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"137","DOI":"10.1007\/s11222-009-9153-8","article-title":"Estimation of prediction error by using K-fold cross-validation","volume":"21","author":"Fushiki","year":"2011","journal-title":"Stat. Comput."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Jain, L.C., and Medsker, L.R. (1999). Recurrent Neural Networks: Design and Applications, CRC Press, Inc.. [1st ed.].","DOI":"10.1201\/9781420049176"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"2673","DOI":"10.1109\/78.650093","article-title":"Bidirectional recurrent neural networks","volume":"45","author":"Schuster","year":"1997","journal-title":"IEEE Trans. Signal Process."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"1735","DOI":"10.1162\/neco.1997.9.8.1735","article-title":"Long Short-Term Memory","volume":"9","author":"Hochreiter","year":"1997","journal-title":"Neural Comput."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/12\/4216\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T06:19:27Z","timestamp":1760163567000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/12\/4216"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,6,19]]},"references-count":29,"journal-issue":{"issue":"12","published-online":{"date-parts":[[2021,6]]}},"alternative-id":["s21124216"],"URL":"https:\/\/doi.org\/10.3390\/s21124216","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,6,19]]}}}