{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,21]],"date-time":"2026-04-21T05:46:42Z","timestamp":1776750402433,"version":"3.51.2"},"reference-count":47,"publisher":"MDPI AG","issue":"16","license":[{"start":{"date-parts":[[2022,8,12]],"date-time":"2022-08-12T00:00:00Z","timestamp":1660262400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100003448","name":"General Secretariat for Research and Technology","doi-asserted-by":"publisher","award":["T6YB\u03a0-00238"],"award-info":[{"award-number":["T6YB\u03a0-00238"]}],"id":[{"id":"10.13039\/501100003448","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Ergonomic risk assessment is vital for identifying work-related human postures that can be detrimental to the health of a worker. Traditionally, ergonomic risks are reported by human experts through time-consuming and error-prone procedures; however, automatic algorithmic methods have recently started to emerge. To further facilitate the automatic ergonomic risk assessment, this paper proposes a novel variational deep learning architecture to estimate the ergonomic risk of any work-related task by utilizing the Rapid Entire Body Assessment (REBA) framework. The proposed method relies on the processing of RGB images and the extraction of 3D skeletal information that is then fed to a novel deep network for accurate and robust estimation of REBA scores for both individual body parts and the entire body. Through a variational approach, the proposed method processes the skeletal information to construct a descriptive skeletal latent space that can accurately model human postures. Moreover, the proposed method distills knowledge from ground truth ergonomic risk scores and leverages it to further enhance the discrimination ability of the skeletal latent space, leading to improved accuracy. Experiments on two well-known datasets (i.e., University of Washington Indoor Object Manipulation (UW-IOM) and Technische Universit\u00e4t M\u00fcnchen (TUM) Kitchen) validate the ability of the proposed method to achieve accurate results, overcoming current state-of-the-art methods.<\/jats:p>","DOI":"10.3390\/s22166051","type":"journal-article","created":{"date-parts":[[2022,8,15]],"date-time":"2022-08-15T23:44:03Z","timestamp":1660607043000},"page":"6051","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":25,"title":["Automatic Ergonomic Risk Assessment Using a Variational Deep Network Architecture"],"prefix":"10.3390","volume":"22","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-3014-1907","authenticated-orcid":false,"given":"Theocharis","family":"Chatzis","sequence":"first","affiliation":[{"name":"Visual Computing Lab, Information Technologies Institute, Centre for Research and Technology Hellas, VCL of CERTH\/ITI Hellas, 57001 Thessaloniki, Greece"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7391-6875","authenticated-orcid":false,"given":"Dimitrios","family":"Konstantinidis","sequence":"additional","affiliation":[{"name":"Visual Computing Lab, Information Technologies Institute, Centre for Research and Technology Hellas, VCL of CERTH\/ITI Hellas, 57001 Thessaloniki, Greece"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1584-7047","authenticated-orcid":false,"given":"Kosmas","family":"Dimitropoulos","sequence":"additional","affiliation":[{"name":"Visual Computing Lab, Information Technologies Institute, Centre for Research and Technology Hellas, VCL of CERTH\/ITI Hellas, 57001 Thessaloniki, Greece"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2022,8,12]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"73","DOI":"10.5271\/sjweh.1494","article-title":"A conceptual model for work-related neck and upper-limb musculoskeletal disorders","volume":"19","author":"Armstrong","year":"1993","journal-title":"Scand. J. Work Environ. Health"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"285","DOI":"10.1002\/ajim.20750","article-title":"Risk factors for work-related musculoskeletal disorders: A systematic review of recent longitudinal studies","volume":"53","author":"Vieira","year":"2010","journal-title":"Am. J. Ind. Med."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"4528","DOI":"10.1016\/j.promfg.2015.07.468","article-title":"A cross-sectional study on work-related musculoskeletal disorders and associated risk factors among hospital health cares","volume":"3","author":"Mirmohammadi","year":"2015","journal-title":"Procedia Manuf."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"190","DOI":"10.1093\/occmed\/kqi082","article-title":"Ergonomic methods for assessing exposure to risk factors for work-related musculoskeletal disorders","volume":"55","author":"David","year":"2005","journal-title":"Occup. Med."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1016\/0003-6870(93)90080-S","article-title":"RULA: A survey method for the investigation of work-related upper limb disorders","volume":"24","author":"McAtamney","year":"1993","journal-title":"Appl. Ergon."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"201","DOI":"10.1016\/S0003-6870(99)00039-3","article-title":"Rapid entire body assessment (REBA)","volume":"31","author":"Hignett","year":"2000","journal-title":"Appl. Ergon."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"616","DOI":"10.1080\/1463922X.2012.678283","article-title":"The European assembly worksheet","volume":"14","author":"Schaub","year":"2013","journal-title":"Theor. Issues Ergon. Sci."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"102882","DOI":"10.1016\/j.apergo.2019.102882","article-title":"Ergonomics assessment methods used by ergonomics professionals","volume":"81","author":"Lowe","year":"2019","journal-title":"Appl. Ergon."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Kee, D. (2022). Systematic Comparison of OWAS, RULA, and REBA Based on a Literature Review. Int. J. Environ. Res. Public Health, 19.","DOI":"10.3390\/ijerph19010595"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Micheletti Cremasco, M., Giustetto, A., Caffaro, F., Colantoni, A., Cavallo, E., and Grigolato, S. (2019). Risk assessment for musculoskeletal disorders in forestry: A comparison between RULA and REBA in the manual feeding of a wood-chipper. Int. J. Environ. Res. Public Health, 16.","DOI":"10.3390\/ijerph16050793"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Shezi, B., Street, R.A., Mathee, A., Cele, N., Ndabandaba, S., and Naidoo, R.N. (2021). Ergonomic Risk Assessment during an Informal Hand-Made Cookware Operation: Extending an Existing Model. Int. J. Environ. Res. Public Health, 18.","DOI":"10.3390\/ijerph18189459"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"420","DOI":"10.1016\/j.apergo.2013.05.010","article-title":"Comparison of concepts in easy-to-use methods for MSD risk assessment","volume":"45","year":"2014","journal-title":"Appl. Ergon."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"103574","DOI":"10.1016\/j.apergo.2021.103574","article-title":"The role of machine learning in the primary prevention of work-related musculoskeletal disorders: A scoping review","volume":"98","author":"Chan","year":"2022","journal-title":"Appl. Ergon."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"103732","DOI":"10.1016\/j.apergo.2022.103732","article-title":"A data analytic end-to-end framework for the automated quantification of ergonomic risk factors across multiple tasks using a single wearable sensor","volume":"102","author":"Lamooki","year":"2022","journal-title":"Appl. Ergon."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"103579","DOI":"10.1016\/j.apergo.2021.103579","article-title":"Manufacturing worker perceptions of using wearable inertial sensors for multiple work shifts","volume":"98","author":"Zhang","year":"2022","journal-title":"Appl. Ergon."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"3153","DOI":"10.1109\/LRA.2019.2925305","article-title":"Toward ergonomic risk prediction via segmentation of indoor object manipulation actions using spatiotemporal convolutional networks","volume":"4","author":"Parsa","year":"2019","journal-title":"IEEE Robot. Autom. Lett."},{"key":"ref_17","unstructured":"Konstantinidis, D., Dimitropoulos, K., and Daras, P. (July, January 29). Towards Real-Time Generalized Ergonomic Risk Assessment for the Prevention of Musculoskeletal Disorders. Proceedings of the 14th PErvasive Technologies Related to Assistive Environments Conference, Corfu, Greece."},{"key":"ref_18","unstructured":"Al-Radhi, M.S., Csap\u00f3, T.G., and N\u00e9meth, G. (2017, January 22\u201325). Continuous vocoder in feed-forward deep neural network based speech synthesis. Proceedings of the Digital Speech and Image Processing, Novi Sad, Serbia."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Mudiyanselage, S.E., Nguyen, P.H.D., Rajabi, M.S., and Akhavian, R. (2021). Automated Workers\u2019 Ergonomic Risk Assessment in Manual Material Handling Using sEMG Wearable Sensors and Machine Learning. Electronics, 10.","DOI":"10.3390\/electronics10202558"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"566","DOI":"10.1016\/j.apergo.2012.11.008","article-title":"Innovative system for real-time ergonomic feedback in industrial manufacturing","volume":"44","author":"Vignais","year":"2013","journal-title":"Appl. Ergon."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Tenorth, M., Bandouch, J., and Beetz, M. (October, January 27). The TUM kitchen data set of everyday manipulation activities for motion tracking and action recognition. Proceedings of the 2009 IEEE 12th International Conference on Computer Vision Workshops, ICCV Workshops, Kyoto, Japan.","DOI":"10.1109\/ICCVW.2009.5457583"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"2","DOI":"10.1016\/j.autcon.2016.11.007","article-title":"Wearable IMU-based real-time motion warning system for construction workers\u2019 musculoskeletal disorders prevention","volume":"74","author":"Yan","year":"2017","journal-title":"Autom. Constr."},{"key":"ref_23","unstructured":"Malais\u00e9, A., Maurice, P., Colas, F., Charpillet, F., and Ivaldi, S. (2018, January 25\u201329). Activity recognition with multiple wearable sensors for industrial applications. Proceedings of the ACHI 2018-Eleventh International Conference on Advances in Computer-Human Interactions, Rome, Italy."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"1132","DOI":"10.1109\/LRA.2019.2894389","article-title":"Activity recognition for ergonomics assessment of industrial tasks with automatic feature selection","volume":"4","author":"Maurice","year":"2019","journal-title":"IEEE Robot. Autom. Lett."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"96","DOI":"10.1016\/j.autcon.2017.10.010","article-title":"Wearable technology for personalized construction safety monitoring and trending: Review of applicable devices","volume":"85","author":"Awolusi","year":"2018","journal-title":"Autom. Constr."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"03119007","DOI":"10.1061\/(ASCE)CO.1943-7862.0001708","article-title":"Wearable sensing technology applications in construction safety and health","volume":"145","author":"Ahn","year":"2019","journal-title":"J. Constr. Eng. Manag."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Abobakr, A., Nahavandi, D., Iskander, J., Hossny, M., Nahavandi, S., and Smets, M. (2017, January 11\u201313). A kinect-based workplace postural analysis system using deep residual networks. Proceedings of the 2017 IEEE International Systems Engineering Symposium (ISSE), Vienna, Austria.","DOI":"10.1109\/SysEng.2017.8088272"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Parsa, B., and Dariush, B. (2020, January 1\u20135). Spatio-temporal pyramid graph convolutions for human action recognition and postural assessment. Proceedings of the IEEE\/CVF Winter Conference on Applications of Computer Vision, Village, CO, USA.","DOI":"10.1109\/WACV45572.2020.9093368"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Parsa, B., and Banerjee, A.G. (2021, January 5\u20139). A Multi-Task Learning Approach for Human Activity Segmentation and Ergonomics Risk Assessment. Proceedings of the IEEE\/CVF Winter Conference on Applications of Computer Vision, Waikoloa, HI, USA.","DOI":"10.1109\/WACV48630.2021.00240"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"1090","DOI":"10.1177\/1071181319631174","article-title":"A deep learning-based RULA method for working posture assessment","volume":"Volume 63","author":"Li","year":"2019","journal-title":"Proceedings of the Human Factors and Ergonomics Society Annual Meeting"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"103138","DOI":"10.1016\/j.apergo.2020.103138","article-title":"A novel vision-based real-time method for evaluating postural risk factors associated with musculoskeletal disorders","volume":"87","author":"Li","year":"2020","journal-title":"Appl. Ergon."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Li, C., and Lee, S. (2011, January 19\u201322). Computer vision techniques for worker motion analysis to reduce musculoskeletal disorders in construction. Proceedings of the Computing in Civil Engineering (2011), Miami, FL, USA.","DOI":"10.1061\/41182(416)47"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"562","DOI":"10.1016\/j.apergo.2016.10.015","article-title":"Validation of an ergonomic assessment method using Kinect data in real workplace conditions","volume":"65","author":"Plantard","year":"2017","journal-title":"Appl. Ergon."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Mehrizi, R., Peng, X., Tang, Z., Xu, X., Metaxas, D., and Li, K. (2018, January 15\u201319). Toward marker-free 3D pose estimation in lifting: A deep multi-view solution. Proceedings of the 2018 13th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2018), Xi\u2019an, China.","DOI":"10.1109\/FG.2018.00078"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Zhang, X., Xu, C., and Tao, D. (2020, January 14\u201319). Context aware graph convolution for skeleton-based action recognition. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.01434"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"9532","DOI":"10.1109\/TIP.2020.3028207","article-title":"Skeleton-based action recognition with multi-stream adaptive graph convolutional networks","volume":"29","author":"Shi","year":"2020","journal-title":"IEEE Trans. Image Process."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"103219","DOI":"10.1016\/j.cviu.2021.103219","article-title":"Skeleton-based action recognition via spatial and temporal transformer networks","volume":"208","author":"Plizzari","year":"2021","journal-title":"Comput. Vis. Image Underst."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Kocabas, M., Athanasiou, N., and Black, M.J. (2020, January 14\u201319). Vibe: Video inference for human body pose and shape estimation. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.00530"},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Lin, K., Wang, L., and Liu, Z. (2021, January 20\u201325). End-to-end human pose and mesh reconstruction with transformers. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Nashville, TN, USA.","DOI":"10.1109\/CVPR46437.2021.00199"},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Zhang, S., Liu, X., and Xiao, J. (2017, January 24\u201331). On geometric features for skeleton-based action recognition using multilayer lstm networks. Proceedings of the 2017 IEEE Winter Conference on Applications of Computer Vision (WACV), Santa Rosa, CA, USA.","DOI":"10.1109\/WACV.2017.24"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Konstantinidis, D., Dimitropoulos, K., and Daras, P. (2018, January 16\u201318). A deep learning approach for analyzing video and skeletal features in sign language recognition. Proceedings of the 2018 IEEE International Conference on Imaging Systems and Techniques (IST), Krakow, Poland.","DOI":"10.1109\/IST.2018.8577085"},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Konstantinidis, D., Dimitropoulos, K., and Daras, P. (2018, January 3\u20135). Sign language recognition based on hand and body skeletal data. Proceedings of the 2018-3DTV-Conference: The True Vision-Capture, Transmission and Display of 3D Video (3DTV-CON), Helsinki, Finland.","DOI":"10.1109\/3DTV.2018.8478467"},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Konstantinidis, D., Dimitropoulos, K., and Daras, P. (2018, January 3\u20137). Skeleton-based action recognition based on deep learning and Grassmannian pyramids. Proceedings of the 2018 26th European Signal Processing Conference (EUSIPCO), Rome, Italy.","DOI":"10.23919\/EUSIPCO.2018.8553163"},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Van Crombrugge, I., Sels, S., Ribbens, B., Steenackers, G., Penne, R., and Vanlanduit, S. (2022). Accuracy Assessment of Joint Angles Estimated from 2D and 3D Camera Measurements. Sensors, 22.","DOI":"10.3390\/s22051729"},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Theodoridis, T., Chatzis, T., Solachidis, V., Dimitropoulos, K., and Daras, P. (2020, January 14\u201319). Cross-Modal Variational Alignment of Latent Spaces. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition Workshops, Seattle, WA, USA.","DOI":"10.1109\/CVPRW50498.2020.00488"},{"key":"ref_46","unstructured":"Kingma, D.P., and Ba, J. (2015, January 7\u20139). Adam: A Method for Stochastic Optimization. Proceedings of the International Conference on Learning Representations, San Diego, CA, USA."},{"key":"ref_47","unstructured":"Paszke, A., Gross, S., Chintala, S., Chanan, G., Yang, E., DeVito, Z., Lin, Z., Desmaison, A., Antiga, L., and Lerer, A. (2017, January 4\u20139). Automatic differentiation in pytorch. Proceedings of the NIPS Workshop, Long Beach, CA, USA."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/16\/6051\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T00:08:09Z","timestamp":1760141289000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/16\/6051"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,8,12]]},"references-count":47,"journal-issue":{"issue":"16","published-online":{"date-parts":[[2022,8]]}},"alternative-id":["s22166051"],"URL":"https:\/\/doi.org\/10.3390\/s22166051","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,8,12]]}}}