{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,1]],"date-time":"2026-06-01T23:41:52Z","timestamp":1780357312670,"version":"3.54.1"},"reference-count":47,"publisher":"MDPI AG","issue":"7","license":[{"start":{"date-parts":[[2025,6,22]],"date-time":"2025-06-22T00:00:00Z","timestamp":1750550400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["J. Imaging"],"abstract":"<jats:p>Hand hygiene is paramount for public health, especially in critical sectors like healthcare and the food industry. Ensuring compliance with recommended hand washing gestures is vital, necessitating autonomous evaluation systems leveraging machine learning techniques. However, the scarcity of comprehensive datasets poses a significant challenge. This study addresses this issue by presenting an open synthetic hand washing dataset, created using 3D computer-generated imagery, comprising 96,000 frames (equivalent to 64 min of footage), encompassing eight gestures performed by four characters in four diverse environments. This synthetic dataset includes RGB images, depth\/isolated depth images and hand mask images. Using this dataset, four neural network models, Inception-V3, Yolo-8n, Yolo-8n segmentation and PointNet, were trained for gesture classification. The models were subsequently evaluated on a large real-world hand washing dataset, demonstrating successful classification accuracies of 56.9% for Inception-V3, 76.3% for Yolo-8n and 79.3% for Yolo-8n segmentation. These findings underscore the effectiveness of synthetic data in training machine learning models for hand washing gesture recognition.<\/jats:p>","DOI":"10.3390\/jimaging11070208","type":"journal-article","created":{"date-parts":[[2025,6,23]],"date-time":"2025-06-23T03:39:26Z","timestamp":1750649966000},"page":"208","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["Hand Washing Gesture Recognition Using Synthetic Dataset"],"prefix":"10.3390","volume":"11","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-7724-6848","authenticated-orcid":false,"given":"R\u00fcstem","family":"\u00d6zakar","sequence":"first","affiliation":[{"name":"Deparment of Computer Engineering, Faculty of Engineering and Architecture, Erzurum Technical University, Erzurum 25100, Turkey"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7212-5457","authenticated-orcid":false,"given":"Ey\u00fcp","family":"Gedikli","sequence":"additional","affiliation":[{"name":"Deparment of Computer Engineering, Faculty of Computer and Information Sciences, Trabzon University, Trabzon 61300, Turkey"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2025,6,22]]},"reference":[{"key":"ref_1","unstructured":"World Health Organization (2025, May 07). How to Handwash and Handrub. Available online: https:\/\/www.who.int\/multi-media\/details\/how-to-handwash-and-handrub."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"e209","DOI":"10.1016\/S1473-3099(21)00383-2","article-title":"Hand hygiene in health care: 20 years of ongoing advances and perspectives","volume":"21","author":"Lotfinejad","year":"2021","journal-title":"Lancet Infect. Dis."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"847","DOI":"10.1016\/j.ajic.2022.12.008","article-title":"Implementation of an electronic hand hygiene monitoring system: Learnings on how to maximize the investment","volume":"51","author":"McMullen","year":"2023","journal-title":"Am. J. Infect. Control"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"\u00d6zakar, R., and Gedikli, E. (2023). Evaluation of hand washing procedure using vision-based frame level and spatio-temporal level data models. Electronics, 12.","DOI":"10.3390\/electronics12092024"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"119588","DOI":"10.1016\/j.eswa.2023.119588","article-title":"Real-time hand rubbing quality estimation using deep learning enhanced by separation index and feature-based confidence metric","volume":"218","author":"Haghpanah","year":"2023","journal-title":"Exrt Syst. Appl."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Ju, S., and Reibman, A.R. (2024, January 7\u20139). Exploring the Impact of Hand Pose and Shadow on Hand-Washing Action Recognition. Proceedings of the 2024 IEEE 7th International Conference on Multimedia Information Processing and Retrieval (MIPR), San Jose, CA, USA.","DOI":"10.1109\/MIPR62202.2024.00073"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Lattanzi, E., and Calisti, L. (2023, January 10\u201312). Energy-aware tiny machine learning for sensor-based hand-washing recognition. Proceedings of the 2023 8th International Conference on Machine Learning Technologies, Stockholm, Sweden.","DOI":"10.1145\/3589883.3589886"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"3606","DOI":"10.1007\/s10489-024-05305-4","article-title":"ResMFuse-Net: Residual-based multilevel fused network with spatial\u2013temporal features for hand hygiene monitoring","volume":"54","author":"Asif","year":"2024","journal-title":"Appl. Intell."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Pepito, C.P.C., Aleluya, E.R.M., Alagon, F.J.A., Clar, S.E., Abayan, J.J.A., Salaan, C.J.O., and Bahinting, M.F.P. (2023, January 19\u201323). Mask, Hairnet, and Handwash Detection System for Food Manufacturing Health and Safety Monitoring. Proceedings of the 2023 IEEE 15th International Conference on Humanoid, Nanotechnology, Information Technology, Communication and Control, Environment, and Management (HNICEM), Coron, Philippines.","DOI":"10.1109\/HNICEM60674.2023.10589183"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Xie, T., Tian, J., and Ma, L. (2022). A vision-based hand hygiene monitoring approach using self-attention convolutional neural network. Biomed. Signal Process. Control, 76.","DOI":"10.1016\/j.bspc.2022.103651"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Lulla, M., Rutkovskis, A., Slavinska, A., Vilde, A., Gromova, A., Ivanovs, M., Skadins, A., Kadikis, R., and Elsts, A. (2021). Hand-washing video dataset annotated according to the world health organization\u2019s hand-washing guidelines. Data, 6.","DOI":"10.3390\/data6040038"},{"key":"ref_12","unstructured":"Nagaraj, A., Sood, M., Sureka, C., and Srinivasa, G. (2022). Real-time Action Recognition for Fine-Grained Actions and The Hand Wash Dataset. arXiv."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Mumuni, A., Mumuni, F., and Gerrar, N.K. (2024). A survey of synthetic data augmentation methods in computer vision. arXiv.","DOI":"10.1007\/s11633-022-1411-7"},{"key":"ref_14","unstructured":"Bauer, A., Trapp, S., Stenger, M., Leppich, R., Kounev, S., Leznik, M., Chard, K., and Foster, I. (2024). Comprehensive exploration of synthetic data generation: A survey. arXiv."},{"key":"ref_15","unstructured":"Ultralytics (2025, May 07). Yolo-8. Available online: https:\/\/docs.ultralytics.com\/models\/yolov8\/."},{"key":"ref_16","unstructured":"(2025, May 07). Blender. Available online: https:\/\/www.blender.org\/."},{"key":"ref_17","unstructured":"(2025, May 07). Makehuman. Available online: http:\/\/www.makehumancommunity.org\/."},{"key":"ref_18","unstructured":"(2025, May 07). Skin Resource 1. Available online: http:\/\/www.makehumancommunity.org\/skin\/kamden_skin.html\/."},{"key":"ref_19","unstructured":"(2025, May 07). Skin Resource 2. Available online: http:\/\/www.makehumancommunity.org\/clothes\/f_dress_11.html\/."},{"key":"ref_20","unstructured":"(2025, May 07). Hand Model. Available online: https:\/\/blenderartists.org\/t\/realistic-rigged-human-hand\/658854\/2\/."},{"key":"ref_21","unstructured":"(2025, May 07). OpenCV. Available online: https:\/\/opencv.org\/."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Zengeler, N., Kopinski, T., and Handmann, U. (2019). Hand gesture recognition in automotive human\u2013machine interaction using depth cameras. Sensors, 19.","DOI":"10.3390\/s19010059"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"2288","DOI":"10.1109\/JBHI.2022.3144917","article-title":"Estimating parkinsonism severity in natural gait videos of older adults with dementia","volume":"26","author":"Sabo","year":"2022","journal-title":"IEEE J. Biomed. Health Inform."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"617","DOI":"10.4218\/etrij.2021-0061","article-title":"Onboard dynamic RGB-D simultaneous localization and mapping for mobile robot navigation","volume":"43","author":"Canovas","year":"2021","journal-title":"ETRI J."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., and Wojna, Z. (2016, January 27\u201330). Rethinking the inception architecture for computer vision. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.308"},{"key":"ref_26","unstructured":"Qi, C.R., Su, H., Mo, K., and Guibas, L.J. (2017, January 21\u201326). PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Ge, L., Cai, Y., Weng, J., and Yuan, J. (2018, January 18\u201322). Hand pointnet: 3d hand pose estimation using point sets. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00878"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"3158","DOI":"10.1109\/TMI.2022.3180343","article-title":"Two-stage mesh deep learning for automated tooth segmentation and landmark localization on 3D intraoral scans","volume":"41","author":"Wu","year":"2022","journal-title":"IEEE Trans. Med. Imaging"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Cao, P., Chen, H., Zhang, Y., and Wang, G. (2019, January 22\u201325). Multi-view frustum pointnet for object detection in autonomous driving. Proceedings of the 2019 IEEE International Conference on Image Processing (ICIP), Taipei, Taiwan.","DOI":"10.1109\/ICIP.2019.8803572"},{"key":"ref_30","unstructured":"Kober, J., Ramos, F., and Tomlin, C. (2020, January 16\u201318). Learning Obstacle Representations for Neural Motion Planning. Proceedings of the 2020 Conference on Robot Learning, Virtual. PMLR, Proceedings of Machine Learning Research."},{"key":"ref_31","unstructured":"Kingma, D.P. (2014). Adam: A method for stochastic optimization. arXiv."},{"key":"ref_32","unstructured":"(2025, May 07). Tensorflow. Available online: https:\/\/www.tensorflow.org\/."},{"key":"ref_33","unstructured":"(2025, May 07). Keras. Available online: https:\/\/keras.io\/."},{"key":"ref_34","unstructured":"Howard, A.G. (2017). Mobilenets: Efficient convolutional neural networks for mobile vision applications. arXiv."},{"key":"ref_35","unstructured":"Zhou, Q.Y., Park, J., and Koltun, V. (2018). Open3D: A Modern Library for 3D Data Processing. arXiv."},{"key":"ref_36","unstructured":"Keras (2025, May 07). PointNet Keras Implementation. Available online: https:\/\/keras.io\/examples\/vision\/pointnet\/."},{"key":"ref_37","unstructured":"(2025, May 07). Scikit-Learn. Available online: https:\/\/scikit-learn.org\/stable\/."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"219","DOI":"10.1007\/s00138-009-0234-7","article-title":"A vision-based system for automatic hand washing quality assessment","volume":"22","author":"Llorca","year":"2011","journal-title":"Mach. Vis. Appl."},{"key":"ref_39","unstructured":"Xia, B., Dahyot, R., Ruttle, J., Caulfield, D., and Lacey, G. (2015, January 26\u201328). Hand hygiene poses recognition with rgb-d videos. Proceedings of the 17th Irish Machine Vision and Image Processing Conference, Irish Pattern Recognition & Classification Society, Dublin, Ireland."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Dietz, A., P\u00f6sch, A., and Reithmeier, E. (2018, January 13\u201315). Hand hygiene monitoring based on segmentation of interacting hands with convolutional networks. Proceedings of the Medical Imaging 2018: Imaging Informatics for Healthcare, Research, and Applications, SPIE, Houston, TX, USA.","DOI":"10.1117\/12.2294047"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Zhong, C., Reibman, A.R., Cordoba, H.M., and Deering, A.J. (2019, January 27\u201329). Hand-hygiene activity recognition in egocentric video. Proceedings of the 2019 IEEE 21st International Workshop on Multimedia Signal Processing (MMSP), Kuala Lumpur, Malaysia.","DOI":"10.1109\/MMSP.2019.8901753"},{"key":"ref_42","unstructured":"Ivanovs, M., Kadikis, R., Lulla, M., Rutkovskis, A., and Elsts, A. (2020). Automated quality assessment of hand washing using deep learning. arXiv."},{"key":"ref_43","unstructured":"Kim, M., Choi, J., and Kim, N. (2020). Fully automated hand hygiene monitoring in operating room using 3D convolutional neural network. arXiv."},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Prakasa, E., and Sugiarto, B. (2020, January 18\u201320). Video analysis on handwashing movement for the completeness evaluation. Proceedings of the 2020 International Conference on Radar, Antenna, Microwave, Electronics, and Telecommunications (ICRAMET), Virtual.","DOI":"10.1109\/ICRAMET51080.2020.9298612"},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Vo, H.Q., Do, T., Pham, V.C., Nguyen, D., Duong, A.T., and Tran, Q.D. (2021, January 17\u201320). Fine-grained hand gesture recognition in multi-viewpoint hand hygiene. Proceedings of the 2021 IEEE International Conference on Systems, Man, and Cybernetics (SMC), Melbourne, Australia.","DOI":"10.1109\/SMC52423.2021.9659180"},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Zhong, C., Reibman, A.R., Mina, H.A., and Deering, A.J. (2021). Designing a computer-vision application: A case study for hand-hygiene assessment in an open-room environment. J. Imaging, 7.","DOI":"10.3390\/jimaging7090170"},{"key":"ref_47","unstructured":"Ozakar, R. (2025, May 07). Github Repository. Available online: https:\/\/github.com\/r-ozakar."}],"container-title":["Journal of Imaging"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2313-433X\/11\/7\/208\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,9]],"date-time":"2025-10-09T17:56:44Z","timestamp":1760032604000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2313-433X\/11\/7\/208"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,6,22]]},"references-count":47,"journal-issue":{"issue":"7","published-online":{"date-parts":[[2025,7]]}},"alternative-id":["jimaging11070208"],"URL":"https:\/\/doi.org\/10.3390\/jimaging11070208","relation":{},"ISSN":["2313-433X"],"issn-type":[{"value":"2313-433X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,6,22]]}}}