{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T01:24:48Z","timestamp":1760145888601,"version":"build-2065373602"},"reference-count":31,"publisher":"MDPI AG","issue":"18","license":[{"start":{"date-parts":[[2024,9,17]],"date-time":"2024-09-17T00:00:00Z","timestamp":1726531200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Eshelman Institute of Innovation (UNC-CH)"},{"name":"QleanAir (Solna, Sweden)"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>(1) Background: As digital health technology evolves, the role of accurate medical-gloved hand tracking is becoming more important for the assessment and training of practitioners to reduce procedural errors in clinical settings. (2) Method: This study utilized computer vision for hand pose estimation to model skeletal hand movements during in situ aseptic drug compounding procedures. High-definition video cameras recorded hand movements while practitioners wore medical gloves of different colors. Hand poses were manually annotated, and machine learning models were developed and trained using the DeepLabCut interface via an 80\/20 training\/testing split. (3) Results: The developed model achieved an average root mean square error (RMSE) of 5.89 pixels across the training data set and 10.06 pixels across the test set. When excluding keypoints with a confidence value below 60%, the test set RMSE improved to 7.48 pixels, reflecting high accuracy in hand pose tracking. (4) Conclusions: The developed hand pose estimation model effectively tracks hand movements across both controlled and in situ drug compounding contexts, offering a first-of-its-kind medical glove hand tracking method. This model holds potential for enhancing clinical training and ensuring procedural safety, particularly in tasks requiring high precision such as drug compounding.<\/jats:p>","DOI":"10.3390\/s24186005","type":"journal-article","created":{"date-parts":[[2024,9,18]],"date-time":"2024-09-18T01:16:10Z","timestamp":1726622170000},"page":"6005","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Enhanced 2D Hand Pose Estimation for Gloved Medical Applications: A Preliminary Model"],"prefix":"10.3390","volume":"24","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-4213-3349","authenticated-orcid":false,"given":"Adam W.","family":"Kiefer","sequence":"first","affiliation":[{"name":"Department of Exercise and Sport Science, University of North Carolina at Chapel Hill, Chapel Hill, NC 27599, USA"},{"name":"Human Movement Science Curriculum, University of North Carolina at Chapel Hill, Chapel Hill, NC 27599, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Dominic","family":"Willoughby","sequence":"additional","affiliation":[{"name":"Human Movement Science Curriculum, University of North Carolina at Chapel Hill, Chapel Hill, NC 27599, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ryan P.","family":"MacPherson","sequence":"additional","affiliation":[{"name":"Department of Exercise and Sport Science, University of North Carolina at Chapel Hill, Chapel Hill, NC 27599, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2637-0918","authenticated-orcid":false,"given":"Robert","family":"Hubal","sequence":"additional","affiliation":[{"name":"Renaissance Computing Institute, University of North Carolina at Chapel Hill, Chapel Hill, NC 27599, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7214-6477","authenticated-orcid":false,"given":"Stephen F.","family":"Eckel","sequence":"additional","affiliation":[{"name":"Eshelman School of Pharmacy, University of North Carolina at Chapel Hill, Chapel Hill, NC 27599, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2024,9,17]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"5274","DOI":"10.1007\/s00464-023-09983-y","article-title":"Tracking and evaluating motion skills in laparoscopy with inertial sensors","volume":"37","author":"Heiliger","year":"2023","journal-title":"Surg. Endosc."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"251","DOI":"10.1097\/SIH.0000000000000423","article-title":"Developing a Profile of Procedural Expertise: A Simulation Study of Tracheal Intubation Using 3-Dimensional Motion Capture","volume":"15","author":"Kerrey","year":"2020","journal-title":"Simul. Healthc."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"872","DOI":"10.1177\/000313481608201002","article-title":"Surgical Hand Tracking in Open Surgery Using a Versatile Motion Sensing System: Are We There Yet?","volume":"82","author":"Genovese","year":"2016","journal-title":"Am. Surg."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Deng, Z., Xiang, N., and Pan, J. (2023). State of the Art in Immersive Interactive Technologies for Surgery Simulation: A Review and Prospective. Bioengineering, 10.","DOI":"10.3390\/bioengineering10121346"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"972","DOI":"10.1002\/bjs.7115","article-title":"Objective assessment of technical surgical skills","volume":"97","author":"Tuijthof","year":"2010","journal-title":"Br. J. Surg."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"212","DOI":"10.1111\/acem.12590","article-title":"The Development and Validation of Hand Motion Analysis to Evaluate Competency in Central Line Catheterization","volume":"22","author":"Clinkard","year":"2015","journal-title":"Acad. Emerg. Med."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"226","DOI":"10.1016\/j.jvir.2020.10.010","article-title":"Analysis of Kinematic Differences in Hand Motion between Novice and Experienced Operators in IR: A Pilot Study","volume":"32","author":"Weinstein","year":"2021","journal-title":"J. Vasc. Interv. Radiol."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/s10916-021-01735-6","article-title":"A Novel Suture Training System for Open Surgery Replicating Procedures Performed by Experts Using Augmented Reality","volume":"45","author":"Nagayo","year":"2021","journal-title":"J. Med. Syst."},{"key":"ref_9","unstructured":"(2024, April 23). Feasibility of Tracking in Open Surgical Simulation. Available online: https:\/\/www.ijohs.com\/read\/article\/webpdf\/contents-1669131551342-87e055cc-de77-4aed-b154-f680142856b2."},{"key":"ref_10","unstructured":"(2024, April 23). New England Compounding Center Meningitis Outbreak-Wikipedia. Available online: https:\/\/en.wikipedia.org\/wiki\/New_England_Compounding_Center_meningitis_outbreak."},{"key":"ref_11","unstructured":"Cabelka, C. (2024, April 23). Novel Technologies for the Evaluation of Sterile Compounding Technique. Available online: https:\/\/cdr.lib.unc.edu\/concern\/honors_theses\/k0698k02w."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Oudah, M., Al-Naji, A., and Chahl, J. (2020). Hand Gesture Recognition Based on Computer Vision: A Review of Techniques. J. Imaging, 6.","DOI":"10.3390\/jimaging6080073"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"412","DOI":"10.1017\/cem.2017.337","article-title":"Tracking Motion Devices as Assessment Tools in Anesthesia Procedures: Have We Been Using Them Well?","volume":"19","author":"Corvetto","year":"2017","journal-title":"Can. J. Emerg. Med."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Kaur, H., and Rani, J. (2016, January 4\u20136). A review: Study of various techniques of Hand gesture recognition. Proceedings of the 1st IEEE International Conference on Power Electronics, Intelligent Control and Energy Systems, ICPEICES 2016, Delhi, India.","DOI":"10.1109\/ICPEICES.2016.7853514"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"17","DOI":"10.1007\/s11265-015-1090-5","article-title":"Real-time Motion-based Hand Gestures Recognition from Time-of-Flight Video","volume":"86","author":"Molina","year":"2017","journal-title":"J. Signal Process. Syst."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"102","DOI":"10.1016\/j.patcog.2015.07.014","article-title":"A novel finger and hand pose estimation technique for real-time hand gesture recognition","volume":"49","author":"Zhou","year":"2016","journal-title":"Pattern Recognit"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"54","DOI":"10.1016\/j.engappai.2014.06.006","article-title":"Real time hand detection in a complex background","volume":"35","author":"Stergiopoulou","year":"2014","journal-title":"Eng. Appl. Artif. Intell."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Devineau, G., Moutarde, F., Xi, W., and Yang, J. (2018, January 15\u201319). Deep learning for hand gesture recognition on skeletal data. Proceedings of the 13th IEEE International Conference on Automatic Face and Gesture Recognition, FG 2018, Xi\u2019an, China.","DOI":"10.1109\/FG.2018.00025"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"108044","DOI":"10.1016\/j.patcog.2021.108044","article-title":"Normalized edge convolutional networks for skeleton-based hand gesture recognition","volume":"118","author":"Guo","year":"2021","journal-title":"Pattern Recognit."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"80","DOI":"10.1016\/j.patcog.2017.10.033","article-title":"Convolutional Neural Networks and Long Short-Term Memory for skeleton-based human activity and hand gesture recognition","volume":"76","author":"Cabido","year":"2018","journal-title":"Pattern Recognit."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Zhong, E., Del-Blanco, C.R., Berj\u00f3n, D., Jaureguizar, F., and Garc\u00eda, N. (2023). Real-Time Monocular Skeleton-Based Hand Gesture Recognition Using 3D-Jointsformer. Sensors, 23.","DOI":"10.3390\/s23167066"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"799","DOI":"10.1007\/s11548-021-02369-2","article-title":"Towards markerless surgical tool and hand pose estimation","volume":"16","author":"Hein","year":"2021","journal-title":"Int. J. Comput. Assist. Radiol. Surg."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Peng, S., Liu, Y., Huang, Q., Zhou, X., and Bao, H. (2019, January 15\u201320). Pvnet: Pixel-wise voting network for 6dof pose estimation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00469"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"245","DOI":"10.1145\/3130800.3130883","article-title":"Embodied hands: Modeling and capturing hands and bodies together","volume":"36","author":"Romero","year":"2017","journal-title":"ACM Trans. Graph (ToG)"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Hasson, Y., Tekin, B., Bogo, F., Laptev, I., Pollefeys, M., and Schmid, C. (2020, January 13\u201319). Leveraging photometric consistency over time for sparsely supervised hand-object reconstruction. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.00065"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"2253","DOI":"10.1007\/s11548-022-02688-y","article-title":"HMD-EgoPose: Head-mounted display-based egocentric marker-less tool and hand pose estimation for augmented surgical guidance","volume":"17","author":"Doughty","year":"2022","journal-title":"Int. J. Comput. Assist. Radiol. Surg."},{"key":"ref_27","unstructured":"Jocher, G.R. (2024, August 30). ultralytics\/yolov5. GitHub. Available online: https:\/\/github.com\/ultralytics\/yolov5."},{"key":"ref_28","unstructured":"Tan, M., and Le, Q. (2019, January 9\u201315). EfficientNet: Rethinking model scaling for convolutional neural networks. Proceedings of the 36th International Conference on Machine Learning. Proceedings of Machine Learning Research, Long Beach, CA, USA."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"1477","DOI":"10.1007\/s11548-022-02637-9","article-title":"Robust hand tracking for surgical telestration","volume":"17","author":"Petersen","year":"2022","journal-title":"Int. J. Comput. Assist. Radiol. Surg."},{"key":"ref_30","unstructured":"Zhang, F., Bazarevsky, V., Vakunov, A., Tkachenka, A., Sung, G., Chang, C.L., and Grundmann, M. (2020). MediaPipe Hands: On-device Real-time Hand Tracking. arXiv."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"496","DOI":"10.1038\/s41592-022-01443-0","article-title":"Multi-animal pose estimation, identification and tracking with DeepLabCut","volume":"19","author":"Lauer","year":"2022","journal-title":"Nat. Methods"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/24\/18\/6005\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T15:57:40Z","timestamp":1760111860000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/24\/18\/6005"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,9,17]]},"references-count":31,"journal-issue":{"issue":"18","published-online":{"date-parts":[[2024,9]]}},"alternative-id":["s24186005"],"URL":"https:\/\/doi.org\/10.3390\/s24186005","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2024,9,17]]}}}