{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,10]],"date-time":"2026-03-10T21:30:08Z","timestamp":1773178208287,"version":"3.50.1"},"reference-count":45,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2025,7,3]],"date-time":"2025-07-03T00:00:00Z","timestamp":1751500800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Virtual Worlds"],"abstract":"<jats:p>The advent of mixed reality (MR) systems has revolutionized human\u2013computer interactions by seamlessly integrating virtual elements with the real world. Devices like the HoloLens 2 (HL2) enable intuitive, hands-free interactions through advanced hand-tracking technology, making them valuable in fields such as education, healthcare, engineering, and training simulations. However, despite the growing adoption of MR, there is a noticeable lack of comprehensive comparisons between the hand-tracking accuracy of the HL2 and high-precision benchmarks like motion capture systems. Such evaluations are essential to assess the reliability of MR interactions, identify potential tracking limitations, and improve the overall precision of hand-based input in immersive applications. This study aims to assess the accuracy of HL2 in tracking hand position and measuring kinematic hand parameters, including joint angles and lateral pinch span (distance between thumb and index fingertips), using its tracking data. To achieve this, the Vicon motion capture system (VM) was used as a gold-standard reference. Three tasks were designed: (1) finger tracing of a 2D pattern in 3D space, (2) grasping various common objects, and (3) lateral pinching of objects with varying sizes. Task 1 tests fingertip tracking, Task 2 evaluates joint angle accuracy, and Task 3 examines the accuracy of pinch span measurement. In all tasks, HL2 and VM simultaneously recorded hand positions and movements. The data captured in Task 1 were analyzed to evaluate HL2\u2019s hand-tracking capabilities against VM. Finger rotation angles from Task 2 and lateral pinch span from Task 3 were then used to assess HL2\u2019s accuracy compared to VM. The results indicate that the HL2 exhibits millimeter-level errors compared to Vicon\u2019s tracking system in Task 1, spanning in a range from 2 mm to 4 mm, suggesting that HL2\u2019s hand-tracking system demonstrates good accuracy. Additionally, the reconstructed grasping positions in Task 2 from both systems show a strong correlation and an average error of 5\u00b0, while in Task 3, the accuracy of the HL2 is comparable to that of VM, improving performance as the object thickness increases.<\/jats:p>","DOI":"10.3390\/virtualworlds4030031","type":"journal-article","created":{"date-parts":[[2025,7,3]],"date-time":"2025-07-03T06:01:33Z","timestamp":1751522493000},"page":"31","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["Evaluation of HoloLens 2 for Hand Tracking and Kinematic Features Assessment"],"prefix":"10.3390","volume":"4","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-1452-146X","authenticated-orcid":false,"given":"Jessica","family":"Bertolasi","sequence":"first","affiliation":[{"name":"U-VIP: Unit for Visually Impaired People, Istituto Italiano di Tecnologia, Via Enrico Melen 83, 16152 Genoa, Italy"},{"name":"Department of Informatics, Bioengineering, Robotics and Systems Engineering, University of Genoa, Via All\u2019Opera Pia 13, 16145 Genoa, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Nadia Vanessa","family":"Garcia-Hernandez","sequence":"additional","affiliation":[{"name":"Department of Robotics and Advanced Manufacturing, Center for Research and Advanced Studies (CINVESTAV), Zona Industrial, Ramos Arizpe, Saltillo 25900, Mexico"},{"name":"Ministry of Science, Humanities, Technology and Innovation (SECIHTI), Avenida Insurgentes Sur 1582, Mexico City 03940, Mexico"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1766-7795","authenticated-orcid":false,"given":"Mariacarla","family":"Memeo","sequence":"additional","affiliation":[{"name":"Electronic Design Laboratory (EDL), Fondazione Istituto Italiano di Tecnologia, Via Enrico Melen 83, 16152 Genoa, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5433-6894","authenticated-orcid":false,"given":"Marta","family":"Guarischi","sequence":"additional","affiliation":[{"name":"U-VIP: Unit for Visually Impaired People, Istituto Italiano di Tecnologia, Via Enrico Melen 83, 16152 Genoa, Italy"},{"name":"Department of Informatics, Bioengineering, Robotics and Systems Engineering, University of Genoa, Via All\u2019Opera Pia 13, 16145 Genoa, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Monica","family":"Gori","sequence":"additional","affiliation":[{"name":"U-VIP: Unit for Visually Impaired People, Istituto Italiano di Tecnologia, Via Enrico Melen 83, 16152 Genoa, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2025,7,3]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"249","DOI":"10.1162\/pres.18.4.249","article-title":"On the Role of Presence in Mixed Reality","volume":"18","author":"Wagner","year":"2009","journal-title":"Presence Teleoper. Virtual Augment. Real."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"107289","DOI":"10.1016\/j.chb.2022.107289","article-title":"What is XR? Towards a Framework for Augmented and Virtual Reality","volume":"133","author":"Rauschnabel","year":"2022","journal-title":"Comput. Hum. Behav."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"680","DOI":"10.1111\/bjet.13049","article-title":"HoloLens and mobile augmented reality in medical and health science education: A randomised controlled trial","volume":"52","author":"Moro","year":"2021","journal-title":"Br. J. Educ. Technol."},{"key":"ref_4","first-page":"2","article-title":"Using Microsoft HoloLens to improve memory recall in anatomy and physiology: A pilot study to examine the efficacy of using augmented reality in education","volume":"12","author":"Chen","year":"2019","journal-title":"J. Educ. Technol. Dev. Exch."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"368","DOI":"10.1002\/ase.2049","article-title":"Virtual and Augmented Reality Enhancements to Medical and Science Student Physiology and Anatomy Test Performance: A Systematic Review and Meta-Analysis","volume":"14","author":"Moro","year":"2021","journal-title":"Anat. Sci. Educ."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"1143","DOI":"10.1007\/s00464-019-06862-3","article-title":"Effectiveness of the HoloLens mixed-reality headset in minimally invasive surgery: A simulation-based feasibility study","volume":"34","author":"Aydin","year":"2020","journal-title":"Surg. Endosc."},{"key":"ref_7","unstructured":"Hernandez, N.V.G., Buccelli, S., Laffranchi, M., and de Michieli, L. (2023, January 13\u201316). Mixed Reality-based Exergames for Upper Limb Robotic Rehabilitation. Proceedings of the Companion of the 2023 ACM\/IEEE International Conference on Human-Robot Interaction, Stockholm, Sweden."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"83","DOI":"10.20870\/IJVR.2009.8.2.2729","article-title":"Mixed Reality Entertainment and Art","volume":"8","author":"Cheok","year":"2009","journal-title":"Int. J. Virtual Real."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Park, S., Bokijonov, S., and Choi, Y. (2021). Review of Microsoft HoloLens Applications over the Past Five Years. Appl. Sci., 11.","DOI":"10.3390\/app11167259"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"312","DOI":"10.1016\/j.promfg.2021.10.044","article-title":"Comparing software frameworks of Augmented Reality solutions for manufacturing","volume":"55","author":"Kolla","year":"2021","journal-title":"Procedia Manuf."},{"key":"ref_11","unstructured":"Kupinski, M.A., and Nishikawa, R.M. (2007). Hologram Stability Evaluation for Microsoft HoloLens, SPIE."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Xu, C., Wang, Y., Quan, W., and Yang, H. (2020). Multi-Person Collaborative Interaction Algorithm and Application Based on HoloLens, Springer.","DOI":"10.1007\/978-981-13-9406-5_37"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Kern, F., Keser, T., Niebling, F., and Latoschik, M.E. (2021, January 8\u201310). Using Hand Tracking and Voice Commands to Physically Align Virtual Surfaces in AR for Handwriting and Sketching with HoloLens 2. Proceedings of the 27th ACM Symposium on Virtual Reality Software and Technology, Osaka, Japan.","DOI":"10.1145\/3489849.3489940"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"H\u00fcbner, P., Clintworth, K., Liu, Q., Weinmann, M., and Wursthorn, S. (2020). Evaluation of HoloLens Tracking and Depth Sensing for Indoor Mapping Applications. Sensors, 20.","DOI":"10.3390\/s20041021"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"164","DOI":"10.1007\/s10055-024-01059-z","article-title":"Assessment of Gamified Mixed Reality Environments for Upper Limb Robotic Rehabilitation: Pilot Study on Healthy Adults","volume":"28","author":"Buccelli","year":"2024","journal-title":"Virtual Real."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"S169","DOI":"10.1080\/10255842.2020.1714228","article-title":"Reliability of the head tracking measured by Microsoft Hololens during different walking conditions","volume":"22","author":"Guinet","year":"2019","journal-title":"Comput. Methods Biomech. Biomed. Eng."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Soares, I., Sousa, R.B., Petry, M., and Moreira, A.P. (2021). Accuracy and Repeatability Tests on HoloLens 2 and HTC Vive. Multimodal Technol. Interact., 5.","DOI":"10.20944\/preprints202108.0190.v1"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"1742","DOI":"10.1016\/j.jbiomech.2016.04.006","article-title":"Validation of the Leap Motion Controller using markered motion capture technology","volume":"49","author":"Smeragliuolo","year":"2016","journal-title":"J. Biomech."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Carnevale, A., Mannocchi, I., Sassi, M.S.H., Carli, M., De Luca, G., Longo, U.G., Denaro, V., and Schena, E. (2022). Virtual Reality for Shoulder Rehabilitation: Accuracy Evaluation of Oculus Quest 2. Sensors, 22.","DOI":"10.3390\/s22155511"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"1052","DOI":"10.3758\/s13428-022-02051-8","article-title":"A methodological framework to assess the accuracy of virtual reality hand-tracking systems: A case study with the Meta Quest 2","volume":"56","author":"Abdlkarim","year":"2023","journal-title":"Behav. Res. Methods"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"632","DOI":"10.1080\/17483107.2019.1688398","article-title":"Quantitative analysis of the Oculus Rift S in controlled movement","volume":"16","author":"Jost","year":"2021","journal-title":"Disabil. Rehabil. Assist. Technol."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"3798","DOI":"10.1109\/ACCESS.2020.3047698","article-title":"Dynamic Pose Tracking Performance Evaluation of HTC Vive Virtual Reality System","volume":"9","author":"Ikbal","year":"2021","journal-title":"IEEE Access"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"151","DOI":"10.1089\/g4h.2017.0114","article-title":"Comparison of Oculus Rift and HTC Vive: Feasibility for Virtual Reality-Based Exploration, Navigation, Exergaming, and Rehabilitation","volume":"7","author":"Borrego","year":"2018","journal-title":"Games Health J."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Chaconas, N., and Hollerer, T. (2018, January 18\u201322). An Evaluation of Bimanual Gestures on the Microsoft HoloLens. Proceedings of the 2018 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), Tuebingen\/Reutlingen, Germany.","DOI":"10.1109\/VR.2018.8446320"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Schneider, D., Biener, V., Otte, A., Gesslein, T., Gagel, P., Campos, C., Pucihar, K.\u010c., Kljun, M., Ofek, E., and Pahud, M. (2021, January 9\u201310). Accuracy Evaluation of Touch Tasks in Commodity Virtual and Augmented Reality Head-Mounted Displays. Proceedings of the 2021 ACM Symposium on Spatial User Interaction, Virtual. Art. No. 7.","DOI":"10.1145\/3485279.3485283"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Balakrishnan, P., and Guo, H.-J. (2024). HoloLens 2 Technical Evaluation as Mixed Reality Guide, Springer.","DOI":"10.1007\/978-3-031-61041-7_10"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"70","DOI":"10.1123\/jab.23.1.70","article-title":"Measurements of Wrist and Finger Postures: A Comparison of Goniometric and Motion Capture Techniques","volume":"23","author":"Cook","year":"2007","journal-title":"J. Appl. Biomech."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Yang, Y., Fermuller, C., Li, Y., and Aloimonos, Y. (2015, January 7\u201312). Grasp type revisited: A modern perspective on a classical feature for vision. Proceedings of the 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298637"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Hamon, P., Chablat, D., and Plestan, F. (2021). A New Robotic Hand Based on the Design of Fingers with Spatial Motions. Volume 8B, Proceedings of the 45th Mechanisms and Robotics Conference (MR), Virtual, 17\u201319 August 2021, American Society of Mechanical Engineers.","DOI":"10.1115\/DETC2021-70233"},{"key":"ref_30","unstructured":"The MathWorks Inc. (2024). MATLAB Version: 24.2.0 (r2024b), The MathWorks Inc."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"445","DOI":"10.1016\/j.gaitpost.2005.05.001","article-title":"Experimental protocol for the kinematic analysis of the hand: Definition and repeatability","volume":"23","author":"Carpinella","year":"2006","journal-title":"Gait Posture"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"239","DOI":"10.1109\/34.121791","article-title":"A method for registration of 3-D shapes","volume":"14","author":"Besl","year":"1992","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"981","DOI":"10.1016\/j.jbiomech.2004.05.042","article-title":"ISB recommendation on definitions of joint coordinate systems of various joints for the reporting of human joint motion\u2014Part II: Shoulder, elbow, wrist and hand","volume":"38","author":"Wu","year":"2005","journal-title":"J. Biomech."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"1165","DOI":"10.1109\/10.649988","article-title":"Surface-marker cluster design criteria for 3-D bone movement reconstruction","volume":"44","author":"Cappozzo","year":"1997","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"399","DOI":"10.1080\/01621459.1967.10482916","article-title":"On the Kolmogorov-Smirnov Test for Normality with Mean and Variance Unknown","volume":"62","author":"Lilliefors","year":"1967","journal-title":"J. Am. Stat. Assoc."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"240","DOI":"10.1098\/rspl.1895.0041","article-title":"Note on regression and inheritance in the case of two parents","volume":"58","author":"Pearson","year":"1895","journal-title":"Proc. R. Soc. Lond."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"72","DOI":"10.2307\/1412159","article-title":"The Proof and Measurement of Association between Two Things","volume":"15","author":"Spearman","year":"1904","journal-title":"Am. J. Psychol."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"451","DOI":"10.1152\/jn.91310.2008","article-title":"Recovery of Thumb and Finger Extension and Its Relation to Grasp Performance After Stroke","volume":"102","author":"Lang","year":"2009","journal-title":"J. Neurophysiol."},{"key":"ref_39","first-page":"1124","article-title":"Hand kinematics in osteoarthritis patients while performing functional activities","volume":"45","author":"Agost","year":"2022","journal-title":"Disabil. Rehabil."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"569","DOI":"10.1518\/0018720024496999","article-title":"Effect of Grip Span on Lateral Pinch Grip Strength","volume":"44","author":"Shivers","year":"2002","journal-title":"Hum. Factors J. Hum. Factors Ergon. Soc."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"1066","DOI":"10.1097\/PRS.0000000000003802","article-title":"Mixed Reality with HoloLens: Where Virtual Reality Meets Augmented Reality in the Operating Room","volume":"140","author":"Tepper","year":"2017","journal-title":"Plast. Reconstr. Surg."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"113558","DOI":"10.1016\/j.knosys.2025.113558","article-title":"A modified black-winged kite optimizer based on chaotic maps for global optimization of real-world applications","volume":"318","author":"Mansouri","year":"2025","journal-title":"Knowledge-Based Syst."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"313","DOI":"10.1007\/s10462-024-10857-5","article-title":"Improving the Kepler optimization algorithm with chaotic maps: Comprehensive performance evaluation and engineering applications","volume":"57","author":"Bencherqui","year":"2024","journal-title":"Artif. Intell. Rev."},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Mchichou, I., Ouchker, R., Tahiri, M.A., Amakdouf, H., Jamil, M.O., and Qjidaa, H. (2024, January 19\u201320). Enhanced Hybrid Approach for Real-Time Emotion Recognition Using Canny Edge Detection and Deep Learning on Embedded Systems. Proceedings of the 2024 3rd International Conference on Embedded Systems and Artificial Intelligence (ESAI), Fez, Morocco.","DOI":"10.1109\/ESAI62891.2024.10913599"},{"key":"ref_45","unstructured":"Bertolasi, J. Evaluation of HoloLens 2 for Hand Tracking and Kinematic Features Assessment."}],"container-title":["Virtual Worlds"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2813-2084\/4\/3\/31\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,9]],"date-time":"2025-10-09T18:03:46Z","timestamp":1760033026000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2813-2084\/4\/3\/31"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,7,3]]},"references-count":45,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2025,9]]}},"alternative-id":["virtualworlds4030031"],"URL":"https:\/\/doi.org\/10.3390\/virtualworlds4030031","relation":{},"ISSN":["2813-2084"],"issn-type":[{"value":"2813-2084","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,7,3]]}}}