{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,1]],"date-time":"2026-10-01T10:02:18Z","timestamp":1790848938179,"version":"4.1.0"},"reference-count":34,"publisher":"MDPI AG","issue":"4","license":[{"start":{"date-parts":[[2025,2,11]],"date-time":"2025-02-11T00:00:00Z","timestamp":1739232000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"European Union\u2019s Horizon Europe","award":["101099916"],"award-info":[{"award-number":["101099916"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Ensuring the accurate tracking of hand and fingers movements is an ongoing challenge for upper limb rehabilitation assessment, as the high number of degrees of freedom and segments in the limited volume of the hand makes this a difficult task. The objective of this study is to evaluate the performance of two markerless approaches (the Leap Motion Controller and the Google MediaPipe API) in comparison to a marker-based one, and to improve the precision of the markerless methods by introducing additional data processing algorithms fusing multiple recording devices. Fifteen healthy participants were instructed to perform five distinct hand movements while being recorded by the three motion capture methods simultaneously. The captured movement data from each device was analyzed using a skeletal model of the hand through the inverse kinematics method of the OpenSim software. Finally, the root mean square errors of the angles formed by each finger segment were calculated for the markerless and marker-based motion capture methods to compare their accuracy. Our results indicate that the MediaPipe-based setup is more accurate than the Leap Motion Controller-based one (average root mean square error of 10.9\u00b0 versus 14.7\u00b0), showing promising results for the use of markerless-based methods in clinical applications.<\/jats:p>","DOI":"10.3390\/s25041079","type":"journal-article","created":{"date-parts":[[2025,2,11]],"date-time":"2025-02-11T09:36:05Z","timestamp":1739266565000},"page":"1079","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":27,"title":["Optimisation and Comparison of Markerless and Marker-Based Motion Capture Methods for Hand and Finger Movement Analysis"],"prefix":"10.3390","volume":"25","author":[{"ORCID":"https:\/\/orcid.org\/0009-0009-5095-4279","authenticated-orcid":false,"given":"Valentin","family":"Maggioni","sequence":"first","affiliation":[{"name":"Contr\u00f4le Artificiel de Mouvements et de Neuroproth\u00e8ses Intuitives (CAMIN), Institut National de Recherche en Informatique et en Automatique (INRIA), Centre d\u2019Universit\u00e9 C\u00f4te d\u2019Azur, Universit\u00e9 de Montpellier, 34090 Montpellier, France"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7379-8004","authenticated-orcid":false,"given":"Christine","family":"Azevedo-Coste","sequence":"additional","affiliation":[{"name":"Contr\u00f4le Artificiel de Mouvements et de Neuroproth\u00e8ses Intuitives (CAMIN), Institut National de Recherche en Informatique et en Automatique (INRIA), Centre d\u2019Universit\u00e9 C\u00f4te d\u2019Azur, Universit\u00e9 de Montpellier, 34090 Montpellier, France"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sam","family":"Durand","sequence":"additional","affiliation":[{"name":"Contr\u00f4le Artificiel de Mouvements et de Neuroproth\u00e8ses Intuitives (CAMIN), Institut National de Recherche en Informatique et en Automatique (INRIA), Centre d\u2019Universit\u00e9 C\u00f4te d\u2019Azur, Universit\u00e9 de Montpellier, 34090 Montpellier, France"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7737-8269","authenticated-orcid":false,"given":"Fran\u00e7ois","family":"Bailly","sequence":"additional","affiliation":[{"name":"Contr\u00f4le Artificiel de Mouvements et de Neuroproth\u00e8ses Intuitives (CAMIN), Institut National de Recherche en Informatique et en Automatique (INRIA), Centre d\u2019Universit\u00e9 C\u00f4te d\u2019Azur, Universit\u00e9 de Montpellier, 34090 Montpellier, France"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2025,2,11]]},"reference":[{"key":"ref_1","unstructured":"Zhang, F., Bazarevsky, V., Vakunov, A., Tkachenka, A., Sung, G., Chang, C.L., and Grundmann, M. (2020). MediaPipe Hands: On-device Real-time Hand Tracking. arXiv."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Azevedo-Coste, C., William, L., Fonseca, L., Hiairrassary, A., Andreu, D., Geffrier, A., Teissier, J., Fattal, C., and Guiraud, D. (2022). Activating effective functional hand movements in individuals with complete tetraplegia through neural stimulation. Sci. Rep., 12.","DOI":"10.1038\/s41598-022-19906-x"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Novacek, T., Marty, C., and Jirina, M. (2021, January 20\u201322). Project MultiLeap: Fusing Data from Multiple Leap Motion Sensors. Proceedings of the 2021 IEEE 7th International Conference on Virtual Reality (ICVR), Foshan, China.","DOI":"10.1109\/ICVR51878.2021.9483819"},{"key":"ref_4","unstructured":"Goebl, W., and Palmer, C. (2009, January 15\u201318). Finger motion in piano performance: Touch and tempo. Proceedings of the International Symposium on Performance Science, Auckland, New Zealand."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Bailly, F., Ceglia, A., Michaud, B., Rouleau, D.M., and Begon, M. (2021). Real-time and dynamically consistent estimation of muscle forces using a moving horizon emg-marker tracking algorithm\u2014Application to upper limb biomechanics. Front. Bioeng. Biotechnol., 9.","DOI":"10.3389\/fbioe.2021.642742"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Krishna, S., P, V.V., and J, D.B. (2021, January 11\u201317). SignPose: Sign Language Animation Through 3D Pose Lifting. Proceedings of the 2021 IEEE\/CVF International Conference on Computer Vision Workshops (ICCVW), Montreal, BC, Canada.","DOI":"10.1109\/ICCVW54120.2021.00298"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"57","DOI":"10.1186\/s12984-023-01186-9","article-title":"A systematic review of the applications of markerless motion capture (MMC) technology for clinical measurement in rehabilitation","volume":"20","author":"Lam","year":"2023","journal-title":"J. Neuroeng. Rehabil."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Merriaux, P., Dupuis, Y., Boutteau, R., Vasseur, P., and Savatier, X. (2017). A Study of Vicon System Positioning Performance. Sensors, 17.","DOI":"10.3390\/s17071591"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"182","DOI":"10.1177\/0954411914522023","article-title":"Validity of a simple videogrammetric method to measure the movement of all hand segments for clinical purposes","volume":"228","author":"Vergara","year":"2014","journal-title":"Proc. Inst. Mech. Eng. Part H J. Eng. Med."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"44","DOI":"10.1016\/j.neuron.2020.09.017","article-title":"A Primer on Motion Capture with Deep Learning: Principles, Pitfalls, and Perspectives","volume":"108","author":"Mathis","year":"2020","journal-title":"Neuron"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"103275","DOI":"10.1016\/j.cviu.2021.103275","article-title":"A review of 3D human pose estimation algorithms for markerless motion capture","volume":"212","author":"Desmarais","year":"2021","journal-title":"Comput. Vis. Image Underst."},{"key":"ref_12","unstructured":"Bray, J. (2024, February 13). Markerless Based Human Motion Capture: A Survey. Computer Science, Engineering. Available online: https:\/\/citeseerx.ist.psu.edu\/document?repid=rep1&type=pdf&doi=6b31e5351901c6429c3d11c85c11420fee936911."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"231","DOI":"10.1006\/cviu.2000.0897","article-title":"A Survey of Computer Vision-Based Human Motion Capture","volume":"81","author":"Moeslund","year":"2001","journal-title":"Comput. Vis. Image Underst."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Yuan, S., Ye, Q., Stenger, B., Jain, S., and Kim, T.K. (2017, January 21\u201326). BigHand2.2M Benchmark: Hand Pose Dataset and State of the Art Analysis. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.279"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Steffensen, E.A., Magalh\u00e3es, F., Knarr, B.A., and Kingston, D.C. (2023). Comparison of markerless and marker-based motion capture of gait kinematics in individuals with cerebral palsy and chronic stroke: A case study series. Res. Sq.","DOI":"10.21203\/rs.3.rs-2557403\/v1"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Kanko, R.M., Laende, E.K., Davis, E.M., Selbie, W.S., and Deluzio, K.J. (2021). Concurrent assessment of gait kinematics using marker-based and markerless motion capture. J. Biomech., 127.","DOI":"10.1016\/j.jbiomech.2021.110665"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Nakano, N., Sakura, T., Ueda, K., Omura, L., Kimura, A., Iino, Y., Fukashiro, S., and Yoshioka, S. (2020). Evaluation of 3D Markerless Motion Capture Accuracy Using OpenPose with Multiple Video Cameras. Front. Sport. Act. Living, 2.","DOI":"10.3389\/fspor.2020.00050"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Albert, J., Owolabi, V., Gebel, A., Brahms, C., Granacher, U., and Arnrich, B. (2020). Evaluation of the Pose Tracking Performance of the Azure Kinect and Kinect v2 for Gait Analysis in Comparison with a Gold Standard: A Pilot Study. Sensors, 20.","DOI":"10.3390\/s20185104"},{"key":"ref_19","first-page":"3","article-title":"Efficient model-based 3D tracking of hand articulations using Kinect","volume":"1","author":"Oikonomidis","year":"2011","journal-title":"BmVC"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Amprimo, G., Masi, G., Pettiti, G., Olmo, G., Priano, L., and Ferraris, C. (2024). Hand tracking for clinical applications: Validation of the Google MediaPipe Hand (GMH) and the depth-enhanced GMH-D frameworks. Biomed. Signal Process. Control., 96.","DOI":"10.1016\/j.bspc.2024.106508"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"1742","DOI":"10.1016\/j.jbiomech.2016.04.006","article-title":"Validation of the Leap Motion Controller using markered motion capture technology","volume":"49","author":"Smeragliuolo","year":"2016","journal-title":"J. Biomech."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Geelen, J.E., Branco, M.P., Ramsey, N.F., van der Helm, F.C.T., Mugge, W., and Schouten, A.C. (2021, January 1\u20135). MarkerLess Motion Capture: ML-MoCap, a low-cost modular multi-camera setup. Proceedings of the 2021 43rd Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC), Virtual.","DOI":"10.1109\/EMBC46164.2021.9629749"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Gionfrida, L., Rusli, W.M.R., Bharath, A.A., and Kedgley, A.E. (2022). Validation of two-dimensional video-based inference of finger kinematics with pose estimation. PLoS ONE, 17.","DOI":"10.1101\/2022.06.22.497125"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"102474","DOI":"10.1016\/j.artmed.2022.102474","article-title":"A hand motion capture method based on infrared thermography for measuring fine motor skills in biomedicine","volume":"135","author":"Zhu","year":"2023","journal-title":"Artif. Intell. Med."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Houston, A., Walters, V., Corbett, T., and Coppack, R. (2021). Evaluation of a multi-sensor Leap Motion setup for biomechanical motion capture of the hand. J. Biomech., 127.","DOI":"10.1016\/j.jbiomech.2021.110713"},{"key":"ref_26","unstructured":"Majoni, N. (2024). Markerless Motion Capture for the Hands and Fingers. [Ph.D. Thesis, McMAster University]."},{"key":"ref_27","first-page":"23","article-title":"Markerless motion capture of hands and fingers in high-speed throwing task and its accuracy verification","volume":"10","author":"Kusafuka","year":"2023","journal-title":"Mech. Eng. J."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Ganguly, A., Rashidi, G., and Mombaur, K. (2021). Comparison of the Performance of the Leap Motion ControllerTM with a Standard Marker-Based Motion Capture System. Sensors, 21.","DOI":"10.3390\/s21051750"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Fatoni, M.H., Herneth, C., Li, J., Budiman, F., Ganguly, A., and Haddadin, S. (2024). Optimizing Interaction Space: Enlarging the Capture Volume for Multiple Portable Motion Capture Devices. arXiv.","DOI":"10.1109\/IROS58592.2024.10801852"},{"key":"ref_30","unstructured":"Karashchuk, P. (2024, September 16). lambdaloop\/anipose: V0.6.0. Available online: https:\/\/zenodo.org\/records\/3515764."},{"key":"ref_31","unstructured":"Maggioni, V., Azevedo-Coste, C., Durand, S., and Bailly, F. (2024, November 22). Experimental Dataset of Ecological Hand and Finger Movements for the Comparison of Markerless Motion Capture Systems, Available online: https:\/\/entrepot.recherche.data.gouv.fr\/dataset.xhtml?persistentId=doi:10.57745\/JQYAWK."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"1940","DOI":"10.1109\/TBME.2007.901024","article-title":"OpenSim: Open-Source Software to Create and Analyze Dynamic Simulations of Movement","volume":"54","author":"Delp","year":"2007","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"1424","DOI":"10.1109\/TBME.2022.3217722","article-title":"A Musculoskeletal Model of the Hand and Wrist Capable of Simulating Functional Tasks","volume":"70","author":"McFarland","year":"2023","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"2797320","DOI":"10.1155\/2024\/2797320","article-title":"A Survey on Convolutional Neural Networks and Their Performance Limitations in Image Recognition Tasks","volume":"2024","author":"Rangel","year":"2024","journal-title":"J. Sens."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/25\/4\/1079\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,9]],"date-time":"2025-10-09T16:31:26Z","timestamp":1760027486000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/25\/4\/1079"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,2,11]]},"references-count":34,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2025,2]]}},"alternative-id":["s25041079"],"URL":"https:\/\/doi.org\/10.3390\/s25041079","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,2,11]]}}}