{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,24]],"date-time":"2026-09-24T06:19:14Z","timestamp":1790230754865,"version":"4.1.0"},"reference-count":49,"publisher":"MDPI AG","issue":"21","license":[{"start":{"date-parts":[[2019,10,28]],"date-time":"2019-10-28T00:00:00Z","timestamp":1572220800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61976022"],"award-info":[{"award-number":["61976022"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Tracking detailed hand motion is a fundamental research topic in the area of human-computer interaction (HCI) and has been widely studied for decades. Existing solutions with single-model inputs either require tedious calibration, are expensive or lack sufficient robustness and accuracy due to occlusions. In this study, we present a real-time system to reconstruct the exact hand motion by iteratively fitting a triangular mesh model to the absolute measurement of hand from a depth camera under the robust restriction of a simple data glove. We redefine and simplify the function of the data glove to lighten its limitations, i.e., tedious calibration, cumbersome equipment, and hampering movement and keep our system lightweight. For accurate hand tracking, we introduce a new set of degrees of freedom (DoFs), a shape adjustment term for personalizing the triangular mesh model, and an adaptive collision term to prevent self-intersection. For efficiency, we extract a strong pose-space prior to the data glove to narrow the pose searching space. We also present a simplified approach for computing tracking correspondences without the loss of accuracy to reduce computation cost. Quantitative experiments show the comparable or increased accuracy of our system over the state-of-the-art with about 40% improvement in robustness. Besides, our system runs independent of Graphic Processing Unit (GPU) and reaches 40 frames per second (FPS) at about 25% Central Processing Unit (CPU) usage.<\/jats:p>","DOI":"10.3390\/s19214680","type":"journal-article","created":{"date-parts":[[2019,10,28]],"date-time":"2019-10-28T11:26:13Z","timestamp":1572261973000},"page":"4680","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":15,"title":["A Model-Based System for Real-Time Articulated Hand Tracking Using a Simple Data Glove and a Depth Camera"],"prefix":"10.3390","volume":"19","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-9162-7612","authenticated-orcid":false,"given":"Linjun","family":"Jiang","sequence":"first","affiliation":[{"name":"Beijing Key Laboratory of Network System Architecture and Convergence, School of Information and Communication Engineering, Beijing University of Posts and Telecommunications, Beijing 100876, China"},{"name":"Beijing Laboratory of Advanced Information Networks, Beijing 100876, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hailun","family":"Xia","sequence":"additional","affiliation":[{"name":"Beijing Key Laboratory of Network System Architecture and Convergence, School of Information and Communication Engineering, Beijing University of Posts and Telecommunications, Beijing 100876, China"},{"name":"Beijing Laboratory of Advanced Information Networks, Beijing 100876, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Caili","family":"Guo","sequence":"additional","affiliation":[{"name":"Beijing Key Laboratory of Network System Architecture and Convergence, School of Information and Communication Engineering, Beijing University of Posts and Telecommunications, Beijing 100876, China"},{"name":"Beijing Laboratory of Advanced Information Networks, Beijing 100876, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2019,10,28]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"244","DOI":"10.1145\/3130800.3130853","article-title":"Articulated distance fields for ultra-fast tracking of hands interacting","volume":"36","author":"Taylor","year":"2017","journal-title":"ACM Trans. Graphics (TOG)"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Malik, J., Elhayek, A., Nunnari, F., Varanasi, K., Tamaddon, K., Heloir, A., and Stricker, D. (2018, January 5\u20138). Deephps: End-to-end estimation of 3d hand pose and shape by learning from synthetic depth. Proceedings of the 2018 International Conference on 3D Vision (3DV), Verona, Italy.","DOI":"10.1109\/3DV.2018.00023"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Oberweger, M., and Lepetit, V. (2017, January 22\u201329). Deepprior++: Improving fast and accurate 3d hand pose estimation. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.","DOI":"10.1109\/ICCVW.2017.75"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Ballan, L., Taneja, A., Gall, J., Van Gool, L., and Pollefeys, M. (2012, January 7\u201313). Motion capture of hands in action using discriminative salient points. Proceedings of the European Conference on Computer Vision, Firenze, Italy.","DOI":"10.1007\/978-3-642-33783-3_46"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"222","DOI":"10.1145\/2980179.2980226","article-title":"Sphere-meshes for real-time hand modeling and tracking","volume":"35","author":"Tkach","year":"2016","journal-title":"ACM Trans. Graphics (TOG)"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Sharp, T., Keskin, C., Robertson, D., Taylor, J., Shotton, J., Kim, D., Rhemann, C., Leichter, I., Vinnikov, A., and Wei, Y. (2015, January 18\u201323). Accurate, robust, and flexible real-time hand tracking. Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, Seoul, Korea.","DOI":"10.1145\/2702123.2702179"},{"key":"ref_7","first-page":"2289","article-title":"Robust RGB-D hand tracking using deep learning priors","volume":"28","author":"Srinivasan","year":"2017","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"172","DOI":"10.1007\/s11263-016-0895-4","article-title":"Capturing Hands in Action using Discriminative Salient Points and Physics Simulation","volume":"118","author":"Tzionas","year":"2016","journal-title":"Int. J. Comput. Vision"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"31644","DOI":"10.3390\/s151229868","article-title":"Robust hand motion tracking through data fusion of 5DT data glove and nimble VR Kinect camera measurements","volume":"15","author":"Arkenbout","year":"2015","journal-title":"Sensors"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"2042","DOI":"10.1109\/JSEN.2018.2790801","article-title":"Sensor Fusion of Leap Motion Controller and Flex Sensors Using Kalman Filter for Human Finger Tracking","volume":"18","author":"Ponraj","year":"2018","journal-title":"IEEE Sens. J."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"461","DOI":"10.1109\/TSMCC.2008.923862","article-title":"A survey of glove-based systems and their applications","volume":"38","author":"Dipietro","year":"2008","journal-title":"IEEE Trans. Syst. Man Cybern. Part C Appl. Rev."},{"key":"ref_12","unstructured":"(2019, October 26). 5DT. Available online: http:\/\/5dt.com\/5dt-data-glove-ultra\/."},{"key":"ref_13","unstructured":"(2019, October 26). CyberGlove. Available online: http:\/\/www.cyberglovesystems.com\/."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Yuan, S., Ye, Q., Stenger, B., Jain, S., and Kim, T.K. (2017, January 22\u201325). Bighand2. 2m benchmark: Hand pose dataset and state of the art analysis. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.279"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Yuan, S., Garcia-Hernando, G., Stenger, B., Moon, G., Yong Chang, J., Mu Lee, K., Molchanov, P., Kautz, J., Honari, S., and Ge, L. (2018, January 18\u201322). Depth-based 3d hand pose estimation: From current achievements to future goals. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00279"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Tang, D., Yu, T.H., and Kim, T.K. (2013, January 1\u20138). Real-time articulated hand pose estimation using semi-supervised transductive regression forests. Proceedings of the IEEE International Conference on Computer Vision, Sydney, Australia.","DOI":"10.1109\/ICCV.2013.400"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"1374","DOI":"10.1109\/TPAMI.2016.2599170","article-title":"Latent Regression Forest: Structured Estimation of 3D Hand Poses","volume":"39","author":"Tang","year":"2017","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_18","unstructured":"Deng, X., Yang, S., Zhang, Y., Tan, P., Chang, L., and Wang, H. (2017). Hand3d: Hand pose estimation using 3d neural network. arXiv."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Guo, H., Wang, G., and Chen, X. (2016). Two-stream convolutional neural network for accurate rgb-d fingertip detection using depth and edge information. arXiv.","DOI":"10.1109\/ICIP.2016.7532831"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Rad, M., Oberweger, M., and Lepetit, V. (2018, January 18\u201322). Feature mapping for learning fast and accurate 3d pose inference from synthetic images. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00490"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Du, K., Lin, X., Sun, Y., and Ma, X. (2019, January 16\u201320). CrossInfoNet: Multi-Task Information Sharing Based Hand Pose Estimation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.01013"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Oberweger, M., Wohlhart, P., and Lepetit, V. (2019). Generalized Feedback Loop for Joint Hand-Object Pose Estimation. IEEE Trans. Pattern Anal. Mach. Intell.","DOI":"10.1109\/TPAMI.2019.2907951"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Qian, C., Sun, X., Wei, Y., Tang, X., and Sun, J. (2014, January 24\u201327). Realtime and robust hand tracking from depth. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA.","DOI":"10.1109\/CVPR.2014.145"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Sun, X., Wei, Y., Liang, S., Tang, X., and Sun, J. (2015, January 7\u201312). Cascaded hand pose regression. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298683"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"169","DOI":"10.1145\/2629500","article-title":"Real-time continuous pose recovery of human hands using convolutional networks","volume":"33","author":"Tompson","year":"2014","journal-title":"ACM Trans. Graphics (TOG)"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Wetzler, A., Slossberg, R., and Kimmel, R. (2015). Rule of thumb: Deep derotation for improved fingertip detection. arXiv.","DOI":"10.5244\/C.29.33"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"101","DOI":"10.1111\/cgf.12700","article-title":"Robust Articulated-ICP for Real-Time Hand Tracking","volume":"34","author":"Tagliasacchi","year":"2015","journal-title":"Comput. Graphics Forum (Symp. Geom. Process.)"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"143","DOI":"10.1145\/2897824.2925965","article-title":"Efficient and precise interactive hand tracking through joint, continuous optimization of pose and correspondences","volume":"35","author":"Taylor","year":"2016","journal-title":"ACM Trans. Graphics (TOG)"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Valentin, J., Dai, A., Nie\u00dfner, M., Kohli, P., Torr, P., Izadi, S., and Keskin, C. (2016, January 25\u201328). Learning to navigate the energy landscape. Proceedings of the 2016 Fourth International Conference on 3D Vision (3DV), Stanford, CA, USA.","DOI":"10.1109\/3DV.2016.41"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Taylor, J., Stebbing, R., Ramakrishna, V., Keskin, C., Shotton, J., Izadi, S., Hertzmann, A., and Fitzgibbon, A. (2014, January 24\u201327). User-specific hand modeling from monocular depth sequences. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA.","DOI":"10.1109\/CVPR.2014.88"},{"key":"ref_31","first-page":"3","article-title":"Efficient model-based 3D tracking of hand articulations using Kinect","volume":"1","author":"Oikonomidis","year":"2011","journal-title":"BMVC"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Fleishman, S., Kliger, M., Lerner, A., and Kutliroff, G. (2015, January 7\u201312). Icpik: Inverse kinematics based articulated-icp. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, Boston, MA, USA.","DOI":"10.1109\/CVPRW.2015.7301345"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Makris, A., and Argyros, A. (2015, January 7\u201310). Model-based 3D hand tracking with on-line hand shape adaptation. Proceedings of the BMVC, Swansea, UK.","DOI":"10.5244\/C.29.77"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Melax, S., Keselman, L., and Orsten, S. Dynamics based 3D skeletal hand tracking. Proceedings of the Graphics Interface 2013. In Proceedings of the Canadian Information Processing Society, Regina, SK, Canada, 29\u201331 May 2013.","DOI":"10.1145\/2448196.2448232"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Sridhar, S., Rhodin, H., Seidel, H.P., Oulasvirta, A., and Theobalt, C. (2014, January 8\u201311). Real-time hand tracking using a sum of anisotropic gaussians model. Proceedings of the 2014 2nd International Conference on 3D Vision, Tokyo, Japan.","DOI":"10.1109\/3DV.2014.37"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Khamis, S., Taylor, J., Shotton, J., Keskin, C., Izadi, S., and Fitzgibbon, A. (2015, January 7\u201312). Learning an efficient model of hand shape variation from depth images. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298869"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"239","DOI":"10.1007\/s10514-015-9462-z","article-title":"DART: dense articulated real-time tracking with consumer depth cameras","volume":"39","author":"Schmidt","year":"2015","journal-title":"Auton. Robots"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Joseph Tan, D., Cashman, T., Taylor, J., Fitzgibbon, A., Tarlow, D., Khamis, S., Izadi, S., and Shotton, J. (2016, January 27\u201330). Fits like a glove: Rapid and reliable hand shape personalization. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.605"},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Remelli, E., Tkach, A., Tagliasacchi, A., and Pauly, M. (2017, January 22\u201329). Low-dimensionality calibration through local anisotropic scaling for robust hand model personalization. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.","DOI":"10.1109\/ICCV.2017.277"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"243","DOI":"10.1145\/3130800.3130830","article-title":"Online generative model personalization for hand tracking","volume":"36","author":"Tkach","year":"2017","journal-title":"ACM Trans. Graphics (TOG)"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Tannous, H., Istrate, D., Benlarbi-Delai, A., Sarrazin, J., Gamet, D., Ho Ba Tho, M., and Dao, T. (2016). A new multi-sensor fusion scheme to improve the accuracy of knee flexion kinematics for functional rehabilitation movements. Sensors, 16.","DOI":"10.3390\/s16111914"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"797","DOI":"10.1007\/s11036-018-1008-0","article-title":"Gesture Recognition Based on Kinect and sEMG Signal Fusion","volume":"23","author":"Sun","year":"2018","journal-title":"Mob. Netw. Appl."},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Pacchierotti, C., Salvietti, G., Hussain, I., Meli, L., and Prattichizzo, D. (2016, January 8\u201311). The hRing: A wearable haptic device to avoid occlusions in hand tracking. Proceedings of the 2016 IEEE Haptics Symposium (HAPTICS), Philadelphia, PV, USA.","DOI":"10.1109\/HAPTICS.2016.7463167"},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"245","DOI":"10.1145\/3130800.3130883","article-title":"Embodied hands: Modeling and capturing hands and bodies together","volume":"36","author":"Romero","year":"2017","journal-title":"ACM Trans. Graphics (TOG)"},{"key":"ref_45","unstructured":"(2019, October 26). Sensfusion. Available online: http:\/\/www.sensfusion.com\/."},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Ganapathi, V., Plagemann, C., Koller, D., and Thrun, S. (2012, January 7\u201313). Real-time human pose tracking from range data. Proceedings of the European Conference on Computer Vision, Firenze, Italy.","DOI":"10.1007\/978-3-642-33783-3_53"},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Poier, G., Opitz, M., Schinagl, D., and Bischof, H. (2019, January 7\u201311). MURAUER: Mapping unlabeled real data for label austerity. Proceedings of the 2019 IEEE Winter Conference on Applications of Computer Vision (WACV), Hilton Waikoloa Village, HI, USA.","DOI":"10.1109\/WACV.2019.00153"},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Ge, L., Ren, Z., and Yuan, J. (2018, January 8\u201314). Point-to-point regression pointnet for 3d hand pose estimation. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.","DOI":"10.1109\/CVPR.2018.00878"},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"43425","DOI":"10.1109\/ACCESS.2018.2863540","article-title":"Shpr-net: Deep semantic hand pose regression from point clouds","volume":"6","author":"Chen","year":"2018","journal-title":"IEEE Access"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/19\/21\/4680\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T13:29:57Z","timestamp":1760189397000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/19\/21\/4680"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,10,28]]},"references-count":49,"journal-issue":{"issue":"21","published-online":{"date-parts":[[2019,11]]}},"alternative-id":["s19214680"],"URL":"https:\/\/doi.org\/10.3390\/s19214680","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,10,28]]}}}