{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,21]],"date-time":"2026-05-21T14:14:38Z","timestamp":1779372878735,"version":"3.53.1"},"reference-count":54,"publisher":"MDPI AG","issue":"22","license":[{"start":{"date-parts":[[2025,11,11]],"date-time":"2025-11-11T00:00:00Z","timestamp":1762819200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100007129","name":"Shandong Provincial Natural Science Foundation","doi-asserted-by":"publisher","award":["ZR2022ME203"],"award-info":[{"award-number":["ZR2022ME203"]}],"id":[{"id":"10.13039\/501100007129","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>To precisely understand the interaction behaviors of humans, a computer vision system needs to accurately acquire the poses of the hand and its manipulated object. Vision-based hand\u2013object pose estimation has become an important research topic. However, it is still a challenging task due to severe occlusion. In this study, a hand\u2013object pose estimation method based on anchor regression is proposed to address this problem. First, a hand\u2013object 3D center detection method was established to extract hand\u2013object foreground images from the original depth images. Second, a method based on anchor regression is proposed to simultaneously estimate the poses of the hand and object in a single framework. A convolutional neural network with ResNet-50 as the backbone was built to predict the position deviations and weights of the uniformly distributed anchor points in the image to the keypoints of the hand and the manipulated object. According to the experimental results on the FPHA-HO dataset, the mean keypoint errors of the hand and object of the proposed method were 11.85 mm and 18.97 mm, respectively. The proposed hand\u2013object pose estimation method can accurately estimate the poses of the hand and the manipulated object based on a single egocentric depth image.<\/jats:p>","DOI":"10.3390\/s25226881","type":"journal-article","created":{"date-parts":[[2025,11,11]],"date-time":"2025-11-11T12:44:55Z","timestamp":1762865095000},"page":"6881","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["Hand\u2013Object Pose Estimation Based on Anchor Regression from a Single Egocentric Depth Image"],"prefix":"10.3390","volume":"25","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-9241-5160","authenticated-orcid":false,"given":"Jingang","family":"Lin","sequence":"first","affiliation":[{"name":"School of Mechanical and Automotive Engineering, Qingdao University of Technology, Qingdao 266520, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0327-5205","authenticated-orcid":false,"given":"Dongnian","family":"Li","sequence":"additional","affiliation":[{"name":"School of Mechanical and Automotive Engineering, Qingdao University of Technology, Qingdao 266520, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3185-1062","authenticated-orcid":false,"given":"Chengjun","family":"Chen","sequence":"additional","affiliation":[{"name":"School of Mechanical and Automotive Engineering, Qingdao University of Technology, Qingdao 266520, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zhengxu","family":"Zhao","sequence":"additional","affiliation":[{"name":"School of Mechanical and Automotive Engineering, Qingdao University of Technology, Qingdao 266520, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2025,11,11]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Ge, L., Liang, H., Yuan, J., and Thalmann, D. (2016, January 27\u201330). Robust 3D hand pose estimation in single depth images: From single-view CNN to multi-view CNNs. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.391"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Li, S., and Lee, D. (2019, January 15\u201320). Point-to-pose voting based hand pose estimation using residual permutation equivariant layer. Proceedings of the 2019 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.01220"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"527","DOI":"10.1109\/TCYB.2017.2779800","article-title":"Hough forest with optimized leaves for global hand pose estimation with arbitrary postures","volume":"49","author":"Liang","year":"2019","journal-title":"IEEE Trans. Cybern."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Ge, L., Cai, Y., Weng, J., and Yuan, J. (2018, January 18\u201323). Hand PointNet: 3D hand pose estimation using point sets. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00878"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Yuan, S., Garcia-Hernando, G., Stenger, B., Moon, G., Chang, J.Y., Lee, K.M., Molchanov, P., Kautz, J., Honari, S., and Ge, L. (2018, January 18\u201323). Depth-based 3D hand pose estimation: From current achievements to future goals. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00279"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Ge, L., Liang, H., Yuan, J., and Thalmann, D. (2017, January 21\u201326). 3D convolutional neural networks for efficient and robust hand pose estimation from single depth images. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.602"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Kanis, J., Gruber, I., Kr\u0148oul, Z., Boh\u00e1\u010dek, M., Straka, J., and Hr\u00faz, M. (2023). MuTr: Multi-stage transformer for hand pose estimation from full-scene depth image. Sensors, 23.","DOI":"10.3390\/s23125509"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Tekin, B., Sinha, S.N., and Fua, P. (2018, January 18\u201323). Real-time seamless single shot 6D object pose prediction. Proceedings of the 2018 IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00038"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Xiang, Y., Schmidt, T., Narayanan, V., and Fox, D. (2017). PoseCNN: A convolutional neural network for 6D object pose estimation in cluttered scenes. arXiv.","DOI":"10.15607\/RSS.2018.XIV.019"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Costanzo, M., De Simone, M., Federico, S., and Natale, C. (2023). Non-prehensile manipulation actions and visual 6D pose estimation for fruit grasping based on tactile sensing. Robotics, 12.","DOI":"10.3390\/robotics12040092"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Alterani, A.B., Costanzo, M., De Simone, M., Federico, S., and Natale, C. (2024). Experimental comparison of two 6D pose estimation algorithms in robotic fruit-picking tasks. Robotics, 13.","DOI":"10.3390\/robotics13090127"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Li, S., Wang, H., and Lee, D. (August, January 31). Hand pose estimation for hand-object interaction cases using augmented autoencoder. Proceedings of the 2020 IEEE International Conference on Robotics and Automation (ICRA), Paris, France.","DOI":"10.1109\/ICRA40945.2020.9197299"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Sridhar, S., Mueller, F., Zollh\u00f6fer, M., Casas, D., Oulasvirta, A., and Theobalt, C. (2016, January 11\u201314). Real-time joint tracking of a hand manipulating an object from RGB-D input. Proceedings of the European Conference on Computer Vision, Amsterdam, The Netherlands.","DOI":"10.1007\/978-3-319-46475-6_19"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Oikonomidis, I., Kyriazis, N., and Argyros, A.A. (2011, January 6\u201313). Full DOF tracking of a hand interacting with an object by modeling occlusions and physical constraints. Proceedings of the 2011 International Conference on Computer Vision, Barcelona, Spain.","DOI":"10.1109\/ICCV.2011.6126483"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Ballan, L., Taneja, A., Gall, J., Van Gool, L., and Pollefeys, M. (2012, January 7\u201313). Motion capture of hands in action using discriminative salient points. Proceedings of the European Conference on Computer Vision (ECCV), Florence, Italy.","DOI":"10.1007\/978-3-642-33783-3_46"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"172","DOI":"10.1007\/s11263-016-0895-4","article-title":"Capturing hands in action using discriminative salient points and physics simulation","volume":"118","author":"Tzionas","year":"2016","journal-title":"Int. J. Comput. Vision"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Kyriazis, N., and Argyros, A. (2013, January 23\u201328). Physically plausible 3D scene tracking: The single actor hypothesis. Proceedings of the 2013 IEEE Conference on Computer Vision and Pattern Recognition, Portland, OR, USA.","DOI":"10.1109\/CVPR.2013.9"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"6745","DOI":"10.1007\/s11042-018-6452-0","article-title":"Tracking a hand in interaction with an object based on single depth images","volume":"78","author":"Li","year":"2019","journal-title":"Multimed. Tools Appl."},{"key":"ref_19","unstructured":"Lepetit, V. (2020). Recent advances in 3D object and hand pose estimation. arXiv."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Xiong, F., Zhang, B., Xiao, Y., Cao, Z., Yu, T., Zhou, J.T., and Yuan, J. (November, January 27). A2J: Anchor-to-joint regression network for 3D articulated pose estimation from a single depth image. Proceedings of the 2019 IEEE\/CVF International Conference on Computer Vision (ICCV), Seoul, Republic of Korea.","DOI":"10.1109\/ICCV.2019.00088"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"1898","DOI":"10.1109\/TPAMI.2019.2907951","article-title":"Generalized feedback loop for joint hand-object pose estimation","volume":"42","author":"Oberweger","year":"2020","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Tekin, B., Bogo, F., and Pollefeys, M. (2019, January 15\u201320). H+O: Unified egocentric recognition of 3D hand-object poses and interactions. Proceedings of the 2019 IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00464"},{"key":"ref_23","unstructured":"Redmon, J., and Farhadi, A. (2018). YOLOv3: An incremental improvement. arXiv."},{"key":"ref_24","unstructured":"Oberweger, M., Wohlhart, P., and Lepetit, V. (2015). Hands deep in deep learning for hand pose estimation. arXiv."},{"key":"ref_25","unstructured":"Zhou, W. (2020). 3D Hand Pose Estimation Using Depth Images. [Ph.D. Thesis, Harbin Institute of Technology]. (In Chinese)."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Armagan, A., Garcia-Hernando, G., Baek, S., Hampali, S., Rad, M., Zhang, Z., Xie, S., Chen, M., Zhang, B., and Xiong, F. (2020, January 23\u201328). Measuring generalisation to unseen viewpoints, articulations, shapes and objects for 3D hand pose estimation under hand-object interaction. Proceedings of the 16th European Conference on Computer Vision (ECCV), Glasgow, UK.","DOI":"10.1007\/978-3-030-58592-1_6"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"30","DOI":"10.29019\/enfoqueute.1187","article-title":"Deep learning implementation for peruvian blueberry export standards: A YOLOv8n solution","volume":"16","author":"Paredes","year":"2025","journal-title":"Enfoque UTE"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"138","DOI":"10.1016\/j.neucom.2018.06.097","article-title":"Pose guided structured region ensemble network for cascaded hand pose estimation","volume":"395","author":"Chen","year":"2020","journal-title":"Neurocomputing"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Cheng, W., Park, J.H., and Ko, J.H. (2021, January 10\u201317). HandFoldingNet: A 3D hand pose estimation network using multiscale-feature guided folding of a 2D hand skeleton. Proceedings of the IEEE\/CVF International Conference on Computer Vision, Montreal, QC, Canada.","DOI":"10.1109\/ICCV48922.2021.01107"},{"key":"ref_30","unstructured":"Madadi, M., Escalera, S., Bar\u00f3, X., and Gonzalez, J. (2017). End-to-end global to local CNN learning for hand pose recovery in depth data. arXiv."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"42","DOI":"10.1016\/j.neucom.2021.01.045","article-title":"Spatial-aware stacked regression network for real-time 3D hand pose estimation","volume":"437","author":"Ren","year":"2021","journal-title":"Neurocomputing"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Charles, R.Q., Su, H., Kaichun, M., and Guibas, L.J. (2017, January 21\u201326). PointNet: Deep learning on point sets for 3D classification and segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.16"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Li, M., Gao, Y., and Sang, N. (2021, January 2\u20139). Exploiting learnable joint groups for hand pose estimation. Proceedings of the AAAI Conference on Artificial Intelligence, Online.","DOI":"10.1609\/aaai.v35i3.16287"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Moon, G., and Lee, K.M. (2020, January 23\u201328). I2L-MeshNet: Image-to-lixel prediction network for accurate 3D human pose and mesh estimation from a single RGB image. Proceedings of the 16th European Conference on Computer Vision, Glasgow, UK.","DOI":"10.1007\/978-3-030-58571-6_44"},{"key":"ref_35","unstructured":"Ren, P., Sun, H., Qi, Q., Wang, J., and Huang, W. (2019, January 9\u201312). SRN: Stacked regression network for real-time 3D hand pose estimation. Proceedings of the British Machine Vision Conference (BMVC), Cardiff, UK."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Huang, W., Ren, P., Wang, J., Qi, Q., and Sun, H. (2020, January 7\u201312). AWR: Adaptive weighting regression for 3D hand pose estimation. Proceedings of the AAAI Conference on Artificial Intelligence, New York, NY, USA.","DOI":"10.1609\/aaai.v34i07.6761"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Kehl, W., Manhardt, F., Tombari, F., Ilic, S., and Navab, N. (2017, January 22\u201329). SSD-6D: Making RGB-based 3D detection and 6D pose estimation great again. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.","DOI":"10.1109\/ICCV.2017.169"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S., Fu, C.-Y., and Berg, A.C. (2016, January 11\u201314). SSD: Single shot multibox detector. Proceedings of the European Conference on Computer Vision, Amsterdam, The Netherlands.","DOI":"10.1007\/978-3-319-46448-0_2"},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Rad, M., and Lepetit, V. (2017, January 22\u201329). BB8: A scalable, accurate, robust to partial occlusion method for predicting the 3D poses of challenging objects without using depth. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.","DOI":"10.1109\/ICCV.2017.413"},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Peng, S., Liu, Y., Huang, Q., Zhou, X., and Bao, H. (2019, January 15\u201320). PVNet: Pixel-wise voting network for 6DOF pose estimation. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00469"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"381","DOI":"10.1145\/358669.358692","article-title":"Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography","volume":"24","author":"Fischler","year":"1981","journal-title":"Commun. ACM"},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Song, C., Song, J., and Huang, Q. (2020, January 13\u201319). HybridPose: 6D object pose estimation under hybrid representations. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.00051"},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Hasson, Y., Varol, G., Tzionas, D., Kalevatykh, I., Black, M.J., Laptev, I., and Schmid, C. (2019, January 15\u201320). Learning joint reconstruction of hands and manipulated objects. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.01208"},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Doosti, B., Naha, S., Mirbagheri, M., and Crandall, D.J. (2020, January 13\u201319). Hope-Net: A graph-based model for hand-object pose estimation. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.00664"},{"key":"ref_45","unstructured":"Yang, H., Sun, W., Liu, J., Zheng, J., Xiao, J., and Mian, A. (2025). Occlusion-aware 3D hand-object pose estimation with masked autoencoders. arXiv."},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Banerjee, P., Shkodrani, S., Moulon, P., Hampali, S., Han, S., Zhang, F., Zhang, L., Fountain, J., Miller, E., and Basol, S. (2025, January 10\u201317). HOT3D: Hand and object tracking in 3D from egocentric multi-view videos. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Nashville, TN, USA.","DOI":"10.1109\/CVPR52734.2025.00662"},{"key":"ref_47","unstructured":"Wang, J., Zhang, Q., Chao, Y.-W., Wen, B., Guo, X., and Xiang, Y. (2024). HO-Cap: A capture system and dataset for 3D reconstruction and pose tracking of hand-object interaction. arXiv."},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Hampali, S., Rad, M., Oberweger, M., and Lepetit, V. (2020, January 13\u201319). HOnnotate: A method for 3D annotation of hand and object poses. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.00326"},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Brahmbhatt, S., Tang, C., Twigg, C.D., Kemp, C.C., and Hays, J. (2020, January 23\u201328). ContactPose: A dataset of grasps with object contact and hand pose. Proceedings of the 16th European Conference on Computer Vision (ECCV), Glasgow, UK.","DOI":"10.1007\/978-3-030-58601-0_22"},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Chao, Y.-W., Yang, W., Xiang, Y., Molchanov, P., Handa, A., Tremblay, J., Narang, Y.S., Van Wyk, K., Iqbal, U., and Birchfield, S. (2021, January 20\u201325). DexYCB: A benchmark for capturing hand grasping of objects. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Nashville, TN, USA.","DOI":"10.1109\/CVPR46437.2021.00893"},{"key":"ref_51","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27\u201330). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_52","doi-asserted-by":"crossref","unstructured":"Deng, J., Dong, W., Socher, R., Li, L.J., Li, K., and Fei-Fei, L. (2009, January 20\u201325). ImageNet: A large-scale hierarchical image database. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Miami, FL, USA.","DOI":"10.1109\/CVPR.2009.5206848"},{"key":"ref_53","doi-asserted-by":"crossref","unstructured":"Garcia-Hernando, G., Yuan, S., Baek, S., and Kim, T.-K. (2018, January 18\u201323). First-person hand action benchmark with RGB-D videos and 3D hand pose annotations. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00050"},{"key":"ref_54","unstructured":"Mittal, A., Zisserman, A., and Torr, P.H. (September, January 29). Hand detection using multiple proposals. Proceedings of the British Machine Vision Conference (BMVC), Dundee, UK."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/25\/22\/6881\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,11,11]],"date-time":"2025-11-11T12:46:55Z","timestamp":1762865215000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/25\/22\/6881"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,11,11]]},"references-count":54,"journal-issue":{"issue":"22","published-online":{"date-parts":[[2025,11]]}},"alternative-id":["s25226881"],"URL":"https:\/\/doi.org\/10.3390\/s25226881","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,11,11]]}}}