{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T03:02:50Z","timestamp":1760238170637,"version":"build-2065373602"},"reference-count":33,"publisher":"MDPI AG","issue":"15","license":[{"start":{"date-parts":[[2020,7,24]],"date-time":"2020-07-24T00:00:00Z","timestamp":1595548800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100004663","name":"Ministry of Science and Technology, Taiwan","doi-asserted-by":"publisher","award":["MOST 109-2634-F-003-006 and MOST 109-2634-F-003-007"],"award-info":[{"award-number":["MOST 109-2634-F-003-006 and MOST 109-2634-F-003-007"]}],"id":[{"id":"10.13039\/501100004663","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Accurate estimation of 3D object pose is highly desirable in a wide range of applications, such as robotics and augmented reality. Although significant advancement has been made for pose estimation, there is room for further improvement. Recent pose estimation systems utilize an iterative refinement process to revise the predicted pose to obtain a better final output. However, such refinement process only takes account of geometric features for pose revision during the iteration. Motivated by this approach, this paper designs a novel iterative refinement process that deals with both color and geometric features for object pose refinement. Experiments show that the proposed method is able to reach 94.74% and 93.2% in ADD(-S) metric with only 2 iterations, outperforming the state-of-the-art methods on the LINEMOD and YCB-Video datasets, respectively.<\/jats:p>","DOI":"10.3390\/s20154114","type":"journal-article","created":{"date-parts":[[2020,7,24]],"date-time":"2020-07-24T09:06:09Z","timestamp":1595581569000},"page":"4114","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":5,"title":["Iterative Pose Refinement for Object Pose Estimation Based on RGBD Data"],"prefix":"10.3390","volume":"20","author":[{"given":"Shao-Kang","family":"Huang","sequence":"first","affiliation":[{"name":"Department of Electrical Engineering, National Taiwan Normal University, Taipei 106, Taiwan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3697-8401","authenticated-orcid":false,"given":"Chen-Chien","family":"Hsu","sequence":"additional","affiliation":[{"name":"Department of Electrical Engineering, National Taiwan Normal University, Taipei 106, Taiwan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Wei-Yen","family":"Wang","sequence":"additional","affiliation":[{"name":"Department of Electrical Engineering, National Taiwan Normal University, Taipei 106, Taiwan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Cheng-Hung","family":"Lin","sequence":"additional","affiliation":[{"name":"Department of Electrical Engineering, National Taiwan Normal University, Taipei 106, Taiwan"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2020,7,24]]},"reference":[{"key":"ref_1","unstructured":"Chen, H., Hsu, C., and Wang, W. (2020, January 5\u20138). Object Pose Estimation System for Pick and Place Automation. Proceedings of the International Conference on System Science and Engineering 2020 (ICSSE 2020), Sunport Hall Takamatsu, Japan."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Lowe, D.G. (1999, January 20\u201327). Object recognition from local scale-invariant features. Proceedings of the Seventh IEEE International Conference on Computer Vision, Kerkyra, Greece.","DOI":"10.1109\/ICCV.1999.790410"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Tulsiani, S., and Malik, J. (2015, January 7\u201312). Viewpoints and keypoints. Proceedings of the 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298758"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Pavlakos, G., Zhou, X., Chan, A., Derpanis, K. G., and Daniilidis, K. (June, January 29). 6-DOF object pose from semantic keypoints. Proceedings of the 2017 IEEE International Conference on Robotics and Automation (ICRA), Marina Bay Sands, Singapore.","DOI":"10.1109\/ICRA.2017.7989233"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Hinterstoisser, S., Lepetit, V., Ilic, S., Holzer, S., Bradski, G., Konolige, K., and Navab, N. (2020, May 02). Model Based Training, Detection and Pose Estimation of Texture-Less 3D Objects in Heavily Cluttered Scenes. Available online: http:\/\/www.stefan-hinterstoisser.com\/papers\/hinterstoisser2012accv.pdf.","DOI":"10.1007\/978-3-642-33885-4_60"},{"key":"ref_6","unstructured":"Cao, Z., Sheikh, Y., and Banerjee, N.K. (2016, January 16\u201321). Real-time scalable 6DoF pose estimation for texture-less objects. Proceedings of the 2016 IEEE International Conference on Robotics and Automation (ICRA), Stockholm, Sweden."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Brachmann, E., Krull, A., Michel, F., Gumhold, S., Shotton, J., and Rother, C. (2014, January 6\u201312). Learning 6D object pose estimation using 3D object coordinates. Proceedings of the European Conference on Computer Vision, Zurich, Switzerland.","DOI":"10.1007\/978-3-319-10605-2_35"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Ge, L., Cai, Y., Weng, J., and Yuan, J. (2018, January 18\u201322). PointNet: 3D Hand Pose Estimation using Point Sets. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00878"},{"key":"ref_9","unstructured":"Chen, Y., Tu, Z., Ge, L., Zhang, D., Chen, R., and Yuan, J. (November, January 27). SO-HandNet: Self-Organizing Network for 3D Hand Pose Estimation with Semi-Supervised Learning. Proceedings of the IEEE International Conference on Computer Vision (ICCV), Seoul, Korea."},{"key":"ref_10","unstructured":"Tian, M., Pan, L., Ang Jr, M.H., and Lee, G.H. (June, January 31). Robust 6D Object Pose Estimation by Learning RGB-D Features. Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), Paris, France. to be published."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Wang, C., Xu, D., Zhu, Y., Mart\u00edn-Mart\u00edn, R., Lu, C., Fei-Fei, L., and Savarese, S. (2019, January 15\u201321). DenseFusion: 6D object pose estimation by iterative dense fusion. Proceedings of the 2019 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA. in press.","DOI":"10.1109\/CVPR.2019.00346"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Brachmann, E., Michel, F., Krull, A., Ying Yang, M., and Gumhold, S. (2016, January 26\u201330). Uncertainty-driven 6D pose estimation of objects and scenes from a single RGB image. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.366"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Peng, S., Liu, Y., Huang, Q., Zhou, X., and Bao, H. (2019, January 15\u201321). Pvnet: pixel-wise voting network for 6dof pose estimation. Proceedings of the 2019 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00469"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Wohlhart, P., and Lepetit, V. (2015, January 7\u201312). Learning descriptors for object recognition and 3D pose estimation. Proceedings of the 2015 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298930"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Rad, M., and Lepetit, V. (2017, January 22\u201329). BB8: A scalable, accurate, robust to partial occlusion method for predicting the 3D poses of challenging objects without using depth. Proceedings of the IEEE International Conference on Computer Vision (ICCV), Venice, Italy.","DOI":"10.1109\/ICCV.2017.413"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Kehl, W., Manhardt, F., Tombari, F., Ilic, S., and Navab, N. (2017, January 22\u201329). SSD-6D: making RGB-based 3D detection and 6D pose estimation great again. Proceedings of the IEEE International Conference on Computer Vision (ICCV), Venice, Italy.","DOI":"10.1109\/ICCV.2017.169"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Tekin, B., Sinha, S.N., and Fua, P. (2018, January 18\u201322). Real-time seamless single shot 6D object pose prediction. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00038"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Sundermeyer, M., Marton, Z., Durner, M., Brucker, M., and Triebel, R. (2018, January 8\u201314). Implicit 3D orientation learning for 6D object detection from RGB images. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.","DOI":"10.1007\/978-3-030-01231-1_43"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Li, Y., Wang, G., Ji, X., Xiang, Y., and Fox, D. (2018, January 8\u201314). DeepIM: deep iterative matching for 6D pose estimation. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.","DOI":"10.1007\/978-3-030-01231-1_42"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Castro, P., Armagan, A., and Kim, T. (2020, January 4\u20138). Accurate 6D object pose estimation by pose conditioned mesh reconstruction. Proceedings of the 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Barcelona, Spain.","DOI":"10.1109\/ICASSP40776.2020.9053627"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Tong, X., Li, R., Ge, L., Zhao, L., and Wang, K.A. (2020). New Edge Patch with Rotation Invariance for Object Detection and Pose Estimation. Sensors, 20.","DOI":"10.3390\/s20030887"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Li, M., and Hashimoto, K. (2018). Accurate Object Pose Estimation Using Depth Only. Sensors, 18.","DOI":"10.3390\/s18041045"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Xiang, Y., Schmidt, T., Narayanan, V., and Fox, D. (2018, January 26\u201330). Posecnn: A convolutional neural network for 6d object pose estimation in cluttered scenes. Proceedings of the Robotics: Science and System XIV, Pittsburgh, PA, USA.","DOI":"10.15607\/RSS.2018.XIV.019"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Hu, Y., Hugonot, J., Fua, P., and Salzmann, M. (2019, January 16\u201321). Segmentation-driven 6D object pose estimation. Proceedings of the 2019 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00350"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"381","DOI":"10.1145\/358669.358692","article-title":"Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography","volume":"24","author":"Fischler","year":"1981","journal-title":"Commun. ACM"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Pauwels, K., Rubio, L., D\u00edaz, J., and Ros, E. (2013, January 23\u201328). Real-time model-based rigid object pose estimation and tracking combining dense and sparse visual cues. Proceedings of the 2013 IEEE Conference on Computer Vision and Pattern Recognition, Portland, OR, USA.","DOI":"10.1109\/CVPR.2013.304"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"239","DOI":"10.1109\/34.121791","article-title":"A method for registration of 3-D shapes","volume":"14","author":"Besl","year":"1992","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_28","unstructured":"(2020, May 02). Generalized-icp. Available online: http:\/\/www.robots.ox.ac.uk\/~avsegal\/resources\/papers\/Generalized_ICP.pdf."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Hoda\u0148, T., Michel, F., Brachmann, E., Kehl, W., GlentBuch, A., Kraft, D., Drost, B., Vidal, J., Ihrke, S., and Zabulis, X. (2018, January 8\u201314). BOP: benchmark for 6D object pose estimation. Proceedings of the 15th European Conference on Computer Vision, Munich, Germany.","DOI":"10.1007\/978-3-030-01249-6_2"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Kendall, A., Grimes, M., and Cipolla, R. (2015, January 7\u201313). PoseNet: A convolutional network for real-time 6-DOF camera relocalization. Proceedings of the 2015 IEEE International Conference on Computer Vision (ICCV), Santiago, Chile.","DOI":"10.1109\/ICCV.2015.336"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Qi, C.R., Liu, W., Wu, C., Su, H., and Guibas, L.J. (2018, January 18\u201322). Frustum PointNets for 3D object detection from RGB-D data. Proceedings of the 2018 IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00102"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Michel, F., Kirillov, A., Brachmann, E., Krull, A., Gumhold, S., Savchynskyy, B., and Rother, C. (2017, January 21\u201326). Global hypothesis generation for 6d object pose estimation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.20"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Zhao, H., Shi, J., Qi, X., Wang, X., and Jia, J. (2017, January 21\u201326). Pyramid scene parsing network. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, Hawaii.","DOI":"10.1109\/CVPR.2017.660"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/15\/4114\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T09:51:20Z","timestamp":1760176280000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/15\/4114"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,7,24]]},"references-count":33,"journal-issue":{"issue":"15","published-online":{"date-parts":[[2020,8]]}},"alternative-id":["s20154114"],"URL":"https:\/\/doi.org\/10.3390\/s20154114","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2020,7,24]]}}}