{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,16]],"date-time":"2026-01-16T18:09:44Z","timestamp":1768586984899,"version":"3.49.0"},"reference-count":28,"publisher":"MDPI AG","issue":"8","license":[{"start":{"date-parts":[[2018,8,18]],"date-time":"2018-08-18T00:00:00Z","timestamp":1534550400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Automation of the bin picking task with robots entails the key step of pose estimation, which identifies and locates objects so that the robot can pick and manipulate the object in an accurate and reliable way. This paper proposes a novel point pair feature-based descriptor named Boundary-to-Boundary-using-Tangent-Line (B2B-TL) to estimate the pose of industrial parts including some parts whose point clouds lack key details, for example, the point cloud of the ridges of a part. The proposed descriptor utilizes the 3D point cloud data and 2D image data of the scene simultaneously, and the 2D image data could compensate the missing key details of the point cloud. Based on the descriptor B2B-TL, Multiple Edge Appearance Models (MEAM), a method using multiple models to describe the target object, is proposed to increase the recognition rate and reduce the computation time. A novel pipeline of an online computation process is presented to take advantage of B2B-TL and MEAM. Our algorithm is evaluated against synthetic and real scenes and implemented in a bin picking system. The experimental results show that our method is sufficiently accurate for a robot to grasp industrial parts and is fast enough to be used in a real factory environment.<\/jats:p>","DOI":"10.3390\/s18082719","type":"journal-article","created":{"date-parts":[[2018,8,20]],"date-time":"2018-08-20T11:23:06Z","timestamp":1534764186000},"page":"2719","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":55,"title":["Point Pair Feature-Based Pose Estimation with Multiple Edge Appearance Models (PPF-MEAM) for Robotic Bin Picking"],"prefix":"10.3390","volume":"18","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-4863-7943","authenticated-orcid":false,"given":"Diyi","family":"Liu","sequence":"first","affiliation":[{"name":"Graduate School of Engineering, Tohoku University, Aramaki Aza Aoba 6-6-01, Aoba-Ku, Sendai 980-8579, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Shogo","family":"Arai","sequence":"additional","affiliation":[{"name":"Graduate School of Engineering, Tohoku University, Aramaki Aza Aoba 6-6-01, Aoba-Ku, Sendai 980-8579, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jiaqi","family":"Miao","sequence":"additional","affiliation":[{"name":"Jack Baskin School of Engineering, University of California, Santa Cruz, CA 95064, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jun","family":"Kinugawa","sequence":"additional","affiliation":[{"name":"Graduate School of Engineering, Tohoku University, Aramaki Aza Aoba 6-6-01, Aoba-Ku, Sendai 980-8579, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Zhao","family":"Wang","sequence":"additional","affiliation":[{"name":"Graduate School of Engineering, Tohoku University, Aramaki Aza Aoba 6-6-01, Aoba-Ku, Sendai 980-8579, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Kazuhiro","family":"Kosuge","sequence":"additional","affiliation":[{"name":"Graduate School of Engineering, Tohoku University, Aramaki Aza Aoba 6-6-01, Aoba-Ku, Sendai 980-8579, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2018,8,18]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"R\u00f6hrbein, F., Veiga, G., and Natale, C. (2014). Active Recognition and Manipulation for Mobile Robot Bin Picking. The Gearing Up and Accelerating Cross-fertilization between Academic and Industrial Robotics Research in Europe, Springer International Publishing.","DOI":"10.1007\/978-3-319-02934-4"},{"key":"ref_2","first-page":"1","article-title":"Introduction\u2013Automation and the Need for Pose Estimation","volume":"Volume 44","author":"Buchholz","year":"2015","journal-title":"Bin-Picking: New Approaches for a Classical Problem"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Collet, A., Berenson, D., Srinivasa, S.S., and Ferguson, D. (2009, January 12\u201317). Object recognition and full pose registration from a single image for robotic manipulation. Proceedings of the 2009 IEEE International Conference on Robotics and Automation (ICRA), Kobe, Japan.","DOI":"10.1109\/ROBOT.2009.5152739"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"876","DOI":"10.1109\/TPAMI.2011.206","article-title":"Gradient Response Maps for Real-Time Detection of Texture-Less Objects","volume":"34","author":"Hinterstoisser","year":"2012","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Rodrigues, J.J., Kim, J.S., Furukawa, M., Xavier, J., Aguiar, P., and Kanade, T. (2012, January 7\u201312). 6D Pose Estimation of Textureless Shiny Objects Using Random Ferns for Bin-picking. Proceedings of the 2012 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Vilamoura, Portugal.","DOI":"10.1109\/IROS.2012.6385680"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Shroff, N., Taguchi, Y., Tuzel, O., Veeraraghavan, A., Ramalingam, S., and Okuda, H. (2011, January 9\u201313). Finding a Needle in a Specular Haystack. Proceedings of the 2011 IEEE International Conference on Robotics and Automation (ICRA), Shanghai, China.","DOI":"10.1109\/ICRA.2011.5979857"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"951","DOI":"10.1177\/0278364911436018","article-title":"Fast Object Localization and Pose Estimation in Heavy Clutter for Robotic Bin Picking","volume":"31","author":"Liu","year":"2012","journal-title":"Int. J. Robot. Res."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"1902","DOI":"10.1109\/TPAMI.2011.266","article-title":"Combining Scale-Space and Similarity-Based Aspect Graphs for Fast 3D Object Recognition","volume":"34","author":"Ulrich","year":"2012","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Rusu, R.B., Bradski, G., Thibaux, R., John, H., and Willow, G. (2010, January 18\u201322). Fast 3D Recognition and Pose Using the Viewpoint Feature Histogram. Proceedings of the 2010 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Taipei, Taiwan.","DOI":"10.1109\/IROS.2010.5651280"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"433","DOI":"10.1109\/34.765655","article-title":"Using Spin Images for Efficient Object Recognition in Cluttered 3D Scenes","volume":"21","author":"Johnson","year":"1999","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Aldoma, A., Vincze, M., Blodow, N., David, G., Suat, G., Rusu, R.B., Bradski, G., and Garage, W. (2011, January 6\u201313). CAD-model Recognition and 6DOF Pose Estimation Using 3D Cues. Proceedings of the 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops), Barcelona, Spain.","DOI":"10.1109\/ICCVW.2011.6130296"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Drost, B., Ulrich, M., Navab, N., and Ilic, S. (2010, January 13\u201318). Model Globally, Match Locally: Efficient and Robust 3D Object Recognition. Proceedings of the 2010 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), San Francisco, CA, USA.","DOI":"10.1109\/CVPR.2010.5540108"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Wu, C.H., Jiang, S.Y., and Song, K.T. (2015, January 13\u201316). CAD-based Pose Estimation for Random Bin-picking of Multiple Objects Using a RGB-D Camera. Proceedings of the 15th International Conference on Control, Automation and Systems (ICCAS), Busan, Korea.","DOI":"10.1109\/ICCAS.2015.7364621"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Mohamad, M., Rappaport, D., and Greenspan, M. (2014, January 8\u201311). Generalized 4-points Congruent Sets for 3d Registration. Proceedings of the 2014 International Conference on 3D Vision, Tokyo, Japan.","DOI":"10.1109\/3DV.2014.21"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Birdal, T., and Ilic, S. (2015, January 19\u201322). Point Pair Features Based Object Detection and Pose Estimation Revisited. Proceedings of the 2015 International Conference on 3D Vision (3DV), Lyon, France.","DOI":"10.1109\/3DV.2015.65"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Wong, J.M., Kee, V., Le, T., Wagner, S., Mariottini, G.L., Schneider, A., and Wu, J. (2017, January 24\u201328). Segicp: Integrated Deep Semantic Segmentation and Pose Estimation. Proceedings of the 2017 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Vancouver, BC, Canada.","DOI":"10.1109\/IROS.2017.8206470"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Hinterstoisser, S., Holzer, S., Cagniart, C., Ilic, S., Konolige, K., Navab, N., and Lepetit, V. (2011, January 6\u201313). Multimodal Templates for Real-time Detection of Textureless Objects in Heavily Cluttered Scenes. Proceedings of the 2011 IEEE International Conference on Computer Vision (ICCV), Barcelona, Spain.","DOI":"10.1109\/ICCV.2011.6126326"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Katz, S., Tal, A., and Basri, R. (2007). Direct Visibility of Point Sets. ACM Trans. Graph., 26.","DOI":"10.1145\/1239451.1239475"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Rusu, R.B., and Cousins, S. (2011, January 9\u201313). 3D is here: Point Cloud Library (PCL). Proceedings of the 2011 IEEE International Conference on Robotics and automation (ICRA), Shanghai, China.","DOI":"10.1109\/ICRA.2011.5980567"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"679","DOI":"10.1109\/TPAMI.1986.4767851","article-title":"A Computational Approach to Edge detection","volume":"PAMI-8","author":"Canny","year":"1986","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"1782","DOI":"10.3390\/s17081782","article-title":"Curve Set Feature-based Robust and Fast Pose Estimation Algorithm","volume":"17","author":"Li","year":"2017","journal-title":"Sensors"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"239","DOI":"10.1109\/34.121791","article-title":"Method for Registration of 3-D Shapes","volume":"14","author":"Besl","year":"1992","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Choi, C., Taguchi, Y., Tuzel, O., and Liu, M.Y. (2012, January 14\u201318). Voting-based Pose Estimation for Fobotic Assembly Using a 3D Sensor. Proceedings of the 2012 IEEE International Conference on Robotics and Automation (ICRA), Saint Paul, MN, USA.","DOI":"10.1109\/ICRA.2012.6225371"},{"key":"ref_24","unstructured":"Rusu, R.B., Blodow, N., Marton, Z., Soos, A., and Beetz, M. (November, January 29). Towards 3D Object Maps for Autonomous Household Robots. Proceedings of the 2007 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), San Diego, CA, USA."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Drost, B., and Ilic, S. (2012, January 13\u201315). 3D Object Detection and Localization Using Multimodal Point Pair Features. Proceedings of the Second International Conference on 3D Imaging, Modeling, Processing, Visualization & Transmission, Zurich, Switzerland.","DOI":"10.1109\/3DIMPVT.2012.53"},{"key":"ref_26","unstructured":"Liu, D. (2018, August 06). Tohoku University 6D Pose Estimation Dataset. Available online: https:\/\/zenodo.org\/badge\/latestdoi\/143503964."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Drost, B., Ulrich, M., Bergmann, P., H\u00e4rtinger, P., and Steger, C. (2017, January 22\u201329). Introducing MVTec ITODD \u2014 A Dataset for 3D Object Recognition in Industry. Proceedings of the 2017 IEEE International Conference on Computer Vision (ICCV), Venice, Italy.","DOI":"10.1109\/ICCVW.2017.257"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Hodan, T., Haluza, P., Obdr\u017e\u00e1lek, \u0160., Matas, J., Lourakis, M., and Zabulis, X. (2017, January 24\u201331). T-LESS: An RGB-D dataset for 6D Pose Estimation of Texture-less Objects. Proceedings of the 2017 IEEE Winter Conference on Applications of Computer Vision (WACV), Santa Rosa, CA, USA.","DOI":"10.1109\/WACV.2017.103"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/18\/8\/2719\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T15:19:33Z","timestamp":1760195973000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/18\/8\/2719"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,8,18]]},"references-count":28,"journal-issue":{"issue":"8","published-online":{"date-parts":[[2018,8]]}},"alternative-id":["s18082719"],"URL":"https:\/\/doi.org\/10.3390\/s18082719","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2018,8,18]]}}}