{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T04:15:25Z","timestamp":1760242525591,"version":"build-2065373602"},"reference-count":32,"publisher":"MDPI AG","issue":"9","license":[{"start":{"date-parts":[[2017,9,15]],"date-time":"2017-09-15T00:00:00Z","timestamp":1505433600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Both three-dimensional (3D) object recognition and pose estimation are open topics in the research community. These tasks are required for a wide range of applications, sometimes separately, sometimes concurrently. Many different algorithms have been presented in the literature to solve these problems separately, and some to solve them jointly. In this paper, an algorithm to solve them simultaneously is introduced. It is based on the definition of a four-dimensional (4D) tensor that gathers and organizes the projections of a 3D object from different points of view. This 4D tensor is then represented by a set of 4D orthonormal moments. Once these moments are arranged in a matrix that can be computed off-line, recognition and pose estimation is reduced to the solution of a linear least squares problem, involving that matrix and the 2D moments of the observed projection of an unknown object. The abilities of this method for 3D object recognition and pose estimation is analytically proved, demonstrating that it does not rely on experimental work to apply a generic technique to these problems. An additional strength of the algorithm is that the required projection is textureless and defined at a very low resolution. This method is computationally simple and shows very good performance in both tasks, allowing its use in applications where real-time constraints have to be fulfilled. Three different kinds of experiments have been conducted in order to perform a thorough validation of the proposed approach: recognition and pose estimation under z axis (yaw) rotations, the same estimation but with the addition of y axis rotations (pitch), and estimation of the pose of objects in real images downloaded from the Internet. In all these cases, results are encouraging, at a similar level to those of state-of-the art algorithms.<\/jats:p>","DOI":"10.3390\/s17092122","type":"journal-article","created":{"date-parts":[[2017,9,15]],"date-time":"2017-09-15T10:22:10Z","timestamp":1505470930000},"page":"2122","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":4,"title":["Simultaneous Recognition and Relative Pose Estimation of 3D Objects Using 4D Orthonormal Moments"],"prefix":"10.3390","volume":"17","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-9498-5407","authenticated-orcid":false,"given":"Sergio","family":"Dominguez","sequence":"first","affiliation":[{"name":"Centre for Automation and Robotics UPM-CSIC, Universidad Polit\u00e9cnica de Madrid, Jose Gutierrez Abascal, 2, 28006 Madrid, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2017,9,15]]},"reference":[{"key":"ref_1","unstructured":"Khurana, P., Sharma, A., Singh, S.N., and Singh, P.K. (2016, January 16\u201318). A survery on object recognition and segmentation techniques. Proceedings of the IEEE International Conference on Computing for Sustainable Global Development, New Delhi, India."},{"key":"ref_2","unstructured":"Cupec, R., Grbic, R., and Nyarko, E.K. (2016). Survey of State-of-the-Art Methods for Object Recognition in 3D Point Clouds, Josip Juraj Strossmayer University of Osijek. Technical Report."},{"key":"ref_3","unstructured":"Siciliano, B., and Khatib, O. (2016). Handbook of Robitcs, Springer."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Flusser, J., Suk, T., and Zitov\u00e1, B. (2017). 2D and 3D Image Analysis by Moments, John Wiley and Sons.","DOI":"10.1002\/9781119039402"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Hoiem, D., and Savarese, S. (2011). Representations and Techniques for 3D Object Recognition and Scene Interpretation, Morgan and Claypool Publishers.","DOI":"10.1007\/978-3-031-01557-1"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"2633","DOI":"10.1109\/TVCG.2015.2513408","article-title":"Pose estimation for Augmented Reality: A hands-on survey","volume":"22","author":"Marchand","year":"2016","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"1309","DOI":"10.1109\/TRO.2016.2624754","article-title":"Past, Present, and Future of Simultaneous Localization And Mapping: Towards the Robust-Perception Age","volume":"32","author":"Cadena","year":"2016","journal-title":"IEEE Trans. Robot."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"662","DOI":"10.1109\/TPAMI.1985.4767722","article-title":"Applications of Tensor Theory to Object Recognition and Orientation Determination","volume":"PAMI-7","author":"Cyganski","year":"1985","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_9","unstructured":"Nayar, S.K., Nene, S.A., and Murase, H. (1996, January 22\u201328). Real-time 100 object recognition system. Proceedings of the 1996 IEEE International Conference on Robotics and Automation, Minneapolis, MN, USA."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Gordon, I., and Lowe, D.G. (2006). What and where: 3D object recognition with accurate pose. Toward Cathegory-Level Object Recognition, Springer.","DOI":"10.1007\/11957959_4"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Collet, A., Berenson, D., Srinivasa, S.S., and Ferguson, D. (2009, January 12\u201317). Object recognition and full pose registration from a single image for robotic manipulation. Proceedings of the 2009 IEEE International Conference on Robotics and Automation, Kobe, Japan.","DOI":"10.1109\/ROBOT.2009.5152739"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Rusu, R.B., Bradski, G., Thibaux, R., and Hsu, J. (2010, January 18\u201322). Fast 3D recognition and pose using de viewpoint feature histogram. Proceedings of the 2010 IEEE\/RSJ International Conference on Intelligent Robots and Systems, Taipei, Taiwan.","DOI":"10.1109\/IROS.2010.5651280"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"364","DOI":"10.1007\/978-3-319-20904-3_33","article-title":"General object tip detection and pose estimation for robot manipulation","volume":"9136","author":"Shukla","year":"2015","journal-title":"Lect. Notes Comput. Sci."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Lee, S., Wei, L., and Naguib, A.M. (2016, January 21\u201322). Adaptive bayesian recognition and pose estimation of 3D industrial objects with optimal feature selection. Proceedings of the 2016 IEEE International Symposium on Assembly and Manufacturing, Fort Worth, TX, USA.","DOI":"10.1109\/ISAM.2016.7750717"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Sarkar, K., Pagani, A., and Stricker, D. (2016, January 27\u201329). Feature-augmented trained models for 6DOF object recognition and camera calibration. Proceedings of the 2016 11th Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications, Rome, Italy.","DOI":"10.5220\/0005781106320640"},{"key":"ref_16","unstructured":"Do Monte Lima, J.P.S., and Teichrieb, V. (2016, January 4\u20137). An efficient global point cloud descriptor for object recognition and pose estimation. Proceedings of the 2016 29th SIBGRAPI Conference on Graphics, Patterns and Images, Sao Paulo, Brazil."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Wojke, N., Neuhaus, F., and Paulus, D. (2016, January 25\u201328). Localization and pose estimation of textureless objects for autonomous exploration misions. Proceedings of the 2016 IEEE International Conference on Image Processing, Phoenix, AZ, USA.","DOI":"10.1109\/ICIP.2016.7532569"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"He, R., Rojas, J., and Guan, Y. (2017). A 3D object detection and pose estimation pipeline using RGB-D images. arXiv.","DOI":"10.1109\/ROBIO.2017.8324634"},{"key":"ref_19","unstructured":"Gand\u00eda, F., and Casas, A.G. (2003, January 19\u201323). Fast spacecraft pose estimation based on Zernike moments. Proceedings of the 7th International Symposium on Artificial Intelligence, Robotics and Automation in Space, Nara, Japan."},{"key":"ref_20","unstructured":"Tahri, O., and Chaumette, F. (2005, January 18\u201322). Complex objects pose estimation based on image moments invariants. Proceedings of the 2005 IEEE International Conference on Robotics and Automation, Barcelona, Spain."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Komuro, T., and Ishikawa, M. (2007, January 10\u201314). A moment-based 3D object tracking algorithm for high-speed vision. Proceedings of the 2007 IEEE International Conference on Robotics and Automation, Roma, Italy.","DOI":"10.1109\/ROBOT.2007.363765"},{"key":"ref_22","unstructured":"Tahri, O. (2014). Good Image Features for Visual Servoing and Pose Estimation. [Ph.D. Thesis, Habilitation \u00e0 Diriger des Recherches, Universit\u00e9 Blaise Pascal]."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Sahu, U.K., and Patra, D. (2015, January 17\u201320). Shape features for image-based servo-control using image moments. Proceedings of the 2015 Annual IEEE India Conference, New Delhi, India.","DOI":"10.1109\/INDICON.2015.7443577"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"78","DOI":"10.1109\/TMM.2006.886359","article-title":"A bayesian 3D search engine using adaptive views clustering","volume":"9","author":"Ansary","year":"2007","journal-title":"IEEE Trans. Multimedia"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"229","DOI":"10.1007\/s11263-009-0277-2","article-title":"A 3D shape retrieval framework supporting multimodal queries","volume":"89","author":"Daras","year":"2010","journal-title":"Int. J. Comput. Vis."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Rammath, K., Sinha, S.N., Szeliski, R., and Hsiao, E. (2014, January 24\u201326). Car make and model recognition using 3D curve alignement. Proceedings of the 2014 IEEE Conference on Applications of Computer Vision, Steamboat Springs, CO, USA.","DOI":"10.1109\/WACV.2014.6836087"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Liu, Z., Zhao, C., Wu, X., and Chen, W. (2017). An effective 3D shape descriptor for object recognition with RGB-D sensors. Sensors, 17.","DOI":"10.3390\/s17030451"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"1996","DOI":"10.1109\/TPAMI.2005.232","article-title":"An efficient method for the computation of Legendre moments","volume":"27","author":"Yap","year":"2005","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Xiang, Y., Mottaghi, R., and Savarese, S. (2014, January 24\u201326). Beyond PASCAL: A Benchmark for 3D Object Detection in the Wild. Proceedings of the IEEE Winter Conference on Applications of Computer Vision (WACV), Steamboat Springs, CO, USA.","DOI":"10.1109\/WACV.2014.6836101"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Su, H.S., Qi, C.R., Li, Y., and Guibas, L.J. (2015, January 13\u201316). Render for CNN: Viewpoint Estimation in Images Using CNNs Trained with Rendered 3D Model Views. Proceedings of the IEEE International Conference on Computer Vision (ICCV), Santiago, Chile.","DOI":"10.1109\/ICCV.2015.308"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Tulsiani, S., and Malik, J. (2015, January 13\u201316). Viewpoints and Keypoints. Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), Santiago, Chile.","DOI":"10.1109\/CVPR.2015.7298758"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"199","DOI":"10.1109\/TCYB.2013.2251331","article-title":"Efficient iterative pose estimation using an invariant to rotations","volume":"44","author":"Tahri","year":"2014","journal-title":"IEEE Trans. Cybern."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/17\/9\/2122\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T18:45:00Z","timestamp":1760208300000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/17\/9\/2122"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2017,9,15]]},"references-count":32,"journal-issue":{"issue":"9","published-online":{"date-parts":[[2017,9]]}},"alternative-id":["s17092122"],"URL":"https:\/\/doi.org\/10.3390\/s17092122","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2017,9,15]]}}}