{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,19]],"date-time":"2025-12-19T21:07:39Z","timestamp":1766178459354,"version":"build-2065373602"},"reference-count":30,"publisher":"MDPI AG","issue":"8","license":[{"start":{"date-parts":[[2017,8,8]],"date-time":"2017-08-08T00:00:00Z","timestamp":1502150400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Natural landmarks are the main features in the next step of the research in localization of mobile robot platforms. The identification and recognition of these landmarks are crucial to better localize a robot. To help solving this problem, this work proposes an approach for the identification and recognition of natural marks included in the environment using images from RGB-D (Red, Green, Blue, Depth) sensors. In the identification step, a structural analysis of the natural landmarks that are present in the environment is performed. The extraction of edge points of these landmarks is done using the 3D point cloud obtained from the RGB-D sensor. These edge points are smoothed through the     S  l 0      algorithm, which minimizes the standard deviation of the normals at each point. Then, the second step of the proposed algorithm begins, which is the proper recognition of the natural landmarks. This recognition step is done as a real-time algorithm that extracts the points referring to the filtered edges and determines to which structure they belong to in the current scenario: stairs or doors. Finally, the geometrical characteristics that are intrinsic to the doors and stairs are identified. The approach proposed here has been validated with real robot experiments. The performed tests verify the efficacy of our proposed approach.<\/jats:p>","DOI":"10.3390\/s17081824","type":"journal-article","created":{"date-parts":[[2017,8,8]],"date-time":"2017-08-08T10:28:08Z","timestamp":1502188088000},"page":"1824","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":23,"title":["Stairs and Doors Recognition as Natural Landmarks Based on Clouds of 3D Edge-Points from RGB-D Sensors for Mobile Robot Localization"],"prefix":"10.3390","volume":"17","author":[{"given":"Leonardo","family":"Souto","sequence":"first","affiliation":[{"name":"Natalnet Labs, Universidade Federal do Rio Grande do Norte (UFRN), 59078-970 Natal, RN, Brazil"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Andr\u00e9","family":"Castro","sequence":"additional","affiliation":[{"name":"LaSER-Embedded Systems and Robotics Lab, Universidade Federal da Paraiba (UFPB), 58058-600 Jo\u00e3o Pessoa, PB, Brazil"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7735-5630","authenticated-orcid":false,"given":"Luiz","family":"Gon\u00e7alves","sequence":"additional","affiliation":[{"name":"Natalnet Labs, Universidade Federal do Rio Grande do Norte (UFRN), 59078-970 Natal, RN, Brazil"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Tiago","family":"Nascimento","sequence":"additional","affiliation":[{"name":"LaSER-Embedded Systems and Robotics Lab, Universidade Federal da Paraiba (UFPB), 58058-600 Jo\u00e3o Pessoa, PB, Brazil"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2017,8,8]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Fox, D., Burgard, W., Kruppa, H., and Thrun, S. (1999). Collaborative Multi-Robot Localization. Mustererkennung 1999, Springer.","DOI":"10.1007\/978-3-642-60243-6_2"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Chi, W., Zhang, W., Gu, J., and Ren, H. (2013, January 12\u201314). A vision-based mobile robot localization method. Proceedings of the 2013 IEEE International Conference on Robotics and Biomimetics (ROBIO), Shenzhen, China.","DOI":"10.1109\/ROBIO.2013.6739882"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Ganganath, N., and Leung, H. (2012, January 12\u201314). Mobile robot localization using odometry and kinect sensor. Proceedings of the 2012 IEEE International Conference on Emerging Signal Processing Applications (ESPA), Las Vegas, NV, USA.","DOI":"10.1109\/ESPA.2012.6152453"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Lee, S., Tewolde, G.S., Lim, J., and Kwon, J. (2015, January 21\u201323). Vision based localization for multiple mobile robots using low-cost vision sensor. Proceedings of the 2015 IEEE International Conference on Electro\/Information Technology (EIT), Dekalb, IL, USA.","DOI":"10.1109\/EIT.2015.7293353"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Peipei, S., Wenyu, L., Ningjia, Y., and Feng, D. (2015, January 28\u201330). An intelligent vision localization system of a service robot nao. Proceedings of the 34th Chinese Control Conference (CCC), Hangzhou, China.","DOI":"10.1109\/ChiCC.2015.7260577"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Nascimento, R.C.A., Silva, B.M.F., and Goncalves, L.M.G. (2013, January 21\u201327). Real-time localization of mobile robots in indoor environments using a ceiling camera structure. Proceedings of the 2013 Latin American Robotics Symposium and Competition, Arequipa, Peru.","DOI":"10.1109\/LARS.2013.58"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Duan, P., Tian, G., and Wu, H. (2014, January 5\u201310). A multi-sensor-based mobile robot localization framework. Proceedings of the 2014 IEEE International Conference on Robotics and Biomimetics (ROBIO), Bali, Indonesia.","DOI":"10.1109\/ROBIO.2014.7090403"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Bischoff, B., Nguyen-Tuong, D., Streichert, F., Ewert, M., and Knoll, A. (2012, January 5\u20137). Fusing vision and odometry for accurate indoor robot localization. Proceedings of the 12th International Conference on Control Automation Robotics Vision (ICARCV), Guangzhou, China.","DOI":"10.1109\/ICARCV.2012.6485183"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Li, M., Lin, R., Wang, Z., and Hong, Y. (2013, January 12\u201314). Omnidirectional vision based mobile robot topological localization. Proceedings of the 2013 IEEE International Conference on Robotics and Biomimetics (ROBIO), Shenzhen, China.","DOI":"10.1109\/ROBIO.2013.6739747"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Gu, Z., Liu, H., and Zhang, G. (2014, January 5\u201310). Real-time indoor localization of service robots using fisheye camera and laser pointers. Proceedings of the 2014 IEEE International Conference on Robotics and Biomimetics (ROBIO), Bali, Indonesia.","DOI":"10.1109\/ROBIO.2014.7090531"},{"key":"ref_11","unstructured":"Lee, Y.H., Leung, T.S., and Medioni, G. (2012, January 11\u201315). Real-time staircase detection from a wearable stereo system. Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012), Tsukuba, Japan."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Lin, C., He, B., and Zhang, J. (2014, January 5\u201310). Study on indoor robot of self-localization based on RGB-D sensor. Proceedings of the 2014 IEEE International Conference on Robotics and Biomimetics (ROBIO), Bali, Indonesia.","DOI":"10.1109\/ROBIO.2014.7090737"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Lee, S.J., Tewolde, G., Lim, J., and Kwon, J. (2015, January 7\u201311). QR-code based localization for indoor mobile robot with validation using a 3D optical tracking instrument. Proceedings of the 2015 IEEE International Conference on Advanced Intelligent Mechatronics (AIM), Busan, Korea.","DOI":"10.1109\/AIM.2015.7222664"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Huletski, A., Kartashov, D., and Krinkin, K. (2015, January 20\u201324). The artificial landmark design for mobile robots localization and mapping. Proceedings of the 17th Conference of Open Innovations Association (FRUCT), Yaroslavl, Russia.","DOI":"10.1109\/FRUCT.2015.7117971"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Chen, D., Peng, Z., and Ling, X. (2014, January 5\u201310). A low-cost localization system based on artificial landmarks with two degree of freedom platform camera. Proceedings of the 2014 IEEE International Conference on Robotics and Biomimetics (ROBIO), Bali, Indonesia.","DOI":"10.1109\/ROBIO.2014.7090400"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"458","DOI":"10.1108\/01439910010378879","article-title":"Landmark-based navigation of industrial mobile robots","volume":"27","author":"Hu","year":"2000","journal-title":"Ind. Robot Int. J."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Sun, Y., Ding, N., Qian, H., and Xu, Y. (2012, January 11\u201314). Real-time monocular visual self-localization approach using natural circular landmarks for indoor navigation. Proceedings of the 2012 IEEE International Conference on Robotics and Biomimetics (ROBIO), Guangzhou, China.","DOI":"10.1109\/ROBIO.2012.6491015"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Alves, P., Costelha, H., and Neves, C. (2013, January 24\u201324). Localization and navigation of a mobile robot in an office-like environment. Proceedings of the 2013 13th International Conference on Autonomous Robot Systems (Robotica), Lisbon, Portugal.","DOI":"10.1109\/Robotica.2013.6623536"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Salem, M. (2012, January 27\u201329). Multi-stage localization given topological map for autonomous robots. Proceedings of the 2012 Seventh International Conference on Computer Engineering Systems (ICCES), Cairo, Egypt.","DOI":"10.1109\/ICCES.2012.6408483"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Liu, M., Lei, X., Zhang, S., and Mu, B. (2010, January 14\u201318). Natural landmark extraction in 2D laser data based on local curvature scale for mobile robot navigation. Proceedings of the 2010 IEEE International Conference on Robotics and Biomimetics (ROBIO), Tianjin, China.","DOI":"10.1109\/ROBIO.2010.5723381"},{"key":"ref_21","unstructured":"Rous, M., Lupschen, H., and Kraiss, K.F. (2005, January 18\u201322). Vision-Based Indoor Scene Analysis for Natural Landmark Detection. Proceedings of the 2005 IEEE International Conference on Robotics and Automation, Barcelona, Spain."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Xiong, X., and Choi, B.J. (2011, January 27\u201329). Position estimation algorithm based on natural landmark and fish-eyes\u2019 lens for indoor mobile robot. Proceedings of the 2011 IEEE 3rd International Conference on Communication Software and Networks (ICCSN), Xi\u2019an, China.","DOI":"10.1109\/ICCSN.2011.6014964"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Mohamed, H., Moussa, A., Elhabiby, M., El-Sheimy, N., and Sesay, A. (2017). A novel real-time reference key frame scan matching method. Sensors, 17.","DOI":"10.3390\/s17051060"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Chai, X., Wen, F., and Yuan, K. (2011, January 7\u201310). Fast vision-based object segmentation for natural landmark detection on Indoor Mobile Robot. Proceedings of the 2011 IEEE International Conference on Mechatronics and Automation, Beijing, China.","DOI":"10.1109\/ICMA.2011.5986286"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Castro, A.L.F., de Brito, Y.B., de Souto, L.A.V., and Nascimento, T.P. (2016, January 4\u20136). A novel approach for natural landmarks identification using RGB-D sensors. Proceedings of the 2016 International Conference on Autonomous Robot Systems and Competitions (ICARSC), Braganca, Portugal.","DOI":"10.1109\/ICARSC.2016.20"},{"key":"ref_26","unstructured":"Microsoft (2017, August 02). Kinect for Windows Sensor Components and Specifications. Available online: https:\/\/msdn.microsoft.com\/library\/jj131033.aspx."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Hoppe, H., DeRose, T., Duchamp, T., McDonald, J., and Stuetzle, W. (1992, January 27\u201331). Surface reconstruction from unorganized points. Proceedings of the 19th Annual Conference on Computer Graphics and Interactive Techniques, Chicago, IL, USA.","DOI":"10.1145\/133994.134011"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"289","DOI":"10.1109\/TSP.2008.2007606","article-title":"A fast approach for overcomplete sparse decomposition based on smoothed L0 norm","volume":"57","author":"Mohimani","year":"2009","journal-title":"IEEE Trans. Signal Process."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Redmon, J., Divvala, S., Girshick, R., and Farhadi, A. (2016, January 27\u201330). You only look once: Unified, real-time object detection. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA.","DOI":"10.1109\/CVPR.2016.91"},{"key":"ref_30","unstructured":"StereoLabs (2017, August 02). Zed Camera. Available online: https:\/\/www.stereolabs.com\/."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/17\/8\/1824\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T18:41:47Z","timestamp":1760208107000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/17\/8\/1824"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2017,8,8]]},"references-count":30,"journal-issue":{"issue":"8","published-online":{"date-parts":[[2017,8]]}},"alternative-id":["s17081824"],"URL":"https:\/\/doi.org\/10.3390\/s17081824","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2017,8,8]]}}}