{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,26]],"date-time":"2026-03-26T08:07:12Z","timestamp":1774512432893,"version":"3.50.1"},"reference-count":51,"publisher":"MDPI AG","issue":"22","license":[{"start":{"date-parts":[[2019,11,13]],"date-time":"2019-11-13T00:00:00Z","timestamp":1573603200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100004837","name":"Ministerio de Ciencia e Innovaci\u00f3n","doi-asserted-by":"publisher","award":["FJCI-2015-25700"],"award-info":[{"award-number":["FJCI-2015-25700"]}],"id":[{"id":"10.13039\/501100004837","id-type":"DOI","asserted-by":"publisher"}]},{"name":"FP7 for research, technological development and demonstration","award":["601116"],"award-info":[{"award-number":["601116"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Sewers represent a very important infrastructure of cities whose state should be monitored periodically. However, the length of such infrastructure prevents sensor networks from being applicable. In this paper, we present a mobile platform (SIAR) designed to inspect the sewer network. It is capable of sensing gas concentrations and detecting failures in the network such as cracks and holes in the floor and walls or zones were the water is not flowing. These alarms should be precisely geo-localized to allow the operators performing the required correcting measures. To this end, this paper presents a robust localization system for global pose estimation on sewers. It makes use of prior information of the sewer network, including its topology, the different cross sections traversed and the position of some elements such as manholes. The system is based on a Monte Carlo Localization system that fuses wheel and RGB-D odometry for the prediction stage. The update step takes into account the sewer network topology for discarding wrong hypotheses. Additionally, the localization is further refined with novel updating steps proposed in this paper which are activated whenever a discrete element in the sewer network is detected or the relative orientation of the robot over the sewer gallery could be estimated. Each part of the system has been validated with real data obtained from the sewers of Barcelona. The whole system is able to obtain median localization errors in the order of one meter in all cases. Finally, the paper also includes comparisons with state-of-the-art Simultaneous Localization and Mapping (SLAM) systems that demonstrate the convenience of the approach.<\/jats:p>","DOI":"10.3390\/s19224946","type":"journal-article","created":{"date-parts":[[2019,11,14]],"date-time":"2019-11-14T10:56:34Z","timestamp":1573728994000},"page":"4946","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":26,"title":["A Robust Localization System for Inspection Robots in Sewer Networks"],"prefix":"10.3390","volume":"19","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-6664-6216","authenticated-orcid":false,"given":"David","family":"Alejo","sequence":"first","affiliation":[{"name":"School of Engineering, Universidad Pablo de Olavide, 41012 Sevilla, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8869-2846","authenticated-orcid":false,"given":"Fernando","family":"Caballero","sequence":"additional","affiliation":[{"name":"Department of Systems Engineering and Automation, Universidad de Sevilla, 41009 Sevilla, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4927-8647","authenticated-orcid":false,"given":"Luis","family":"Merino","sequence":"additional","affiliation":[{"name":"School of Engineering, Universidad Pablo de Olavide, 41012 Sevilla, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2019,11,13]]},"reference":[{"key":"ref_1","unstructured":"ECHORD++ (2019, November 11). Utility Infrastructures and Condition Monitoring for Sewer Network. Robots for the Inspection and the Clearance of the Sewer Network in Cities. Available online: http:\/\/echord.eu\/public\/wp-content\/uploads\/2015\/11\/20141218_Challenge-Brief_Urban_Robotics.pdf."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Alejo, D., Caballero, F., and Merino, L. (2017, January 24\u201328). RGBD-based robot localization in sewer networks. Proceedings of the 2017 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Vancouver, BC, Canada.","DOI":"10.1109\/IROS.2017.8206263"},{"key":"ref_3","unstructured":"Bakambu, J.N., Polotski, V., and Cohen, P. (2000, January 27). Heading-aided odometry and range-data integration for positioning of autonomous mining vehicles. Proceedings of the 2000 IEEE International Conference on Control Applications. Conference Proceedings (Cat. No.00CH37162), Anchorage, AK, USA."},{"key":"ref_4","unstructured":"Hertzberg, J., and Kirchner, F. (1996, January 9\u201311). Landmark-based autonomous navigation in sewerage pipes. Proceedings of the First Euromicro Workshop on Advanced Mobile Robots (EUROBOT \u201996), Kaiserslautern, Germany."},{"key":"ref_5","unstructured":"Nassiraei, A.A.F., Honda, M., and Ishii, K. (2010, January 19\u201323). New approach to the self-localization of autonomous sewer inspection robots. Proceedings of the 2010 World Automation Congress, Kobe, Japan."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Tardioli, D., and Villarroel, J.L. (2014, January 14\u201315). Odometry-less localization in tunnel-like environments. Proceedings of the 2014 IEEE International Conference on Autonomous Robot Systems and Competitions (ICARSC), Espinho, Portugal.","DOI":"10.1109\/ICARSC.2014.6849764"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"186","DOI":"10.1002\/rob.20428","article-title":"Design considerations of robotic system for cleaning and inspection of large-diameter sewers","volume":"29","author":"Walter","year":"2012","journal-title":"J. Field Robot."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Rizzo, C., Kumar, V., Lera, F., and Villarroel, J.L. (2014, January 14\u201318). RF odometry for localization in pipes based on periodic signal fadings. Proceedings of the 2014 IEEE\/RSJ International Conference on Intelligent Robots and Systems, Chicago, IL, USA.","DOI":"10.1109\/IROS.2014.6943211"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"76","DOI":"10.1016\/j.mechatronics.2008.06.001","article-title":"Tracing and localization system for pipeline robot","volume":"19","author":"Qi","year":"2009","journal-title":"Mechatronics"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"180","DOI":"10.1002\/rob.20361","article-title":"Three-dimensional localization for the MagneBike inspection robot","volume":"28","author":"Pomerleau","year":"2011","journal-title":"J. Field Robot."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Jacobson, A., Zeng, F., Smith, D., Boswell, N., Peynot, T., and Milford, M. (2018, January 1\u20135). Semi-Supervised SLAM: Leveraging Low-Cost Sensors on Underground Autonomous Vehicles for Position Tracking. Proceedings of the 2018 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Madrid, Spain.","DOI":"10.1109\/IROS.2018.8593750"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Zeng, F., Jacobson, A., Smith, D., Boswell, N., Peynot, T., and Milford, M. (2019, January 20\u201324). LookUP: Vision-Only Real-Time Precise Underground Localisation for Autonomous Mining Vehicles. Proceedings of the 2019 International Conference on Robotics and Automation (ICRA), Montreal, QC, Canada.","DOI":"10.1109\/ICRA.2019.8794453"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Mascarich, F., Wilson, T., Papachristos, C., and Alexis, K. (2018, January 13). Radiation Source Localization in GPS-Denied Environments Using Aerial Robots. Proceedings of the 2018 IEEE International Conference on Robotics and Automation (ICRA), Brisbane, QLD, Australia.","DOI":"10.1109\/ICRA.2018.8460760"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Bloesch, M., Omari, S., Hutter, M., and Siegwart, R. (October, January 28). Robust visual inertial odometry using a direct EKF-based approach. Proceedings of the 2015 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Hamburg, Germany.","DOI":"10.1109\/IROS.2015.7353389"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"1255","DOI":"10.1109\/TRO.2017.2705103","article-title":"ORB-SLAM2: An Open-Source SLAM System for Monocular, Stereo and RGB-D Cameras","volume":"33","year":"2017","journal-title":"IEEE Trans. Robot."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"416","DOI":"10.1002\/rob.21831","article-title":"RTAB-Map as an open-source lidar and visual simultaneous localization and mapping library for large-scale and long-term online operation","volume":"36","author":"Michaud","year":"2019","journal-title":"J. Field Robot."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"763","DOI":"10.1002\/rob.21854","article-title":"CCM-SLAM: Robust and efficient centralized collaborative monocular simultaneous localization and mapping for robotic teams","volume":"36","author":"Schmuck","year":"2019","journal-title":"J. Field Robot."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"1533","DOI":"10.1109\/TASLP.2014.2339736","article-title":"Convolutional Neural Networks for Speech Recognition","volume":"22","author":"Mohamed","year":"2014","journal-title":"IEEE-ACM Trans. Audio Speech Language Process."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"2298","DOI":"10.1109\/TPAMI.2016.2646371","article-title":"An End-to-End Trainable Neural Network for Image-Based Sequence Recognition and Its Application to Scene Text Recognition","volume":"39","author":"Shi","year":"2017","journal-title":"IEEE Trans. Pattern Anal."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"5727","DOI":"10.1109\/TIP.2016.2615288","article-title":"Joint Facial Action Unit Detection and Feature Fusion: A Multi-Conditional Learning Approach","volume":"25","author":"Eleftheriadis","year":"2016","journal-title":"IEEE Trans. Image Process."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"545","DOI":"10.1016\/j.patcog.2018.04.022","article-title":"Learning structures of interval-based Bayesian networks in probabilistic generative model for human complex activity recognition","volume":"81","author":"Liu","year":"2018","journal-title":"Pattern Recognit."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"286","DOI":"10.1016\/j.neucom.2014.11.026","article-title":"Traffic sign segmentation and classification using statistical learning methods","volume":"153","year":"2015","journal-title":"Neurocomputing"},{"key":"ref_23","unstructured":"(2019, November 12). SIAR\u2014Sewer Inspection Autonomous Robot. Available online: https:\/siar.idmind.pt."},{"key":"ref_24","unstructured":"(2019, November 12). Astra Series\u2014Orbbec. Available online: https:\/\/orbbec3d.com\/product-astra-pro\/."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Grau, A., Morel, Y., Puig-Pey, A., and Cecchi, F. (2019). SIAR: A Ground Robot Solution for Semi-autonomous Inspection of Visitable Sewers. Advances in Robotics Research: From Lab to Market: ECHORD++: Robotic Science Supporting Innovation, Springer International Publishing.","DOI":"10.1007\/978-3-030-22327-4"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"641","DOI":"10.1007\/s10846-015-0198-y","article-title":"Enhanced Monte Carlo Localization with Visual Place Recognition for Robust Robot Localization","volume":"80","author":"Caballero","year":"2015","journal-title":"J. Intell. Robot. Syst."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"99","DOI":"10.1016\/S0004-3702(01)00069-8","article-title":"Robust Monte Carlo localization for mobile robots","volume":"128","author":"Thrun","year":"2001","journal-title":"Artif. Intell."},{"key":"ref_28","unstructured":"Thrun, S., Burgard, W., and Fox, D. (2005). Probabilistic Robotics (Intelligent Robotics and Autonomous Agents), The MIT Press."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Perez-Grau, F.J., Fabresse, F.R., Caballero, F., Viguria, A., and Ollero, A. (2016, January 7\u201310). Long-term aerial robot localization based on visual odometry and radio-based ranging. Proceedings of the 2016 International Conference on Unmanned Aircraft Systems (ICUAS), Arlington, VA, USA.","DOI":"10.1109\/ICUAS.2016.7502653"},{"key":"ref_30","unstructured":"(2019, November 12). ROS Package for Robust Odometry Estimation Based on RGB-D Data. Available online: https:\/\/github.com\/robotics-upo\/rgbd_odom."},{"key":"ref_31","unstructured":"Rosten, E., and Drummond, T. (2006, January 7\u201313). Machine Learning for High-speed Corner Detection. Proceedings of the 9th European Conference on Computer Vision\u2014Volume Part I, ECCV\u201906, Graz, Austria."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Calonder, M., Lepetit, V., Strecha, C., and Fua, P. (2010, January 5\u201311). BRIEF: Binary Robust Independent Elementary Features. Proceedings of the 11th European Conference on Computer Vision: Part IV, ECCV\u201910, Crete, Greece.","DOI":"10.1007\/978-3-642-15561-1_56"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"155","DOI":"10.1007\/s11263-008-0152-6","article-title":"EPnP: An Accurate O(n) Solution to the PnP Problem","volume":"81","author":"Lepetit","year":"2008","journal-title":"Int. J. Comput. Vis."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"2346","DOI":"10.1109\/TPAMI.2015.2409868","article-title":"Visual Place Recognition with Repetitive Structures","volume":"37","author":"Torii","year":"2015","journal-title":"IEEE Trans. Pattern Anal."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Oishi, S., Jeong, Y., Kurazume, R., Iwashita, Y., and Hasegawa, T. (2013, January 12\u201314). ND voxel localization using large-scale 3D environmental map and RGB-D camera. Proceedings of the 2013 IEEE International Conference on Robotics and Biomimetics (ROBIO), Shenzhen, China.","DOI":"10.1109\/ROBIO.2013.6739515"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Biswas, J., and Veloso, M. (2012, January 14\u201318). Depth camera based indoor mobile robot localization and navigation. Proceedings of the 2012 IEEE International Conference on Robotics and Automation, Saint Paul, MN, USA.","DOI":"10.1109\/ICRA.2012.6224766"},{"key":"ref_37","unstructured":"Krizhevsky, A., Sutskever, I., and Hinton, G.E. (2012, January 3\u20136). Imagenet classification with deep convolutional neural networks. Proceedings of the 25th International Conference on Neural Information Processing Systems, Lake Tahoe, NV, USA."},{"key":"ref_38","unstructured":"Donahue, J., Jia, Y., Vinyals, O., Hoffman, J., Zhang, N., Tzeng, E., and Darrell, T. (2014, January 21\u201326). DeCAF: A Deep Convolutional Activation Feature for Generic Visual Recognition. Proceedings of the 31st International Conference on Machine Learning, Beijing, China."},{"key":"ref_39","first-page":"563","article-title":"On the behavior of convolutional nets for feature extraction","volume":"61","author":"Pares","year":"2018","journal-title":"IEEE J. Artif. Intell. Res."},{"key":"ref_40","unstructured":"Simonyan, K., and Zisserman, A. (2014). Very Deep Convolutional Networks for Large-Scale Image Recognition. arXiv."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Cascianelli, S., Bello-Cerezo, R., Bianconi, F., Fravolini, M.L., Belal, M., Palumbo, B., and Kather, J.N. (2018, January 20\u201322). Dimensionality Reduction Strategies for CNN-Based Classification of Histopathological Images. Proceedings of the Intelligent Interactive Multimedia Systems and Services, Gold Coast, Australia.","DOI":"10.1007\/978-3-319-59480-4_3"},{"key":"ref_42","unstructured":"Wang, L., Wu, J., Huang, S., Zheng, L., Xu, X., Zhang, L., and Huang, J. (February, January 27). An Efficient Approach to Informative Feature Extraction from Multimodal Data. Proceedings of the Thirty-Third AAAI Conference on Artificial Intelligence, Honolulu, HI, USA."},{"key":"ref_43","unstructured":"Chollet, F. (2019, November 12). Keras. Available online: https:\/\/github.com\/fchollet\/keras."},{"key":"ref_44","unstructured":"Kingma, D.P., and Ba, J. (2015, January 7\u20139). Adam: A Method for Stochastic Optimization. Proceedings of the 3rd International Conference on Learning Representations (ICLR 2015), San Diego, CA, USA."},{"key":"ref_45","first-page":"1929","article-title":"Dropout: A Simple Way to Prevent Neural Networks from Overfitting","volume":"15","author":"Srivastava","year":"2014","journal-title":"J. Mach. Learn. Res."},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Poppinga, J., Vaskevicius, N., Birk, A., and Pathak, K. (2008, January 22\u201326). Fast plane detection and polygonalization in noisy 3D range images. Proceedings of the 2008 IEEE\/RSJ International Conference on Intelligent Robots and Systems, Nice, France.","DOI":"10.1109\/IROS.2008.4650729"},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"424","DOI":"10.1109\/TRO.2010.2042989","article-title":"Fast Registration Based on Noisy Planes With Unknown Correspondences for 3-D Mapping","volume":"26","author":"Pathak","year":"2010","journal-title":"IEEE Trans. Robot."},{"key":"ref_48","unstructured":"(2019, November 12). Global Monte Carlo-Based Localization from GIS-Based Graphs. Available online: https:\/\/github.com\/robotics-upo\/topological-montecarlo-localization."},{"key":"ref_49","unstructured":"(2019, November 12). Into the Dirt: Datasets of Sewer Networks with Aerial and Ground Platforms. Available online: https:\/\/robotics.upo.es\/datasets\/echord\/."},{"key":"ref_50","unstructured":"ROS.org (2019, November 12). Powering the World\u2019s Robots. Available online: https:\/\/www.ros.org\/."},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"34","DOI":"10.1109\/TRO.2006.889486","article-title":"Improved Techniques for Grid Mapping With Rao-Blackwellized Particle Filters","volume":"23","author":"Grisetti","year":"2007","journal-title":"IEEE Trans. Robot."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/19\/22\/4946\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T13:34:10Z","timestamp":1760189650000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/19\/22\/4946"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,11,13]]},"references-count":51,"journal-issue":{"issue":"22","published-online":{"date-parts":[[2019,11]]}},"alternative-id":["s19224946"],"URL":"https:\/\/doi.org\/10.3390\/s19224946","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,11,13]]}}}