{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,20]],"date-time":"2026-05-20T04:12:57Z","timestamp":1779250377298,"version":"3.51.4"},"reference-count":52,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2023,3,6]],"date-time":"2023-03-06T00:00:00Z","timestamp":1678060800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100000266","name":"Engineering and Physical Sciences Research Council","doi-asserted-by":"publisher","award":["EP\/S016813\/1"],"award-info":[{"award-number":["EP\/S016813\/1"]}],"id":[{"id":"10.13039\/501100000266","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Robot. AI"],"abstract":"<jats:p>Buried sewer pipe networks present many challenges for robot localization systems, which require non-standard solutions due to the unique nature of these environments: they cannot receive signals from global positioning systems (GPS) and can also lack visual features necessary for standard visual odometry algorithms. In this paper, we exploit the fact that pipe joints are equally spaced and develop a robot localization method based on pipe joint detection that operates in one degree-of-freedom along the pipe length. Pipe joints are detected in visual images from an on-board forward facing (electro-optical) camera using a bag-of-keypoints visual categorization algorithm, which is trained offline by unsupervised learning from images of sewer pipe joints. We augment the pipe joint detection algorithm with drift correction using vision-based manhole recognition. We evaluated the approach using real-world data recorded from three sewer pipes (of lengths 30, 50 and 90\u00a0m) and benchmarked against a standard method for visual odometry (ORB-SLAM3), which demonstrated that our proposed method operates more robustly and accurately in these feature-sparse pipes: ORB-SLAM3 completely failed on one tested pipe due to a lack of visual features and gave a mean absolute error in localization of approximately 12%\u201320% on the other pipes (and regularly lost track of features, having to re-initialize multiple times), whilst our method worked successfully on all tested pipes and gave a mean absolute error in localization of approximately 2%\u20134%. In summary, our results highlight an important trade-off between modern visual odometry algorithms that have potentially high precision and estimate full six degree-of-freedom pose but are potentially fragile in feature sparse pipes, <jats:italic>versus<\/jats:italic> simpler, approximate localization methods that operate in one degree-of-freedom along the pipe length that are more robust and can lead to substantial improvements in accuracy.<\/jats:p>","DOI":"10.3389\/frobt.2023.1150508","type":"journal-article","created":{"date-parts":[[2023,4,6]],"date-time":"2023-04-06T05:07:27Z","timestamp":1680757647000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":11,"title":["A robust method for approximate visual robot localization in feature-sparse sewer pipes"],"prefix":"10.3389","volume":"10","author":[{"given":"S.","family":"Edwards","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"R.","family":"Zhang","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"R.","family":"Worley","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"L.","family":"Mihaylova","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"J.","family":"Aitken","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"S. R.","family":"Anderson","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1965","published-online":{"date-parts":[[2023,3,6]]},"reference":[{"key":"B1","first-page":"291","article-title":"A laser scanner for landmark detection with the sewer inspection robot KANTARO","author":"Ahrary","year":"2006"},{"key":"B2","doi-asserted-by":"publisher","first-page":"140173","DOI":"10.1109\/access.2021.3115981","article-title":"Simultaneous localization and mapping for inspection robots in water and sewer pipe networks: A review","volume":"9","author":"Aitken","year":"2021","journal-title":"IEEE Access"},{"key":"B3","doi-asserted-by":"publisher","first-page":"609","DOI":"10.1109\/tcst.2018.2879628","article-title":"Inertial navigation system of pipeline inspection gauge","volume":"28","author":"Al-Masri","year":"2020","journal-title":"IEEE Trans. Control Syst. Technol."},{"key":"B4","doi-asserted-by":"publisher","first-page":"4946","DOI":"10.3390\/s19224946","article-title":"A robust localization system for inspection robots in sewer networks","volume":"19","author":"Alejo","year":"2019","journal-title":"Sensors"},{"key":"B5","first-page":"4070","article-title":"RGBD-based robot localization in sewer networks","author":"Alejo","year":"2017"},{"key":"B6","unstructured":"Failure to act: The economic impact of current investment trends in water and wastewater treatment infrastructure2011"},{"key":"B7","first-page":"207","article-title":"Sound-based online localization for an in-pipe snake robot","author":"Bando","year":"2016"},{"key":"B8","doi-asserted-by":"publisher","first-page":"346","DOI":"10.1016\/j.cviu.2007.09.014","article-title":"Speeded-up robust features (surf)","volume":"110","author":"Bay","year":"2008","journal-title":"Comput. Vis. Image Underst."},{"key":"B9","doi-asserted-by":"publisher","first-page":"1874","DOI":"10.1109\/tro.2021.3075644","article-title":"ORB-SLAM3: An accurate open-source library for visual, visual\u2013inertial, and multimap SLAM","volume":"37","author":"Campos","year":"2021","journal-title":"IEEE Trans. Robotics"},{"key":"B10","doi-asserted-by":"publisher","first-page":"189","DOI":"10.1016\/j.neucom.2019.10.118","article-title":"A comprehensive survey on support vector machine classification: Applications, challenges and trends","volume":"408","author":"Cervantes","year":"2020","journal-title":"Neurocomputing"},{"key":"B11","doi-asserted-by":"publisher","first-page":"104453","DOI":"10.1109\/access.2019.2931748","article-title":"Positioning accuracy of a pipeline surveying system based on MEMS IMU and odometer: Case study","volume":"7","author":"Chen","year":"2019","journal-title":"IEEE Access"},{"key":"B12","doi-asserted-by":"publisher","first-page":"21001","DOI":"10.1115\/1.4030945","article-title":"Pipeline inspection gauge position estimation using inertial measurement unit, odometer, and a set of reference stations","volume":"2","author":"Chowdhury","year":"2016","journal-title":"ASME J. Risk Uncertain. Part B"},{"key":"B13","article-title":"Visual categorization with bags of keypoints","volume-title":"Workshop on statistical learning in computer vision","author":"Csurka","year":"2004"},{"key":"B14","first-page":"1","article-title":"PipeTron series - robots for pipe inspection","author":"Debenest","year":"2014"},{"key":"B15","doi-asserted-by":"publisher","first-page":"73","DOI":"10.1109\/jsen.2002.1000245","article-title":"State of the art in sensor technologies for sewer inspection","volume":"2","author":"Duran","year":"2002","journal-title":"IEEE Sensors J."},{"key":"B16","first-page":"1073","article-title":"Assessing the feasibility of monocular visual simultaneous localization and mapping for live sewer pipes: A field robotics study","author":"Evans","year":"2021"},{"key":"B17","doi-asserted-by":"publisher","first-page":"558","DOI":"10.1007\/bf01934268","article-title":"Least-squares fitting of circles and ellipses","volume":"34","author":"Gander","year":"1994","journal-title":"BIT Numer. Math."},{"key":"B18","doi-asserted-by":"publisher","first-page":"1231","DOI":"10.1177\/0278364913491297","article-title":"Vision meets robotics: The KITTI dataset","volume":"32","author":"Geiger","year":"2013","journal-title":"Int. J. Robotics Res."},{"key":"B19","first-page":"1227","article-title":"Junction detection based on CCWT and MEMS accelerometer measurement","author":"Guan","year":"2018"},{"key":"B20","first-page":"4020","article-title":"Stereo visual odometry for pipe mapping","author":"Hansen","year":""},{"key":"B21","first-page":"3111","article-title":"Monocular visual odometry for robot localization in LNG pipes","author":"Hansen","year":""},{"key":"B22","first-page":"5180","article-title":"Pipe mapping with monocular fisheye imagery","author":"Hansen","year":"2013"},{"key":"B23","doi-asserted-by":"publisher","first-page":"532","DOI":"10.1177\/0278364914550133","article-title":"Visual mapping for natural gas pipe inspection","volume":"34","author":"Hansen","year":"2015","journal-title":"Int. J. Robotics Res."},{"key":"B24","doi-asserted-by":"publisher","first-page":"162035","DOI":"10.1109\/access.2021.3130233","article-title":"Localization, mapping, navigation, and inspection methods in in-pipe robots: A review","volume":"9","author":"Kazeminasab","year":"2021","journal-title":"IEEE Access"},{"key":"B25","doi-asserted-by":"publisher","first-page":"2585","DOI":"10.1109\/jsen.2018.2795043","article-title":"Weaving laser vision system for navigation of mobile robots in pipeline structures","volume":"18","author":"Kim","year":"2018","journal-title":"IEEE Sensors J."},{"key":"B26","doi-asserted-by":"crossref","first-page":"504","DOI":"10.1109\/ICPR.2000.905386","article-title":"Online distance recovery for a sewer inspection robot","volume":"1","author":"Kolesnik","year":"2000","journal-title":"Proc. 15th Int. Conf. Pattern Recognit."},{"key":"B27","doi-asserted-by":"publisher","first-page":"601","DOI":"10.1017\/s0263574714001726","article-title":"Landmark detection methods for in-pipe robot traveling in urban gas pipelines","volume":"34","author":"Lee","year":"2016","journal-title":"Robotica"},{"key":"B28","first-page":"2548","article-title":"Robot mapping and localisation in metal water pipes using hydrophone induced vibration and map alignment by dynamic time warping","author":"Ma","year":""},{"key":"B29","first-page":"1459","article-title":"PipeSLAM: Simultaneous localisation and mapping in feature sparse water pipes using the rao-blackwellised particle filter","author":"Ma","year":""},{"key":"B30","doi-asserted-by":"crossref","first-page":"161","DOI":"10.1007\/978-3-319-22416-9_19","article-title":"Robot mapping and localisation for feature sparse water pipes using voids as landmarks","volume-title":"Towards autonomous robotic systems (TAROS 2015), lecture notes in computer science","author":"Ma","year":"2015"},{"key":"B31","doi-asserted-by":"publisher","first-page":"1","DOI":"10.3182\/20120905-3-HR-2030.00122","article-title":"Dewalop-robust pipe joint detection","volume":"47","author":"Mateos","year":"2011","journal-title":"Proc. Int. Conf. Image Process. Comput. Vis. Pattern Recognit. (IPCV)"},{"key":"B32","first-page":"2537","article-title":"3-D shape measurement of pipe by range finder constructed with omni-directional laser and omni-directional camera","author":"Matsui","year":"2010"},{"key":"B33","doi-asserted-by":"crossref","DOI":"10.1109\/TePRA.2013.6556377","article-title":"IMU and cable encoder data fusion for in-pipe mobile robot localization","author":"Murtra","year":"2013"},{"key":"B34","doi-asserted-by":"publisher","first-page":"64","DOI":"10.1016\/j.autcon.2018.08.005","article-title":"Automated detection of faults in sewers using CCTV image sequences","volume":"95","author":"Myrans","year":"2018","journal-title":"Automation Constr."},{"key":"B35","first-page":"4088","article-title":"A new approach to the sewer pipe inspection: Fully autonomous mobile robot \u201dKANTARO","author":"Nassiraei","year":"2006"},{"key":"B36","doi-asserted-by":"publisher","first-page":"997415","DOI":"10.3389\/frobt.2022.997415","article-title":"Autonomous control for miniaturized mobile robots in unknown pipe networks","volume":"9","author":"Nguyen","year":"2022","journal-title":"Front. Robotics AI"},{"key":"B37","doi-asserted-by":"publisher","first-page":"553","DOI":"10.5244\/C.9.55","article-title":"Robust tracking of circular features","volume":"95","author":"Pan","year":"1995","journal-title":"Proc. Br. Mach. Vis. Conf."},{"key":"B52","doi-asserted-by":"publisher","first-page":"37","DOI":"10.48550\/arXiv.2010.16061","article-title":"Evaluation: From precision, recall and f-measure to ROC, informedness, markedness and correlation","volume":"2","author":"Powers","year":"2011","journal-title":"J. Machine Learning Technologies"},{"key":"B38","doi-asserted-by":"publisher","first-page":"103702","DOI":"10.1016\/j.robot.2020.103702","article-title":"An alternative approach for robot localization inside pipes using RF spatial fadings","volume":"136","author":"Rizzo","year":"2021","journal-title":"Robotics Aut. Syst."},{"key":"B39","first-page":"1724","article-title":"Modularized in-pipe robot capable of selective navigation inside of pipelines","author":"Roh","year":"2008"},{"key":"B40","doi-asserted-by":"publisher","first-page":"57","DOI":"10.1016\/s1462-0758(99)00012-6","article-title":"Towards autonomous sewer robots: The MAKRO project","volume":"1","author":"Rome","year":"1999","journal-title":"Urban Water"},{"key":"B41","doi-asserted-by":"publisher","first-page":"567","DOI":"10.3390\/s16040567","article-title":"A novel method to enhance pipeline trajectory determination using pipeline junctions","volume":"16","author":"Sahli","year":"2016","journal-title":"Sensors"},{"key":"B42","doi-asserted-by":"publisher","first-page":"217","DOI":"10.1002\/rob.20330","article-title":"Visual and nondestructive evaluation inspection of live gas mains using the explorer\u2122 family of pipe robots","volume":"27","author":"Schempf","year":"2010","journal-title":"J. Field Robotics"},{"key":"B43","doi-asserted-by":"publisher","first-page":"28","DOI":"10.1109\/ICARSC.2016.22","article-title":"A robot localization system based on RF fadings using particle filters inside pipes","author":"Seco","year":"2016","journal-title":"Proc. Int. Conf. Aut. Robot Syst. Compet. (ICARSC)"},{"key":"B44","doi-asserted-by":"publisher","first-page":"65","DOI":"10.1016\/j.imavis.2014.10.013","article-title":"How to use bag-of-words model better for image classification","volume":"38","author":"Wang","year":"2015","journal-title":"Image Vis. Comput."},{"key":"B45","doi-asserted-by":"publisher","first-page":"5584","DOI":"10.3390\/s20195584","article-title":"Robot localization in water pipes using acoustic signals and pose graph optimization","volume":"20","author":"Worley","year":"","journal-title":"Sensors"},{"key":"B46","first-page":"160","article-title":"Acoustic echo-localization for pipe inspection robots","author":"Worley","year":""},{"key":"B47","doi-asserted-by":"publisher","first-page":"809","DOI":"10.1109\/tii.2015.2469636","article-title":"Node localization in robotic sensor networks for pipeline inspection","volume":"12","author":"Wu","year":"2015","journal-title":"IEEE Trans. Industrial Inf."},{"key":"B48","first-page":"3180","article-title":"A practical minimalism approach to in-pipe robot localization","author":"Wu","year":"2019"},{"key":"B49","doi-asserted-by":"publisher","first-page":"367","DOI":"10.1121\/10.0016856","article-title":"Microphone array analysis for simultaneous condition detection, localization, and classification in a pipe","volume":"153","author":"Yu","year":"2023","journal-title":"J. Acoust. Soc. Am."},{"key":"B50","doi-asserted-by":"publisher","first-page":"71","DOI":"10.1016\/0262-8856(90)90059-e","article-title":"Comparative study of Hough transform methods for circle finding","volume":"8","author":"Yuen","year":"1990","journal-title":"Image Vis. Comput."},{"key":"B51","doi-asserted-by":"crossref","first-page":"56","DOI":"10.1007\/978-3-030-89177-0_6","article-title":"Improving SLAM in pipe networks by leveraging cylindrical regularity","volume-title":"Proc. Of the annual conference towards autonomous robotic systems","author":"Zhang","year":"2021"}],"container-title":["Frontiers in Robotics and AI"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/frobt.2023.1150508\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,4,6]],"date-time":"2023-04-06T05:07:39Z","timestamp":1680757659000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/frobt.2023.1150508\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,3,6]]},"references-count":52,"alternative-id":["10.3389\/frobt.2023.1150508"],"URL":"https:\/\/doi.org\/10.3389\/frobt.2023.1150508","relation":{},"ISSN":["2296-9144"],"issn-type":[{"value":"2296-9144","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,3,6]]},"article-number":"1150508"}}