{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,23]],"date-time":"2026-03-23T03:24:26Z","timestamp":1774236266737,"version":"3.50.1"},"reference-count":131,"publisher":"MDPI AG","issue":"7","license":[{"start":{"date-parts":[[2022,4,1]],"date-time":"2022-04-01T00:00:00Z","timestamp":1648771200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Due to the advantages of economics, safety, and efficiency, vision-based analysis techniques have recently gained conspicuous advancements, enabling them to be extensively applied for autonomous constructions. Although numerous studies regarding the defect inspection and condition assessment in underground sewer pipelines have presently emerged, we still lack a thorough and comprehensive survey of the latest developments. This survey presents a systematical taxonomy of diverse sewer inspection algorithms, which are sorted into three categories that include defect classification, defect detection, and defect segmentation. After reviewing the related sewer defect inspection studies for the past 22 years, the main research trends are organized and discussed in detail according to the proposed technical taxonomy. In addition, different datasets and the evaluation metrics used in the cited literature are described and explained. Furthermore, the performances of the state-of-the-art methods are reported from the aspects of processing accuracy and speed.<\/jats:p>","DOI":"10.3390\/s22072722","type":"journal-article","created":{"date-parts":[[2022,4,1]],"date-time":"2022-04-01T21:23:55Z","timestamp":1648848235000},"page":"2722","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":42,"title":["Vision-Based Defect Inspection and Condition Assessment for Sewer Pipes: A Comprehensive Survey"],"prefix":"10.3390","volume":"22","author":[{"given":"Yanfen","family":"Li","sequence":"first","affiliation":[{"name":"Department of Computer Science and Engineering, Sejong University, Seoul 05006, Korea"}]},{"given":"Hanxiang","family":"Wang","sequence":"additional","affiliation":[{"name":"Department of Computer Science and Engineering, Sejong University, Seoul 05006, Korea"}]},{"given":"L. Minh","family":"Dang","sequence":"additional","affiliation":[{"name":"Department of Information and Communication Engineering and Convergence Engineering for Intelligent Drone, Sejong University, Seoul 05006, Korea"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3274-4982","authenticated-orcid":false,"given":"Hyoung-Kyu","family":"Song","sequence":"additional","affiliation":[{"name":"Department of Information and Communication Engineering and Convergence Engineering for Intelligent Drone, Sejong University, Seoul 05006, Korea"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7668-3838","authenticated-orcid":false,"given":"Hyeonjoon","family":"Moon","sequence":"additional","affiliation":[{"name":"Department of Computer Science and Engineering, Sejong University, Seoul 05006, Korea"}]}],"member":"1968","published-online":{"date-parts":[[2022,4,1]]},"reference":[{"key":"ref_1","unstructured":"(2022, February 20). The 2019 Canadian Infrastructure Report Card (CIRC). Available online: http:\/\/canadianinfrastructure.ca\/downloads\/canadian-infrastructure-report-card-2019.pdf."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"662","DOI":"10.1080\/1573062X.2020.1713382","article-title":"Sewer asset management\u2013state of the art and research needs","volume":"16","author":"Caradot","year":"2019","journal-title":"Urban Water J."},{"key":"ref_3","unstructured":"(2022, February 20). 2021 Report Card for America\u2019s Infrastructure 2021 Wastewater. Available online: https:\/\/infrastructurereportcard.org\/wp-content\/uploads\/2020\/12\/Wastewater-2021.pdf."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"199","DOI":"10.1016\/j.eng.2018.11.030","article-title":"Advances in computer vision-based civil infrastructure inspection and monitoring","volume":"5","author":"Spencer","year":"2019","journal-title":"Engineering"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"73","DOI":"10.1109\/JSEN.2002.1000245","article-title":"State of the art in sensor technologies for sewer inspection","volume":"2","author":"Duran","year":"2002","journal-title":"IEEE Sens. J."},{"key":"ref_6","unstructured":"2021 Global Green Growth Institute (2022, February 20). Available online: http:\/\/gggi.org\/site\/assets\/uploads\/2019\/01\/Wastewater-System-Operation-and-Maintenance-Guideline-1.pdf."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"103061","DOI":"10.1016\/j.autcon.2019.103061","article-title":"A Survey on image-based automation of CCTV and SSET sewer inspections","volume":"111","author":"Haurum","year":"2020","journal-title":"Autom. Constr."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"103516","DOI":"10.1016\/j.autcon.2020.103516","article-title":"Review of image-based analysis and applications in construction","volume":"122","author":"Mostafa","year":"2021","journal-title":"Autom. Constr."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"102967","DOI":"10.1016\/j.autcon.2019.102967","article-title":"A deep learning-based framework for an automated defect detection system for sewer pipes","volume":"109","author":"Yin","year":"2020","journal-title":"Autom. Constr."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Czimmermann, T., Ciuti, G., Milazzo, M., Chiurazzi, M., Roccella, S., Oddo, C.M., and Dario, P. (2020). Visual-based defect detection and classification approaches for industrial applications\u2014A survey. Sensors, 20.","DOI":"10.3390\/s20051459"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"103289","DOI":"10.1016\/j.autcon.2020.103289","article-title":"Classifying cracks at sub-class level in closed circuit television sewer inspection videos","volume":"118","author":"Zuo","year":"2020","journal-title":"Autom. Constr."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"96","DOI":"10.1016\/j.compind.2018.03.020","article-title":"Utilizing text recognition for the defects extraction in sewers CCTV inspection videos","volume":"99","author":"Dang","year":"2018","journal-title":"Comput. Ind."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"104381","DOI":"10.1016\/j.ijpvp.2021.104381","article-title":"Detection algorithm of defects on polyethylene gas pipe using image recognition","volume":"191","author":"Li","year":"2021","journal-title":"Int. J. Press. Vessel. Pip."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"47","DOI":"10.1016\/j.autcon.2005.02.007","article-title":"Segmentation of buried concrete pipe images","volume":"15","author":"Sinha","year":"2006","journal-title":"Autom. Constr."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"1327","DOI":"10.1016\/j.eswa.2007.08.013","article-title":"Automated diagnosis of sewer pipe defects based on machine learning approaches","volume":"35","author":"Yang","year":"2008","journal-title":"Expert Syst. Appl."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"29","DOI":"10.1016\/S0886-7798(00)00021-3","article-title":"Condition assessment of underground sewer pipes using a modified digital image processing paradigm","volume":"14","author":"McKim","year":"1999","journal-title":"Tunn. Undergr. Space Technol."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"214","DOI":"10.1080\/15732479.2010.541265","article-title":"The consistency of visual sewer inspection data","volume":"9","author":"Dirksen","year":"2013","journal-title":"Struct. Infrastruct. Eng."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"1385","DOI":"10.1080\/15732479.2013.816974","article-title":"Visual sewer inspection: Detail of coding system versus data quality?","volume":"10","author":"Dirksen","year":"2014","journal-title":"Struct. Infrastruct. Eng."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"04020038","DOI":"10.1061\/(ASCE)CP.1943-5487.0000918","article-title":"Machine learning for crack detection: Review and model performance comparison","volume":"34","author":"Hsieh","year":"2020","journal-title":"J. Comput. Civ. Eng."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"103721","DOI":"10.1016\/j.engappai.2020.103721","article-title":"A state of the art review on condition assessment models developed for sewer pipelines","volume":"93","author":"Hawari","year":"2020","journal-title":"Eng. Appl. Artif. Intell."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"1090","DOI":"10.1111\/mice.12412","article-title":"Automatic pixel-level crack detection and measurement using fully convolutional network","volume":"33","author":"Yang","year":"2018","journal-title":"Comput.-Aided Civ. Infrastruct. Eng."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Li, G., Ma, B., He, S., Ren, X., and Liu, Q. (2020). Automatic tunnel crack detection based on u-net and a convolutional neural network with alternately updated clique. Sensors, 20.","DOI":"10.3390\/s20030717"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Wang, M., Luo, H., and Cheng, J.C. (2020, January 8\u201310). Severity Assessment of Sewer Pipe Defects in Closed-Circuit Television (CCTV) Images Using Computer Vision Techniques. Proceedings of the Construction Research Congress 2020: Infrastructure Systems and Sustainability, Tempe, AZ, USA.","DOI":"10.1061\/9780784482858.101"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Moradi, S., Zayed, T., and Golkhoo, F. (2019). Review on computer aided sewer pipeline defect detection and condition assessment. Infrastructures, 4.","DOI":"10.3390\/infrastructures4010010"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"1766","DOI":"10.1016\/j.eswa.2010.07.103","article-title":"Systematic image quality assessment for sewer inspection","volume":"38","author":"Yang","year":"2011","journal-title":"Expert Syst. Appl."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Henriksen, K.S., Lynge, M.S., Jeppesen, M.D., Allahham, M.M., Nikolov, I.A., Haurum, J.B., and Moeslund, T.B. (2020, January 7\u201310). Generating synthetic point clouds of sewer networks: An initial investigation. Proceedings of the International Conference on Augmented Reality, Virtual Reality and Computer Graphics, Lecce, Italy.","DOI":"10.1007\/978-3-030-58468-9_26"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Alejo, D., Caballero, F., and Merino, L. (2017, January 24\u201328). RGBD-based robot localization in sewer networks. Proceedings of the 2017 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Vancouver, BC, Canada.","DOI":"10.1109\/IROS.2017.8206263"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.autcon.2016.10.010","article-title":"A technology for sewer pipe inspection (Part 2): Experimental assessment of a new laser profiler for sewer defect detection and quantification","volume":"73","author":"Lepot","year":"2017","journal-title":"Autom. Constr."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"118","DOI":"10.1109\/TASE.2006.873225","article-title":"Automated pipe defect detection and categorization using camera\/laser-based profiler and artificial neural network","volume":"4","author":"Duran","year":"2007","journal-title":"IEEE Trans. Autom. Sci. Eng."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Khan, M.S., and Patil, R. (2018, January 16\u201319). Acoustic characterization of pvc sewer pipes for crack detection using frequency domain analysis. Proceedings of the 2018 IEEE International Smart Cities Conference (ISC2), Kansas City, MO, USA.","DOI":"10.1109\/ISC2.2018.8656739"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"149","DOI":"10.1016\/j.autcon.2011.06.013","article-title":"Evaluation of ultrasonic inspection and imaging systems for concrete pipes","volume":"22","author":"Iyer","year":"2012","journal-title":"Autom. Constr."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"105174","DOI":"10.1016\/j.compag.2019.105174","article-title":"Crop pest recognition in natural scenes using convolutional neural networks","volume":"169","author":"Li","year":"2020","journal-title":"Comput. Electron. Agric."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"29411","DOI":"10.1007\/s11042-020-09571-5","article-title":"Smartphone-based bulky waste classification using convolutional neural networks","volume":"79","author":"Wang","year":"2020","journal-title":"Multimed. Tools Appl."},{"key":"ref_34","first-page":"451","article-title":"Damage Detection and Classification System for Sewer Inspection using Convolutional Neural Networks based on Deep Learning","volume":"22","author":"Hassan","year":"2018","journal-title":"J. Korea Inst. Inf. Commun. Eng."},{"key":"ref_35","first-page":"4","article-title":"Support vector machines: A practical consequence of learning theory","volume":"13","author":"Scholkopf","year":"1998","journal-title":"IEEE Intell. Syst."},{"key":"ref_36","unstructured":"Li, X., Wang, L., and Sung, E. (August, January 31). A study of AdaBoost with SVM based weak learners. Proceedings of the 2005 IEEE International Joint Conference on Neural Networks, Montreal, QC, Canada."},{"key":"ref_37","first-page":"145","article-title":"Overcome support vector machine diagnosis overfitting","volume":"13","author":"Han","year":"2014","journal-title":"Cancer Inform."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"22","DOI":"10.1016\/j.ins.2013.11.003","article-title":"Nonparallel hyperplane support vector machine for binary classification problems","volume":"263","author":"Shao","year":"2014","journal-title":"Inf. Sci."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"189","DOI":"10.1016\/j.neucom.2019.10.118","article-title":"A comprehensive survey on support vector machine classification: Applications, challenges and trends","volume":"408","author":"Cervantes","year":"2020","journal-title":"Neurocomputing"},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Xu, Y., Yang, J., Zhao, S., Wu, H., and Sawan, M. (September, January 31). An end-to-end deep learning approach for epileptic seizure prediction. Proceedings of the 2020 2nd IEEE International Conference on Artificial Intelligence Circuits and Systems (AICAS), Genoa, Italy.","DOI":"10.1109\/AICAS48895.2020.9073988"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"17","DOI":"10.1007\/s11783-019-1102-y","article-title":"Diagnosis of sewer pipe defects on image recognition of multi-features and support vector machine in a southern Chinese city","volume":"13","author":"Ye","year":"2019","journal-title":"Front. Environ. Sci. Eng."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"179","DOI":"10.1109\/TIT.1962.1057692","article-title":"Visual pattern recognition by moment invariants","volume":"8","author":"Hu","year":"1962","journal-title":"IRE Trans. Inf. Theory"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"974","DOI":"10.1117\/1.602138","article-title":"Fourier transform method for automatic processing of moir\u00e9 deflectograms","volume":"38","author":"Quiroga","year":"1999","journal-title":"Opt. Eng."},{"key":"ref_44","unstructured":"Tomasi, C., and Manduchi, R. (1998, January 7). Bilateral filtering for gray and color images. Proceedings of the Sixth International Conference on Computer Vision (IEEE Cat. No. 98CH36271), Bombay, IN, USA."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"779","DOI":"10.1109\/TIP.2018.2871597","article-title":"Fast adaptive bilateral filtering","volume":"28","author":"Gavaskar","year":"2018","journal-title":"IEEE Trans. Image Process."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"106","DOI":"10.1113\/jphysiol.1962.sp006837","article-title":"Receptive fields, binocular interaction and functional architecture in the cat\u2019s visual cortex","volume":"160","author":"Hubel","year":"1962","journal-title":"J. Physiol."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"436","DOI":"10.1038\/nature14539","article-title":"Deep learning","volume":"521","author":"LeCun","year":"2015","journal-title":"Nature"},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"273","DOI":"10.1016\/j.autcon.2018.03.028","article-title":"Automated defect classification in sewer closed circuit television inspections using deep convolutional neural networks","volume":"91","author":"Kumar","year":"2018","journal-title":"Autom. Constr."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"281","DOI":"10.1016\/j.autcon.2019.04.013","article-title":"A defect classification methodology for sewer image sets with convolutional neural networks","volume":"104","author":"Meijer","year":"2019","journal-title":"Autom. Constr."},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"158","DOI":"10.1016\/j.dsp.2003.07.002","article-title":"A simple and effective histogram equalization approach to image enhancement","volume":"14","author":"Cheng","year":"2004","journal-title":"Digit. Signal Process."},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"1329","DOI":"10.1007\/s11760-018-1286-9","article-title":"Image dehazing using morphological opening, dilation and Gaussian filtering","volume":"12","author":"Echeverri","year":"2018","journal-title":"Signal Image Video Process."},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"107630","DOI":"10.1016\/j.cie.2021.107630","article-title":"Deep Learning-based Sewer Defect Classification for Highly Imbalanced Dataset","volume":"161","author":"Dang","year":"2021","journal-title":"Comput. Ind. Eng."},{"key":"ref_53","unstructured":"Simonyan, K., and Zisserman, A. (2014). Very deep convolutional networks for large-scale image recognition. arXiv."},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"97","DOI":"10.1061\/(ASCE)1076-0342(2000)6:3(97)","article-title":"Classification of defects in sewer pipes using neural networks","volume":"6","author":"Moselhi","year":"2000","journal-title":"J. Infrastruct. Syst."},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"393","DOI":"10.1109\/72.991425","article-title":"Classification of underground pipe scanned images using feature extraction and neuro-fuzzy algorithm","volume":"13","author":"Sinha","year":"2002","journal-title":"IEEE Trans. Neural Netw."},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"73","DOI":"10.1016\/j.autcon.2005.02.005","article-title":"Neuro-fuzzy network for the classification of buried pipe defects","volume":"15","author":"Sinha","year":"2006","journal-title":"Autom. Constr."},{"key":"ref_57","doi-asserted-by":"crossref","first-page":"160","DOI":"10.1061\/(ASCE)0887-3801(2009)23:3(160)","article-title":"Visual pattern recognition supporting defect reporting and condition assessment of wastewater collection systems","volume":"23","author":"Guo","year":"2009","journal-title":"J. Comput. Civ. Eng."},{"key":"ref_58","doi-asserted-by":"crossref","first-page":"587","DOI":"10.1016\/j.autcon.2008.12.003","article-title":"Automated defect detection for sewer pipeline inspection and condition assessment","volume":"18","author":"Guo","year":"2009","journal-title":"Autom. Constr."},{"key":"ref_59","doi-asserted-by":"crossref","first-page":"3562","DOI":"10.1016\/j.eswa.2008.02.006","article-title":"Segmenting ideal morphologies of sewer pipe defects on CCTV images for automated diagnosis","volume":"36","author":"Yang","year":"2009","journal-title":"Expert Syst. Appl."},{"key":"ref_60","doi-asserted-by":"crossref","unstructured":"Ganegedara, H., Alahakoon, D., Mashford, J., Paplinski, A., M\u00fcller, K., and Deserno, T.M. (2012, January 10\u201315). Self organising map based region of interest labelling for automated defect identification in large sewer pipe image collections. Proceedings of the 2012 International Joint Conference on Neural Networks (IJCNN), Brisbane, Australia.","DOI":"10.1109\/IJCNN.2012.6252482"},{"key":"ref_61","doi-asserted-by":"crossref","first-page":"263","DOI":"10.1007\/s10044-013-0355-5","article-title":"Classification of defects with ensemble methods in the automated visual inspection of sewer pipes","volume":"18","author":"Wu","year":"2015","journal-title":"Pattern Anal. Appl."},{"key":"ref_62","doi-asserted-by":"crossref","first-page":"36","DOI":"10.1016\/j.proeng.2016.07.416","article-title":"Automated detection of faults in wastewater pipes from CCTV footage by using random forests","volume":"154","author":"Myrans","year":"2016","journal-title":"Procedia Eng."},{"key":"ref_63","doi-asserted-by":"crossref","unstructured":"Myrans, J., Kapelan, Z., and Everson, R. (2022, February 20). Automatic detection of sewer faults using continuous CCTV footage. Computing & Control for the Water Industry, Available online: https:\/\/easychair.org\/publications\/open\/ZQH3.","DOI":"10.29007\/w41w"},{"key":"ref_64","doi-asserted-by":"crossref","unstructured":"Moradi, S., and Zayed, T. (2017). Real-time defect detection in sewer closed circuit television inspection videos. Pipelines 2017, ASCE.","DOI":"10.1061\/9780784480885.027"},{"key":"ref_65","unstructured":"Myrans, J., Kapelan, Z., and Everson, R. (2022, February 20). Using automatic anomaly detection to identify faults in sewers. WDSA\/CCWI Joint Conference Proceedings, Available online: https:\/\/ojs.library.queensu.ca\/index.php\/wdsa-ccw\/article\/view\/12030."},{"key":"ref_66","doi-asserted-by":"crossref","first-page":"1478","DOI":"10.29007\/w41w","article-title":"Automatic identification of sewer fault types using CCTV footage","volume":"3","author":"Myrans","year":"2018","journal-title":"EPiC Ser. Eng."},{"key":"ref_67","doi-asserted-by":"crossref","unstructured":"Chen, K., Hu, H., Chen, C., Chen, L., and He, C. (2018, January 11\u201313). An intelligent sewer defect detection method based on convolutional neural network. Proceedings of the 2018 IEEE International Conference on Information and Automation (ICIA), Wuyishan, China.","DOI":"10.1109\/ICInfA.2018.8812445"},{"key":"ref_68","doi-asserted-by":"crossref","unstructured":"Moradi, S., Zayed, T., and Golkhoo, F. (2018). Automated sewer pipeline inspection using computer vision techniques. Pipelines 2018: Condition Assessment, Construction, and Rehabilitation, American Society of Civil Engineers.","DOI":"10.1061\/9780784481653.064"},{"key":"ref_69","doi-asserted-by":"crossref","first-page":"1836","DOI":"10.1109\/TASE.2019.2900170","article-title":"Automatic detection and classification of sewer defects via hierarchical deep learning","volume":"16","author":"Xie","year":"2019","journal-title":"IEEE Trans. Autom. Sci. Eng."},{"key":"ref_70","doi-asserted-by":"crossref","first-page":"199","DOI":"10.1016\/j.autcon.2019.01.017","article-title":"Sewer damage detection from imbalanced CCTV inspection data using deep convolutional neural networks with hierarchical classification","volume":"101","author":"Li","year":"2019","journal-title":"Autom. Constr."},{"key":"ref_71","doi-asserted-by":"crossref","first-page":"102849","DOI":"10.1016\/j.autcon.2019.102849","article-title":"Underground sewer pipe condition assessment based on convolutional neural networks","volume":"106","author":"Hassan","year":"2019","journal-title":"Autom. Constr."},{"key":"ref_72","doi-asserted-by":"crossref","unstructured":"Khan, S.M., Haider, S.A., and Unwala, I. (2020, January 14\u201316). A Deep Learning Based Classifier for Crack Detection with Robots in Underground Pipes. Proceedings of the 2020 IEEE 17th International Conference on Smart Communities: Improving Quality of Life Using ICT, IoT and AI (HONET), Charlotte, NC, USA.","DOI":"10.1109\/HONET50430.2020.9322665"},{"key":"ref_73","doi-asserted-by":"crossref","first-page":"103372","DOI":"10.1016\/j.autcon.2020.103372","article-title":"Artificial intelligence-empowered pipeline for image-based inspection of concrete structures","volume":"120","author":"Chow","year":"2020","journal-title":"Autom. Constr."},{"key":"ref_74","doi-asserted-by":"crossref","unstructured":"Klusek, M., and Szydlo, T. (2021, January 16\u201318). Supporting the Process of Sewer Pipes Inspection Using Machine Learning on Embedded Devices. Proceedings of the International Conference on Computational Science, Krakow, Poland.","DOI":"10.1007\/978-3-030-77980-1_27"},{"key":"ref_75","doi-asserted-by":"crossref","first-page":"67","DOI":"10.1016\/j.iatssr.2018.05.005","article-title":"Smarter and more connected: Future intelligent transportation system","volume":"42","author":"Sumalee","year":"2018","journal-title":"Iatss Res."},{"key":"ref_76","doi-asserted-by":"crossref","first-page":"3152","DOI":"10.1109\/TITS.2019.2929020","article-title":"Deep learning for intelligent transportation systems: A survey of emerging trends","volume":"21","author":"Veres","year":"2019","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_77","doi-asserted-by":"crossref","first-page":"194228","DOI":"10.1109\/ACCESS.2020.3033289","article-title":"A deep learning-based hybrid framework for object detection and recognition in autonomous driving","volume":"8","author":"Li","year":"2020","journal-title":"IEEE Access"},{"key":"ref_78","doi-asserted-by":"crossref","unstructured":"Yahata, S., Onishi, T., Yamaguchi, K., Ozawa, S., Kitazono, J., Ohkawa, T., Yoshida, T., Murakami, N., and Tsuji, H. (2017, January 14\u201319). A hybrid machine learning approach to automatic plant phenotyping for smart agriculture. Proceedings of the 2017 International Joint Conference on Neural Networks (IJCNN), Anchorage, AK, USA.","DOI":"10.1109\/IJCNN.2017.7966067"},{"key":"ref_79","doi-asserted-by":"crossref","unstructured":"Boukhris, L., Abderrazak, J.B., and Besbes, H. (2020, January 15\u201319). Tailored Deep Learning based Architecture for Smart Agriculture. Proceedings of the 2020 International Wireless Communications and Mobile Computing (IWCMC), Limassol, Cyprus.","DOI":"10.1109\/IWCMC48107.2020.9148182"},{"key":"ref_80","doi-asserted-by":"crossref","first-page":"105742","DOI":"10.1016\/j.compag.2020.105742","article-title":"Using channel pruning-based YOLO v4 deep learning algorithm for the real-time and accurate detection of apple flowers in natural environments","volume":"178","author":"Wu","year":"2020","journal-title":"Comput. Electron. Agric."},{"key":"ref_81","doi-asserted-by":"crossref","first-page":"103391","DOI":"10.1016\/j.autcon.2020.103391","article-title":"Autonomous anchoring for robotic construction","volume":"120","author":"Melenbrink","year":"2020","journal-title":"Autom. Constr."},{"key":"ref_82","doi-asserted-by":"crossref","first-page":"103737","DOI":"10.1016\/j.autcon.2021.103737","article-title":"Autonomous construction hoist system based on deep reinforcement learning in high-rise building construction","volume":"128","author":"Lee","year":"2021","journal-title":"Autom. Constr."},{"key":"ref_83","doi-asserted-by":"crossref","first-page":"103912","DOI":"10.1016\/j.autcon.2021.103912","article-title":"Automatic detection of sewer defects based on improved you only look once algorithm","volume":"131","author":"Tan","year":"2021","journal-title":"Autom. Constr."},{"key":"ref_84","doi-asserted-by":"crossref","unstructured":"Redmon, J., Divvala, S., Girshick, R., and Farhadi, A. (2016, January 21\u201326). You only look once: Unified, real-time object detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2016.91"},{"key":"ref_85","doi-asserted-by":"crossref","unstructured":"Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S., Fu, C.-Y., and Berg, A.C. (2016, January 8\u201314). Ssd: Single shot multibox detector. Proceedings of the European Conference on Computer Vision, Munich, Germany.","DOI":"10.1007\/978-3-319-46448-0_2"},{"key":"ref_86","doi-asserted-by":"crossref","unstructured":"Law, H., and Deng, J. (2018, January 8\u201314). Cornernet: Detecting objects as paired keypoints. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.","DOI":"10.1007\/978-3-030-01264-9_45"},{"key":"ref_87","doi-asserted-by":"crossref","unstructured":"Lin, T.-Y., Goyal, P., Girshick, R., He, K., and Doll\u00e1r, P. (2017, January 22\u201329). Focal loss for dense object detection. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.","DOI":"10.1109\/ICCV.2017.324"},{"key":"ref_88","doi-asserted-by":"crossref","unstructured":"Girshick, R. (2015, January 7\u201313). Fast r-cnn. Proceedings of the IEEE International Conference on Computer Vision, Santiago, Chile.","DOI":"10.1109\/ICCV.2015.169"},{"key":"ref_89","doi-asserted-by":"crossref","first-page":"1137","DOI":"10.1109\/TPAMI.2016.2577031","article-title":"Faster R-CNN: Towards real-time object detection with region proposal networks","volume":"39","author":"Ren","year":"2016","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_90","unstructured":"Dai, J., Li, Y., He, K., and Sun, J. (2016, January 5\u201310). R-fcn: Object detection via region-based fully convolutional networks. Proceedings of the Advances in Neural Information Processing Systems, Barcelona, Spain."},{"key":"ref_91","unstructured":"Redmon, J., and Farhadi, A. (2018). Yolov3: An incremental improvement. arXiv."},{"key":"ref_92","doi-asserted-by":"crossref","unstructured":"Won, J.-H., Lee, D.-H., Lee, K.-M., and Lin, C.-H. (2019, January 23\u201326). An improved YOLOv3-based neural network for de-identification technology. Proceedings of the 2019 34th International Technical Conference on Circuits\/Systems, Computers and Communications (ITC-CSCC), Jeju, Korea.","DOI":"10.1109\/ITC-CSCC.2019.8793382"},{"key":"ref_93","doi-asserted-by":"crossref","unstructured":"Zhao, L., and Li, S. (2020). Object detection algorithm based on improved YOLOv3. Electronics, 9.","DOI":"10.3390\/electronics9030537"},{"key":"ref_94","doi-asserted-by":"crossref","first-page":"103622","DOI":"10.1016\/j.autcon.2021.103622","article-title":"Automation for sewer pipe assessment: CCTV video interpretation algorithm and sewer pipe video assessment (SPVA) system development","volume":"125","author":"Yin","year":"2021","journal-title":"Autom. Constr."},{"key":"ref_95","unstructured":"Murugan, P. (2017). Feed forward and backward run in deep convolution neural network. arXiv."},{"key":"ref_96","doi-asserted-by":"crossref","unstructured":"Neubeck, A., and Van Gool, L. (2006, January 20\u201324). Efficient non-maximum suppression. Proceedings of the 18th International Conference on Pattern Recognition (ICPR\u201906), Hong Kong, China.","DOI":"10.1109\/ICPR.2006.479"},{"key":"ref_97","doi-asserted-by":"crossref","first-page":"103840","DOI":"10.1016\/j.tust.2021.103840","article-title":"Towards an automated condition assessment framework of underground sewer pipes based on closed-circuit television (CCTV) images","volume":"110","author":"Wang","year":"2021","journal-title":"Tunn. Undergr. Space Technol."},{"key":"ref_98","doi-asserted-by":"crossref","first-page":"155","DOI":"10.1016\/j.autcon.2018.08.006","article-title":"Automated detection of sewer pipe defects in closed-circuit television images using deep learning techniques","volume":"95","author":"Cheng","year":"2018","journal-title":"Autom. Constr."},{"key":"ref_99","doi-asserted-by":"crossref","first-page":"103438","DOI":"10.1016\/j.autcon.2020.103438","article-title":"Automated sewer pipe defect tracking in CCTV videos based on defect detection and metric learning","volume":"121","author":"Wang","year":"2021","journal-title":"Autom. Constr."},{"key":"ref_100","unstructured":"Oullette, R., Browne, M., and Hirasawa, K. (2004, January 19\u201323). Genetic algorithm optimization of a convolutional neural network for autonomous crack detection. Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No. 04TH8753), Portland, OR, USA."},{"key":"ref_101","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.autcon.2013.10.012","article-title":"Automated defect detection in sewer closed circuit television images using histograms of oriented gradients and support vector machine","volume":"38","author":"Halfawy","year":"2014","journal-title":"Autom. Constr."},{"key":"ref_102","doi-asserted-by":"crossref","unstructured":"Wang, M., and Cheng, J.C. (2018). Development and improvement of deep learning based automated defect detection for sewer pipe inspection using faster R-CNN. Workshop of the European Group for Intelligent Computing in Engineering, Springer.","DOI":"10.1007\/978-3-319-91638-5_9"},{"key":"ref_103","doi-asserted-by":"crossref","first-page":"99","DOI":"10.1016\/j.autcon.2018.01.004","article-title":"Automated defect detection tool for closed circuit television (cctv) inspected sewer pipelines","volume":"89","author":"Hawari","year":"2018","journal-title":"Autom. Constr."},{"key":"ref_104","unstructured":"Yin, X., Chen, Y., Zhang, Q., Bouferguene, A., Zaman, H., Al-Hussein, M., Russell, R., and Kurach, L. (2019, January 12\u201315). A neural network-based application for automated defect detection for sewer pipes. Proceedings of the 2019 Canadian Society for Civil Engineering Annual Conference, CSCE 2019, Montreal, QC, Canada."},{"key":"ref_105","doi-asserted-by":"crossref","first-page":"04019047","DOI":"10.1061\/(ASCE)CP.1943-5487.0000866","article-title":"Deep learning\u2013based automated detection of sewer defects in CCTV videos","volume":"34","author":"Kumar","year":"2020","journal-title":"J. Comput. Civ. Eng."},{"key":"ref_106","doi-asserted-by":"crossref","first-page":"1219","DOI":"10.1007\/s12205-019-0980-7","article-title":"Crack automatic detection of CCTV video of sewer inspection with low resolution","volume":"23","author":"Heo","year":"2019","journal-title":"KSCE J. Civ. Eng."},{"key":"ref_107","doi-asserted-by":"crossref","first-page":"3289","DOI":"10.1109\/TII.2018.2873237","article-title":"A vision-based system for internal pipeline inspection","volume":"15","author":"Piciarelli","year":"2018","journal-title":"IEEE Trans. Ind. Inform."},{"key":"ref_108","doi-asserted-by":"crossref","unstructured":"Kumar, S.S., and Abraham, D.M. (2019). A deep learning based automated structural defect detection system for sewer pipelines. Computing in Civil Engineering 2019: Smart Cities, Sustainability, and Resilience, American Society of Civil Engineers.","DOI":"10.1061\/9780784482445.029"},{"key":"ref_109","doi-asserted-by":"crossref","first-page":"2124","DOI":"10.1177\/1475921720965445","article-title":"Vision-based automated crack detection using convolutional neural networks for condition assessment of infrastructure","volume":"20","author":"Rao","year":"2021","journal-title":"Struct. Health Monit."},{"key":"ref_110","doi-asserted-by":"crossref","first-page":"103823","DOI":"10.1016\/j.autcon.2021.103823","article-title":"Sewer pipe defect detection via deep learning with local and global feature fusion","volume":"129","author":"Li","year":"2021","journal-title":"Autom. Constr."},{"key":"ref_111","doi-asserted-by":"crossref","first-page":"126584","DOI":"10.1016\/j.conbuildmat.2022.126584","article-title":"DefectTR: End-to-end defect detection for sewage networks using a transformer","volume":"325","author":"Dang","year":"2022","journal-title":"Constr. Build. Mater."},{"key":"ref_112","doi-asserted-by":"crossref","first-page":"13094","DOI":"10.1016\/j.eswa.2011.04.116","article-title":"Morphological segmentation based on edge detection for sewer pipe defects on CCTV images","volume":"38","author":"Su","year":"2011","journal-title":"Expert Syst. Appl."},{"key":"ref_113","doi-asserted-by":"crossref","first-page":"8686","DOI":"10.3390\/s140508686","article-title":"Application of morphological segmentation to leaking defect detection in sewer pipelines","volume":"14","author":"Su","year":"2014","journal-title":"Sensors"},{"key":"ref_114","unstructured":"Wang, M., and Cheng, J. (2019, January 21\u201324). Semantic segmentation of sewer pipe defects using deep dilated convolutional neural network. Proceedings of the International Symposium on Automation and Robotics in Construction, Banff, AB, Canada. Available online: https:\/\/www.proquest.com\/openview\/9641dc9ed4c7e5712f417dcb2b380f20\/1."},{"key":"ref_115","doi-asserted-by":"crossref","first-page":"182","DOI":"10.1016\/j.neucom.2018.08.052","article-title":"Semantic scene completion with dense CRF from a single depth image","volume":"318","author":"Zhang","year":"2018","journal-title":"Neurocomputing"},{"key":"ref_116","doi-asserted-by":"crossref","first-page":"162","DOI":"10.1111\/mice.12481","article-title":"A unified convolutional neural network integrated with conditional random field for pipe defect segmentation","volume":"35","author":"Wang","year":"2020","journal-title":"Comput.-Aided Civ. Infrastruct. Eng."},{"key":"ref_117","doi-asserted-by":"crossref","unstructured":"Long, J., Shelhamer, E., and Darrell, T. (2015, January 7\u201312). Fully convolutional networks for semantic segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298965"},{"key":"ref_118","unstructured":"Fayyaz, M., Saffar, M.H., Sabokrou, M., Fathy, M., Klette, R., and Huang, F. (2016). STFCN: Spatio-temporal FCN for semantic video segmentation. arXiv."},{"key":"ref_119","doi-asserted-by":"crossref","first-page":"1043","DOI":"10.1007\/s00371-018-1519-5","article-title":"Dual-path adversarial learning for fully convolutional network (FCN)-based medical image segmentation","volume":"34","author":"Bi","year":"2018","journal-title":"Vis. Comput."},{"key":"ref_120","doi-asserted-by":"crossref","unstructured":"Lu, Y., Chen, Y., Zhao, D., and Chen, J. (2019, January 10\u201312). Graph-FCN for image semantic segmentation. Proceedings of the International Symposium on Neural Networks, Moscow, Russia.","DOI":"10.1007\/978-3-030-22796-8_11"},{"key":"ref_121","doi-asserted-by":"crossref","unstructured":"Ronneberger, O., Fischer, P., and Brox, T. (2015, January 5\u20139). U-net: Convolutional networks for biomedical image segmentation. Proceedings of the International Conference on Medical Image Computing and Computer-Assisted Intervention, Munich, Germany.","DOI":"10.1007\/978-3-319-24574-4_28"},{"key":"ref_122","doi-asserted-by":"crossref","first-page":"103383","DOI":"10.1016\/j.autcon.2020.103383","article-title":"Automatic sewer pipe defect semantic segmentation based on improved U-Net","volume":"119","author":"Pan","year":"2020","journal-title":"Autom. Constr."},{"key":"ref_123","doi-asserted-by":"crossref","first-page":"921","DOI":"10.1016\/j.imavis.2005.05.017","article-title":"A robust approach for automatic detection and segmentation of cracks in underground pipeline images","volume":"23","author":"Iyer","year":"2005","journal-title":"Image Vis. Comput."},{"key":"ref_124","doi-asserted-by":"crossref","first-page":"110727","DOI":"10.1016\/j.measurement.2022.110727","article-title":"A Robust Instance Segmentation Framework for Underground Sewer Defect Detection","volume":"190","author":"Li","year":"2022","journal-title":"Measurement"},{"key":"ref_125","doi-asserted-by":"crossref","unstructured":"Haurum, J.B., and Moeslund, T.B. (2021, January 19\u201325). Sewer-ML: A Multi-Label Sewer Defect Classification Dataset and Benchmark. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Nashville, TN, USA.","DOI":"10.1109\/CVPR46437.2021.01325"},{"key":"ref_126","doi-asserted-by":"crossref","first-page":"875","DOI":"10.1016\/j.autcon.2010.06.001","article-title":"A morphological approach to pipe image interpretation based on segmentation by support vector machine","volume":"19","author":"Mashford","year":"2010","journal-title":"Autom. Constr."},{"key":"ref_127","doi-asserted-by":"crossref","first-page":"135","DOI":"10.1016\/j.autcon.2011.06.012","article-title":"Ultrasonic signal processing methods for detection of defects in concrete pipes","volume":"22","author":"Iyer","year":"2012","journal-title":"Autom. Constr."},{"key":"ref_128","doi-asserted-by":"crossref","first-page":"953930","DOI":"10.1155\/2013\/953930","article-title":"Review of physical based monitoring techniques for condition assessment of corrosion in reinforced concrete","volume":"2013","author":"Lei","year":"2013","journal-title":"Math. Probl. Eng."},{"key":"ref_129","doi-asserted-by":"crossref","first-page":"69","DOI":"10.1061\/(ASCE)1076-0342(1999)5:2(69)","article-title":"Diagnostic techniques for sewer systems","volume":"5","author":"Makar","year":"1999","journal-title":"J. Infrastruct. Syst."},{"key":"ref_130","doi-asserted-by":"crossref","first-page":"153","DOI":"10.2166\/hydro.2018.073","article-title":"Automated detection of fault types in CCTV sewer surveys","volume":"21","author":"Myrans","year":"2019","journal-title":"J. Hydroinform."},{"key":"ref_131","doi-asserted-by":"crossref","first-page":"375","DOI":"10.1016\/S1007-0214(08)70177-9","article-title":"Imagery enhancement and interpretation for remote visual inspection of aging civil infrastructure","volume":"13","author":"Guo","year":"2008","journal-title":"Tsinghua Sci. Technol."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/7\/2722\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T22:48:32Z","timestamp":1760136512000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/7\/2722"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,4,1]]},"references-count":131,"journal-issue":{"issue":"7","published-online":{"date-parts":[[2022,4]]}},"alternative-id":["s22072722"],"URL":"https:\/\/doi.org\/10.3390\/s22072722","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,4,1]]}}}