{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,14]],"date-time":"2026-04-14T03:57:38Z","timestamp":1776139058481,"version":"3.50.1"},"reference-count":53,"publisher":"MDPI AG","issue":"20","license":[{"start":{"date-parts":[[2022,10,17]],"date-time":"2022-10-17T00:00:00Z","timestamp":1665964800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Defect detection of petrochemical pipelines is an important task for industrial production safety. At present, pipeline defect detection mainly relies on closed circuit television method (CCTV) to take video of the pipeline inner wall and then detect the defective area manually, so the detection is very time-consuming and has a high rate of false and missed detections. To solve the above issues, we proposed an automatic defect detection system for petrochemical pipeline based on Cycle-GAN and improved YOLO v5. Firstly, in order to create the pipeline defect dataset, the original pipeline videos need pre-processing, which includes frame extraction, unfolding, illumination balancing, and image stitching to create coherent and tiled pipeline inner wall images. Secondly, aiming at the problems of small amount of samples and the imbalance of defect and non-defect classes, a sample enhancement strategy based on Cycle-GAN is proposed to generate defect images and expand the data set. Finally, in order to detect defective areas on the pipeline and improve the detection accuracy, a robust defect detection model based on improved YOLO v5 and Transformer attention mechanism is proposed, with the average precision and recall as 93.10% and 90.96%, and the F1-score as 0.920 on the test set. The proposed system can provide reference for operators in pipeline health inspection, improving the efficiency and accuracy of detection.<\/jats:p>","DOI":"10.3390\/s22207907","type":"journal-article","created":{"date-parts":[[2022,10,18]],"date-time":"2022-10-18T00:31:01Z","timestamp":1666053061000},"page":"7907","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":66,"title":["An Automatic Defect Detection System for Petrochemical Pipeline Based on Cycle-GAN and YOLO v5"],"prefix":"10.3390","volume":"22","author":[{"given":"Kun","family":"Chen","sequence":"first","affiliation":[{"name":"Petroleum Engineering School, Southwest Petroleum University, Chengdu 610050, China"},{"name":"Tianjin Petrochemical Equipment and Instrumentation Research, Tianjin 300270, China"}]},{"given":"Hongtao","family":"Li","sequence":"additional","affiliation":[{"name":"Tianjin Petrochemical Equipment and Instrumentation Research, Tianjin 300270, China"}]},{"given":"Chunshu","family":"Li","sequence":"additional","affiliation":[{"name":"Tianjin Petrochemical Corporation, Tianjin 300270, China"}]},{"given":"Xinyue","family":"Zhao","sequence":"additional","affiliation":[{"name":"School of Astronautics, Beihang University, Beijing 100191, China"}]},{"given":"Shujie","family":"Wu","sequence":"additional","affiliation":[{"name":"School of Astronautics, Beihang University, Beijing 100191, China"}]},{"given":"Yuxiao","family":"Duan","sequence":"additional","affiliation":[{"name":"School of Astronautics, Beihang University, Beijing 100191, China"}]},{"given":"Jinshen","family":"Wang","sequence":"additional","affiliation":[{"name":"School of Astronautics, Beihang University, Beijing 100191, China"}]}],"member":"1968","published-online":{"date-parts":[[2022,10,17]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"99","DOI":"10.1016\/j.autcon.2018.01.004","article-title":"Automated defect detection tool for closed circuit television (cctv) inspected sewer pipelines","volume":"89","author":"Hawari","year":"2018","journal-title":"Autom. Constr."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"04027","DOI":"10.1051\/e3sconf\/202123604027","article-title":"Literature Review of Machine Vision in Application Field","volume":"Volume 236","author":"Zhang","year":"2021","journal-title":"E3S Web of Conferences"},{"key":"ref_3","unstructured":"Scholl, K.U., Kepplin, V., Berns, K., and Dillmann, R. (2000, January 24\u201328). Controlling a multi-joint robot for autonomous sewer inspection. Proceedings of the 2000 ICRA. Millennium Conference\u2014IEEE International Conference on Robotics and Automation\u2014Symposia Proceedings (Cat. No.00CH37065), San Francisco, CA, USA."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"23","DOI":"10.1007\/s10015-006-0392-x","article-title":"A study of an autonomous mobile robot for a sewer inspection system","volume":"11","author":"Ahrary","year":"2007","journal-title":"Artif. Life Robot."},{"key":"ref_5","unstructured":"Scholl, K.U., Kepplin, V., Berns, K., and Dillmann, R. (1999, January 17\u201321). An articulated service robot for autonomous sewer inspection tasks. Proceedings of the 1999 IEEE\/RSJ International Conference on Intelligent Robots and Systems. Human and Environment Friendly Robots with High Intelligence and Emotional Quotients (Cat. No.99CH36289), Kyongju, Korea."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"57","DOI":"10.1016\/S1462-0758(99)00012-6","article-title":"Towards autonomous sewer robots: The MAKRO project","volume":"1","author":"Rome","year":"1999","journal-title":"Urban Water"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"581","DOI":"10.1016\/S0926-5805(99)00007-2","article-title":"Automated detection of surface defects in water and sewer pipes","volume":"8","author":"Moselhi","year":"1999","journal-title":"Autom. Constr."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"3562","DOI":"10.1016\/j.eswa.2008.02.006","article-title":"Segmenting ideal morphologies of sewer pipe defects on CCTV images for automated diagnosis","volume":"36","author":"Yang","year":"2009","journal-title":"Expert Syst. Appl."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"153","DOI":"10.2166\/hydro.2018.073","article-title":"Automated detection of fault types in CCTV sewer surveys","volume":"21","author":"Myrans","year":"2019","journal-title":"J. Hydroinform."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"587","DOI":"10.1016\/j.autcon.2008.12.003","article-title":"Automated defect detection for sewer pipeline inspection and condition assessment","volume":"18","author":"Guo","year":"2009","journal-title":"Autom. Constr."},{"key":"ref_11","first-page":"17","article-title":"Diagnosis of sewer pipe defects on image recognition of multi-features and support vector machine in a southern Chinese city","volume":"13","author":"Ye","year":"2019","journal-title":"J. Environ. Sci. Eng."},{"key":"ref_12","first-page":"15238-3779","article-title":"A New Image-Based Model for Predicting Cracks in Sewer Pipes","volume":"4","author":"Khalifa","year":"2013","journal-title":"Int. J. Adv. Comput. Sci. Appl."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.autcon.2013.10.012","article-title":"Automated defect detection in sewer closed circuit television images using histograms of oriented gradients and support vector machine","volume":"38","author":"Halfawy","year":"2014","journal-title":"Autom. Constr."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"39574","DOI":"10.1109\/ACCESS.2020.2975887","article-title":"Sewer Pipeline Fault Identification Using Anomaly Detection Algorithms on Video Sequences","volume":"8","author":"Fang","year":"2020","journal-title":"IEEE Access"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Moradi, S., and Zayed, T. (2017, January 8\u201311). Real-Time Defect Detection in Sewer Closed Circuit Television Inspection Videos. Proceedings of the Pipelines 2017, Berlin, Germany.","DOI":"10.1061\/9780784480885.027"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"04020018","DOI":"10.1061\/(ASCE)IS.1943-555X.0000553","article-title":"Automated Anomaly Detection and Localization in Sewer Inspection Videos Using Proportional Data Modeling and Deep Learning\u2013Based Text Recognition","volume":"26","author":"Moradi","year":"2020","journal-title":"J. Infrastruct. Syst."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"103438","DOI":"10.1016\/j.autcon.2020.103438","article-title":"Automated sewer pipe defect tracking in CCTV videos based on defect detection and metric learning","volume":"121","author":"Wang","year":"2021","journal-title":"Autom. Constr."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Haurum, J.B., Bahnsen, C.H., Pedersen, M., and Moeslund, T.B. (2020). Water Level Estimation in Sewer Pipes Using Deep Convolutional Neural Networks. Water, 12.","DOI":"10.3390\/w12123412"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Ji, H.W., Yoo, S.S., Lee, B.J., Koo, D.D., and Kang, J.H. (2020). Measurement of Wastewater Discharge in Sewer Pipes Using Image Analysis. Water, 12.","DOI":"10.3390\/w12061771"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"103383","DOI":"10.1016\/j.autcon.2020.103383","article-title":"Automatic sewer pipe defect semantic segmentation based on improved U- Net","volume":"119","author":"Pan","year":"2020","journal-title":"Autom. Constr."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"3289","DOI":"10.1109\/TII.2018.2873237","article-title":"A Vision-Based System for Internal Pipeline Inspection","volume":"15","author":"Piciarelli","year":"2019","journal-title":"IEEE Trans. Ind. Inform."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"162","DOI":"10.1111\/mice.12481","article-title":"A unified convolutional neural network integrated with conditional random field for pipe defect segmentation","volume":"35","author":"Wang","year":"2020","journal-title":"Comput.-Aided Civ. Infrastruct. Eng."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Chen, K., Hu, H., Chen, C., Chen, L., and He, C. (2018, January 11\u201313). An intelligent sewer defect detection method based on convolutional neural network. Proceedings of the 2018 IEEE International Conference on Information and Automation (ICIA), Wuyishan, China.","DOI":"10.1109\/ICInfA.2018.8812445"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"1836","DOI":"10.1109\/TASE.2019.2900170","article-title":"Automatic detection and classification of sewer defects via hierarchical deep learning","volume":"16","author":"Xie","year":"2019","journal-title":"IEEE Trans. Autom. Sci. Eng."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"102849","DOI":"10.1016\/j.autcon.2019.102849","article-title":"Underground sewer pipe condition assessment based on convolutional neural networks","volume":"106","author":"Hassan","year":"2019","journal-title":"Autom. Constr."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"84","DOI":"10.1145\/3065386","article-title":"Imagenet classification with deep convolutional neural networks","volume":"60","author":"Krizhevsky","year":"2017","journal-title":"Commun. ACM"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"103840","DOI":"10.1016\/j.tust.2021.103840","article-title":"Towards an automated condition assessment framework of underground sewer pipes based on closed-circuit television (CCTV) images","volume":"110","author":"Wang","year":"2021","journal-title":"Tunn. Undergr. Space Technol."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"04019047","DOI":"10.1061\/(ASCE)CP.1943-5487.0000866","article-title":"Deep Learning\u2013Based Automated Detection of Sewer Defects in CCTV Videos","volume":"34","author":"Kumar","year":"2020","journal-title":"J. Comput. Civ. Eng."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"103622","DOI":"10.1016\/j.autcon.2021.103622","article-title":"Automation for sewer pipe assessment: CCTV video interpretation algorithm and sewer pipe video assessment (SPVA) system development","volume":"125","author":"Yin","year":"2021","journal-title":"Autom. Constr."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"2124","DOI":"10.1177\/1475921720965445","article-title":"Vision-based automated crack detection using convolutional neural networks for condition assessment of infrastructure","volume":"20","author":"Rao","year":"2020","journal-title":"Struct. Health Monit."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"103823","DOI":"10.1016\/j.autcon.2021.103823","article-title":"Sewer pipe defect detection via deep learning with local and global feature fusion","volume":"129","author":"Li","year":"2021","journal-title":"Autom. Constr."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Klusek, M., and Szydlo, T. (2021, January 4\u20135). Supporting the Process of Sewer Pipes Inspection Using Machine Learning on Embedded Devices. Proceedings of the ICCS, Phagwara, India.","DOI":"10.1007\/978-3-030-77980-1_27"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"126584","DOI":"10.1016\/j.conbuildmat.2022.126584","article-title":"DefectTR: End-to-end defect detection for sewage networks using a transformer","volume":"325","author":"Dang","year":"2022","journal-title":"Constr. Build. Mater."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"125385","DOI":"10.1016\/j.conbuildmat.2021.125385","article-title":"A Multi-defect detection system for sewer pipelines based on StyleGAN-SDM and fusion CNN","volume":"312","author":"Ma","year":"2021","journal-title":"Constr. Build. Mater."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"06006","DOI":"10.1051\/matecconf\/20153206006","article-title":"Defect detection in pipes using a mobile laser-optics technology and digital geometry","volume":"Volume 32","author":"Tezerjani","year":"2015","journal-title":"MATEC Web of Conferences"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.measurement.2012.05.032","article-title":"State of the art review of inspection technologies for condition assessment of water pipes","volume":"46","author":"Liu","year":"2013","journal-title":"Measurement"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3439950","article-title":"Deep learning for anomaly detection: A review","volume":"54","author":"Pang","year":"2021","journal-title":"ACM Comput. Surv. (CSUR)"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.autcon.2016.10.010","article-title":"A technology for sewer pipe inspection (Part 2): Experimental assessment of a new laser profiler for sewer defect detection and quantification","volume":"73","author":"Lepot","year":"2017","journal-title":"Autom. Constr."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1364\/JOSA.61.000001","article-title":"Lightness and retinex theory","volume":"61","author":"Land","year":"1971","journal-title":"Josa"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"965","DOI":"10.1109\/83.597272","article-title":"A multiscale retinex for bridging the gap between color images and the human observation of scenes","volume":"6","author":"Jobson","year":"1997","journal-title":"IEEE Trans. Image Process."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"3812","DOI":"10.1093\/nar\/gkg509","article-title":"SIFT: Predicting amino acid changes that affect protein function","volume":"31","author":"Ng","year":"2003","journal-title":"Nucleic Acids Res."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Zhu, J.Y., Park, T., Isola, P., and Efros, A.A. (2017, January 22\u201329). Unpaired image-to-image translation using cycle-consistent adversarial networks. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.","DOI":"10.1109\/ICCV.2017.244"},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Redmon, J., Divvala, S., Girshick, R., and Farhadi, A. (2016, January 27\u201330). You only look once: Unified, real-time object detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.91"},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Isola, P., Zhu, J.Y., Zhou, T., and Efros, A.A. (2017, January 21\u201326). Image-to-image translation with conditional adversarial networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.632"},{"key":"ref_45","unstructured":"Adler, J., and Lunz, S. (2018, January 3\u20138). Banach wasserstein gan. Proceedings of the Advances in Neural Information Processing Systems 31 (NeurIPS 2018), Montr\u00e9al, QC, Canada."},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Mao, X., Li, Q., Xie, H., Lau, R.Y., Wang, Z., and Paul Smolley, S. (2017, January 22\u201329). Least squares generative adversarial networks. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.","DOI":"10.1109\/ICCV.2017.304"},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Girshick, R., Donahue, J., Darrell, T., and Malik, J. (2014, January 23\u201328). Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation. Proceedings of the 2014 IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA.","DOI":"10.1109\/CVPR.2014.81"},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Girshick, R. (2015, January 7\u201313). Fast r-cnn. Proceedings of the IEEE International Conference on Computer Vision, Santiago, Chile.","DOI":"10.1109\/ICCV.2015.169"},{"key":"ref_49","unstructured":"Ren, S., He, K., Girshick, R., and Sun, J. (2016, January 5\u201310). Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks. Proceedings of the NIPS, Barcelona, Spain."},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S., Fu, C.Y., and Berg, A.C. (2016). Ssd: Single shot multibox detector. Proceedings of the European Conference on Computer Vision, Springer.","DOI":"10.1007\/978-3-319-46448-0_2"},{"key":"ref_51","unstructured":"Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, \u0141., and Polosukhin, I. (2017, January 4\u20139). Attention is all you need. Proceedings of the Advances in Neural Information Processing Systems 30 (NIPS 2017), Long Beach, CA, USA."},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"143","DOI":"10.1017\/S0962492900002919","article-title":"Approximation theory of the MLP model in neural networks","volume":"8","author":"Pinkus","year":"1999","journal-title":"Acta Numer."},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"1038","DOI":"10.1109\/JAS.2020.1003243","article-title":"Convolutional multi-head self-attention on memory for aspect sentiment classification","volume":"7","author":"Zhang","year":"2020","journal-title":"IEEE\/CAA J. Autom. Sin."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/20\/7907\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T00:56:06Z","timestamp":1760144166000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/20\/7907"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,10,17]]},"references-count":53,"journal-issue":{"issue":"20","published-online":{"date-parts":[[2022,10]]}},"alternative-id":["s22207907"],"URL":"https:\/\/doi.org\/10.3390\/s22207907","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,10,17]]}}}