{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,14]],"date-time":"2026-01-14T15:31:43Z","timestamp":1768404703967,"version":"3.49.0"},"reference-count":38,"publisher":"MDPI AG","issue":"21","license":[{"start":{"date-parts":[[2021,11,8]],"date-time":"2021-11-08T00:00:00Z","timestamp":1636329600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["No.U1813222, No.42075129"],"award-info":[{"award-number":["No.U1813222, No.42075129"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Constant monitoring of road surfaces helps to show the urgency of deterioration or problems in the road construction and to improve the safety level of the road surface. Conditional generative adversarial networks (cGAN) are a powerful tool to generate or transform the images used for crack detection. The advantage of this method is the highly accurate results in vector-based images, which are convenient for mathematical analysis of the detected cracks at a later time. However, images taken under established parameters are different from images in real-world contexts. Another potential problem of cGAN is that it is difficult to detect the shape of an object when the resulting accuracy is low, which can seriously affect any further mathematical analysis of the detected crack. To tackle this issue, this paper proposes a method called improved cGAN with attention gate (ICGA) for roadway surface crack detection. To obtain a more accurate shape of the detected target object, ICGA establishes a multi-level model with independent stages. In the first stage, everything except the road is treated as noise and removed from the image. These images are stored in a new dataset. In the second stage, ICGA determines the cracks. Therefore, ICGA focuses on the redistribution of cracks, not the auxiliary elements in the image. ICGA adds two attention gates to a U-net architecture and improves the segmentation capacities of the generator in pix2pix. Extensive experimental results on dashboard camera images of the Unsupervised Llamas dataset show that our method has better performance than other state-of-the-art methods.<\/jats:p>","DOI":"10.3390\/s21217405","type":"journal-article","created":{"date-parts":[[2021,11,8]],"date-time":"2021-11-08T22:08:41Z","timestamp":1636409321000},"page":"7405","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":17,"title":["Road Surface Crack Detection Method Based on Conditional Generative Adversarial Networks"],"prefix":"10.3390","volume":"21","author":[{"given":"Anastasiia","family":"Kyslytsyna","sequence":"first","affiliation":[{"name":"School of Electronics and Information Engineering, Hebei University of Technology, Tianjin 300401, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3968-481X","authenticated-orcid":false,"given":"Kewen","family":"Xia","sequence":"additional","affiliation":[{"name":"School of Electronics and Information Engineering, Hebei University of Technology, Tianjin 300401, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Artem","family":"Kislitsyn","sequence":"additional","affiliation":[{"name":"Department of IT SBERX, Sberbank, 17997 Moscow, Russia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Isselmou","family":"Abd El Kader","sequence":"additional","affiliation":[{"name":"Department Biomedical Engineering, School of Electrical Engineering, Hebei University of Technology, Tianjin 300401, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Youxi","family":"Wu","sequence":"additional","affiliation":[{"name":"School of Artificial Intelligence, Hebei University of Technology, Tianjin 300401, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2021,11,8]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Abdellatif, M., Peel, H., and Cohn, A.G. (2020). Pavement Crack Detection from Hyperspectral Images Using a Novel Asphalt Crack Index. Remote Sens., 12.","DOI":"10.3390\/rs12183084"},{"key":"ref_2","unstructured":"Oh, H., Garrick, N., and Achenie, L. (1997, January 25\u201330). Segmentation Algorithm Using Iterative Clipping for Processing Noisy Pavement Images. Proceedings of the Imaging Technologies: Techniques and Applications in Civil Engineering, Second International Conference, Davos, Switzerland."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"227","DOI":"10.1016\/j.patrec.2011.11.004","article-title":"CrackTree: Automatic Crack Detection from Pavement Images","volume":"33","author":"Zou","year":"2012","journal-title":"Pattern Recognit. Lett."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Roli, F. (1996). Measure of Texture Anisotropy for Crack Detection on Textured Surfaces. Electron. Lett., 1274\u20131275.","DOI":"10.1049\/el:19960872"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Nguyen, T.S., Begot, S., Duculty, F., and Avila, M. (2011, January 11\u201314). Free-Form Anisotropy: A New Method for Crack Detection on Pavement Surface Images. Proceedings of the 2011 18th IEEE International Conference on Image Processing, Brussels, Belgium.","DOI":"10.1109\/ICIP.2011.6115610"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"19307","DOI":"10.3390\/s141019307","article-title":"Automatic Crack Detection and Classification Method for Subway Tunnel Safety Monitoring","volume":"14","author":"Zhang","year":"2014","journal-title":"Sensors"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"130","DOI":"10.1016\/j.imavis.2016.11.018","article-title":"An Efficient and Reliable Coarse-to-Fine Approach for Asphalt Pavement Crack Detection","volume":"57","author":"Zhang","year":"2017","journal-title":"Image Vis. Comput."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Yu, Y., Rashidi, M., Samali, B., Yousefi, A.M., and Wang, W. (2021). Multi-Image-Feature-Based Hierarchical Concrete Crack Identification Framework Using Optimized Svm Multi-Classifiers and d\u2013s Fusion Algorithm for Bridge Structures. Remote Sens., 13.","DOI":"10.3390\/rs13020240"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Dong, C., Li, L., Yan, J., Zhang, Z., Pan, H., and Catbas, F.N. (2021). Pixel-Level Fatigue Crack Segmentation in Large-Scale Images of Steel Structures Using an Encoder\u2013Decoder Network. Sensors, 21.","DOI":"10.3390\/s21124135"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"3434","DOI":"10.1109\/TITS.2016.2552248","article-title":"Automatic Road Crack Detection Using Random Structured Forests","volume":"17","author":"Shi","year":"2016","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"2025","DOI":"10.1109\/TITS.2018.2856928","article-title":"Automatic Pavement Crack Detection by Multi-Scale Image Fusion","volume":"20","author":"Li","year":"2019","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"63","DOI":"10.23947\/1992-5980-2019-19-1-63-73","article-title":"Deep Convolution Neural Network Model in Problem of Crack Segmentation on Asphalt Images","volume":"19","author":"Sobol","year":"2019","journal-title":"Vestn. Don State Tech. Univ."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Park, S., Bang, S., Kim, H., and Kim, H. (2018, January 20\u201325). Patch-Based Crack Detection in Black Box Road Images Using Deep Learning. Proceedings of the ISARC 2018\u201435th International Symposium on Automation and Robotics in Construction, Berlin, Germany.","DOI":"10.22260\/ISARC2018\/0104"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"1090","DOI":"10.1111\/mice.12412","article-title":"Automatic Pixel-Level Crack Detection and Measurement Using Fully Convolutional Network","volume":"33","author":"Yang","year":"2018","journal-title":"Comput. Civ. Infrastruct. Eng."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Oliveira, H., and Correia, P.L. (2014, January 27\u201330). CrackIT\u2014An Image Processing Toolbox for Crack Detection and Characterization. Proceedings of the 2014 IEEE International Conference on Image Processing (ICIP), Paris, France.","DOI":"10.1109\/ICIP.2014.7025160"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"139","DOI":"10.1016\/j.neucom.2019.01.036","article-title":"DeepCrack: A Deep Hierarchical Feature Learning Architecture for Crack Segmentation","volume":"338","author":"Liu","year":"2019","journal-title":"Neurocomputing"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"1525","DOI":"10.1109\/TITS.2019.2910595","article-title":"Feature Pyramid and Hierarchical Boosting Network for Pavement Crack Detection","volume":"21","author":"Yang","year":"2020","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"103176","DOI":"10.1016\/j.autcon.2020.103176","article-title":"An Integrated Approach to Automatic Pixel-Level Crack Detection and Quantification of Asphalt Pavement","volume":"114","author":"Ji","year":"2020","journal-title":"Autom. Constr."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Feng, X., Xiao, L., Li, W., Pei, L., Sun, Z., Ma, Z., Shen, H., and Ju, H. (2020). Pavement Crack Detection and Segmentation Method Based on Improved Deep Learning Fusion Model. Math. Probl. Eng., 2020.","DOI":"10.1155\/2020\/8515213"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"115","DOI":"10.1007\/s42421-020-00020-1","article-title":"Applications of Deep Learning in Intelligent Transportation Systems","volume":"2","author":"Haghighat","year":"2020","journal-title":"J. Big Data Anal. Transp."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"1306","DOI":"10.1109\/TITS.2020.2990703","article-title":"Da CrackGAN: Pavement Crack Detection Using Partially Accurate Ground Truths Based on Generative Adversarial Learning","volume":"22","author":"Zhang","year":"2021","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"139","DOI":"10.1145\/3422622","article-title":"Generative Adversarial Networks","volume":"63","author":"Goodfellow","year":"2020","journal-title":"Commun. ACM"},{"key":"ref_23","unstructured":"Mirza, M., and Osindero, S. (2014). Conditional Generative Adversarial Nets. arXiv."},{"key":"ref_24","unstructured":"Jay, F., Renou, J.-P., Voinnet, O., and Navarro, L. (2017, January 22\u201329). Unpaired Image-to-Image Translation Using Cycle-Consistent Adversarial Networks Jun-Yan. Proceedings of the IEEE International Conference on Computer Vision (ICCV), Venice, Italy."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Isola, P., Zhu, J.Y., Zhou, T., and Efros, A.A. (2017, January 21\u201326). Image-to-Image Translation with Conditional Adversarial Networks. Proceedings of the 30th IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2017, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.632"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"529","DOI":"10.1007\/978-3-030-36189-1_44","article-title":"Improvement of Residual Attention Network for Image Classification","volume":"Volume 11935LNCS","author":"Liang","year":"2019","journal-title":"Lecture Notes in Computer Science"},{"key":"ref_27","unstructured":"Jetley, S., Lord, N.A., Lee, N., and Torr, P.H.S. (May, January 30). Learn to Pay Attention. Proceedings of the 6th International Conference on Learning Representations. (ICLR 2018), Vancouver, BC, Canada."},{"key":"ref_28","unstructured":"Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, \u0141., and Polosukhin, I. (2017, January 4\u20139). Attention Is All You Need. Proceedings of the 31st International Conference on Neural Information Processing Systems (NIPS), Long Beach, CA, USA."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Huang, Z., Zhao, Y., Liu, Y., and Song, G. (2021). GCAUNet: A Group Cross-Channel Attention Residual UNet for Slice Based Brain Tumor Segmentation. Biomed. Signal Process. Control, 70.","DOI":"10.1016\/j.bspc.2021.102958"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Tsai, Y.-C., and Chatterjee, A. (2017). Comprehensive, Quantitative Crack Detection Algorithm Performance Evaluation System. J. Comput. Civ. Eng., 31.","DOI":"10.1061\/(ASCE)CP.1943-5487.0000696"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Ren, M., and Zemel, R.S. (2017, January 21\u201326). End-to-End Instance Segmentation with Recurrent Attention. Proceedings of the 30th IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2017, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.39"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Khanh, T.L.B., Dao, D.P., Ho, N.H., Yang, H.J., Baek, E.T., Lee, G., Kim, S.H., and Yoo, S.B. (2020). Enhancing U-Net with Spatial-Channel Attention Gate for Abnormal Tissue Segmentation in Medical Imaging. Appl. Sci., 10.","DOI":"10.3390\/app10175729"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"119","DOI":"10.1007\/s11633-017-1053-3","article-title":"A Survey on Deep Learning-Based Fine-Grained Object Classification and Semantic Segmentation","volume":"14","author":"Zhao","year":"2017","journal-title":"Int. J. Autom. Comput."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Yang, Z., He, X., Gao, J., Deng, L., and Smola, A. (2016, January 27\u201330). Stacked Attention Networks for Image Question Answering. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.10"},{"key":"ref_35","unstructured":"Oktay, O., Schlemper, J., Folgoc, L.L., Lee, M., Heinrich, M., Misawa, K., Mori, K., McDonagh, S., Hammerla, N.Y., and Kainz, B. (2018). Attention U-Net: Learning Where to Look for the Pancreas. arXiv."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Shen, T., Jiang, J., Zhou, T., Pan, S., Long, G., and Zhang, C. (2018, January 2\u20137). Disan: Directional Self-Attention Network for RnN\/CNN-Free Language Understanding. Proceedings of the 32nd AAAI Conference on Artificial Intelligence, New Orleans, LA, USA.","DOI":"10.1609\/aaai.v32i1.11941"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Behrendt, K., and Soussan, R. (2019, January 27\u201328). Unsupervised Labeled Lane Markers Using Maps. Proceedings of the IEEE\/CVF International Conference on Computer Vision Workshops (ICCVW 2019), Seoul, Korea.","DOI":"10.1109\/ICCVW.2019.00111"},{"key":"ref_38","unstructured":"Derczynski, L. (2016, January 23\u201328). Complementarity, F-Score, and NLP Evaluation. Proceedings of the 10th International Conference on Language Resources and Evaluation (LREC 2016), Portoro\u017e, Slovenia."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/21\/7405\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T07:27:14Z","timestamp":1760167634000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/21\/7405"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,11,8]]},"references-count":38,"journal-issue":{"issue":"21","published-online":{"date-parts":[[2021,11]]}},"alternative-id":["s21217405"],"URL":"https:\/\/doi.org\/10.3390\/s21217405","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,11,8]]}}}