{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,20]],"date-time":"2026-03-20T00:04:23Z","timestamp":1773965063993,"version":"3.50.1"},"reference-count":52,"publisher":"MDPI AG","issue":"16","license":[{"start":{"date-parts":[[2022,8,11]],"date-time":"2022-08-11T00:00:00Z","timestamp":1660176000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Key Science and Technology Research Project of Jinhua","award":["2021-3-176"],"award-info":[{"award-number":["2021-3-176"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>To realize the intelligent and accurate measurement of pavement surface potholes, an improved You Only Look Once version three (YOLOv3) object detection model combining data augmentation and structure optimization is proposed in this study. First, color adjustment was used to enhance the image contrast, and data augmentation was performed through geometric transformation. Pothole categories were subdivided into P1 and P2 on the basis of whether or not there was water. Then, the Residual Network (ResNet101) and complete IoU (CIoU) loss were used to optimize the structure of the YOLOv3 model, and the K-Means++ algorithm was used to cluster and modify the multiscale anchor sizes. Lastly, the robustness of the proposed model was assessed by generating adversarial examples. Experimental results demonstrated that the proposed model was significantly improved compared with the original YOLOv3 model; the detection mean average precision (mAP) was 89.3%, and the F1-score was 86.5%. On the attacked testing dataset, the overall mAP value reached 81.2% (\u22128.1%), which shows that this proposed model performed well on samples after random occlusion and adding noise interference, proving good robustness.<\/jats:p>","DOI":"10.3390\/rs14163892","type":"journal-article","created":{"date-parts":[[2022,8,11]],"date-time":"2022-08-11T21:15:05Z","timestamp":1660252505000},"page":"3892","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":101,"title":["Automatic Detection of Pothole Distress in Asphalt Pavement Using Improved Convolutional Neural Networks"],"prefix":"10.3390","volume":"14","author":[{"given":"Danyu","family":"Wang","sequence":"first","affiliation":[{"name":"Department of Roadway Engineering, School of Transportation, Southeast University, Nanjing 211189, China"},{"name":"National Demonstration Center for Experimental Road and Traffic Engineering Education, Southeast University, Nanjing 211189, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8012-7682","authenticated-orcid":false,"given":"Zhen","family":"Liu","sequence":"additional","affiliation":[{"name":"Department of Roadway Engineering, School of Transportation, Southeast University, Nanjing 211189, China"},{"name":"National Demonstration Center for Experimental Road and Traffic Engineering Education, Southeast University, Nanjing 211189, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8561-7223","authenticated-orcid":false,"given":"Xingyu","family":"Gu","sequence":"additional","affiliation":[{"name":"Department of Roadway Engineering, School of Transportation, Southeast University, Nanjing 211189, China"},{"name":"National Demonstration Center for Experimental Road and Traffic Engineering Education, Southeast University, Nanjing 211189, China"}]},{"given":"Wenxiu","family":"Wu","sequence":"additional","affiliation":[{"name":"Jinhua Highway Administration Bureau, Jinhua 321000, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8011-1290","authenticated-orcid":false,"given":"Yihan","family":"Chen","sequence":"additional","affiliation":[{"name":"Department of Roadway Engineering, School of Transportation, Southeast University, Nanjing 211189, China"},{"name":"National Demonstration Center for Experimental Road and Traffic Engineering Education, Southeast University, Nanjing 211189, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8442-8271","authenticated-orcid":false,"given":"Lutai","family":"Wang","sequence":"additional","affiliation":[{"name":"Department of Roadway Engineering, School of Transportation, Southeast University, Nanjing 211189, China"},{"name":"National Demonstration Center for Experimental Road and Traffic Engineering Education, Southeast University, Nanjing 211189, China"}]}],"member":"1968","published-online":{"date-parts":[[2022,8,11]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Liu, S., Tu, X., Xu, C., Chen, L., Lin, S., and Li, R. (2021). An Optimized Deep Neural Network for Overhead Contact System Recognition from LiDAR Point Clouds. Remote Sens., 13.","DOI":"10.3390\/rs13204110"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"126085","DOI":"10.1016\/j.conbuildmat.2021.126085","article-title":"Studies on the validity of strain sensors for pavement monitoring: A case study for a fiber Bragg grating sensor and resistive sensor","volume":"321","author":"Liu","year":"2022","journal-title":"Constr. Build. Mater."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"244","DOI":"10.1016\/j.conbuildmat.2019.01.150","article-title":"A fast adaptive crack detection algorithm based on a double-edge extraction operator of FSM","volume":"204","author":"Luo","year":"2019","journal-title":"Constr. Build. Mater."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"109877","DOI":"10.1016\/j.measurement.2021.109877","article-title":"An improved minimal path selection approach with new strategies for pavement crack segmentation","volume":"184","author":"Chen","year":"2021","journal-title":"Measurement"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"120084","DOI":"10.1016\/j.conbuildmat.2020.120084","article-title":"Fast and robust pavement crack distress segmentation utilizing steerable filtering and local order energy","volume":"262","author":"Liang","year":"2020","journal-title":"Constr. Build. Mater."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"111248","DOI":"10.1016\/j.measurement.2022.111248","article-title":"Automatic detection of asphalt pavement thickness: A method combining GPR images and improved Canny algorithm","volume":"196","author":"Wang","year":"2022","journal-title":"Measurement"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"119085","DOI":"10.1016\/j.atmosenv.2022.119085","article-title":"Visibility classification and influencing-factors analysis of airport: A deep learning approach","volume":"278","author":"Liu","year":"2022","journal-title":"Atmos. Environ."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"84","DOI":"10.1145\/3065386","article-title":"Imagenet classification with deep convolutional neural networks","volume":"60","author":"Krizhevsky","year":"2017","journal-title":"Commun. ACM"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"361","DOI":"10.1111\/mice.12263","article-title":"Deep Learning-Based Crack Damage Detection Using Convolutional Neural Networks","volume":"32","author":"Cha","year":"2017","journal-title":"Comput. Aided Civ. Infrastruct. Eng."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Xiong, Y., Zhou, Y., Wang, F., Wang, S., Wang, Z., Ji, J., Wang, J., Zou, W., You, D., and Qin, G. (2022). A Novel Intelligent Method Based on the Gaussian Heatmap Sampling Technique and Convolutional Neural Network for Landslide Susceptibility Mapping. Remote Sens., 14.","DOI":"10.3390\/rs14122866"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"24365","DOI":"10.1007\/s11042-021-10707-4","article-title":"Medical image analysis based on deep learning approach","volume":"80","author":"Puttagunta","year":"2021","journal-title":"Multimedia Tools Appl."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Liu, Z., Wu, W., Gu, X., Li, S., Wang, L., and Zhang, T. (2021). Application of Combining YOLO Models and 3D GPR Images in Road Detection and Maintenance. Remote Sens., 13.","DOI":"10.3390\/rs13061081"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Xu, J., Zhang, J., and Sun, W. (2021). Recognition of the Typical Distress in Concrete Pavement Based on GPR and 1D-CNN. Remote Sens., 13.","DOI":"10.3390\/rs13122375"},{"key":"ref_14","first-page":"28","article-title":"Research on Improved YOLOv3 Traffic Sign Detection Method","volume":"56","author":"Deng","year":"2020","journal-title":"Comput. Eng. Appl."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"04021024","DOI":"10.1061\/JPEODX.0000280","article-title":"3D Visualization of Airport Pavement Quality Based on BIM and WebGL Integration","volume":"147","author":"Liu","year":"2021","journal-title":"J. Transp. Eng. Part B Pavements"},{"key":"ref_16","first-page":"2063","article-title":"A Real-time Detection Method for Multi-scale Pedestrians in Complex Environment","volume":"43","author":"Zhou","year":"2021","journal-title":"J. Electron. Inf. Technol."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Liu, T., Wang, Y., Niu, X., Chang, L., Zhang, T., and Liu, J. (2022). LiDAR Odometry by Deep Learning-Based Feature Points with Two-Step Pose Estimation. Remote Sens., 14.","DOI":"10.3390\/rs14122764"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"123549","DOI":"10.1016\/j.conbuildmat.2021.123549","article-title":"Cost-effective system for detection and quantification of concrete surface cracks by combination of convolutional neural network and image processing techniques","volume":"293","author":"Miao","year":"2021","journal-title":"Constr. Build. Mater."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Girshick, R., Donahue, J., Darrell, T., and Malik, J. (2014, January 23\u201328). Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA.","DOI":"10.1109\/CVPR.2014.81"},{"key":"ref_20","unstructured":"Dai, J., Li, Y., He, K., and Sun, J. (2016, January 5\u201310). R-fcn: Object detection via region-based fully convolutional networks. Proceedings of the Advances in Neural Information Processing Systems 29 (NIPS 2016), Barcelona, Spain."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"1904","DOI":"10.1109\/TPAMI.2015.2389824","article-title":"Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition","volume":"37","author":"He","year":"2015","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Nie, M., and Wang, K. (2018, January 10\u201312). Pavement Distress Detection Based on Transfer Learning. Proceedings of the 2018 5th International Conference on Systems and Informatics (ICSAI), Nanjing, China.","DOI":"10.1109\/ICSAI.2018.8599473"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"265","DOI":"10.1139\/cjce-2020-0764","article-title":"Detecting potholes in asphalt pavement under small-sample conditions based on improved faster region-based convolution neural networks","volume":"49","author":"Pei","year":"2022","journal-title":"Can. J. Civ. Eng."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"23","DOI":"10.1080\/14680629.2019.1614969","article-title":"Faster region convolutional neural network for automated pavement distress detection","volume":"22","author":"Song","year":"2021","journal-title":"Road Mater. Pavement Des."},{"key":"ref_25","unstructured":"Cao, X.G., Gu, Y.F., and Bai, X.Z. (2017, January 23\u201325). Detecting of foreign object debris on airfield pavement using convolution neural network. Proceedings of the LIDAR Imaging Detection and Target Recognition 2017, Changchun, China."},{"key":"ref_26","unstructured":"Redmon, J., and Farhadi, A. (2018). YOLOv3: An Incremental Improvement. arXiv."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"103991","DOI":"10.1016\/j.autcon.2021.103991","article-title":"Pavement distress detection using convolutional neural networks with images captured via UAV","volume":"133","author":"Zhu","year":"2022","journal-title":"Autom. Constr."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Liu, Z., Gu, X., Yang, H., Wang, L., Chen, Y., and Wang, D. (2022). Novel YOLOv3 Model With Structure and Hyperparameter Optimization for Detection of Pavement Concealed Cracks in GPR Images. IEEE Trans. Intell. Transp. Syst., 1\u201311.","DOI":"10.1109\/TITS.2022.3174626"},{"key":"ref_29","first-page":"164","article-title":"YOLOv3 Traffic sign Detection based on SPP and Improved FPN","volume":"57","author":"Liu","year":"2021","journal-title":"Comput. Eng. Appl."},{"key":"ref_30","unstructured":"Bochkovskiy, A., Wang, C.-Y., and Liao, H.-Y.M. (2020). YOLOv4: Optimal Speed and Accuracy of Object Detection. arXiv."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"103912","DOI":"10.1016\/j.autcon.2021.103912","article-title":"Automatic detection of sewer defects based on improved you only look once algorithm","volume":"131","author":"Tan","year":"2021","journal-title":"Autom. Constr."},{"key":"ref_32","first-page":"40","article-title":"Multi-Channel Fusion Leakage Detection","volume":"5","author":"Cao","year":"2020","journal-title":"J. Cyber Secur."},{"key":"ref_33","unstructured":"Guo, T.W., Lu, K., Chai, X., and Zhong, Y. (2018, January 25\u201328). Wool and Cashmere Images Identification Based on Deep Learning. Proceedings of the Textile Bioengi-neering and Informatics Symposium (TBIS), Manchester, UK."},{"key":"ref_34","unstructured":"(2015, October 05). Tzutalin. LabelImg. Git Code. Available online: https:\/\/github.com\/tzutalin\/labelImg."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Xue, J., Xu, H., Yang, H., Wang, B., Wu, P., Choi, J., Cai, L., and Wu, Y. (2021). Multi-Feature Enhanced Building Change Detection Based on Semantic Information Guidance. Remote Sens., 13.","DOI":"10.3390\/rs13204171"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"109900","DOI":"10.1016\/j.measurement.2021.109900","article-title":"Application of image technology on pavement distress detection: A review","volume":"184","author":"Du","year":"2021","journal-title":"Measurement"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"111281","DOI":"10.1016\/j.measurement.2022.111281","article-title":"GPR-based detection of internal cracks in asphalt pavement: A combination method of DeepAugment data and object detection","volume":"197","author":"Liu","year":"2022","journal-title":"Measurement"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"1233","DOI":"10.5370\/JEET.2015.10.3.1233","article-title":"Automatic Method for Contrast Enhancement of Natural Color Images","volume":"10","author":"Lae","year":"2015","journal-title":"J. Electr. Eng. Technol."},{"key":"ref_39","first-page":"1848","article-title":"Light field all-in-focus image fusion based on wavelet domain sharpness evaluation","volume":"45","author":"Xie","year":"2019","journal-title":"J. Beijing Univ. Aeronaut. Astronaut."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27\u201330). Deep Residual Learning for Image Recognition. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_41","unstructured":"Ioffe, S., and Szegedy, C. (2015). Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift. arXiv."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"2739","DOI":"10.1007\/s00371-021-02150-1","article-title":"A multivariate intersection over union of SiamRPN network for visual tracking","volume":"38","author":"Huang","year":"2021","journal-title":"Vis. Comput."},{"key":"ref_43","first-page":"190","article-title":"Robustness Certification Research on Deep Learning Models: A Survey","volume":"45","author":"Ji","year":"2022","journal-title":"Chin. J. Comput."},{"key":"ref_44","first-page":"1725","article-title":"Random occlusion assisted deep representation learning for vehicle re-identification","volume":"35","author":"Hou","year":"2018","journal-title":"Control. Theory Appl."},{"key":"ref_45","first-page":"1091","article-title":"Research on Denoising Algorithm for Salt and Pepper Noise","volume":"30","author":"Wang","year":"2015","journal-title":"J. Data Acquis. Processing"},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"71","DOI":"10.1007\/s11856-018-1646-8","article-title":"Gaussian noise sensitivity and Fourier tails","volume":"225","author":"Kindler","year":"2018","journal-title":"Isr. J. Math."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"6376","DOI":"10.1007\/s10489-021-02327-0","article-title":"Evidential fully convolutional network for semantic segmentation","volume":"51","author":"Tong","year":"2021","journal-title":"Appl. Intell."},{"key":"ref_48","unstructured":"Guo, C., Pleiss, G., Sun, Y., and Weinberger, K.Q. (2017). On Calibration of Modern Neural Networks. arXiv."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"1137","DOI":"10.1109\/TPAMI.2016.2577031","article-title":"Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks","volume":"39","author":"Ren","year":"2017","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Cai, Z., and Vasconcelos, N. (2018, January 18\u201323). Cascade R-CNN: Delving into High Quality Object Detection. Proceedings of the 2018 IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00644"},{"key":"ref_51","doi-asserted-by":"crossref","unstructured":"Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S., Fu, C., and Berg, A.C. (2015). SSD: Single Shot MultiBox Detector. arXiv.","DOI":"10.1007\/978-3-319-46448-0_2"},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"47","DOI":"10.1111\/mice.12561","article-title":"Generative adversarial network for road damage detection","volume":"36","author":"Maeda","year":"2021","journal-title":"Comput. Aided Civ. Infrastruct. Eng."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/14\/16\/3892\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T00:07:17Z","timestamp":1760141237000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/14\/16\/3892"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,8,11]]},"references-count":52,"journal-issue":{"issue":"16","published-online":{"date-parts":[[2022,8]]}},"alternative-id":["rs14163892"],"URL":"https:\/\/doi.org\/10.3390\/rs14163892","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,8,11]]}}}