{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,18]],"date-time":"2026-04-18T17:47:04Z","timestamp":1776534424445,"version":"3.51.2"},"reference-count":28,"publisher":"MDPI AG","issue":"7","license":[{"start":{"date-parts":[[2023,4,6]],"date-time":"2023-04-06T00:00:00Z","timestamp":1680739200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Key Research and Development Plan of Shaanxi Province","award":["2022JBGS3-08"],"award-info":[{"award-number":["2022JBGS3-08"]}]},{"name":"Key Research and Development Plan of Shaanxi Province","award":["51978071"],"award-info":[{"award-number":["51978071"]}]},{"name":"Key Research and Development Plan of Shaanxi Province","award":["300102242901"],"award-info":[{"award-number":["300102242901"]}]},{"name":"Project of National Natural Science Foundation of China","award":["2022JBGS3-08"],"award-info":[{"award-number":["2022JBGS3-08"]}]},{"name":"Project of National Natural Science Foundation of China","award":["51978071"],"award-info":[{"award-number":["51978071"]}]},{"name":"Project of National Natural Science Foundation of China","award":["300102242901"],"award-info":[{"award-number":["300102242901"]}]},{"name":"National Central University Special Fund for Basic Research Funds","award":["2022JBGS3-08"],"award-info":[{"award-number":["2022JBGS3-08"]}]},{"name":"National Central University Special Fund for Basic Research Funds","award":["51978071"],"award-info":[{"award-number":["51978071"]}]},{"name":"National Central University Special Fund for Basic Research Funds","award":["300102242901"],"award-info":[{"award-number":["300102242901"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>To solve the problem of low accuracy of pavement crack detection caused by natural environment interference, this paper designed a lightweight detection framework named PCDETR (Pavement Crack DEtection TRansformer) network, based on the fusion of the convolution features with the sequence features and proposed an efficient pavement crack detection method. Firstly, the scalable Swin-Transformer network and the residual network are used as two parallel channels of the backbone network to extract the long-sequence global features and the underlying visual local features of the pavement cracks, respectively, which are concatenated and fused to enrich the extracted feature information. Then, the encoder and decoder of the transformer detection framework are optimized; the location and category information of the pavement cracks can be obtained directly using the set prediction, which provided a low-code method to reduce the implementation complexity. The research result shows that the highest AP (Average Precision) of this method reaches 45.8% on the COCO dataset, which is significantly higher than that of DETR and its variants model Conditional DETR where the AP values are 36.9% and 42.8%, respectively. On the self-collected pavement crack dataset, the AP of the proposed method reaches 45.6%, which is 3.8% higher than that of Mask R-CNN (Region-based Convolution Neural Network) and 8.8% higher than that of Faster R-CNN. Therefore, this method is an efficient pavement crack detection algorithm.<\/jats:p>","DOI":"10.3390\/s23073772","type":"journal-article","created":{"date-parts":[[2023,4,6]],"date-time":"2023-04-06T08:41:52Z","timestamp":1680770512000},"page":"3772","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":17,"title":["Automatic Pavement Crack Detection Transformer Based on Convolutional and Sequential Feature Fusion"],"prefix":"10.3390","volume":"23","author":[{"given":"Zhaoyun","family":"Sun","sequence":"first","affiliation":[{"name":"School of Information Engineering, Chang\u2019an University, Xi\u2019an 710064, China"}]},{"given":"Junzhi","family":"Zhai","sequence":"additional","affiliation":[{"name":"School of Information Engineering, Chang\u2019an University, Xi\u2019an 710064, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1084-8289","authenticated-orcid":false,"given":"Lili","family":"Pei","sequence":"additional","affiliation":[{"name":"School of Information Engineering, Chang\u2019an University, Xi\u2019an 710064, China"}]},{"given":"Wei","family":"Li","sequence":"additional","affiliation":[{"name":"School of Information Engineering, Chang\u2019an University, Xi\u2019an 710064, China"}]},{"given":"Kaiyue","family":"Zhao","sequence":"additional","affiliation":[{"name":"School of Information Engineering, Chang\u2019an University, Xi\u2019an 710064, China"}]}],"member":"1968","published-online":{"date-parts":[[2023,4,6]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"196","DOI":"10.1016\/j.aei.2015.01.008","article-title":"A review on computer vision based defect detection and condition assessment of concrete and asphalt civil infrastructure","volume":"29","author":"Koch","year":"2015","journal-title":"Adv. Eng. Inform."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"14531","DOI":"10.1109\/ACCESS.2020.2966881","article-title":"Review of Pavement Defect Detection Methods","volume":"8","author":"Cao","year":"2020","journal-title":"IEEE Access"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"322","DOI":"10.1016\/j.conbuildmat.2017.09.110","article-title":"Deep Convolutional Neural Networks with transfer learning for computer vision-based data-driven pavement distress detection","volume":"157","author":"Gopalakrishnan","year":"2017","journal-title":"Constr. Build. Mater."},{"key":"ref_4","unstructured":"Simonyan, K., and Zisserman, A. (2015). Very Deep Convolutional Networks for Large-Scale Image Recognition. Int. Conf. Learn. Represent."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"84","DOI":"10.1145\/3065386","article-title":"ImageNet classification with deep convolutional neural networks","volume":"60","author":"Krizhevsky","year":"2017","journal-title":"Commun. ACM"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Yusof, N.A.M., Osman, M.K., Hussain, Z., Noor, M.H.M., Ibrahim, A., Tahir, N.M., and Abidin, N.Z. (December, January 29). Automated Asphalt Pavement Crack Detection and Classification using Deep Convolution Neural Network. Proceedings of the 2019 9th IEEE International Conference on Control System, Computing and Engineering (ICCSCE), Penang, Malaysia.","DOI":"10.1109\/ICCSCE47578.2019.9068551"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Hammouch, W., Chouiekh, C., Khaissidi, G., and Mrabti, M. (2022). Crack Detection and Classification in Moroccan Pavement Using Convolutional Neural Network. Infrastructures, 7.","DOI":"10.3390\/infrastructures7110152"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Huyan, J., Li, W., Tighe, S., Xu, Z., and Zhai, J. (2020). CrackU-net: A novel deep convolutional neural network for pixelwise pavement crack detection. Struct. Control Health Monit., 27.","DOI":"10.1002\/stc.2551"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Ronneberger, O., Fischer, P., and Brox, T. (2015, January 5\u20139). Unet Convolutional networks for biomedical image segmentation. Proceedings of the International Conference on Medical Image Computing and Computer-Assisted Intervention, Munich, Germany.","DOI":"10.1007\/978-3-319-24574-4_28"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"54564","DOI":"10.1109\/ACCESS.2020.2981561","article-title":"Crack Detection of Concrete Pavement with Cross-Entropy Loss Function and Improved VGG16 Network Model","volume":"8","author":"Qu","year":"2020","journal-title":"IEEE Access"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"139","DOI":"10.1016\/j.neucom.2019.01.036","article-title":"DeepCrack: A deep hierarchical feature learning architecture for crack segmentation","volume":"338","author":"Liu","year":"2019","journal-title":"Neurocomputing"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"6412562","DOI":"10.1155\/2020\/6412562","article-title":"Automated Pavement Crack Damage Detection Using Deep Multiscale Convolutional Features","volume":"2020","author":"Song","year":"2020","journal-title":"J. Adv. Transp."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27\u201330). Deep Residual Learning for Image Recognition. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"11710","DOI":"10.1109\/TITS.2021.3106647","article-title":"A Crack Detection Algorithm for Concrete Pavement Based on Attention Mechanism and Multi-Features Fusion","volume":"23","author":"Qu","year":"2022","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"3434","DOI":"10.1109\/TITS.2016.2552248","article-title":"Automatic Road Crack Detection Using Random Structured Forests","volume":"17","author":"Shi","year":"2016","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"128837","DOI":"10.1109\/ACCESS.2019.2939201","article-title":"A Survey of Deep Learning-Based Object Detection","volume":"7","author":"Jiao","year":"2019","journal-title":"IEEE Access"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"1137","DOI":"10.1109\/TPAMI.2016.2577031","article-title":"Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks","volume":"39","author":"Ren","year":"2017","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_18","unstructured":"Redmon, J., and Farhadi, A. (2018, April 08). YOLOv3: An Incremental Improvement. CORNELL UNIV URL. Available online: http:\/\/arxiv.org\/abs\/1804.02767."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S., Fu, C.-Y., and Berg, A.C. (2016). SSD: Single Shot MultiBox Detector. arXiv.","DOI":"10.1007\/978-3-319-46448-0_2"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"1981","DOI":"10.1080\/10298436.2020.1833204","article-title":"Automated pavement distress detection using region based convolutional neural networks","volume":"23","author":"Ibragimov","year":"2020","journal-title":"Int. J. Pavement Eng."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Shen, T., and Nie, M. (2020, January 20\u201322). Pavement Damage Detection Based on Cascade R-CNN. Proceedings of the 4th International Conference on Computer Science and Application Engineering, Sanya, China.","DOI":"10.1145\/3424978.3425139"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Zhao, L., Wu, Y., Luo, X., and Yuan, Y. (2022). Automatic Defect Detection of Pavement Diseases. Remote Sens., 14.","DOI":"10.3390\/rs14194836"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"14328","DOI":"10.1109\/JSEN.2022.3181003","article-title":"An Improved YOLOv5 Crack Detection Method Combined with Transformer","volume":"22","author":"Xiang","year":"2022","journal-title":"IEEE Sens. J."},{"key":"ref_24","unstructured":"Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, L., and Polosukhin, I. (2017). Attention Is All You Need. arXiv."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Liu, Z., Lin, Y., Cao, Y., Hu, H., We, Y., Zhang, Z., Lin, S., Guo, B., and Asia, M.R. (2021, January 11\u201317). Swin Transformer: Hierarchical Vision Transformer using Shifted Windows. Proceedings of the IEEE\/CVF International Conference on Computer Vision, Montreal, BC, Canada.","DOI":"10.1109\/ICCV48922.2021.00986"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Meng, D., Chen, X., Fan, Z., Zeng, G., Li, H., Yuan, Y., Sun, L., and Wang, J. (2021, January 11\u201317). Conditional DETR for Fast Training Convergence. Proceedings of the IEEE\/CVF International Conference on Computer Vision, Montreal, BC, Canada.","DOI":"10.1109\/ICCV48922.2021.00363"},{"key":"ref_27","first-page":"1143","article-title":"End-to-End Pavement Crack Detection Method Based on Transformer","volume":"53","author":"Liu","year":"2022","journal-title":"J. Taiyuan Univ. Technol."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"740","DOI":"10.1007\/978-3-319-10602-1_48","article-title":"Microsoft COCO: Common objects in context","volume":"8693","author":"Lin","year":"2014","journal-title":"Lect. Notes Comput."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/7\/3772\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T19:11:11Z","timestamp":1760123471000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/7\/3772"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,4,6]]},"references-count":28,"journal-issue":{"issue":"7","published-online":{"date-parts":[[2023,4]]}},"alternative-id":["s23073772"],"URL":"https:\/\/doi.org\/10.3390\/s23073772","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,4,6]]}}}