{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,20]],"date-time":"2026-04-20T23:40:37Z","timestamp":1776728437386,"version":"3.51.2"},"reference-count":56,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2018,7,24]],"date-time":"2018-07-24T00:00:00Z","timestamp":1532390400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Data"],"abstract":"<jats:p>Deep learning, more specifically deep convolutional neural networks, is fast becoming a popular choice for computer vision-based automated pavement distress detection. While pavement image analysis has been extensively researched over the past three decades or so, recent ground-breaking achievements of deep learning algorithms in the areas of machine translation, speech recognition, and computer vision has sparked interest in the application of deep learning to automated detection of distresses in pavement images. This paper provides a narrative review of recently published studies in this field, highlighting the current achievements and challenges. A comparison of the deep learning software frameworks, network architecture, hyper-parameters employed by each study, and crack detection performance is provided, which is expected to provide a good foundation for driving further research on this important topic in the context of smart pavement or asset management systems. The review concludes with potential avenues for future research; especially in the application of deep learning to not only detect, but also characterize the type, extent, and severity of distresses from 2D and 3D pavement images.<\/jats:p>","DOI":"10.3390\/data3030028","type":"journal-article","created":{"date-parts":[[2018,7,24]],"date-time":"2018-07-24T11:51:38Z","timestamp":1532433098000},"page":"28","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":174,"title":["Deep Learning in Data-Driven Pavement Image Analysis and Automated Distress Detection: A Review"],"prefix":"10.3390","volume":"3","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-8346-5580","authenticated-orcid":false,"given":"Kasthurirangan","family":"Gopalakrishnan","sequence":"first","affiliation":[{"name":"Department of Civil, Construction, and Environmental Engineering, Iowa State University, Ames, IA 50011, USA"}]}],"member":"1968","published-online":{"date-parts":[[2018,7,24]]},"reference":[{"key":"ref_1","unstructured":"ASCE (2017). American Society of Civil Engineers (ASCE) 2017 Infrastructure Report Card: Roads, American Society of Civil Engineers (ASCE)."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Flintsch, G., and McGhee, K. (2009). NCHRP Synthesis 401: Quality Management of Pavement Condition Data Collection, Transportation Research Board.","DOI":"10.17226\/14325"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Gopalakrishnan, K. (2017, May 09). Advanced Pavement Health Monitoring and Management. Available online: http:\/\/www.igi-global.com\/video.aspx?ref=advanced-pavement-health-monitoring-management&titleid=137625.","DOI":"10.4018\/978-1-4666-9700-3"},{"key":"ref_4","unstructured":"Tsai, Y., and Wang, Z. (2015). Development of an Asphalt Pavement Raveling Detection Algorithm Using Emerging 3D Laser Technology and Macrotexture Analysis, Transportation Research Board. Final Report NCHRP IDEA Project 163."},{"key":"ref_5","first-page":"391","article-title":"Network level pavement evaluation with 1 mm 3D survey system","volume":"2","author":"Wang","year":"2015","journal-title":"J. Traffic Transp. Eng. Engl. Ed."},{"key":"ref_6","first-page":"e1320780","article-title":"Deep Learning in Visual Computing and Signal Processing","volume":"2017","author":"Xie","year":"2017","journal-title":"Appl. Comput. Intell. Soft Comput."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"053208","DOI":"10.1063\/1.4946894","article-title":"Perspective: Materials informatics and big data: Realization of the \u2018fourth paradigm\u2019 of science in materials science","volume":"4","author":"Agrawal","year":"2016","journal-title":"APL Mater."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"11","DOI":"10.1016\/j.neucom.2016.12.038","article-title":"A survey of deep neural network architectures and their applications","volume":"234","author":"Liu","year":"2017","journal-title":"Neurocomputing"},{"key":"ref_9","unstructured":"Bahrampour, S., Ramakrishnan, N., Schott, L., and Shah, M. (arXiv, 2016). Comparative Study of Deep Learning Software Frameworks, arXiv."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Fonnegra, R.D., Blair, B., and D\u00edaz, G.M. (2017, January 16\u201318). Performance comparison of deep learning frameworks in image classification problems using convolutional and recurrent networks. Proceedings of the 2017 IEEE Colombian Conference on Communications and Computing (COLCOM), Cartagena, Colombia.","DOI":"10.1109\/ColComCon.2017.8088219"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Shi, S., Wang, Q., Xu, P., and Chu, X. (2016, January 16\u201318). Benchmarking State-of-the-Art Deep Learning Software Tools. Proceedings of the 2016 7th International Conference on Cloud Computing and Big Data (CCBD), Macau, China.","DOI":"10.1109\/CCBD.2016.029"},{"key":"ref_12","unstructured":"Caffe (2018, February 15). Caffe\u2014Deep Learning Framework. Available online: http:\/\/caffe.berkeleyvision.org\/."},{"key":"ref_13","unstructured":"Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., and Darrell, T. (1998, January 19\u201321). Caffe: Convolutional Architecture for Fast Feature Embedding. Proceedings of the 22nd ACM International Conference on Multimedia, New York, NY, USA."},{"key":"ref_14","unstructured":"TensorFlow (2018, February 15). TensorFlow. Available online: https:\/\/www.tensorflow.org\/."},{"key":"ref_15","unstructured":"Theano (2018, February 16). Theano at a Glance\u2014Theano 1.0.0 Documentation. Available online: http:\/\/deeplearning.net\/software\/theano\/introduction.html."},{"key":"ref_16","unstructured":"Torch (2018, February 16). Torch\u2014Scientific Computing for LuaJIT. Available online: http:\/\/torch.ch\/."},{"key":"ref_17","unstructured":"Chollet, F. (2015). Keras, GitHub."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Chambon, S., and Moliard, J.-M. (2011). Automatic Road Pavement Assessment with Image Processing: Review and Comparison. Int. J. Geophys., 20.","DOI":"10.1155\/2011\/989354"},{"key":"ref_19","unstructured":"Oliveira, H., and Correia, P.L. (2009, January 24\u201328). Automatic road crack segmentation using entropy and image dynamic thresholding. Proceedings of the 2009 17th European Signal Processing Conference, Glasgow, UK."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"11","DOI":"10.1061\/(ASCE)TE.1943-5436.0000051","article-title":"Critical assessment of pavement distress segmentation methods","volume":"136","author":"Tsai","year":"2009","journal-title":"J. Transp. Eng."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"130","DOI":"10.1016\/j.imavis.2016.11.018","article-title":"An efficient and reliable coarse-to-fine approach for asphalt pavement crack detection","volume":"57","author":"Zhang","year":"2017","journal-title":"Image Vis. Comput."},{"key":"ref_22","first-page":"2008","article-title":"Evaluating Pavement Cracks with Bidimensional Empirical Mode Decomposition","volume":"861701","year":"2008","journal-title":"EURASIP J. Adv. Signal Process."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Subirats, P., Dumoulin, J., Legeay, V., and Barba, D. (2006, January 8\u201311). Automation of Pavement Surface Crack Detection using the Continuous Wavelet Transform. Proceedings of the 2006 International Conference on Image Processing, Atlanta, GA, USA.","DOI":"10.1109\/ICIP.2006.313007"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"73","DOI":"10.3141\/2024-09","article-title":"Wavelet-Based Pavement Distress Image Edge Detection with \u00e0 Trous Algorithm","volume":"2024","author":"Wang","year":"2007","journal-title":"Transp. Res. Rec. J. Transp. Res. Board"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"572","DOI":"10.1111\/j.1467-8667.2010.00674.x","article-title":"Beamlet Transform-Based Technique for Pavement Crack Detection and Classification","volume":"25","author":"Ying","year":"2010","journal-title":"Comput. Aided Civ. Infrastruct. Eng."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"196","DOI":"10.1016\/j.aei.2015.01.008","article-title":"A review on computer vision based defect detection and condition assessment of concrete and asphalt civil infrastructure","volume":"29","author":"Koch","year":"2015","journal-title":"Adv. Eng. Inform."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"155","DOI":"10.1109\/TITS.2012.2208630","article-title":"Automatic Road Crack Detection and Characterization","volume":"14","author":"Oliveira","year":"2013","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Fujita, Y., Shimada, K., Ichihara, M., and Hamamoto, Y. (2017, January 14). A method based on machine learning using hand-crafted features for crack detection from asphalt pavement surface images. Proceedings of the Thirteenth International Conference on Quality Control by Artificial Vision 2017, Tokyo, Japan.","DOI":"10.1117\/12.2264075"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Hizukuri, A., and Nagata, T. (2017, January 14). Development of a classification method for a crack on a pavement surface images using machine learning. Proceedings of the Thirteenth International Conference on Quality Control by Artificial Vision 2017, Tokyo, Japan.","DOI":"10.1117\/12.2266911"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"227","DOI":"10.1016\/j.patrec.2011.11.004","article-title":"CrackTree: Automatic crack detection from pavement images","volume":"33","author":"Zou","year":"2012","journal-title":"Pattern Recognit. Lett."},{"key":"ref_31","unstructured":"Some, L. (2016). Automatic Image-Based Road Crack Detection Methods, KTH Royal Institute of Technology."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Oliveira, H., and Correia, P.L. (2014, January 27\u201330). CrackIT\u2014An image processing toolbox for crack detection and characterization. Proceedings of the 2014 IEEE International Conference on Image Processing (ICIP), Paris, France.","DOI":"10.1109\/ICIP.2014.7025160"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Zhang, L., Yang, F., Zhang, Y.D., and Zhu, Y.J. (2016, January 25\u201328). Road crack detection using deep convolutional neural network. Proceedings of the 2016 IEEE International Conference on Image Processing (ICIP), Phoenix, AZ, USA.","DOI":"10.1109\/ICIP.2016.7533052"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Pauly, L., Peel, H., Hogg, D., and Fuentes, R. (July, January 28). Deeper Networks for Pavement Crack Detection. Proceedings of the 34th International Symposium on Automation and Robotics in Construction (ISARC 2017), Taipei, Taiwan.","DOI":"10.22260\/ISARC2017\/0066"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Eisenbach, M., Stricker, R., Seichter, D., Amende, K., Debes, K., Sesselmann, M., Ebersbach, D., Stoeckert, U., and Gross, H.M. (2017, January 14\u201319). How to get pavement distress detection ready for deep learning? A systematic approach. Proceedings of the 2017 International Joint Conference on Neural Networks (IJCNN), Anchorage, AK, USA.","DOI":"10.1109\/IJCNN.2017.7966101"},{"key":"ref_36","unstructured":"Maeda, H., Sekimoto, Y., Seto, T., Kashiyama, T., and Omata, H. (arXiv, 2018). Road Damage Detection Using Deep Neural Networks with Images Captured Through a Smartphone, arXiv."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Maeda, H., Sekimoto, Y., and Seto, T. (2016, January 31). Lightweight Road Manager: Smartphone-based Automatic Determination of Road Damage Status by Deep Neural Network. Proceedings of the 5th ACM SIGSPATIAL International Workshop on Mobile Geographic Information Systems, New York, NY, USA.","DOI":"10.1145\/3004725.3004729"},{"key":"ref_38","first-page":"21","article-title":"SSD: Single Shot MultiBox Detector","volume":"Volume 9905","author":"Liu","year":"2016","journal-title":"European Conference on Computer Vision"},{"key":"ref_39","unstructured":"Howard, A.G., Zhu, M., Chen, B., Kalenichenko, D., Wang, W., Weyand, T., Andreetto, M., and Adam, H. (arXiv, 2017). MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications, arXiv."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"228","DOI":"10.1016\/j.ijprt.2016.05.001","article-title":"Mitigation strategies for reflection cracking in rehabilitated pavements\u2014A synthesis","volume":"9","author":"Dhakal","year":"2016","journal-title":"Int. J. Pavement Res. Technol."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"775","DOI":"10.1016\/j.conbuildmat.2017.04.097","article-title":"Recognition, location, measurement, and 3D reconstruction of concealed cracks using convolutional neural networks","volume":"146","author":"Tong","year":"2017","journal-title":"Constr. Build. Mater."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Wang, X., and Hu, Z. (2017, January 8\u201310). Grid-based pavement crack analysis using deep learning. Proceedings of the 4th International Conference on Transportation Information and Safety (ICTIS), Banff, AB, Canada.","DOI":"10.1109\/ICTIS.2017.8047878"},{"key":"ref_43","unstructured":"Fan, Z., Wu, Y., and Li, W. (arXiv, 2018). Automatic Pavement Crack Detection Based on Structured Prediction with the Convolutional Neural Network, arXiv."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"3434","DOI":"10.1109\/TITS.2016.2552248","article-title":"Automatic Road Crack Detection Using Random Structured Forests","volume":"17","author":"Shi","year":"2016","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Ma, K., Hoai, M., and Samaras, D. (2017, January 4\u20137). Large-scale Continual Road Inspection: Visual Infrastructure Assessment in the Wild. Proceedings of the British Machine Vision Conference, London, UK.","DOI":"10.5244\/C.31.151"},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"805","DOI":"10.1111\/mice.12297","article-title":"Automated Pixel-Level Pavement Crack Detection on 3D Asphalt Surfaces Using a Deep-Learning Network","volume":"32","author":"Zhang","year":"2017","journal-title":"Comput. Civ. Infrastruct. Eng."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"322","DOI":"10.1016\/j.conbuildmat.2017.09.110","article-title":"Deep Convolutional Neural Networks with transfer learning for computer vision-based data-driven pavement distress detection","volume":"157","author":"Gopalakrishnan","year":"2017","journal-title":"Constr. Build. Mater."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"1285","DOI":"10.1109\/TMI.2016.2528162","article-title":"Deep convolutional neural networks for computer-aided detection: CNN architectures, dataset characteristics and transfer learning","volume":"35","author":"Shin","year":"2016","journal-title":"IEEE Trans. Med. Imaging"},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Bar, Y., Diamant, I., Wolf, L., Lieberman, S., Konen, E., and Greenspan, H. (2015, January 16\u201319). Chest pathology detection using deep learning with non-medical training. Proceedings of the 2015 IEEE 12th International Symposium on Biomedical Imaging (ISBI), New York, NY, USA.","DOI":"10.1109\/ISBI.2015.7163871"},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"60","DOI":"10.1016\/j.media.2017.07.005","article-title":"A survey on deep learning in medical image analysis","volume":"42","author":"Litjens","year":"2017","journal-title":"Med. Image Anal."},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"04018001","DOI":"10.1061\/(ASCE)CP.1943-5487.0000736","article-title":"Unified Approach to Pavement Crack and Sealed Crack Detection Using Preclassification Based on Transfer Learning","volume":"32","author":"Zhang","year":"2018","journal-title":"J. Comput. Civ. Eng."},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"361","DOI":"10.1111\/mice.12263","article-title":"Deep Learning-Based Crack Damage Detection Using Convolutional Neural Networks","volume":"32","author":"Cha","year":"2017","journal-title":"Comput. Aided Civ. Infrastruct. Eng."},{"key":"ref_53","doi-asserted-by":"crossref","unstructured":"Feng, C., Liu, M.-Y., and Lee, T.-Y. (2017, January 25\u201327). Deep Active Learning for Civil Infrastructure Defect Detection and Classification. Proceedings of the 2017 International Workshop on Computing in Civil Engineering, Seattle, WA, USA.","DOI":"10.1061\/9780784480823.036"},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"1","DOI":"10.7708\/ijtte.2018.8(1).01","article-title":"Crack Damage Detection in Unmanned Aerial Vehicle Images of Civil Infrastructure Using Pre-Trained Deep Learning Model","volume":"8","author":"Gopalakrishnan","year":"2018","journal-title":"Int. J. Traffic Transp. Eng."},{"key":"ref_55","doi-asserted-by":"crossref","unstructured":"Buda, M., Maki, A., and Mazurowski, M.A. (arXiv, 2017). A systematic study of the class imbalance problem in convolutional neural networks, arXiv.","DOI":"10.1016\/j.neunet.2018.07.011"},{"key":"ref_56","unstructured":"Stanford University (2018, March 09). Unsupervised Feature Learning and Deep Learning Tutorial. Available online: http:\/\/ufldl.stanford.edu\/tutorial\/selftaughtlearning\/SelfTaughtLearning\/."}],"container-title":["Data"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2306-5729\/3\/3\/28\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T15:14:02Z","timestamp":1760195642000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2306-5729\/3\/3\/28"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,7,24]]},"references-count":56,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2018,9]]}},"alternative-id":["data3030028"],"URL":"https:\/\/doi.org\/10.3390\/data3030028","relation":{},"ISSN":["2306-5729"],"issn-type":[{"value":"2306-5729","type":"electronic"}],"subject":[],"published":{"date-parts":[[2018,7,24]]}}}