{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,5]],"date-time":"2026-06-05T07:41:13Z","timestamp":1780645273539,"version":"3.54.1"},"reference-count":60,"publisher":"MDPI AG","issue":"5","license":[{"start":{"date-parts":[[2021,3,1]],"date-time":"2021-03-01T00:00:00Z","timestamp":1614556800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>This paper proposes a customized convolutional neural network for crack detection in concrete structures. The proposed method is compared to four existing deep learning methods based on training data size, data heterogeneity, network complexity, and the number of epochs. The performance of the proposed convolutional neural network (CNN) model is evaluated and compared to pretrained networks, i.e., the VGG-16, VGG-19, ResNet-50, and Inception V3 models, on eight datasets of different sizes, created from two public datasets. For each model, the evaluation considered computational time, crack localization results, and classification measures, e.g., accuracy, precision, recall, and F1-score. Experimental results demonstrated that training data size and heterogeneity among data samples significantly affect model performance. All models demonstrated promising performance on a limited number of diverse training data; however, increasing the training data size and reducing diversity reduced generalization performance, and led to overfitting. The proposed customized CNN and VGG-16 models outperformed the other methods in terms of classification, localization, and computational time on a small amount of data, and the results indicate that these two models demonstrate superior crack detection and localization for concrete structures.<\/jats:p>","DOI":"10.3390\/s21051688","type":"journal-article","created":{"date-parts":[[2021,3,1]],"date-time":"2021-03-01T10:25:18Z","timestamp":1614594318000},"page":"1688","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":283,"title":["Performance Evaluation of Deep CNN-Based Crack Detection and Localization Techniques for Concrete Structures"],"prefix":"10.3390","volume":"21","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5996-7804","authenticated-orcid":false,"given":"Luqman","family":"Ali","sequence":"first","affiliation":[{"name":"Department of Computer Science and Software Engineering, College of Information Technology, UAEU, Al Ain 15551, United Arab Emirates"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6102-3765","authenticated-orcid":false,"given":"Fady","family":"Alnajjar","sequence":"additional","affiliation":[{"name":"Department of Computer Science and Software Engineering, College of Information Technology, UAEU, Al Ain 15551, United Arab Emirates"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4230-4067","authenticated-orcid":false,"given":"Hamad Al","family":"Jassmi","sequence":"additional","affiliation":[{"name":"Department of Civil Engineering, College of Engineering, UAEU, Al Ain 15551, United Arab Emirates"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Munkhjargal","family":"Gocho","sequence":"additional","affiliation":[{"name":"Department of Computer Science and Software Engineering, College of Information Technology, UAEU, Al Ain 15551, United Arab Emirates"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2227-3299","authenticated-orcid":false,"given":"Wasif","family":"Khan","sequence":"additional","affiliation":[{"name":"Department of Computer Science and Software Engineering, College of Information Technology, UAEU, Al Ain 15551, United Arab Emirates"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7001-3710","authenticated-orcid":false,"given":"M. Adel","family":"Serhani","sequence":"additional","affiliation":[{"name":"Department of Computer Science and Software Engineering, College of Information Technology, UAEU, Al Ain 15551, United Arab Emirates"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2021,3,1]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"255","DOI":"10.1061\/(ASCE)0887-3801(2003)17:4(255)","article-title":"Analysis of edge-detection techniques for crack identification in bridges","volume":"17","author":"Abudayyeh","year":"2003","journal-title":"J. Comput. Civ. Eng."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"04014110","DOI":"10.1061\/(ASCE)CP.1943-5487.0000447","article-title":"Sealed-Crack Detection Algorithm Using Heuristic Thresholding Approach","volume":"30","author":"Kamaliardakani","year":"2016","journal-title":"J. Comput. Civ. Eng."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"861","DOI":"10.1016\/j.imavis.2011.10.003","article-title":"FoSA: F* Seed-growing Approach for crack-line detection from pavement images","volume":"29","author":"Li","year":"2011","journal-title":"Image Vis. Comput."},{"key":"ref_4","unstructured":"Yamaguchi, T., Nakamura, S., and Hashimoto, S. (2008, January 3\u20135). An efficient crack detection method using percolation-based image processing. Proceedings of the 2008 3rd IEEE Conference on Industrial Electronics and Applications, ICIEA 2008, Singapore."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"21","DOI":"10.1007\/s00138-005-0012-0","article-title":"Morphological segmentation and classification of underground pipe images","volume":"17","author":"Sinha","year":"2006","journal-title":"Mach. Vis. Appl."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"58","DOI":"10.1016\/j.autcon.2005.02.006","article-title":"Automated detection of cracks in buried concrete pipe images","volume":"15","author":"Sinha","year":"2006","journal-title":"Autom. Constr."},{"key":"ref_7","first-page":"72510A","article-title":"Introduction of a wavelet transform based on 2D matched filter in a Markov random field for fine structure extraction: Application on road crack detection","volume":"Volume 7251","author":"Chambon","year":"2009","journal-title":"Image Processing: Machine Vision Applications II"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"245","DOI":"10.1007\/s00138-009-0244-5","article-title":"A robust automatic crack detection method from noisy concrete surfaces","volume":"22","author":"Fujita","year":"2011","journal-title":"Mach. Vis. Appl."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"644","DOI":"10.1111\/mice.12098","article-title":"Regionally enhanced multiphase segmentation technique for damaged surfaces","volume":"29","author":"Ghosh","year":"2014","journal-title":"Comput. Civ. Infrastruct. Eng."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"162","DOI":"10.1111\/j.1467-8667.2012.00790.x","article-title":"Texture Analysis Based Damage Detection of Ageing Infrastructural Elements","volume":"28","author":"Schoefs","year":"2013","journal-title":"Comput. Civ. Infrastruct. Eng."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Moon, H.G., and Kim, J.H. (July, January 21). Inteligent crack detecting algorithm on the concrete crack image using neural network. Proceedings of the 28th International Symposium on Automation and Robotics in Construction, ISARC 2011, Seoul, Korea.","DOI":"10.22260\/ISARC2011\/0279"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"2831","DOI":"10.1016\/S0045-7825(02)00221-9","article-title":"Detection of cracks using neural networks and computational mechanics","volume":"191","author":"Liu","year":"2002","journal-title":"Comput. Methods Appl. Mech. Eng."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"73","DOI":"10.1016\/j.autcon.2005.02.005","article-title":"Neuro-fuzzy network for the classification of buried pipe defects","volume":"15","author":"Sinha","year":"2006","journal-title":"Autom. Constr."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"263","DOI":"10.1007\/s10044-013-0355-5","article-title":"Classification of defects with ensemble methods in the automated visual inspection of sewer pipes","volume":"18","author":"Wu","year":"2015","journal-title":"Pattern Anal. Appl."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"227","DOI":"10.1007\/s00138-011-0394-0","article-title":"An innovative methodology for detection and quantification of cracks through incorporation of depth perception","volume":"24","author":"Jahanshahi","year":"2013","journal-title":"Mach. Vis. Appl."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"763","DOI":"10.1007\/s11554-014-0451-9","article-title":"NEROvideo: A general-purpose CNN-UM video processing system","volume":"12","author":"Tetzlaff","year":"2016","journal-title":"J. Real-Time Image Process."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"04020010","DOI":"10.1061\/(ASCE)CP.1943-5487.0000890","article-title":"Crack Detection and Segmentation Using Deep Learning with 3D Reality Mesh Model for Quantitative Assessment and Integrated Visualization","volume":"34","author":"Kalfarisi","year":"2020","journal-title":"J. Comput. Civ. Eng."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"4392","DOI":"10.1109\/TIE.2017.2764844","article-title":"NB-CNN: Deep Learning-Based Crack Detection Using Convolutional Neural Network and Na\u00efve Bayes Data Fusion","volume":"65","author":"Chen","year":"2018","journal-title":"IEEE Trans. Ind. Electron."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"67","DOI":"10.1016\/j.neucom.2017.11.059","article-title":"Aurora image search with contextual CNN feature","volume":"281","author":"Yang","year":"2018","journal-title":"Neurocomputing"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"43","DOI":"10.1016\/j.eswa.2017.11.028","article-title":"A new image classification method using CNN transfer learning and web data augmentation","volume":"95","author":"Han","year":"2018","journal-title":"Expert Syst. Appl."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Maeda, H., Sekimoto, Y., and Seto, T. (2016). Lightweight Road Manager: Smartphone-Based Automatic Determination of Road Damage Status by Deep Neural Network. Proceedings of the 5th ACM SIGSPATIAL International Workshop on Mobile Geographic Information Systems, Association for Computing Machinery. MobiGIS \u201916.","DOI":"10.1145\/3004725.3004729"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"1127","DOI":"10.1109\/JAS.2019.1911684","article-title":"Accurate and Robust Eye Center Localization via Fully Convolutional Networks","volume":"6","author":"Xia","year":"2019","journal-title":"EEE\/CAA J. Autom. Sin."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Ali, L., Valappil, N.K., Kareem, D.N.A., John, M.J., and Jassmi, H.A. (November, January UAE). Pavement Crack Detection and Localization using Convolutional Neural Networks (CNNs). Proceedings of the 2019 International Conference on Digitization (ICD), Sharjah.","DOI":"10.1109\/ICD47981.2019.9105786"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Ali, L., Harous, S., Zaki, N., Khan, W., Alnajjar, F., and Jassmi, H.A. (2021, January 19\u201321). Performance Evaluation of Different Algorithms for Crack Detection in Concrete Structures. Proceedings of the 2021 2nd International Conference on Computation, Automation and Knowledge Management (ICCAKM), Dubai, UAE.","DOI":"10.1109\/ICCAKM50778.2021.9357717"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"273","DOI":"10.1109\/TITS.2019.2891167","article-title":"Pixel-Level Cracking Detection on 3D Asphalt Pavement Images Through Deep-Learning- Based CrackNet-V","volume":"21","author":"Fei","year":"2020","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Zhang, L., Yang, F., Zhang, Y.D., and Zhu, Y.J. (2016, January 25\u201328). Road crack detection using deep convolutional neural network. Proceedings of the International Conference on Image Processing, ICIP, Phoenix, AZ, USA.","DOI":"10.1109\/ICIP.2016.7533052"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Wang, K.C.P., Zhang, A., Li, J.Q., Fei, Y., Chen, C., and Li, B. (2017). Deep Learning for Asphalt Pavement Cracking Recognition Using Convolutional Neural Network. Airfield and Highway Pavements 2017: Design, Construction, Evaluation, and Management of Pavements, Proceedings of the International Conference on Highway Pavements and Airfield Technology, ASCE American Society of Civil Engineers 2017, Philadelphia, PA, USA, 27\u201330 August 2017, American Society of Civil Engineers.","DOI":"10.1061\/9780784480922.015"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"361","DOI":"10.1111\/mice.12263","article-title":"Deep Learning-Based Crack Damage Detection Using Convolutional Neural Networks","volume":"32","author":"Cha","year":"2017","journal-title":"Comput. Civ. Infrastruct. Eng."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Xu, H., Su, X., Wang, Y., Cai, H., Cui, K., and Chen, X. (2019). Automatic Bridge Crack Detection Using a Convolutional Neural Network. Appl. Sci., 9.","DOI":"10.3390\/app9142867"},{"key":"ref_30","unstructured":"Pauly, L., Hogg, D., Fuentes, R., and Peel, H. (July, January 28). Deeper networks for pavement crack detection. Proceedings of the 34th ISARC, Taipei, Taiwan."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Fan, Z., Li, C., Chen, Y., Mascio, P.D., Chen, X., Zhu, G., and Loprencipe, G. (2020). Ensemble of Deep Convolutional Neural Networks for Automatic Pavement Crack Detection and Measurement. Coatings, 10.","DOI":"10.3390\/coatings10020152"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"775","DOI":"10.1016\/j.conbuildmat.2017.04.097","article-title":"Recognition, location, measurement, and 3D reconstruction of concealed cracks using convolutional neural networks","volume":"146","author":"Tong","year":"2017","journal-title":"Constr. Build. Mater."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"1090","DOI":"10.1111\/mice.12412","article-title":"Automatic pixel-level crack detection and measurement using fully convolutional network","volume":"33","author":"Yang","year":"2018","journal-title":"Comput. Aided Civ. Infrastruct. Eng."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"805","DOI":"10.1111\/mice.12297","article-title":"Automated Pixel-Level Pavement Crack Detection on 3D Asphalt Surfaces Using a Deep-Learning Network","volume":"32","author":"Zhang","year":"2017","journal-title":"Comput. Aided Civil Infrastruct. Eng."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"04018041","DOI":"10.1061\/(ASCE)CP.1943-5487.0000775","article-title":"Deep Learning\u2013Based Fully Automated Pavement Crack Detection on 3D Asphalt Surfaces with an Improved CrackNet","volume":"32","author":"Zhang","year":"2018","journal-title":"J. Comput. Civ. Eng."},{"key":"ref_36","unstructured":"Simonyan, K., and Zisserman, A. (2014). Very deep convolutional networks for large-scale image recognition. arXiv."},{"key":"ref_37","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (July, January 26). Deep residual learning for image recognition. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA."},{"key":"ref_38","unstructured":"Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., and Wojna, Z. (July, January 26). Rethinking the Inception Architecture for Computer Vision. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"322","DOI":"10.1016\/j.conbuildmat.2017.09.110","article-title":"Deep Convolutional Neural Networks with transfer learning for computer vision-based data-driven pavement distress detection","volume":"157","author":"Gopalakrishnan","year":"2017","journal-title":"Constr. Build. Mater."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"04018001","DOI":"10.1061\/(ASCE)CP.1943-5487.0000736","article-title":"Unified Approach to Pavement Crack and Sealed Crack Detection Using Preclassification Based on Transfer Learning","volume":"32","author":"Zhang","year":"2018","journal-title":"J. Comput. Civ. Eng."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"748","DOI":"10.1111\/mice.12363","article-title":"Deep Transfer Learning for Image-Based Structural Damage Recognition","volume":"33","author":"Gao","year":"2018","journal-title":"Comput. Civ. Infrastruct. Eng."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Bang, S., Park, S., Kim, H., Yoon, Y.S., and Kim, H. (2018). A deep residual network with transfer learning for pixel-level road crack detection. 35th International Symposium on Automation and Robotics in Construction (ISARC 2018), IAARC Publications.","DOI":"10.22260\/ISARC2018\/0103"},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"da Silva, W.R.L., and de Lucena, D.S. (2018). Concrete Cracks Detection Based on Deep Learning Image Classification. Proceedings, 2.","DOI":"10.3390\/ICEM18-05387"},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"1","DOI":"10.7708\/ijtte.2018.8(1).01","article-title":"Crack damage detection in unmanned aerial vehicle images of civil infrastructure using pre-trained deep learning model","volume":"8","author":"Gopalakrishnan","year":"2018","journal-title":"Int. J. Traffic Transp. Eng."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"4493","DOI":"10.1007\/s12205-019-0437-z","article-title":"Structural Damage Detection using Deep Convolutional Neural Network and Transfer Learning","volume":"23","author":"Feng","year":"2019","journal-title":"KSCE J. Civ. Eng."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"1664","DOI":"10.1016\/j.dib.2018.11.015","article-title":"SDNET2018: An annotated image dataset for non-contact concrete crack detection using deep convolutional neural networks","volume":"21","author":"Dorafshan","year":"2018","journal-title":"Data Br."},{"key":"ref_47","unstructured":"\u00d6zgenel, \u00c7.F. (2019). Concrete Crack Images for Classification. Version 2. Mendeley Data."},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Wanderley, M.D.D.S., e Bueno LD, A., Zanchettin, C., and Oliveira, A.L. (2017). The Impact of Dataset Complexity on Transfer Learning over Convolutional Neural Networks. Artificial Neural Networks and Machine Learning\u2014ICANN 2017, Springer.","DOI":"10.1007\/978-3-319-68612-7_66"},{"key":"ref_49","first-page":"818","article-title":"Visualizing and understanding convolutional networks","volume":"Volume 8689","author":"Zeiler","year":"2014","journal-title":"European Conference on Computer Vision"},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"524","DOI":"10.1109\/TNNLS.2015.2412037","article-title":"Generating Highly Accurate Predictions for Missing QoS Data via Aggregating Nonnegative Latent Factor Models","volume":"27","author":"Luo","year":"2016","journal-title":"IEEE Trans. Neural Netw. Learn Syst."},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"1798","DOI":"10.1109\/TCYB.2019.2903736","article-title":"Temporal Pattern-Aware QoS Prediction via Biased Non-Negative Latent Factorization of Tensors","volume":"50","author":"Luo","year":"2020","journal-title":"IEEE Trans. Cybern."},{"key":"ref_52","unstructured":"Kingma, D.P., and Ba, J. (2017). Adam: A Method for Stochastic Optimization. arXiv."},{"key":"ref_53","unstructured":"Nair, V., and Hinton, G.E. (2010, January 21\u201324). Rectified linear units improve Restricted Boltzmann machines. Proceedings of the ICML 2010\u201427th International Conference on Machine Learning, Haifa, Israel."},{"key":"ref_54","first-page":"2","article-title":"A comparison of deep convolutional neural networks for image-based detection of concrete surface cracks","volume":"26","year":"2019","journal-title":"Comput. Assist. Methods Eng. Sci."},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"107474","DOI":"10.1016\/j.patcog.2020.107474","article-title":"A novel hybrid approach for crack detection","volume":"107","author":"Fang","year":"2020","journal-title":"Pattern Recognit."},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"1031","DOI":"10.1016\/j.conbuildmat.2018.08.011","article-title":"Comparison of deep convolutional neural networks and edge detectors for image-based crack detection in concrete","volume":"186","author":"Dorafshan","year":"2018","journal-title":"Construct. Build. Mater."},{"key":"ref_57","doi-asserted-by":"crossref","unstructured":"Yan, J., Downey, A., Cancelli, A., Laflamme, S., Chen, A., Li, J., and Ubertini, F. (2019). Concrete crack detection and monitoring using a capacitive dense sensor array. Sensors, 19.","DOI":"10.3390\/s19081843"},{"key":"ref_58","doi-asserted-by":"crossref","first-page":"022022","DOI":"10.1088\/1742-6596\/1168\/2\/022022","article-title":"An Overview of Overfitting and its Solutions","volume":"1168","author":"Ying","year":"2019","journal-title":"J. Phys. Conf. Ser."},{"key":"ref_59","doi-asserted-by":"crossref","first-page":"7192","DOI":"10.1109\/JIOT.2019.2915095","article-title":"Novel IoT-Based Privacy-Preserving Yoga Posture Recognition System Using Low-Resolution Infrared Sensors and Deep Learning","volume":"6","author":"Gochoo","year":"2019","journal-title":"IEEE Internet Things J."},{"key":"ref_60","doi-asserted-by":"crossref","first-page":"24452","DOI":"10.1109\/ACCESS.2018.2829347","article-title":"Automatic Pixel-Level Pavement Crack Detection Using Information of Multi-Scale Neighborhoods","volume":"6","author":"Ai","year":"2018","journal-title":"IEEE Access"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/5\/1688\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T05:30:59Z","timestamp":1760160659000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/5\/1688"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,3,1]]},"references-count":60,"journal-issue":{"issue":"5","published-online":{"date-parts":[[2021,3]]}},"alternative-id":["s21051688"],"URL":"https:\/\/doi.org\/10.3390\/s21051688","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,3,1]]}}}