{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,6]],"date-time":"2026-06-06T04:17:33Z","timestamp":1780719453202,"version":"3.54.1"},"reference-count":43,"publisher":"MDPI AG","issue":"21","license":[{"start":{"date-parts":[[2019,11,4]],"date-time":"2019-11-04T00:00:00Z","timestamp":1572825600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Image sensors are widely used for detecting cracks on concrete surfaces to help proactive and timely management of concrete structures. However, it is a challenging task to reliably detect cracks on damaged surfaces in the real world due to noise and undesired artifacts. In this paper, we propose an autonomous crack detection algorithm based on convolutional neural network (CNN) to solve the problem. To this aim, the proposed algorithm uses a two-branched CNN architecture, consisting of sub-networks named a crack-component-aware (CCA) network and a crack-region-aware (CRA) network. The CCA network is to learn gradient component regarding cracks, and the CRA network is to learn a region-of-interest by distinguishing critical cracks and noise such as scratches. Specifically, the two sub-networks are built on convolution-deconvolution CNN architectures, but also they are comprised of different functional components to achieve their own goals efficiently. The two sub-networks are trained in an end-to-end to jointly optimize parameters and produce the final output of localizing important cracks. Various crack image samples and learning methods are used for efficiently training the proposed network. In the experimental results, the proposed algorithm provides better performance in the crack detection than the conventional algorithms.<\/jats:p>","DOI":"10.3390\/s19214796","type":"journal-article","created":{"date-parts":[[2019,11,4]],"date-time":"2019-11-04T10:49:07Z","timestamp":1572864547000},"page":"4796","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":21,"title":["Learning to Detect Cracks on Damaged Concrete Surfaces Using Two-Branched Convolutional Neural Network"],"prefix":"10.3390","volume":"19","author":[{"given":"Jieun","family":"Lee","sequence":"first","affiliation":[{"name":"Department of Electrical and Electronic Engineering, Ewha Womans University, Seoul 03760, Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hee-Sun","family":"Kim","sequence":"additional","affiliation":[{"name":"Department of Architectural and Urban Systems Engineering, Ewha Womans University, Seoul 03760, Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Nayoung","family":"Kim","sequence":"additional","affiliation":[{"name":"Department of Electrical and Electronic Engineering, Ewha Womans University, Seoul 03760, Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Eun-Mi","family":"Ryu","sequence":"additional","affiliation":[{"name":"Department of Architectural and Urban Systems Engineering, Ewha Womans University, Seoul 03760, Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Je-Won","family":"Kang","sequence":"additional","affiliation":[{"name":"Department of Electrical and Electronic Engineering, Ewha Womans University, Seoul 03760, Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2019,11,4]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"591","DOI":"10.1109\/TASE.2014.2354314","article-title":"Automated crack detection on concrete bridges","volume":"13","author":"Prasanna","year":"2016","journal-title":"IEEE Trans. Autom. Sci. Eng."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"4392","DOI":"10.1109\/TIE.2017.2764844","article-title":"Nb-cnn: Deep learning-based crack detection using convolutional neural network and naive bayes data fusion","volume":"65","author":"Chen","year":"2018","journal-title":"IEEE Trans. Ind. Electron."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Zhang, L., Yang, F., Zhang, Y.D., and Zhu, Y.J. (2016, January 25\u201328). Road crack detection using deep convolutional neural network. Proceedings of the 2016 IEEE International Conference on Image Processing (ICIP), Phoenix, AZ, USA.","DOI":"10.1109\/ICIP.2016.7533052"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Makantasis, K., Protopapadakis, E., Doulamis, A., Doulamis, N., and Loupos, C. (2015, January 3\u20135). Deep convolutional neural networks for efficient vision based tunnel inspection. Proceedings of the 2015 IEEE International Conference on Intelligent Computer Communication and Processing (ICCP), Cluj-Napoca, Romania.","DOI":"10.1109\/ICCP.2015.7312681"},{"key":"ref_5","unstructured":"Korea Concrete Institute (2012). Korea Structural Concrete Design Code 2012, Korea Concrete Institute. English & Korean."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Noh, Y., Koo, D., Kang, Y.-M., Park, D., and Lee, D. (2017, January 13\u201317). Automatic crack detection on concrete images using segmentation via fuzzy c-means clustering. Proceedings of the 2017 International Conference on Applied System Innovation (ICASI), Sapporo, Japan.","DOI":"10.1109\/ICASI.2017.7988574"},{"key":"ref_7","unstructured":"Youm, M., Yun, H., Jung, T., and Lee, G. (2015, January 28\u201330). High-speed crack detection of structure by computer vision. Proceedings of the KSCE 2015 Convention 2015 Civil Expo and Conference, Gunsan, Korea."},{"key":"ref_8","unstructured":"Song, Q., Lin, G., Ma, J., and Zhang, H. (2016, January 27\u201329). An edge-detection method based on adaptive canny algorithm and iterative segmentation threshold. Proceedings of the 2016 2nd International Conference on Control Science and Systems Engineering (ICCSSE), Singapore."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Xie, S., and Tu, Z. (2015, January 7\u201313). Holistically-nested edge detection. Proceedings of the 2015 IEEE International Conference on Computer Vision, Santiago, Chile.","DOI":"10.1109\/ICCV.2015.164"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Liu, N., Han, J., and Yang, M.-H. (2018, January 18\u201323). Picanet: Learning pixel-wise contextual attention for saliency detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00326"},{"key":"ref_11","unstructured":"Chen, H., Qi, X., Yu, L., and Heng, P.-A. (July, January 26). Dcan: Deep contour-aware networks for accurate gland segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA."},{"key":"ref_12","unstructured":"Kim, H., Ryu, E., Lee, Y., Kang, J.-W., and Lee, J. (2018, January 5\u20137). Performance evaluation of fire damaged reinforced concrete beams using machine learning. Proceedings of the 17th International Conference on Computing in Civil and Bulding Engineering, Tampere, Finland."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"64186","DOI":"10.1109\/ACCESS.2019.2916330","article-title":"Real-time tunnel crack analysis system via deep learning","volume":"7","author":"Song","year":"2019","journal-title":"IEEE Access"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"361","DOI":"10.1111\/mice.12263","article-title":"Deep learning-based crack damage detection using convolutional neural networks","volume":"32","author":"Cha","year":"2017","journal-title":"Comput. Aided Civ. Infrastruct. Eng."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Kim, B., and Cho, S. (2018). Automated vision-based detection of cracks on concrete surfaces using a deep learning technique. Sensors, 18.","DOI":"10.3390\/s18103452"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"1250","DOI":"10.1016\/j.proeng.2017.01.418","article-title":"Development of an automatic detector of cracks in concrete using machine learning","volume":"171","author":"Yokoyama","year":"2017","journal-title":"Procedia Eng."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Silva, W., and Diogo, S. (2018). Concrete cracks detection based on deep learning image classification. Multidiscip. Digit. Publ. Inst. Proc., 2.","DOI":"10.3390\/ICEM18-05387"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"252","DOI":"10.1109\/TSMCC.2002.804448","article-title":"Gaussian-based edge-detection methods\u2014A survey","volume":"32","author":"Basu","year":"2002","journal-title":"IEEE Trans. Syst. Man Cybern."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"53","DOI":"10.1016\/j.inffus.2018.10.008","article-title":"Multi-channel Fusion Convolutional Neural Network to Classify Syntactic Anomaly from Language-Related ERP Components","volume":"52","author":"Khan","year":"2019","journal-title":"Inf. Fusion"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Ronneberger, O., Fischer, P., and Brox, T. (2015, January 5\u20139). U-net: Convolutional networks for biomedical image segmentation. Proceedings of the MICCAI 2015, Munich, Germany.","DOI":"10.1007\/978-3-319-24574-4_28"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"367","DOI":"10.1109\/TASE.2013.2294687","article-title":"A robotic crack inspection and mapping system for bridge deck maintenance","volume":"11","author":"Lim","year":"2014","journal-title":"IEEE Trans. Autom. Sci. Eng."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"60100","DOI":"10.1109\/ACCESS.2018.2875889","article-title":"Image-based crack detection using crack width transform (cwt) algorithm","volume":"6","author":"Cho","year":"2019","journal-title":"IEEE Access"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"28993","DOI":"10.1109\/ACCESS.2018.2844100","article-title":"An algorithm for concrete crack extraction and identification based on machine vision","volume":"6","author":"Liang","year":"2018","journal-title":"IEEE Access"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"345","DOI":"10.1016\/j.conbuildmat.2017.12.010","article-title":"A method of detecting the cracks of concrete undergo high-temperature","volume":"162","author":"Li","year":"2018","journal-title":"Constr. Build. Mater."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"342","DOI":"10.1111\/mice.12042","article-title":"Road crack detection using visual features extracted by gabor filters","volume":"29","author":"Zalama","year":"2014","journal-title":"Comput. Aided Civ. Infrastruct. Eng."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Li, Y., Li, H., and Wang, H. (2018). Pixel-Wise Crack Detection Using Deep Local Pattern Predictor for Robot Application. Sensors, 18.","DOI":"10.3390\/s18093042"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Chaudhury, S., Nakano, G., Takada, J., and Iketani, A. (2017, January 24\u201331). Spatial-temporal motion field analysis for pixelwise crack detection on concrete surfaces. Proceedings of the 2017 IEEE Winter Conference on Applications of Computer Vision (WACV), Santa Rosa, CA, USA.","DOI":"10.1109\/WACV.2017.44"},{"key":"ref_28","unstructured":"Ioffe, S., and Szegedy, C. (2015, January 6\u201311). Batch normalization: Accelerating deep network training by reducing internal covariate shift. Proceedings of the ICML 2015, Lille, France."},{"key":"ref_29","first-page":"1929","article-title":"Dropout: A simple way to prevent neural networks from overfitting","volume":"15","author":"Srivastava","year":"2014","journal-title":"J. Mach. Learn. Res."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"3954","DOI":"10.1109\/JSTARS.2018.2833382","article-title":"Deepunet: A deep fully convolutional network for pixel-level sea-land segmentation","volume":"11","author":"Li","year":"2018","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Lee, J., Kang, M., and Kang, J.-W. (2017, January 12\u201315). Ensemble of Binary Tree Structured Deep Convolutional Network for Image Classification. Proceedings of the Asia-Pacific Signal and Information Processing Association (APSIPA), Kuala Lumpur, Malaysia.","DOI":"10.1109\/APSIPA.2017.8282260"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"124632","DOI":"10.1109\/ACCESS.2019.2937604","article-title":"Ensemble of Random Binary Output Encoding for Adversarial Robustness","volume":"7","author":"Mun","year":"2019","journal-title":"IEEE Access"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Islam, M., Sohaib, M., Kim, J., and Kim, J. (2018). Crack Classification of a Pressure Vessel Using Feature Selection and Deep Learning Methods. Sensors, 18.","DOI":"10.3390\/s18124379"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"3434","DOI":"10.1109\/TITS.2016.2552248","article-title":"Automatic road crack detection using random structured forests","volume":"17","author":"Shi","year":"2016","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"2718","DOI":"10.1109\/TITS.2015.2477675","article-title":"Automatic crack detection on two-dimensional pavement images: An algorithm based on minimal path selection","volume":"17","author":"Amhaz","year":"2016","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"04018078","DOI":"10.1061\/(ASCE)BE.1943-5592.0001291","article-title":"Fatigue crack detection using unmanned aerial systems in fracture critical inspection of steel bridges","volume":"23","author":"Dorafshan","year":"2018","journal-title":"J. Bridge Eng."},{"key":"ref_37","unstructured":"Martin, D., Fowlke, C., Tal, D., and Malik, J. (2001, January 7\u201314). A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics. Proceedings of the Eighth IEEE International Conference on Computer Vision (ICCV), Vancouver, BC, Canada."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"211","DOI":"10.1007\/s11263-015-0816-y","article-title":"Imagenet large scale visual recognition challenge","volume":"115","author":"Russakovsky","year":"2015","journal-title":"Int. J. Comput. Vis."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"98","DOI":"10.1007\/s11263-014-0733-5","article-title":"The pascal visual object classes challenge: A retrospective","volume":"111","author":"Everingham","year":"2015","journal-title":"Int. J. Comput. Vis."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"501","DOI":"10.1109\/TMI.2004.825627","article-title":"Ridge-based vessel segmentation in color images of the retina","volume":"23","author":"Staal","year":"2004","journal-title":"IEEE Trans. Med. Imaging"},{"key":"ref_41","unstructured":"Krizhevsky, A., Sutskever, H., and Hintton, G.E. (2012). ImageNet Classification with Deep Convolutional Neural Networks, NIPS."},{"key":"ref_42","unstructured":"Springenberg, J.T., Dosovitskiy, A., Brox, T., and Riedmiller, M. (2014). Striving for simplicity: The all convolutional net. arXiv."},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Dorafshan, S., Thomas, R., and Maguire, M. (2018). SDNET2018: An annotated image dataset for non-contact concrete crack detection using deep convolutional neural networks. Data Brief, 1664\u20131668.","DOI":"10.1016\/j.dib.2018.11.015"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/19\/21\/4796\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T13:31:47Z","timestamp":1760189507000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/19\/21\/4796"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,11,4]]},"references-count":43,"journal-issue":{"issue":"21","published-online":{"date-parts":[[2019,11]]}},"alternative-id":["s19214796"],"URL":"https:\/\/doi.org\/10.3390\/s19214796","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,11,4]]}}}