{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,27]],"date-time":"2026-02-27T16:12:21Z","timestamp":1772208741118,"version":"3.50.1"},"reference-count":31,"publisher":"MDPI AG","issue":"8","license":[{"start":{"date-parts":[[2022,8,11]],"date-time":"2022-08-11T00:00:00Z","timestamp":1660176000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Algorithms"],"abstract":"<jats:p>Crack detection on historical surfaces is of significant importance for credible and reliable inspection in heritage structural health monitoring. Thus, several object detection deep learning models are utilized for crack detection. However, the majority of these models are powerful at most in achieving the task of classification, with primitive detection of the crack location. On the other hand, several state-of-the-art studies have proven that pixel-level crack segmentation can powerfully locate objects in images for more accurate and reasonable classification. In order to realize pixel-level deep crack segmentation in images of historical buildings, this paper proposes an automated deep crack segmentation approach designed based on an exhaustive investigation of several U-Net deep learning network architectures. The utilization of pixel-level crack segmentation with U-Net deep learning ensures the identification of pixels that are important for the decision of image classification. Moreover, the proposed approach employs the deep learned features extracted by the U-Net deep learning model to precisely describe crack characteristics for better pixel-level crack segmentation. A primary image dataset of various crack types and severity is collected from historical building surfaces and used for training and evaluating the performance of the proposed approach. Three variants of the U-Net convolutional network architecture are considered for the deep pixel-level segmentation of different types of cracks on historical surfaces. Promising results of the proposed approach using the U2\u2212Net deep learning model are obtained, with a Dice score and mean Intersection over Union (mIoU) of 71.09% and 78.38% achieved, respectively, at the pixel level. Conclusively, the significance of this work is the investigation of the impact of utilizing pixel-level deep crack segmentation, supported by deep learned features, through adopting variants of the U-Net deep learning model for crack detection on historical surfaces.<\/jats:p>","DOI":"10.3390\/a15080281","type":"journal-article","created":{"date-parts":[[2022,8,11]],"date-time":"2022-08-11T21:15:05Z","timestamp":1660252505000},"page":"281","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":17,"title":["Automated Pixel-Level Deep Crack Segmentation on Historical Surfaces Using U-Net Models"],"prefix":"10.3390","volume":"15","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-2362-1574","authenticated-orcid":false,"given":"Esraa","family":"Elhariri","sequence":"first","affiliation":[{"name":"Faculty of Computers and Information, Fayoum University, Fayoum 63514, Egypt"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6553-4159","authenticated-orcid":false,"given":"Nashwa","family":"El-Bendary","sequence":"additional","affiliation":[{"name":"College of Computing and Information Technology, Arab Academy for Science, Technology, and Maritime Transport, Aswan 81516, Egypt"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3067-7173","authenticated-orcid":false,"given":"Shereen A.","family":"Taie","sequence":"additional","affiliation":[{"name":"Faculty of Computers and Information, Fayoum University, Fayoum 63514, Egypt"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2022,8,11]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"725","DOI":"10.1177\/1475921718768747","article-title":"Crack and noncrack classification from concrete surface images using machine learning","volume":"18","author":"Kim","year":"2019","journal-title":"Struct. Health Monit."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1110","DOI":"10.1177\/1475921717737051","article-title":"Evaluation of deep learning approaches based on convolutional neural networks for corrosion detection","volume":"17","author":"Atha","year":"2018","journal-title":"Struct. Health Monit."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"111453","DOI":"10.1016\/j.rse.2019.111453","article-title":"Satellite radar interferometry and in-situ measurements for static monitoring of historical monuments: The case of Gubbio, Italy","volume":"235","author":"Cavalagli","year":"2019","journal-title":"Remote. Sens. Environ."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"19307","DOI":"10.3390\/s141019307","article-title":"Automatic Crack Detection and Classification Method for Subway Tunnel Safety Monitoring","volume":"14","author":"Zhang","year":"2011","journal-title":"Sensors"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Munawar, H.S., Hammad, A.W., Haddad, A., Soares, C.A.P., and Waller, S.T. (2021). Image-Based Crack Detection Methods: A Review. Infrastructures, 6.","DOI":"10.3390\/infrastructures6080115"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Palevi\u010dius, P., Pal, M., Landauskas, M., Orinait\u0117, U., Timofejeva, I., and Ragulskis, M. (2022). Automatic Detection of Cracks on Concrete Surfaces in the Presence of Shadows. Sensors, 22.","DOI":"10.3390\/s22103662"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"139","DOI":"10.1016\/j.neucom.2019.01.036","article-title":"DeepCrack: A deep hierarchical feature learning architecture for crack segmentation","volume":"338","author":"Liu","year":"2019","journal-title":"Neurocomputing"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"1527","DOI":"10.1109\/TGRS.2014.2344714","article-title":"Iterative Tensor Voting for Pavement Crack Extraction Using Mobile Laser Scanning Data","volume":"53","author":"Guan","year":"2015","journal-title":"IEEE Trans. Geosci. Remote. Sens."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"102819","DOI":"10.1016\/j.autcon.2019.04.014","article-title":"Segment-based pavement crack quantification","volume":"105","author":"Weng","year":"2019","journal-title":"Autom. Constr."},{"key":"ref_10","first-page":"100144","article-title":"Pavement crack detection and recognition using the architecture of SegNet","volume":"18","author":"Chen","year":"2020","journal-title":"J. Ind. Inf. Integr."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"103606","DOI":"10.1016\/j.autcon.2021.103606","article-title":"Automatic crack classification and segmentation on masonry surfaces using convolutional neural networks and transfer learning","volume":"125","author":"Dais","year":"2021","journal-title":"Autom. Constr."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1155\/2020\/6412562","article-title":"Automated pavement Crack damage detection using deep multiscale convolutional features","volume":"2020","author":"Song","year":"2020","journal-title":"J. Adv. Transp."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"52","DOI":"10.1016\/j.autcon.2018.11.028","article-title":"Autonomous concrete crack detection using deep fully convolutional neural network","volume":"99","author":"Dung","year":"2019","journal-title":"Autom. Constr."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"951","DOI":"10.1111\/mice.12477","article-title":"Concrete crack detection using context-aware deep semantic segmentation network","volume":"34","author":"Zhang","year":"2019","journal-title":"Comput. Aided Civ. Infrastruct. Eng."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"103291","DOI":"10.1016\/j.autcon.2020.103291","article-title":"Hybrid pixel-level concrete crack segmentation and quantification across complex backgrounds using deep learning","volume":"118","author":"Kang","year":"2020","journal-title":"Autom. Constr."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"1291","DOI":"10.1111\/mice.12622","article-title":"Automated pavement crack detection and segmentation based on two-step convolutional neural network","volume":"35","author":"Liu","year":"2020","journal-title":"Comput. Aided Civ. Infrastruct. Eng."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"929","DOI":"10.1007\/s10346-021-01843-x","article-title":"Landslide detection using deep learning and object-based image analysis","volume":"19","author":"Ghorbanzadeh","year":"2022","journal-title":"Landslides"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"103176","DOI":"10.1016\/j.autcon.2020.103176","article-title":"An integrated approach to automatic pixel-level crack detection and quantification of asphalt pavement","volume":"114","author":"Jia","year":"2020","journal-title":"Autom. Constr."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Li, Y., Li, H., and Wang, H. (2018). Pixel-Wise Crack Detection Using Deep Local Pattern Predictor for Robot Application. Sensors, 18.","DOI":"10.3390\/s18093042"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"858","DOI":"10.1016\/j.istruc.2022.01.061","article-title":"Effective medium crack classification on laboratory concrete specimens via competitive machine learning","volume":"37","author":"Naser","year":"2022","journal-title":"Structures"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"174","DOI":"10.1016\/j.jocs.2018.12.003","article-title":"Multi-grade brain tumor classification using deep CNN with extensive data augmentation","volume":"30","author":"Sajjad","year":"2019","journal-title":"J. Comput. Sci."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"309","DOI":"10.1145\/1015706.1015720","article-title":"\u201cGrabCut\u201d: Interactive foreground extraction using iterated graph cuts","volume":"23","author":"Rother","year":"2004","journal-title":"ACM Trans. Graph."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"1083","DOI":"10.1016\/j.asej.2014.04.012","article-title":"Modified GrabCut for human face segmentation","volume":"5","author":"Khattab","year":"2014","journal-title":"Ain Shams Eng. J."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Vuola, A.O., Akram, S.U., and Kannala, J. (2019, January 8\u201311). Mask-RCNN and U-Net ensembled for nuclei segmentation. Proceedings of the IEEE 16th International Symposium on Biomedical Imaging (ISBI 2019), Venice, Italy.","DOI":"10.1109\/ISBI.2019.8759574"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"749","DOI":"10.1109\/LGRS.2018.2802944","article-title":"Road extraction by deep residual U-Net","volume":"15","author":"Zhang","year":"2018","journal-title":"IEEE Geosci. Remote. Sens. Lett."},{"key":"ref_26","unstructured":"Jetley, S., Lord, N.A., Lee, N., and Torr, P.H.S. (May, January 30). Learn To Pay Attention. Proceedings of the 6th International Conference on Learning Representations, (ICLR 2018), Vancouver, BC, Canada."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Zhou, Z., Siddiquee, M.M.R., Tajbakhsh, N., and Liang, J. (2018, January 20). Unet++: A nested U-Net architecture for medical image segmentation. Proceedings of the 4th International Workshop of Deep Learning in Medical Image Analysis (DLMIA 2018) & 8th International Workshop of Multimodal Learning for Clinical Decision Support (ML-CDS 2018), Granada, Spain.","DOI":"10.1007\/978-3-030-00889-5_1"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Xiao, X., Lian, S., Luo, Z., and Li, Z.S. (2018, January 19\u201321). Weighted Res-UNet for high-quality retina vessel segmentation. Proceedings of the 9th IEEE International Conference on Information Technology in Medicine and Education (ITME 2018), Hangzhou, China.","DOI":"10.1109\/ITME.2018.00080"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"107404","DOI":"10.1016\/j.patcog.2020.107404","article-title":"U2-Net: Going deeper with nested U-structure for salient object detection","volume":"106","author":"Qin","year":"2020","journal-title":"Pattern Recognit."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"3434","DOI":"10.1109\/TITS.2016.2552248","article-title":"Automatic road crack detection using random structured forests","volume":"17","author":"Shi","year":"2016","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_31","unstructured":"Labatut, V., and Cherifi, H. (2011, January 11\u201313). Accuracy measures for the comparison of classifiers. Proceedings of the 5th International Conference on Information Technology, Amman, Jordan."}],"container-title":["Algorithms"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1999-4893\/15\/8\/281\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T00:07:17Z","timestamp":1760141237000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1999-4893\/15\/8\/281"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,8,11]]},"references-count":31,"journal-issue":{"issue":"8","published-online":{"date-parts":[[2022,8]]}},"alternative-id":["a15080281"],"URL":"https:\/\/doi.org\/10.3390\/a15080281","relation":{},"ISSN":["1999-4893"],"issn-type":[{"value":"1999-4893","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,8,11]]}}}