{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,12]],"date-time":"2026-05-12T16:21:53Z","timestamp":1778602913229,"version":"3.51.4"},"reference-count":56,"publisher":"MDPI AG","issue":"13","license":[{"start":{"date-parts":[[2023,6,25]],"date-time":"2023-06-25T00:00:00Z","timestamp":1687651200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100000923","name":"Australian Research Council (ARC) Industry Transformation Research Hub","doi-asserted-by":"publisher","award":["IH210100048"],"award-info":[{"award-number":["IH210100048"]}],"id":[{"id":"10.13039\/501100000923","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Aging infrastructure has drawn increased attention globally, as its collapse would be destructive economically and socially. Precise quantification of minor defects is essential for identifying issues before structural failure occurs. Most studies measured the dimension of defects at image level, ignoring the third-dimensional information available from close-range photogrammetry. This paper aims to develop an efficient approach to accurately detecting and quantifying minor defects on complicated infrastructures. Pixel sizes of inspection images are estimated using spatial information generated from three-dimensional (3D) point cloud reconstruction. The key contribution of this research is to obtain the actual pixel size within the grided small sections by relating spatial information. To automate the process, deep learning technology is applied to detect and highlight the cracked area at the pixel level. The adopted convolutional neural network (CNN) achieves an F1 score of 0.613 for minor crack extraction. After that, the actual crack dimension can be derived by multiplying the pixel number with the pixel size. Compared with the traditional approach, defects distributed on a complex structure can be estimated with the proposed approach. A pilot case study was conducted on a concrete footpath with cracks distributed on a selected 1500 mm \u00d7 1500 mm concrete road section. Overall, 10 out of 88 images are selected for validation; average errors ranging from 0.26 mm to 0.71 mm were achieved for minor cracks under 5 mm, which demonstrates a promising result of the proposed study.<\/jats:p>","DOI":"10.3390\/s23135878","type":"journal-article","created":{"date-parts":[[2023,6,26]],"date-time":"2023-06-26T05:28:02Z","timestamp":1687757282000},"page":"5878","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":7,"title":["Quantification of Structural Defects Using Pixel Level Spatial Information from Photogrammetry"],"prefix":"10.3390","volume":"23","author":[{"given":"Youheng","family":"Guo","sequence":"first","affiliation":[{"name":"School of Civil and Environmental Engineering, University of New South Wales, Sydney, NSW 2052, Australia"},{"name":"Linke & Linke Surveys, 34-36 Byrnes St, Botany, Sydney, NSW 2019, Australia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2118-1165","authenticated-orcid":false,"given":"Xuesong","family":"Shen","sequence":"additional","affiliation":[{"name":"School of Civil and Environmental Engineering, University of New South Wales, Sydney, NSW 2052, Australia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"James","family":"Linke","sequence":"additional","affiliation":[{"name":"Linke & Linke Surveys, 34-36 Byrnes St, Botany, Sydney, NSW 2019, Australia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Zihao","family":"Wang","sequence":"additional","affiliation":[{"name":"Linke & Linke Surveys, 34-36 Byrnes St, Botany, Sydney, NSW 2019, Australia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Khalegh","family":"Barati","sequence":"additional","affiliation":[{"name":"School of Civil and Environmental Engineering, University of New South Wales, Sydney, NSW 2052, Australia"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2023,6,25]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"123381","DOI":"10.1016\/j.conbuildmat.2021.123381","article-title":"A state-of-the-art review on the durability of geopolymer concrete for sustainable structures and infrastructure","volume":"291","author":"Wasim","year":"2021","journal-title":"Constr. Build. Mater."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"04017011","DOI":"10.1061\/(ASCE)CF.1943-5509.0000996","article-title":"Observations and trends among collapsed bridges in New York state","volume":"31","author":"Cook","year":"2017","journal-title":"J. Perform. Constr. Facil."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1056","DOI":"10.1177\/1475921717735326","article-title":"Feasibility of using digital image correlation for unmanned aerial vehicle structural health monitoring of bridges","volume":"17","author":"Reagan","year":"2018","journal-title":"Struct. Health Monit."},{"key":"ref_4","unstructured":"ASCE (2022, November 04). 2021 Report Card for America\u2019s Infrastructure: A comprehensive Assessment of America\u2019s Infrastructure. Available online: https:\/\/infrastructurereportcard.org\/wp-content\/uploads\/2020\/12\/National_IRC_2021-report.pdf."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Khan, F., Ellenberg, A., Mazzotti, M., Kontsos, A., Moon, F., Pradhan, A., and Bartoli, I. (2015, January 23\u201325). Investigation on Bridge Assessment Using Unmanned Aerial Systems. Proceedings of the Structures Congress 2015, Portland, OR, USA.","DOI":"10.1061\/9780784479117.035"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Fu, H., Meng, D., Li, W., and Wang, Y. (2021). Bridge crack semantic segmentation based on improved Deeplabv3+. J. Mar. Sci. Eng., 9.","DOI":"10.3390\/jmse9060671"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Galdelli, A., D\u2019Imperio, M., Marchello, G., Mancini, A., Scaccia, M., Sasso, M., Frontoni, E., and Cannella, F. (2022). A Novel Remote Visual Inspection System for Bridge Predictive Maintenance. Remote Sens., 14.","DOI":"10.3390\/rs14092248"},{"key":"ref_8","unstructured":"Infrastructure Australia (2022, November 05). An Assessment of Australia\u2019s Future Infrastructure Needs, Available online: https:\/\/www.infrastructureaustralia.gov.au\/sites\/default\/files\/2019-08\/Australian%20Infrastructure%20Audit%202019%20-%200.%20Executive%20Summary.pdf."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Qureshi, W.S., Hassan, S.I., McKeever, S., Power, D., Mulry, B., Feighan, K., and O\u2019Sullivan, D. (2022). An Exploration of Recent Intelligent Image Analysis Techniques for Visual Pavement Surface Condition Assessment. Sensors, 22.","DOI":"10.3390\/s22229019"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"511","DOI":"10.1111\/mice.12501","article-title":"Image-based crack assessment of bridge piers using unmanned aerial vehicles and three-dimensional scene reconstruction","volume":"35","author":"Liu","year":"2020","journal-title":"Comput.-Aided Civ. Infrastruct. Eng."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"e2850","DOI":"10.1002\/stc.2850","article-title":"Deep convolutional neural networks for semantic segmentation of cracks","volume":"29","author":"Wang","year":"2022","journal-title":"Struct. Control Health Monit."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"104467","DOI":"10.1016\/j.jngse.2022.104467","article-title":"External corrosion of oil and gas pipelines: A review of failure mechanisms and predictive preventions","volume":"100","author":"Wasim","year":"2022","journal-title":"J. Nat. Gas Sci. Eng."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"115158","DOI":"10.1016\/j.engstruct.2022.115158","article-title":"Novel visual crack width measurement based on backbone double-scale features for improved detection automation","volume":"274","author":"Tang","year":"2023","journal-title":"Eng. Struct."},{"key":"ref_14","unstructured":"Chaiyasarn, K. (2014). Damage Detection and Monitoring for Tunnel Inspection Based on Computer Vision. [Ph.D. Thesis, University of Cambridge]."},{"key":"ref_15","first-page":"84","article-title":"Imagenet classification with deep convolutional neural networks","volume":"60","author":"Krizhevsky","year":"2017","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Zeiler, M.D., and Fergus, R. (2014, January 6\u201312). Visualizing and understanding convolutional networks. Proceedings of the 13th European Conference on Computer Vision, Zurich, Switzerland.","DOI":"10.1007\/978-3-319-10590-1_53"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., and Rabinovich, A. (2015, January 7\u201312). Going deeper with convolutions. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298594"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Ronneberger, O., Fischer, P., and Brox, T. (2015, January 5\u20139). U-net: Convolutional networks for biomedical image segmentation. Proceedings of the 18th International Conference on Medical Image Computing and Computer-Assisted Intervention, Munich, Germany.","DOI":"10.1007\/978-3-319-24574-4_28"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., and Wojna, Z. (2016, January 27\u201330). Rethinking the inception architecture for computer vision. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.308"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Kim, J.J., Kim, A.-R., and Lee, S.-W. (2020). Artificial neural network-based automated crack detection and analysis for the inspection of concrete structures. Appl. Sci., 10.","DOI":"10.3390\/app10228105"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"155","DOI":"10.1109\/TITS.2012.2208630","article-title":"Automatic road crack detection and characterization","volume":"14","author":"Oliveira","year":"2012","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_22","first-page":"8796743","article-title":"Improved crack detection and recognition based on convolutional neural network","volume":"2019","author":"Chen","year":"2019","journal-title":"Model. Simul. Eng."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"6520620","DOI":"10.1155\/2019\/6520620","article-title":"Image-based concrete crack detection using convolutional neural network and exhaustive search technique","volume":"2019","author":"Li","year":"2019","journal-title":"Adv. Civ. Eng."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"129","DOI":"10.1016\/j.autcon.2019.04.005","article-title":"Computer vision-based concrete crack detection using U-net fully convolutional networks","volume":"104","author":"Liu","year":"2019","journal-title":"Autom. Constr."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"52","DOI":"10.1016\/j.autcon.2018.11.028","article-title":"Autonomous concrete crack detection using deep fully convolutional neural network","volume":"99","author":"Dung","year":"2019","journal-title":"Autom. Constr."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"713","DOI":"10.1111\/mice.12440","article-title":"Encoder\u2013decoder network for pixel-level road crack detection in black-box images","volume":"34","author":"Bang","year":"2019","journal-title":"Comput.-Aided Civ. Infrastruct. Eng."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"1722","DOI":"10.1177\/1475921718821719","article-title":"Deep learning\u2013based autonomous concrete crack evaluation through hybrid image scanning","volume":"18","author":"Jang","year":"2019","journal-title":"Struct. Health Monit."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"54564","DOI":"10.1109\/ACCESS.2020.2981561","article-title":"Crack detection of concrete pavement with cross-entropy loss function and improved VGG16 network model","volume":"8","author":"Qu","year":"2020","journal-title":"IEEE Access"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"103372","DOI":"10.1016\/j.autcon.2020.103372","article-title":"Artificial intelligence-empowered pipeline for image-based inspection of concrete structures","volume":"120","author":"Chow","year":"2020","journal-title":"Autom. Constr."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"103606","DOI":"10.1016\/j.autcon.2021.103606","article-title":"Automatic crack classification and segmentation on masonry surfaces using convolutional neural networks and transfer learning","volume":"125","author":"Dais","year":"2021","journal-title":"Autom. Constr."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"123549","DOI":"10.1016\/j.conbuildmat.2021.123549","article-title":"Cost-effective system for detection and quantification of concrete surface cracks by combination of convolutional neural network and image processing techniques","volume":"293","author":"Miao","year":"2021","journal-title":"Constr. Build. Mater."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"103989","DOI":"10.1016\/j.autcon.2021.103989","article-title":"Structural crack detection using deep convolutional neural networks","volume":"133","author":"Ali","year":"2022","journal-title":"Autom. Constr."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"104275","DOI":"10.1016\/j.autcon.2022.104275","article-title":"Automatic concrete crack segmentation model based on transformer","volume":"139","author":"Wang","year":"2022","journal-title":"Autom. Constr."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"04021098","DOI":"10.1061\/(ASCE)CO.1943-7862.0002003","article-title":"Three-Dimensional Object Detection with Deep Neural Networks for Automatic As-Built Reconstruction","volume":"147","author":"Xu","year":"2021","journal-title":"J. Constr. Eng. Manag."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"04021002","DOI":"10.1061\/(ASCE)CP.1943-5487.0000962","article-title":"CorDet: Corner-Aware 3D Object Detection Networks for Automated Scan-to-BIM","volume":"35","author":"Xu","year":"2021","journal-title":"J. Comput. Civil Eng."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"60100","DOI":"10.1109\/ACCESS.2018.2875889","article-title":"Image-based Crack Detection Using Crack Width Transform (CWT) Algorithm","volume":"6","author":"Cho","year":"2018","journal-title":"IEEE Access"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Albareda-Valls, A., Bustos Herrera, A., Zamora Mestre, J.L., and Zaribaf, S.S. (2018). Image Post-Processing Method for Quantification of Cracking in RC Precast Beams under Bending. Buildings, 8.","DOI":"10.3390\/buildings8110158"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"2398124","DOI":"10.1155\/2019\/2398124","article-title":"Determination of geometric parameters of cracks in concrete by image processing","volume":"2019","author":"Vashpanov","year":"2019","journal-title":"Adv. Civ. Eng."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Bang, H., Min, J., and Jeon, H. (2021). Deep Learning-Based Concrete Surface Damage Monitoring Method Using Structured Lights and Depth Camera. Sensors, 21.","DOI":"10.3390\/s21082759"},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Wang, D., Cheng, J., and Cai, H. (2021). Detection Based on Crack Key Point and Deep Convolutional Neural Network. Appl. Sci., 11.","DOI":"10.3390\/app112311321"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Shi, T., Qi, Y., Zhu, C., Tang, Y., and Wu, B. (2021). Three-Dimensional Microscopic Image Reconstruction Based on Structured Light Illumination. Sensors, 21.","DOI":"10.3390\/s21186097"},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Fan, Z., Lin, H., Li, C., Su, J., Bruno, S., and Loprencipe, G. (2022). Use of Parallel ResNet for High-Performance Pavement Crack Detection and Measurement. Sustainability, 14.","DOI":"10.3390\/su14031825"},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Parente, L., Falvo, E., Castagnetti, C., Grassi, F., Mancini, F., Rossi, P., and Capra, A. (2022). Image-Based Monitoring of Cracks: Effectiveness Analysis of an Open-Source Machine Learning-Assisted Procedure. J. Imaging, 8.","DOI":"10.3390\/jimaging8020022"},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"035019","DOI":"10.1088\/0964-1726\/22\/3\/035019","article-title":"A new methodology for non-contact accurate crack width measurement through photogrammetry for automated structural safety evaluation","volume":"22","author":"Jahanshahi","year":"2013","journal-title":"Smart Mater. Struct."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"04014124","DOI":"10.1061\/(ASCE)CP.1943-5487.0000446","article-title":"Concrete crack assessment using digital image processing and 3D scene reconstruction","volume":"30","author":"Liu","year":"2016","journal-title":"J. Comput. Civ. Eng."},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Yang, Y.-S., Chang, C.-H., and Wu, C.-l. (2019). Damage Indexing Method for Shear Critical Tubular Reinforced Concrete Structures Based on Crack Image Analysis. Sensors, 19.","DOI":"10.3390\/s19194304"},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"04020010","DOI":"10.1061\/(ASCE)CP.1943-5487.0000890","article-title":"Crack detection and segmentation using deep learning with 3D reality mesh model for quantitative assessment and integrated visualization","volume":"34","author":"Kalfarisi","year":"2020","journal-title":"J. Comput. Civ. Eng."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"682","DOI":"10.1080\/1573062X.2020.1758166","article-title":"Applying deep convolutional neural network with 3D reality mesh model for water tank crack detection and evaluation","volume":"17","author":"Wu","year":"2020","journal-title":"Urban Water J."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"104388","DOI":"10.1016\/j.autcon.2022.104388","article-title":"Integrated pixel-level CNN-FCN crack detection via photogrammetric 3D texture mapping of concrete structures","volume":"140","author":"Chaiyasarn","year":"2022","journal-title":"Autom. Constr."},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Shokri, P., Shahbazi, M., and Nielsen, J. (2022). Semantic Segmentation and 3D Reconstruction of Concrete Cracks. Remote Sens., 14.","DOI":"10.3390\/rs14225793"},{"key":"ref_51","doi-asserted-by":"crossref","unstructured":"Zhao, S., Kang, F., and Li, J. (2022). Non-Contact Crack Visual Measurement System Combining Improved U-Net Algorithm and Canny Edge Detection Method with Laser Rangefinder and Camera. Appl. Sci., 12.","DOI":"10.2139\/ssrn.4147562"},{"key":"ref_52","doi-asserted-by":"crossref","unstructured":"Woo, H.-J., Seo, D.-M., Kim, M.-S., Park, M.-S., Hong, W.-H., and Baek, S.-C. (2022). Localization of Cracks in Concrete Structures Using an Unmanned Aerial Vehicle. Sensors, 22.","DOI":"10.3390\/s22176711"},{"key":"ref_53","unstructured":"Simonyan, K., and Zisserman, A. (2014). Very deep convolutional networks for large-scale image recognition. arXiv."},{"key":"ref_54","doi-asserted-by":"crossref","unstructured":"Guo, Y., Wang, Z., Shen, X., Barati, K., and Linke, J. (2022). Automatic Detection and Dimensional Measurement of Minor Concrete Cracks with Convolutional Neural Network. ISPRS Ann. Photogramm. Remote Sens. Spat. Inf. Sci., 10.","DOI":"10.5194\/isprs-annals-X-4-W3-2022-57-2022"},{"key":"ref_55","doi-asserted-by":"crossref","unstructured":"Lin, T.-Y., Goyal, P., Girshick, R., He, K., and Doll\u00e1r, P. (2017, January 22\u201329). Focal loss for dense object detection. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.","DOI":"10.1109\/ICCV.2017.324"},{"key":"ref_56","unstructured":"(2011). Residential Slabs and Footing (Standard No. AS 2870)."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/13\/5878\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T20:00:22Z","timestamp":1760126422000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/13\/5878"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,6,25]]},"references-count":56,"journal-issue":{"issue":"13","published-online":{"date-parts":[[2023,7]]}},"alternative-id":["s23135878"],"URL":"https:\/\/doi.org\/10.3390\/s23135878","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,6,25]]}}}