{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,20]],"date-time":"2026-02-20T15:52:31Z","timestamp":1771602751832,"version":"3.50.1"},"reference-count":56,"publisher":"MDPI AG","issue":"14","license":[{"start":{"date-parts":[[2021,7,7]],"date-time":"2021-07-07T00:00:00Z","timestamp":1625616000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001862","name":"Svenska Forskningsr\u00e5det Formas","doi-asserted-by":"publisher","award":["2019-01515"],"award-info":[{"award-number":["2019-01515"]}],"id":[{"id":"10.13039\/501100001862","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>For the inspection of structures, particularly bridges, it is becoming common to replace humans with autonomous systems that use unmanned aerial vehicles (UAV). In this paper, a framework for autonomous bridge inspection using a UAV is proposed with a four-step workflow: (a) data acquisition with an efficient UAV flight path, (b) computer vision comprising training, testing and validation of convolutional neural networks (ConvNets), (c) point cloud generation using intelligent hierarchical dense structure from motion (DSfM), and (d) damage quantification. This workflow starts with planning the most efficient flight path that allows for capturing of the minimum number of images required to achieve the maximum accuracy for the desired defect size, then followed by bridge and damage recognition. Three types of autonomous detection are used: masking the background of the images, detecting areas of potential damage, and pixel-wise damage segmentation. Detection of bridge components by masking extraneous parts of the image, such as vegetation, sky, roads or rivers, can improve the 3D reconstruction in the feature detection and matching stages. In addition, detecting damaged areas involves the UAV capturing close-range images of these critical regions, and damage segmentation facilitates damage quantification using 2D images. By application of DSfM, a denser and more accurate point cloud can be generated for these detected areas, and aligned to the overall point cloud to create a digital model of the bridge. Then, this generated point cloud is evaluated in terms of outlier noise, and surface deviation. Finally, damage that has been detected is quantified and verified, based on the point cloud generated using the Terrestrial Laser Scanning (TLS) method. The results indicate this workflow for autonomous bridge inspection has potential.<\/jats:p>","DOI":"10.3390\/rs13142665","type":"journal-article","created":{"date-parts":[[2021,7,7]],"date-time":"2021-07-07T12:31:25Z","timestamp":1625661085000},"page":"2665","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":30,"title":["Workflow for Off-Site Bridge Inspection Using Automatic Damage Detection-Case Study of the Pahtajokk Bridge"],"prefix":"10.3390","volume":"13","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-1375-3322","authenticated-orcid":false,"given":"Ali","family":"Mirzazade","sequence":"first","affiliation":[{"name":"Structural and Fire Engineering, Department of Civil, Environmental and Natural Resources Engineering, Lule\u00e5 University of Technology, 97187 Lule\u00e5, Sweden"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9423-7436","authenticated-orcid":false,"given":"Cosmin","family":"Popescu","sequence":"additional","affiliation":[{"name":"Structural and Fire Engineering, Department of Civil, Environmental and Natural Resources Engineering, Lule\u00e5 University of Technology, 97187 Lule\u00e5, Sweden"},{"name":"SINTEF Narvik AS, 8517 Narvik, Norway"}]},{"given":"Thomas","family":"Blanksv\u00e4rd","sequence":"additional","affiliation":[{"name":"Structural and Fire Engineering, Department of Civil, Environmental and Natural Resources Engineering, Lule\u00e5 University of Technology, 97187 Lule\u00e5, Sweden"}]},{"given":"Bj\u00f6rn","family":"T\u00e4ljsten","sequence":"additional","affiliation":[{"name":"Structural and Fire Engineering, Department of Civil, Environmental and Natural Resources Engineering, Lule\u00e5 University of Technology, 97187 Lule\u00e5, Sweden"}]}],"member":"1968","published-online":{"date-parts":[[2021,7,7]]},"reference":[{"key":"ref_1","first-page":"1","article-title":"Reviews on innovations and applications in structural health monitoring for infrastructures","volume":"1","author":"Li","year":"2014","journal-title":"Struct. Monit. Maint."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"67","DOI":"10.1023\/A:1022508121821","article-title":"Visual Inspection of Highway Bridges","volume":"21","author":"Graybeal","year":"2002","journal-title":"J. Nondestruct. Eval."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"403","DOI":"10.1061\/(ASCE)1084-0702(2004)9:4(403)","article-title":"Routine Highway Bridge Inspection Condition Documentation Accuracy and Reliability","volume":"9","author":"Phares","year":"2004","journal-title":"J. Bridg. Eng."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"912","DOI":"10.1080\/15732479.2019.1594315","article-title":"3D reconstruction of existing concrete bridges using optical methods","volume":"15","author":"Popescu","year":"2018","journal-title":"Struct. Infrastruct. Eng."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"3","DOI":"10.3141\/1814-01","article-title":"Static Measurement of Beam Deformations via Close-Range Photogrammetry","volume":"1814","author":"White","year":"2002","journal-title":"Transp. Res. Rec. J. Transp. Res. Board"},{"key":"ref_6","unstructured":"Lichti, D., Gordon, S., Stewart, M., Franke, J., and Tsakiri, M. (2021, June 29). Comparison of Digital Photogrammetry and Laser Scanning. Available online: https:\/\/www.researchgate.net\/publication\/245716767_Comparison_of_Digital_Photogrammetry_and_Laser_Scanning."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"19","DOI":"10.1111\/j.1467-8667.2006.00466.x","article-title":"A New Approach for Health Monitoring of Structures: Terrestrial Laser Scanning","volume":"22","author":"Park","year":"2006","journal-title":"Comput. Civ. Infrastruct. Eng."},{"key":"ref_8","unstructured":"Attanayake, U., Tang, P., Servi, A., and Aktan, H. (2021, June 29). Non-Contact Bridge Deflection Measurement: Application of Laser Technology. Available online: http:\/\/dl.lib.uom.lk\/bitstream\/handle\/123\/9425\/SEC-11-63.pdf?sequence=1&isAllowed=y."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"380","DOI":"10.1061\/(ASCE)BE.1943-5592.0000358","article-title":"Imaging Tools for Evaluation of Gusset Plate Connections in Steel Truss Bridges","volume":"18","author":"Higgins","year":"2013","journal-title":"J. Bridg. Eng."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"34","DOI":"10.1016\/j.autcon.2012.04.008","article-title":"An innovative method for remote measurement of minimum vertical underclearance in routine bridge inspection","volume":"25","author":"Riveiro","year":"2012","journal-title":"Autom. Constr."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"365","DOI":"10.12989\/sss.2013.11.4.365","article-title":"Bridge deflection evaluation using strain and rotation meas-urements","volume":"11","author":"Sousa","year":"2013","journal-title":"Smart Struct. Syst."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"784","DOI":"10.1016\/j.measurement.2012.09.018","article-title":"Validation of terrestrial laser scanning and photogrammetry techniques for the measurement of vertical underclearance and beam geometry in structural inspection of bridges","volume":"46","author":"Riveiro","year":"2013","journal-title":"Measurement"},{"key":"ref_13","first-page":"3331","article-title":"Application of Inclinometer in Arch Bridge Dynamic Deflection Measurement","volume":"12","author":"He","year":"2014","journal-title":"TELKOMNIKA Indones. J. Electr. Eng."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1111\/ext.12022","article-title":"Deformation Monitoring in Steel Arch Bridges through Close-Range Photogrammetry and the Finite Element Method","volume":"39","year":"2015","journal-title":"Exp. Tech."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Anigacz, W., Beben, D., and Kwiatkowski, J. (2018). Displacements Monitoring of Suspension Bridge Using Geodetic Techniques. Proceedings of the EECE 2020, Springer Science and Business Media LLC.","DOI":"10.1007\/978-3-319-67443-8_28"},{"key":"ref_16","first-page":"270","article-title":"Terrestrial laser scanning for the monitoring of bridge load tests\u2013two case studies","volume":"50","author":"Ellmann","year":"2017","journal-title":"Surv. Rev."},{"key":"ref_17","first-page":"1","article-title":"Deformation Measurement of a Railroad Bridge Using a Photogrammetric Board without Control Point Survey","volume":"2018","author":"Lee","year":"2018","journal-title":"J. Sens."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"04018046","DOI":"10.1061\/(ASCE)CF.1943-5509.0001185","article-title":"Synthesis of Unmanned Aerial Vehicle Applications for Infrastructures","volume":"32","author":"Duque","year":"2018","journal-title":"J. Perform. Constr. Facil."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"1031","DOI":"10.1016\/j.conbuildmat.2018.08.011","article-title":"Comparison of deep convolutional neural networks and edge detectors for image-based crack detection in concrete","volume":"186","author":"Dorafshan","year":"2018","journal-title":"Constr. Build. Mater."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Girshick, R., Donahue, J., Darrell, T., and Malik, J. (2014, January 23\u201328). Rich feature hierarchies for accurate object detection and semantic segmen-tation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA.","DOI":"10.1109\/CVPR.2014.81"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Girshick, R. (2015, January 7\u201313). Fast R-CNN. Proceedings of the 2015 IEEE International Conference on Computer Vision (ICCV), Santiago, Chile.","DOI":"10.1109\/ICCV.2015.169"},{"key":"ref_22","unstructured":"Ren, S., He, K., Girshick, R., and Sun, J. (2015). Faster r-cnn: Towards real-time object detection with region proposal networks. arXiv."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Redmon, J., Divvala, S., Girshick, R., and Farhadi, A. (2016, January 27\u201330). You only look once: Unified, real-time object detection. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.91"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S., Fu, C.-Y., and Berg, A.C. (2016). Ssd: Single shot multibox detector. European Conference on Computer Vision, Springer.","DOI":"10.1007\/978-3-319-46448-0_2"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"He, K., Gkioxari, G., Dollar, P., and Girshick, R. (2017, January 22\u201329). Mask R-CNN. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.","DOI":"10.1109\/ICCV.2017.322"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"731","DOI":"10.1111\/mice.12334","article-title":"Autonomous structural visual inspection using re-gion-based deep learning for detecting multiple damage types","volume":"33","author":"Cha","year":"2018","journal-title":"Computer-Aid. Civil Infrast. Eng."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"1073","DOI":"10.1111\/mice.12411","article-title":"Damage Classification for Masonry Historic Structures Using Convolutional Neural Networks Based on Still Images","volume":"33","author":"Wang","year":"2018","journal-title":"Comput. Civ. Infrastruct. Eng."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Wu, W., Qurishee, M.A., Owino, J., Fomunung, I., Onyango, M., and Atolagbe, B. (2018). Coupling deep learning and UAV for infra-structure condition assessment automation. 2018 IEEE International Smart Cities Conference (ISC2), IEEE.","DOI":"10.1109\/ISC2.2018.8656971"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"8016","DOI":"10.1109\/TIE.2019.2945265","article-title":"DDNet: Real-time crack segmentation","volume":"67","author":"Choi","year":"2019","journal-title":"IEEE Trans. Ind. Electron."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"415","DOI":"10.1111\/mice.12425","article-title":"Image-based post-disaster inspection of reinforced concrete bridge systems using deep learning with Bayesian optimization","volume":"34","author":"Liang","year":"2018","journal-title":"Comput. Civ. Infrastruct. Eng."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"129","DOI":"10.1016\/j.autcon.2019.04.005","article-title":"Computer vision-based concrete crack detection using U-net fully convolutional networks","volume":"104","author":"Liu","year":"2019","journal-title":"Autom. Constr."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"103606","DOI":"10.1016\/j.autcon.2021.103606","article-title":"Automatic crack classification and segmentation on masonry surfaces using convolutional neural networks and transfer learning","volume":"125","author":"Dais","year":"2021","journal-title":"Autom. Constr."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Zhang, C., Chang, C.-C., and Jamshidi, M. (2021). Simultaneous pixel-level concrete defect detection and grouping using a fully convolutional model. Struct. Health Monit.","DOI":"10.1177\/1475921720985437"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"1090","DOI":"10.1111\/mice.12412","article-title":"Automatic Pixel-Level Crack Detection and Measurement Using Fully Convolutional Network","volume":"33","author":"Yang","year":"2018","journal-title":"Comput. Civ. Infrastruct. Eng."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"367","DOI":"10.1111\/mice.12421","article-title":"Zernike-moment measurement of thin-crack width in images enabled by dual-scale deep learning","volume":"34","author":"Ni","year":"2019","journal-title":"Comput. Aided Civil Infrastruct. Eng."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"e2381","DOI":"10.1002\/stc.2381","article-title":"Image-based concrete crack assessment using mask and region-based convolutional neural network","volume":"26","author":"Kim","year":"2019","journal-title":"Struct. Control. Health Monit."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"616","DOI":"10.1111\/mice.12433","article-title":"Automatic pixel-level multiple damage detection of concrete structure using fully convolution-al network","volume":"34","author":"Li","year":"2019","journal-title":"Comput. Aided Civil Infrastruct. Eng."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Ronneberger, O., Fischer, P., and Brox, T. (2015). U-Net: Convolutional Networks for Biomedical Image Segmentation. arXiv.","DOI":"10.1007\/978-3-319-24574-4_28"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"2481","DOI":"10.1109\/TPAMI.2016.2644615","article-title":"Segnet: A deep convolutional encoder-decoder architecture for image seg-mentation","volume":"39","author":"Badrinarayanan","year":"2017","journal-title":"IEEE Trans. Pattern Anal. Machine Intell."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"04014124","DOI":"10.1061\/(ASCE)CP.1943-5487.0000446","article-title":"Concrete crack assessment using digital image processing and 3D scene reconstruction","volume":"30","author":"Liu","year":"2016","journal-title":"J. Comput. Civil Eng."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"511","DOI":"10.1111\/mice.12501","article-title":"Image-based crack assessment of bridge piers using unmanned aerial vehicles and three-dimensional scene reconstruction","volume":"35","author":"Liu","year":"2019","journal-title":"Comput. Civ. Infrastruct. Eng."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"124","DOI":"10.1080\/15732479.2017.1330891","article-title":"Unmanned aerial vehicle inspection of the Placer River Trail Bridge through image-based 3D modelling","volume":"14","author":"Khaloo","year":"2018","journal-title":"Struct. Infrastruct. Eng."},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., and Wojna, Z. (2016, January 27\u201330). Rethinking the Inception Architecture for Computer Vision. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2016, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.308"},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"04016047","DOI":"10.1061\/(ASCE)CP.1943-5487.0000616","article-title":"Hierarchical dense structure-from-motion reconstructions for infrastructure condition assess-ment","volume":"31","author":"Khaloo","year":"2017","journal-title":"J. Comput. Civil Eng."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"05019001","DOI":"10.1061\/(ASCE)BE.1943-5592.0001343","article-title":"UAV bridge inspection through evaluated 3D reconstruc-tions","volume":"24","author":"Chen","year":"2019","journal-title":"J. Bridge Eng."},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., and Rabinovich, A. (2015, January 7\u201312). Going Deeper with Convolutions. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298594"},{"key":"ref_47","first-page":"34","article-title":"Texture Features based Blur Classification in Barcode Images","volume":"5","author":"Tiwari","year":"2013","journal-title":"Int. J. Inf. Eng. Electron. Bus."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"1532","DOI":"10.1109\/TPAMI.2014.2300479","article-title":"Fast Feature Pyramids for Object Detection","volume":"36","author":"Dollar","year":"2014","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_49","unstructured":"Derpanis, K.G. (2004). The Harris Corner Detector, York University."},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Bay, H., Tuytelaars, T., and Van Gool, L. (2006). Surf: Speeded up robust features. European Conference on Computer Vision, Springer.","DOI":"10.1007\/11744023_32"},{"key":"ref_51","first-page":"214","article-title":"KAZE Features","volume":"Volume 7577","author":"Alcantarilla","year":"2012","journal-title":"Advances in Computational Intelligence"},{"key":"ref_52","first-page":"8","article-title":"Data quality in 3D: Gauging quality measures from users requirements","volume":"36","author":"Sargent","year":"2007","journal-title":"Int. Arch. Photog. Remote Sens. Spatial Inf. Sci."},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"73","DOI":"10.1016\/j.culher.2012.12.003","article-title":"Multi-image 3D reconstruction data evaluation","volume":"15","author":"Koutsoudis","year":"2014","journal-title":"J. Cult. Heritage"},{"key":"ref_54","unstructured":"Cheng, S.-W., and Lau, M.-K. (2017). Denoising a point cloud for surface reconstruction. arXiv."},{"key":"ref_55","first-page":"W19","article-title":"Change detection on points cloud data acquired with a ground laser scanner","volume":"36","author":"Roux","year":"2005","journal-title":"Int. Archives Photog. Remote Sens. Spatial Inf. Sci."},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"111","DOI":"10.1109\/MSP.2011.941097","article-title":"What Is a Savitzky-Golay Filter?","volume":"28","author":"Schafer","year":"2011","journal-title":"IEEE Signal Process. Mag."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/13\/14\/2665\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T06:27:05Z","timestamp":1760164025000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/13\/14\/2665"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,7,7]]},"references-count":56,"journal-issue":{"issue":"14","published-online":{"date-parts":[[2021,7]]}},"alternative-id":["rs13142665"],"URL":"https:\/\/doi.org\/10.3390\/rs13142665","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,7,7]]}}}