{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,17]],"date-time":"2026-04-17T16:52:42Z","timestamp":1776444762340,"version":"3.51.2"},"reference-count":40,"publisher":"MDPI AG","issue":"15","license":[{"start":{"date-parts":[[2022,7,23]],"date-time":"2022-07-23T00:00:00Z","timestamp":1658534400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Portuguese Government","award":["SFRH\/BD\/147532\/2019"],"award-info":[{"award-number":["SFRH\/BD\/147532\/2019"]}]},{"name":"Portuguese Government","award":["FCT\/UIDB\/ECI\/04450\/2020"],"award-info":[{"award-number":["FCT\/UIDB\/ECI\/04450\/2020"]}]},{"name":"Foundation for Science and Technology (FCT)-Aveiro Research Centre for Risks and Sustainability in Construction (RISCO), Universidade de Aveiro","award":["SFRH\/BD\/147532\/2019"],"award-info":[{"award-number":["SFRH\/BD\/147532\/2019"]}]},{"name":"Foundation for Science and Technology (FCT)-Aveiro Research Centre for Risks and Sustainability in Construction (RISCO), Universidade de Aveiro","award":["FCT\/UIDB\/ECI\/04450\/2020"],"award-info":[{"award-number":["FCT\/UIDB\/ECI\/04450\/2020"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Applied Sciences"],"abstract":"<jats:p>Currently, there is extensive research focused on automatic strategies for the segmentation and classification of 3D point clouds, which can accelerate the study of a landmark and integrate it with heterogeneous data and attributes, useful to facilitate the digital management of architectural heritage data. In this work, an automated image-based survey has been exploited a Region- Based Convolutional Neural Network. The training phase has been executed providing examples of images with the anomalies to be detected. At the same time, a laser scanning process was conducted to obtain a point cloud, which acts as a reference for the BIM process. In a final step, a process of projecting information from the images onto the BIM recreates the pathology shapes on the model\u2019s objects, which generates a decision support system for the built environment. The innovation of this research concerns the development of a workflow in which it is possible to automatize the recognition and classification of defects in historical buildings, to finally interpolate this geometric and numerical information with a BIM methodology, obtaining a representation and quantification of the information adapted to the facility management process. The use of innovative techniques such as artificial intelligence algorithms and different plug-ins becomes the main strength of this project.<\/jats:p>","DOI":"10.3390\/app12157403","type":"journal-article","created":{"date-parts":[[2022,7,24]],"date-time":"2022-07-24T22:49:02Z","timestamp":1658702942000},"page":"7403","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":38,"title":["Application of Deep Learning Approach for the Classification of Buildings\u2019 Degradation State in a BIM Methodology"],"prefix":"10.3390","volume":"12","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-9127-7766","authenticated-orcid":false,"given":"Fernanda","family":"Rodrigues","sequence":"first","affiliation":[{"name":"RISCO\u2014Research Center for Risks and Sustainability in Construction, Department of Civil Engineering, University of Aveiro, 3810-193 Aveiro, Portugal"}]},{"given":"Victoria","family":"Cotella","sequence":"additional","affiliation":[{"name":"DIARC\u2014Department of Architecture, University of Naples Federico II, 80134 Napoli, NA, Italy"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1373-4540","authenticated-orcid":false,"given":"Hugo","family":"Rodrigues","sequence":"additional","affiliation":[{"name":"RISCO\u2014Research Center for Risks and Sustainability in Construction, Department of Civil Engineering, University of Aveiro, 3810-193 Aveiro, Portugal"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3628-6795","authenticated-orcid":false,"given":"Eug\u00e9nio","family":"Rocha","sequence":"additional","affiliation":[{"name":"CIDMA\u2014Center for Research & Development in Mathematics and Applications, Department of Mathematics, University of Aveiro, 3810-193 Aveiro, Portugal"}]},{"given":"Felipe","family":"Freitas","sequence":"additional","affiliation":[{"name":"CIDMA\u2014Center for Research & Development in Mathematics and Applications, Department of Mathematics, University of Aveiro, 3810-193 Aveiro, Portugal"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0171-7842","authenticated-orcid":false,"given":"Raquel","family":"Matos","sequence":"additional","affiliation":[{"name":"RISCO\u2014Research Center for Risks and Sustainability in Construction, Department of Civil Engineering, University of Aveiro, 3810-193 Aveiro, Portugal"}]}],"member":"1968","published-online":{"date-parts":[[2022,7,23]]},"reference":[{"key":"ref_1","first-page":"37","article-title":"3D Imaging in Construction and Infrastructure Management: Technological Assessment and Future Research Directions","volume":"Volume 10863","author":"Wei","year":"2018","journal-title":"Workshop of the European Group for Intelligent Computing in Engineering"},{"key":"ref_2","first-page":"1152","article-title":"Construction Scene Parsing (CSP): Structured Annotations of Image Segmentation for Construction Semantic Understanding","volume":"Volume 98","author":"Wei","year":"2020","journal-title":"International Conference on Computing in Civil and Building Engineering"},{"key":"ref_3","first-page":"27","article-title":"A SLAM Integrated Approach for Digital Heritage Documentation","volume":"Volume 12794","author":"Barba","year":"2021","journal-title":"International Conference on Human-Computer Interaction"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"11","DOI":"10.1016\/j.autcon.2017.03.015","article-title":"Conceptualising the FinDD API plug-in: A study of BIM-FM integration","volume":"80","author":"Parn","year":"2017","journal-title":"Autom. Constr."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"02010","DOI":"10.1051\/matecconf\/201820302010","article-title":"Industry Revolution IR 4.0: Future Opportunities and Challenges in Construction Industry","volume":"203","author":"Alaloul","year":"2018","journal-title":"MATEC Web Conf."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"100755","DOI":"10.1016\/j.jobe.2019.100755","article-title":"Building information modeling for facilities management: A literature review and future research directions","volume":"24","author":"Matarneh","year":"2019","journal-title":"J. Build. Eng."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"2017","DOI":"10.1016\/j.advengsoft.2017.08.007","article-title":"Advances in Engineering Software BIM-based integrated delivery technologies for intelligent MEP management in the operation and maintenance phase","volume":"115","author":"Hu","year":"2018","journal-title":"Adv. Eng. Softw."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"392","DOI":"10.1007\/978-3-030-27477-1_30","article-title":"From BIM Towards Digital Twin: Strategy and Future Development for Smart Asset Management","volume":"Volume 853","author":"Borangiu","year":"2020","journal-title":"Service Oriented, Holonic and Multi-agent Manufacturing Systems for Industry of the Future: SOHOMA 2019"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"201","DOI":"10.5194\/isprs-archives-XLII-2-W15-201-2019","article-title":"Condition assessment of RC bridges. Integrating machine learning, photogrammetry and BIM","volume":"XLII-2\/W15","author":"Borin","year":"2019","journal-title":"Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"104813","DOI":"10.1016\/j.engfailanal.2020.104813","article-title":"Remote inspection of RC structures using unmanned aerial vehicles and heuristic image processing","volume":"117","author":"Ribeiro","year":"2020","journal-title":"Eng. Fail. Anal."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"399","DOI":"10.5194\/isprs-archives-XLII-2-399-2018","article-title":"From 2D to 3D supervised segmentation and classification for cultural heritage applications","volume":"XLII-2","author":"Grilli","year":"2018","journal-title":"Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_12","first-page":"207","article-title":"A Guide to Convolutional Neural Networks for Computer Vision","volume":"8","author":"Khan","year":"2018","journal-title":"Synth. Lect. Comput. Vis."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"2278","DOI":"10.1109\/5.726791","article-title":"Gradient-based learning applied to document recognition","volume":"86","author":"Lecun","year":"1998","journal-title":"Proc. IEEE"},{"key":"ref_14","unstructured":"Krizhevsky, A. (2009). Learning Multiple Layers of Features from Tiny Images, University of Toronto. Technical Report TR-2009."},{"key":"ref_15","first-page":"84","article-title":"Imagenet classification with deep convolutional neural networks","volume":"60","author":"Krizhevsky","year":"2012","journal-title":"Adv. Neural Inf. Processing Syst."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27\u201330). Deep residual learning for image recognition. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_17","unstructured":"Scikit-Learn (2022, June 23). Sklearn.metrics.f1_score. Available online: https:\/\/scikit-learn.org\/stable\/modules\/generated\/sklearn.metrics.f1_score.html#."},{"key":"ref_18","unstructured":"Bradski, G., and Kaehler, A. (2009). Learning OpenCV\u2014Computer Vision with the OpenCV Library, O\u2019Reilly Media, Inc."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Fisher, R.B., Breckon, T.P., Dawson-Howe, K., Fitzgibbon, A., Robertson, C., Trucco, E., and Williams, C.K.I. (2016). Dictionary of Computer Vision and Image Processing. Dict. Comput. Vis. Image Process.","DOI":"10.1002\/9781119286462"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"291","DOI":"10.1016\/S0926-5805(03)00043-8","article-title":"Parametric 3D modeling in building construction with examples from precast concrete","volume":"13","author":"Sacks","year":"2004","journal-title":"Autom. Constr."},{"key":"ref_21","unstructured":"Bishop, C.M. (2006). Pattern Recognition and Machine Learning\u2013CERN Document Server, Springer."},{"key":"ref_22","unstructured":"Galle, P. (2002). Computer Age Statistical Inference\u2013Bradley Efron, Trevor Hastie\u2013Google Livros, Institute of Mathematical Statistics Monographs, Cambridge University Press."},{"key":"ref_23","unstructured":"Rogers, S., and Girolami, M. (2017). A first course in machine learning. Chapman & Hall\/CRC Machine Learning & Pattern Recognition Series, Taylor & Francis Group. A Chapman & Hall, book."},{"key":"ref_24","unstructured":"Xu, X. (2021, January 19\u201321). Integrating Segmentation and association Relationship for image Recognition. Proceedings of the 2021 the 11th International Workshop on Computer Science and Engineering (WCSE2021), Shanghai, China."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"447","DOI":"10.5194\/isprs-archives-XLII-4-W18-447-2019","article-title":"Application of Machine and Deep Learning Strategies for the Classification of Heritage Point Clouds","volume":"XLII-4\/W18","author":"Grilli","year":"2019","journal-title":"Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"25","DOI":"10.4995\/var.2021.14179","article-title":"Mo.Se.: Mosaic image segmentation based on deep cascading learning","volume":"12","author":"Felicetti","year":"2021","journal-title":"Virtual Archaeol. Rev."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"787","DOI":"10.1016\/j.aej.2017.01.020","article-title":"Crack detection using image processing: A critical review and analysis","volume":"57","author":"Mohan","year":"2018","journal-title":"Alex. Eng. J."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Shin, H.K., Ahn, Y.H., Lee, S.H., and Kim, H.Y. (2020). Automatic Concrete Damage Recognition Using Multi-Level Attention Convolutional Neural Network. Materials, 13.","DOI":"10.3390\/ma13235549"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"225","DOI":"10.1016\/j.patrec.2021.01.034","article-title":"Building crack identification and total quality management method based on deep learning","volume":"145","author":"Wu","year":"2021","journal-title":"Pattern Recognit. Lett."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"103987","DOI":"10.1016\/j.imavis.2020.103987","article-title":"Intelligent detection of building cracks based on deep learning","volume":"103","author":"Zheng","year":"2020","journal-title":"Image Vis. Comput."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"123785","DOI":"10.1016\/j.conbuildmat.2021.123785","article-title":"Machine learning model for predicting the crack detection and pattern recognition of geopolymer concrete beams","volume":"297","author":"Aravind","year":"2021","journal-title":"Constr. Build. Mater."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Kim, B., and Cho, S. (2018). Automated Vision-Based Detection of Cracks on Concrete Surfaces Using a Deep Learning Technique. Sensors, 18.","DOI":"10.3390\/s18103452"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"103031","DOI":"10.1016\/j.advengsoft.2021.103031","article-title":"Automatic recognition of concrete spall using image processing and metaheuristic optimized LogitBoost classification tree","volume":"159","author":"Cao","year":"2021","journal-title":"Adv. Eng. Softw."},{"key":"ref_34","unstructured":"Paszke, A., Gross, S., Massa, F., Lerer, A., Bradbury, J., Chanan, G., Killen, T., Lin, Z., Gimelshein, N., and Antiga, L. (2019, January 8-\u201314). PyTorch: An imperative style, high-performance deep learning library. Proceedings of the 33rd International Conference on Neural Information Processing System, Vancouver, BC, Canada."},{"key":"ref_35","first-page":"2825","article-title":"Scikit-learn: Machine Learning in Python","volume":"12","author":"Pedregosa","year":"2011","journal-title":"J. Mach. Learn. Res."},{"key":"ref_36","unstructured":"Portuguese General Direction of Cultural Heritage\u2014Portuguese Ministry of Culture (2022, June 23). Church of Santa Casa de Miser-ic\u00f3rdia of Aveiro, Available online: http:\/\/www.monumentos.gov.pt\/Site\/APP_PagesUser\/SIPA.aspx?id=5173."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"1340","DOI":"10.1016\/j.cviu.2011.05.006","article-title":"A comparative study of state-of-the-art evolutionary image registration methods for 3D modeling","volume":"115","author":"Damas","year":"2011","journal-title":"Comput. Vis. Image Underst."},{"key":"ref_38","unstructured":"Howard, S., and Gugger, J. (2020). AI Deep Applications Without a PhD. Learning for Coders with Fastai & Pytorch, O\u2019Reilly Media, Inc."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"157","DOI":"10.1109\/72.279181","article-title":"Learning long-term dependencies with gradient descent is difficult","volume":"5","author":"Bengio","year":"1994","journal-title":"IEEE Trans. Neural Net."},{"key":"ref_40","unstructured":"Kingma, D.P., and Ba, J.L. (2015, January 7\u20139). Adam: A method for stochastic optimization. Proceedings of the 3rd International Conference for Learning Representations, San Diego, CA, USA."}],"container-title":["Applied Sciences"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2076-3417\/12\/15\/7403\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T23:55:22Z","timestamp":1760140522000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2076-3417\/12\/15\/7403"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,7,23]]},"references-count":40,"journal-issue":{"issue":"15","published-online":{"date-parts":[[2022,8]]}},"alternative-id":["app12157403"],"URL":"https:\/\/doi.org\/10.3390\/app12157403","relation":{},"ISSN":["2076-3417"],"issn-type":[{"value":"2076-3417","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,7,23]]}}}