{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,7]],"date-time":"2025-11-07T09:46:18Z","timestamp":1762508778760,"version":"build-2065373602"},"reference-count":37,"publisher":"MDPI AG","issue":"9","license":[{"start":{"date-parts":[[2022,5,9]],"date-time":"2022-05-09T00:00:00Z","timestamp":1652054400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100002347","name":"the Federal Ministry of Education and Research of Germany","doi-asserted-by":"publisher","award":["03WIR0706"],"award-info":[{"award-number":["03WIR0706"]}],"id":[{"id":"10.13039\/501100002347","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Data acquisition systems and methods to capture high-resolution images or reconstruct 3D point clouds of existing structures are an effective way to document their as-is condition. These methods enable a detailed analysis of building surfaces, providing precise 3D representations. However, for the condition assessment and documentation, damages are mainly annotated in 2D representations, such as images, orthophotos, or technical drawings, which do not allow for the application of a 3D workflow or automated comparisons of multitemporal datasets. In the available software for building heritage data management and analysis, a wide range of annotation and evaluation functions are available, but they also lack integrated post-processing methods and systematic workflows. The article presents novel methods developed to facilitate such automated 3D workflows and validates them on a small historic church building in Thuringia, Germany. Post-processing steps using photogrammetric 3D reconstruction data along with imagery were implemented, which show the possibilities of integrating 2D annotations into 3D documentations. Further, the application of voxel-based methods on the dataset enables the evaluation of geometrical changes of multitemporal annotations in different states and the assignment to elements of scans or building models. The proposed workflow also highlights the potential of these methods for condition assessment and planning of restoration work, as well as the possibility to represent the analysis results in standardised building model formats.<\/jats:p>","DOI":"10.3390\/rs14092286","type":"journal-article","created":{"date-parts":[[2022,5,10]],"date-time":"2022-05-10T00:30:28Z","timestamp":1652142628000},"page":"2286","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":4,"title":["Integration and Comparison Methods for Multitemporal Image-Based 2D Annotations in Linked 3D Building Documentation"],"prefix":"10.3390","volume":"14","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-2397-5452","authenticated-orcid":false,"given":"Jakob","family":"Taraben","sequence":"first","affiliation":[{"name":"Chair of Modelling and Simulation of Structures, Bauhaus-Universit\u00e4t Weimar, Marienstra\u00dfe 13a, 99423 Weimar, Germany"}]},{"given":"Guido","family":"Morgenthal","sequence":"additional","affiliation":[{"name":"Chair of Modelling and Simulation of Structures, Bauhaus-Universit\u00e4t Weimar, Marienstra\u00dfe 13a, 99423 Weimar, Germany"}]}],"member":"1968","published-online":{"date-parts":[[2022,5,9]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Sch\u00f6nberger, J.L., and Frahm, J.M. (2016, January 27\u201330). Structure-from-Motion Revisited. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.445"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"621","DOI":"10.2495\/STR150521","article-title":"Vision-based Monitoring of Heritage Monuments: Unmanned Aerial Systems (UAS) for Detailed Inspection And High-accuracy Survey of Structures","volume":"153","author":"Hallermann","year":"2015","journal-title":"Wit Trans. Built Environ."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Luhmann, T., Chizhova, M., and Gorkovchuk, D. (2020). Fusion of UAV and Terrestrial Photogrammetry with Laser Scanning for 3D Reconstruction of Historic Churches in Georgia. Drones, 4.","DOI":"10.3390\/drones4030053"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"305","DOI":"10.1260\/2047-4970.3.2.305","article-title":"A Hybrid Approach for the Semantic Annotation of Spatially Oriented Images","volume":"3","author":"Manuel","year":"2014","journal-title":"Int. J. Herit. Digit. Era"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"399","DOI":"10.5194\/isprs-archives-XLII-2-399-2018","article-title":"From 2D to 3D Supervised Segmentation and Classification for Cultural Heritage Applications","volume":"XLII-2","author":"Grilli","year":"2018","journal-title":"Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Poux, F., Billen, R., Kasprzyk, J.P., Lefebvre, P.H., and Hallot, P. (2020). A Built Heritage Information System Based on Point Cloud Data: HIS-PC. Isprs Int. J.-Geo-Inf., 9.","DOI":"10.3390\/ijgi9100588"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Alfio, V.S., Costantino, D., Pepe, M., and Restuccia Garofalo, A. (2022). A Geomatics Approach in Scan to FEM Process Applied to Cultural Heritage Structure: The Case Study of the \u201cColossus of Barletta\u201d. Remote Sens., 14.","DOI":"10.3390\/rs14030664"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"183","DOI":"10.5194\/isprsarchives-XL-5-W2-183-2013","article-title":"Recording Cultural Heritage Using Terrestrial Laserscanning\u2013Dealing with the system, the huge datasets they create and ways to extract the necessary deliverables you can work with","volume":"XL-5\/W2","author":"Christofori","year":"2013","journal-title":"ISPRS-Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"89","DOI":"10.1016\/j.culher.2017.07.010","article-title":"A 3D-centered information system for the documentation of a complex restoration intervention","volume":"29","author":"Apollonio","year":"2018","journal-title":"J. Cult. Herit."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"45","DOI":"10.1016\/j.isprsjprs.2017.03.001","article-title":"Disaster damage detection through synergistic use of deep learning and 3D point cloud features derived from very high resolution oblique aerial images, and multiple-kernel-learning","volume":"140","author":"Vetrivel","year":"2018","journal-title":"Isprs J. Photogramm. Remote Sens."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Benz, C., Debus, P., Ha, H.K., and Rodehorst, V. (2019, January 2\u20134). Crack Segmentation on UAS-based Imagery using Transfer Learning. Proceedings of the International Conference on Image and Vision Computing New Zealand (IVCNZ), Dunedin, New Zealand.","DOI":"10.1109\/IVCNZ48456.2019.8960998"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Artus, M., Alabassy, M.S.H., and Koch, C. (2022). A BIM Based Framework for Damage Segmentation, Modeling, and Visualization Using IFC. Appl. Sci., 12.","DOI":"10.20944\/preprints202201.0094.v1"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"73","DOI":"10.1007\/s10816-014-9226-7","article-title":"Experiencing Ancient Buildings from a 3D GIS Perspective: A Case Drawn from the Swedish Pompeii Project","volume":"23","author":"Landeschi","year":"2016","journal-title":"J. Archaeol. Method Theory"},{"key":"ref_14","first-page":"666","article-title":"Documenting the State of Preservation of Historical Stone Sculptures in Three Dimensions with Digital Tools","volume":"Volume 12663","author":"Cucchiara","year":"2021","journal-title":"Pattern Recognition. ICPR International Workshops and Challenges"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"777","DOI":"10.5194\/isprs-archives-XLII-2-W11-777-2019","article-title":"Modelling in HBIM to Document Materials Decay by a Thematic Mapping to Manage the Cultural Heritage: The Case of \u201cChiesa della Piet\u00e0\u201d in Fermo","volume":"XLII-2\/W11","author":"Malinverni","year":"2019","journal-title":"ISPRS-Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_16","unstructured":"Garagnani, S. (November, January 28). Building Information Modeling and real world knowledge: A methodological approach to accurate semantic documentation for the built environment. Proceedings of the Digital Heritage International Congress (DigitalHeritage), Marseille, France."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"605","DOI":"10.5194\/isprs-archives-XLII-2-W5-605-2017","article-title":"Modeling the Decay in an HBIM Starting from 3D Point Clouds: A Followed Approach for Cultural Heritage Knowledge","volume":"XLII-2\/W5","author":"Chiabrando","year":"2017","journal-title":"ISPRS-Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"212","DOI":"10.1080\/00396265.2016.1259719","article-title":"From point cloud to BIM: An integrated workflow for documentation, research and modelling of architectural heritage","volume":"50","year":"2018","journal-title":"Surv. Rev."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Costantino, D., Pepe, M., and Restuccia, A. (2021). Scan-to-HBIM for conservation and preservation of Cultural Heritage building: The case study of San Nicola in Montedoro church (Italy). Appl. Geomat.","DOI":"10.1007\/s12518-021-00359-2"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Croce, V., Caroti, G., De Luca, L., Jacquot, K., Piemonte, A., and V\u00e9ron, P. (2021). From the Semantic Point Cloud to Heritage-Building Information Modeling: A Semiautomatic Approach Exploiting Machine Learning. Remote Sens., 13.","DOI":"10.3390\/rs13030461"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Pierdicca, R., Paolanti, M., Matrone, F., Martini, M., Morbidoni, C., Malinverni, E.S., Frontoni, E., and Lingua, A.M. (2020). Point Cloud Semantic Segmentation Using a Deep Learning Framework for Cultural Heritage. Remote Sens., 12.","DOI":"10.3390\/rs12061005"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"191","DOI":"10.5194\/isprs-archives-XLI-B5-191-2016","article-title":"Automated Voxel Model from Point Clouds for Structural Analysis of Cultural Heritage","volume":"XLI-B5","author":"Bitelli","year":"2016","journal-title":"Isprs-Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Poux, F., and Billen, R. (2019). Voxel-based 3D Point Cloud Semantic Segmentation: Unsupervised Geometric and Relationship Featuring vs Deep Learning Methods. ISPRS Int. J. Geo-Inf., 8.","DOI":"10.3390\/ijgi8050213"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Nan, L., and Wonka, P. (2017, January 22\u201329). PolyFit: Polygonal Surface Reconstruction from Point Clouds. Proceedings of the 2017 IEEE International Conference on Computer Vision (ICCV), Venice, Italy.","DOI":"10.1109\/ICCV.2017.258"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"69","DOI":"10.5194\/isprs-archives-XLII-5-W1-69-2017","article-title":"Multitemporal 3D Modelling for Cultural Heritage Emergency During Seismic Events: Damage Assesment of S. Agostino Church in Amatrice (RI)","volume":"XLII-5\/W1","author":"Chiabrando","year":"2017","journal-title":"ISPRS-Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Hallermann, N., Taraben, J., and Morgenthal, G. (2018, January 9\u201313). BIM related workflow for an image-based deformation monitoring of bridges. Proceedings of the 9th International Conference on Bridge Maintenance, Safety and Management (IABMAS), Melbourne, Australia.","DOI":"10.1201\/9781315189390-13"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Vetrivel, A., Duarte, D., Nex, F., Gerke, M., Kerle, N., and Vosselman, G. (2016;, January 12\u201319). Potential of Multi-Temporal Oblique Airborne Imagery for Structural Damage Assessment. Proceedings of the ISPRS Annals of Photogrammetry, Remote Sensing and Spatial Information Sciences, Prague, Czech Republic.","DOI":"10.5194\/isprs-annals-III-3-355-2016"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"370","DOI":"10.1016\/j.aei.2009.06.001","article-title":"Topological analysis of 3D building models using a spatial query language","volume":"23","author":"Borrmann","year":"2009","journal-title":"Adv. Eng. Inf."},{"key":"ref_29","unstructured":"Snavely, N. (2022, March 10). Bundler v0.4 User\u2019s Manual. Available online: https:\/\/www.cs.cornell.edu\/~snavely\/bundler\/bundler-v0.4-manual.html."},{"key":"ref_30","unstructured":"Wada, K. (2022, March 10). labelme: Image Polygonal Annotation with Python. Available online: https:\/\/github.com\/wkentaro\/labelme."},{"key":"ref_31","unstructured":"Sheffer, A., and Polthier, K. (2006). Poisson Surface Reconstruction. Proceedings of the Fourth Eurographics Symposium on Geometry Processing (SGP \u201906), The Eurographics Association."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"103739","DOI":"10.1016\/j.autcon.2021.103739","article-title":"A semantic modeling approach for the automated detection and interpretation of structural damage","volume":"128","author":"Hamdan","year":"2021","journal-title":"Autom. Constr."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"101186","DOI":"10.1016\/j.aei.2020.101186","article-title":"Methods for the Automated Assignment and Comparison of Building Damage Geometries","volume":"47","author":"Taraben","year":"2021","journal-title":"Adv. Eng. Inf."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Yokota, H., and Frangopol, D.M. (2021). Automated linking of 3D inspection data for damage analysis. Proceedings of the Bridge Maintenance, Safety, Management, Life-Cycle Sustainability and Innovations (IABMAS), CRC Press.","DOI":"10.1201\/9780429279119"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"22","DOI":"10.1016\/j.autcon.2016.11.013","article-title":"Multimodels\u2014Instant nD-modeling using original data","volume":"75","author":"Fuchs","year":"2017","journal-title":"Autom. Constr."},{"key":"ref_36","unstructured":"(2022, March 10). buildingSmart. Industry Foundation Classes 4.0.2.1 Version 4.0\u2013Addendum 2\u2013Technical Corrigendum 1. Available online: https:\/\/technical.buildingsmart.org\/standards\/ifc\/ifc-schema-specifications\/."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"4","DOI":"10.1186\/s40965-019-0064-0","article-title":"CityJSON: A compact and easy-to-use encoding of the CityGML data model","volume":"4","author":"Ledoux","year":"2019","journal-title":"Open Geospat. Data Softw. Stand."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/14\/9\/2286\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T23:08:25Z","timestamp":1760137705000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/14\/9\/2286"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,5,9]]},"references-count":37,"journal-issue":{"issue":"9","published-online":{"date-parts":[[2022,5]]}},"alternative-id":["rs14092286"],"URL":"https:\/\/doi.org\/10.3390\/rs14092286","relation":{},"ISSN":["2072-4292"],"issn-type":[{"type":"electronic","value":"2072-4292"}],"subject":[],"published":{"date-parts":[[2022,5,9]]}}}