{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,18]],"date-time":"2026-05-18T20:11:28Z","timestamp":1779135088207,"version":"3.51.4"},"reference-count":53,"publisher":"MDPI AG","issue":"13","license":[{"start":{"date-parts":[[2021,7,4]],"date-time":"2021-07-04T00:00:00Z","timestamp":1625356800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100002830","name":"Centre National d\u2019Etudes Spatiales","doi-asserted-by":"publisher","award":["51\/19030"],"award-info":[{"award-number":["51\/19030"]}],"id":[{"id":"10.13039\/501100002830","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>In the context of rapid urbanization, monitoring the evolution of cities is crucial. To do so, 3D change detection and characterization is of capital importance since, unlike 2D images, 3D data contain vertical information of utmost importance to monitoring city evolution (that occurs along both horizontal and vertical axes). Urban 3D change detection has thus received growing attention, and various methods have been published on the topic. Nevertheless, no quantitative comparison on a public dataset has been reported yet. This study presents an experimental comparison of six methods: three traditional (difference of DSMs, C2C and M3C2), one machine learning with hand-crafted features (a random forest model with a stability feature) and two deep learning (feed-forward and Siamese architectures). In order to compare these methods, we prepared five sub-datasets containing simulated pairs of 3D annotated point clouds with different characteristics: from high to low resolution, with various levels of noise. The methods have been tested on each sub-dataset for binary and multi-class segmentation. For supervised methods, we also assessed the transfer learning capacity and the influence of the training set size. The methods we used provide various kinds of results (2D pixels, 2D patches or 3D points), and each of them is impacted by the resolution of the PCs. However, while the performances of deep learning methods highly depend on the size of the training set, they seem to be less impacted by training on datasets with different characteristics. Oppositely, conventional machine learning methods exhibit stable results, even with smaller training sets, but embed low transfer learning capacities. While the main changes in our datasets were usually identified, there were still numerous instances of false detection, especially in dense urban areas, thereby calling for further development in this field. To assist such developments, we provide a public dataset composed of pairs of point clouds with different qualities together with their change-related annotations. This dataset was built with an original simulation tool which allows one to generate bi-temporal urban point clouds under various conditions.<\/jats:p>","DOI":"10.3390\/rs13132629","type":"journal-article","created":{"date-parts":[[2021,7,4]],"date-time":"2021-07-04T22:35:22Z","timestamp":1625438122000},"page":"2629","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":36,"title":["Change Detection in Urban Point Clouds: An Experimental Comparison with Simulated 3D Datasets"],"prefix":"10.3390","volume":"13","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-3030-1907","authenticated-orcid":false,"given":"Iris","family":"de G\u00e9lis","sequence":"first","affiliation":[{"name":"Magellium, F-31000 Toulouse, France"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2384-8202","authenticated-orcid":false,"given":"S\u00e9bastien","family":"Lef\u00e8vre","sequence":"additional","affiliation":[{"name":"IRISA UMR 6074, Universit\u00e9 Bretagne Sud, F-56000 Vannes, France"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Thomas","family":"Corpetti","sequence":"additional","affiliation":[{"name":"LETG UMR 6554, CNRS, F-35000 Rennes, France"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2021,7,4]]},"reference":[{"key":"ref_1","unstructured":"Rottensteiner, F. (2008). Automated Updating of Building Data Bases from Digital Surface Models and Multi-Spectral Images: Potential and Limitations, ISPRS Congress."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1138","DOI":"10.1016\/j.patrec.2009.10.012","article-title":"2D building change detection from high resolution satelliteimagery: A two-step hierarchical method based on 3D invariant primitives","volume":"31","author":"Champion","year":"2010","journal-title":"Pattern Recognit. Lett."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Rahman, M.T. (2016). Detection of land use\/land cover changes and urban sprawl in Al-Khobar, Saudi Arabia: An analysis of multi-temporal remote sensing data. ISPRS Int. J. Geo-Inf., 5.","DOI":"10.3390\/ijgi5020015"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Reynolds, R., Liang, L., Li, X., and Dennis, J. (2017). Monitoring annual urban changes in a rapidly growing portion of northwest Arkansas with a 20-year Landsat record. Remote Sens., 9.","DOI":"10.3390\/rs9010071"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"3430","DOI":"10.1109\/JSTARS.2016.2542074","article-title":"Building change detection using high resolution remotely sensed data and GIS","volume":"9","author":"Sofina","year":"2016","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"45","DOI":"10.1016\/j.isprsjprs.2017.03.001","article-title":"Disaster damage detection through synergistic use of deep learning and 3D point cloud features derived from very high resolution oblique aerial images, and multiple-kernel-learning","volume":"140","author":"Vetrivel","year":"2018","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"6635","DOI":"10.1080\/01431161.2019.1583394","article-title":"Change detection in urban areas from remote sensing data: A multidimensional classification scheme","volume":"40","author":"Rezgui","year":"2019","journal-title":"Int. J. Remote Sens."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"2365","DOI":"10.1080\/0143116031000139863","article-title":"Change detection techniques","volume":"25","author":"Lu","year":"2004","journal-title":"Int. J. Remote Sens."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Shi, W., Zhang, M., Zhang, R., Chen, S., and Zhan, Z. (2020). Change detection based on artificial intelligence: State-of-the-art and challenges. Remote Sens., 12.","DOI":"10.3390\/rs12101688"},{"key":"ref_10","first-page":"41","article-title":"3D change detection\u2014Approaches and applications","volume":"122","author":"Qin","year":"2016","journal-title":"P&RS"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"89","DOI":"10.5194\/isprs-archives-XLII-4-W18-89-2019","article-title":"3D change detection in urban areas based on DCNN using a single image","volume":"XLII-4\/W18","author":"Arefi","year":"2019","journal-title":"Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_12","first-page":"313","article-title":"Change detection in mire ecosystems: Assessing changes of forest area using airborne remote sensing data","volume":"36","author":"Waser","year":"2007","journal-title":"Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"4020","DOI":"10.1109\/JSTARS.2014.2300509","article-title":"Automatic detection of elevation changes by differential DSM analysis: Application to urban areas","volume":"7","author":"Guerin","year":"2014","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"3772","DOI":"10.1080\/01431161.2018.1552816","article-title":"Detection of building damage caused by Van Earthquake using image and Digital Surface Model (DSM) difference","volume":"40","author":"Erdogan","year":"2019","journal-title":"Int. J. Remote Sens."},{"key":"ref_15","first-page":"148","article-title":"Change detection of buildings using an airborne laser scanner","volume":"54","author":"Murakami","year":"1999","journal-title":"P&RS"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"102929","DOI":"10.1016\/j.earscirev.2019.102929","article-title":"Airborne lidar change detection: An overview of Earth sciences applications","volume":"198","author":"Okyay","year":"2019","journal-title":"Earth-Sci. Rev."},{"key":"ref_17","unstructured":"Vu, T.T., Matsuoka, M., and Yamazaki, F. (2004, January 20\u201324). LIDAR-based change detection of buildings in dense urban areas. Proceedings of the IGARSS 2004, 2004 IEEE International Geoscience and Remote Sensing Symposium, Anchorage, AK, USA."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"62","DOI":"10.1109\/TSMC.1979.4310076","article-title":"A threshold selection method from gray-level histograms","volume":"9","author":"Otsu","year":"1979","journal-title":"IEEE Trans. Syst. Man Cybern."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Gharibbafghi, Z., Tian, J., and Reinartz, P. (2019, January 16\u201317). Superpixel-Based 3D Building Model Refinement and Change Detection, Using VHR Stereo Satellite Imagery. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition Workshops, Long Beach, CA, USA.","DOI":"10.1109\/CVPRW.2019.00069"},{"key":"ref_20","first-page":"259","article-title":"A feature based approach to automatic change detection from LiDAR data in urban areas","volume":"18","author":"Choi","year":"2009","journal-title":"Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"299","DOI":"10.5194\/isprsarchives-XXXIX-B7-299-2012","article-title":"3D building change detection using high resolution stereo images and a GIS database","volume":"39","author":"Dini","year":"2012","journal-title":"Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci. ISPRS Arch."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"1087","DOI":"10.1080\/01431161.2012.717183","article-title":"Airborne photogrammetry and lidar for DSM extraction and 3D change detection over an urban area\u2013a comparative study","volume":"34","author":"Stal","year":"2013","journal-title":"Int. J. Remote Sens."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"968","DOI":"10.1080\/01431161.2012.714504","article-title":"Lidar-based change detection and change-type determination in urban areas","volume":"34","author":"Teo","year":"2013","journal-title":"Int. J. Remote Sens."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"10733","DOI":"10.3390\/rs61110733","article-title":"Object-based analysis of airborne LiDAR data for building change detection","volume":"6","author":"Pang","year":"2014","journal-title":"Remote Sens."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Lyu, X., Hao, M., and Shi, W. (2020). Building Change Detection Using a Shape Context Similarity Model for LiDAR Data. ISPRS Int. J. Geo-Inf., 9.","DOI":"10.3390\/ijgi9110678"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"669","DOI":"10.5194\/isprs-archives-XLI-B3-669-2016","article-title":"Building change detection by combining Lidar data and ortho image","volume":"41","author":"Peng","year":"2016","journal-title":"Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"322","DOI":"10.1016\/j.isprsjprs.2019.11.028","article-title":"Extraction of urban building damage using spectral, height and corner information from VHR satellite images and airborne LiDAR data","volume":"159","author":"Wang","year":"2020","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"322","DOI":"10.1080\/22797254.2019.1604083","article-title":"DSM-based identification of changes in highly dynamic urban agglomerations","volume":"52","author":"Warth","year":"2019","journal-title":"Eur. J. Remote Sens."},{"key":"ref_29","first-page":"389","article-title":"A study on urban change detection using D-DSM from stereo satellite data","volume":"37","author":"Jang","year":"2019","journal-title":"J. Korean Soc. Surv. Geod. Photogramm. Cartogr."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Kalantar, B., Ueda, N., Al-Najjar, H.A., and Halin, A.A. (2020). Assessment of Convolutional Neural Network Architectures for Earthquake-Induced Building Damage Detection based on Pre-and Post-Event Orthophoto Images. Remote Sens., 12.","DOI":"10.3390\/rs12213529"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"1845","DOI":"10.1109\/LGRS.2017.2738149","article-title":"Change detection based on deep siamese convolutional network for optical aerial images","volume":"14","author":"Zhan","year":"2017","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"1884","DOI":"10.1109\/JPROC.2017.2684300","article-title":"Toward seamless multiview scene analysis from satellite to street level","volume":"105","author":"Tuia","year":"2017","journal-title":"Proc. IEEE"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"He, H., Chen, M., Chen, T., and Li, D. (2018). Matching of remote sensing images with complex background variations via Siamese convolutional neural network. Remote Sens., 10.","DOI":"10.3390\/rs10020355"},{"key":"ref_34","unstructured":"Mou, L., Schmitt, M., Wang, Y., and Zhu, X.X. (2017, January 6\u20138). A CNN for the identification of corresponding patches in SAR and optical imagery of urban scenes. Proceedings of the 2017 Joint Urban Remote Sensing Event (JURSE), Dubai, United Arab Emirates."},{"key":"ref_35","unstructured":"Zhang, Z., Vosselman, G., Gerke, M., Tuia, D., and Yang, M.Y. (2018). Change detection between multimodal remote sensing data using siamese CNN. arXiv."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Zhang, Z., Vosselman, G., Gerke, M., Persello, C., Tuia, D., and Yang, M. (2019). Detecting building changes between airborne laser scanning and photogrammetric data. Remote Sens., 11.","DOI":"10.3390\/rs11202417"},{"key":"ref_37","first-page":"30","article-title":"Change detection on points cloud data acquired with a ground laser scanner","volume":"36","author":"Roux","year":"2005","journal-title":"ISPRS Arch."},{"key":"ref_38","first-page":"10","article-title":"Accurate 3D comparison of complex topography with terrestrial laser scanner: Application to the Rangitikei canyon (NZ)","volume":"82","author":"Lague","year":"2013","journal-title":"P&RS"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"102841","DOI":"10.1016\/j.autcon.2019.102841","article-title":"Comparative analysis of machine learning and point-based algorithms for detecting 3D changes in buildings over time using bi-temporal lidar data","volume":"105","author":"Shirowzhan","year":"2019","journal-title":"Autom. Constr."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"393","DOI":"10.5194\/isprsannals-II-3-W5-393-2015","article-title":"Building change detection from LiDAR point cloud data based on connected component analysis","volume":"2","author":"Awrangjeb","year":"2015","journal-title":"ISPRS Ann. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Siddiqui, F.U., and Awrangjeb, M. (December, January 29). A novel building change detection method using 3d building models. Proceedings of the 2017 International Conference on Digital Image Computing: Techniques and Applications (DICTA), Sydney, Australia.","DOI":"10.1109\/DICTA.2017.8227394"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"17051","DOI":"10.3390\/rs71215867","article-title":"Detection and classification of changes in buildings from airborne laser scanning data","volume":"7","author":"Xu","year":"2015","journal-title":"Remote Sens."},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Dai, C., Zhang, Z., and Lin, D. (2020). An Object-Based Bidirectional Method for Integrated Building Extraction and Change Detection between Multimodal Point Clouds. Remote Sens., 12.","DOI":"10.3390\/rs12101680"},{"key":"ref_44","first-page":"693","article-title":"Fast and robust segmentation and classification for change detection in urban point clouds","volume":"XLI-B3","author":"Roynard","year":"2016","journal-title":"ISPRS Arch."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"9682","DOI":"10.3390\/rs70809682","article-title":"Using octrees to detect changes to buildings and trees in the urban environment from airborne LiDAR data","volume":"7","author":"Xu","year":"2015","journal-title":"Remote Sens."},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Tran, T., Ressl, C., and Pfeifer, N. (2018). Integrated change detection and classification in urban areas based on airborne laser scanning point clouds. Sensors, 18.","DOI":"10.3390\/s18020448"},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"8","DOI":"10.1109\/MGRS.2017.2762307","article-title":"Deep learning in remote sensing: A comprehensive review and list of resources","volume":"5","author":"Zhu","year":"2017","journal-title":"IEEE Geosci. Remote Sens. Mag."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"166","DOI":"10.1016\/j.isprsjprs.2019.04.015","article-title":"Deep learning in remote sensing applications: A meta-analysis and review","volume":"152","author":"Ma","year":"2019","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"de G\u00e9lis, I., Lef\u00e8vre, S., Corpetti, T., Ristorcelli, T., Th\u00e9noz, C., and Lassalle, P. (2021, January 11\u201316). Benchmarking change detection in urban 3D point clouds. Proceedings of the IEEE International Geoscience and Remote Sensing Symposium (IGARSS), Brussels, Belgium.","DOI":"10.1109\/IGARSS47720.2021.9553018"},{"key":"ref_50","unstructured":"Girardeau-Montaut, D. (2021, July 02). CloudCompare. Available online: https:\/\/www.danielgm.net\/cc\/."},{"key":"ref_51","unstructured":"Touati, R., Mignotte, M., and Dahmane, M. (2020). Partly Uncoupled Siamese Model for Change Detection from Heterogeneous Remote Sensing Imagery. J. Remote Sens. GIS, 9."},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"271","DOI":"10.5194\/tc-5-271-2011","article-title":"Co-registration and bias corrections of satellite elevation data sets for quantifying glacier thickness change","volume":"5","author":"Nuth","year":"2011","journal-title":"Cryosphere"},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"103568","DOI":"10.1016\/j.autcon.2021.103568","article-title":"Automated building change detection with amodal completion of point clouds","volume":"124","author":"Czerniawski","year":"2021","journal-title":"Autom. Constr."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/13\/13\/2629\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T06:25:54Z","timestamp":1760163954000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/13\/13\/2629"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,7,4]]},"references-count":53,"journal-issue":{"issue":"13","published-online":{"date-parts":[[2021,7]]}},"alternative-id":["rs13132629"],"URL":"https:\/\/doi.org\/10.3390\/rs13132629","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,7,4]]}}}