{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,30]],"date-time":"2026-03-30T19:39:47Z","timestamp":1774899587593,"version":"3.50.1"},"reference-count":48,"publisher":"MDPI AG","issue":"20","license":[{"start":{"date-parts":[[2019,10,18]],"date-time":"2019-10-18T00:00:00Z","timestamp":1571356800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Detecting topographic changes in an urban environment and keeping city-level point clouds up-to-date are important tasks for urban planning and monitoring. In practice, remote sensing data are often available only in different modalities for two epochs. Change detection between airborne laser scanning data and photogrammetric data is challenging due to the multi-modality of the input data and dense matching errors. This paper proposes a method to detect building changes between multimodal acquisitions. The multimodal inputs are converted and fed into a light-weighted pseudo-Siamese convolutional neural network (PSI-CNN) for change detection. Different network configurations and fusion strategies are compared. Our experiments on a large urban data set demonstrate the effectiveness of the proposed method. Our change map achieves a recall rate of 86.17%, a precision rate of 68.16%, and an F1-score of 76.13%. The comparison between Siamese architecture and feed-forward architecture brings many interesting findings and suggestions to the design of networks for multimodal data processing.<\/jats:p>","DOI":"10.3390\/rs11202417","type":"journal-article","created":{"date-parts":[[2019,10,18]],"date-time":"2019-10-18T11:24:15Z","timestamp":1571397855000},"page":"2417","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":55,"title":["Detecting Building Changes between Airborne Laser Scanning and Photogrammetric Data"],"prefix":"10.3390","volume":"11","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-2405-2038","authenticated-orcid":false,"given":"Zhenchao","family":"Zhang","sequence":"first","affiliation":[{"name":"Department of Earth Observation Science, Faculty ITC, University of Twente, 7514AE Enschede, The Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8813-8028","authenticated-orcid":false,"given":"George","family":"Vosselman","sequence":"additional","affiliation":[{"name":"Department of Earth Observation Science, Faculty ITC, University of Twente, 7514AE Enschede, The Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Markus","family":"Gerke","sequence":"additional","affiliation":[{"name":"Institute of Geodesy and Photogrammetry, Technische Universit\u00e4t Braunschweig, DE-38106 Braunschweig, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3742-5398","authenticated-orcid":false,"given":"Claudio","family":"Persello","sequence":"additional","affiliation":[{"name":"Department of Earth Observation Science, Faculty ITC, University of Twente, 7514AE Enschede, The Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Devis","family":"Tuia","sequence":"additional","affiliation":[{"name":"Laboratory of Geo-Information Science and Remote Sensing, Wageningen University, 6700AA Wageningen, The Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0649-9987","authenticated-orcid":false,"given":"Michael Ying","family":"Yang","sequence":"additional","affiliation":[{"name":"Department of Earth Observation Science, Faculty ITC, University of Twente, 7514AE Enschede, The Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2019,10,18]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Tran, T.H.G., Ressl, C., and Pfeifer, N. (2018). Integrated change detection and classification in urban areas based on airborne laser scanning point clouds. Sensors, 18.","DOI":"10.3390\/s18020448"},{"key":"ref_2","first-page":"434","article-title":"Automatic detection of changes from laser scanner and aerial image data for updating building maps","volume":"35","author":"Matikainen","year":"2004","journal-title":"Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"23","DOI":"10.1016\/j.isprsjprs.2014.01.006","article-title":"3D change detection at street level using mobile laser scanning point clouds and terrestrial images","volume":"90","author":"Qin","year":"2014","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_4","first-page":"25","article-title":"A patch-based method for the evaluation of dense image matching quality","volume":"70","author":"Zhang","year":"2018","journal-title":"Int. J. Appl. Earth Obs. Geoinf."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"144","DOI":"10.1111\/phor.12063","article-title":"State of the art in high density image matching","volume":"29","author":"Remondino","year":"2014","journal-title":"Photogramm. Rec."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"135","DOI":"10.5194\/isprsannals-II-3-W4-135-2015","article-title":"ISPRS benchmark for multi-platform photogrammetry","volume":"2","author":"Nex","year":"2015","journal-title":"ISPRS Ann. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"57","DOI":"10.1127\/pfg\/2016\/0288","article-title":"Dense image matching vs. airborne laser scanning\u2013comparison of two methods for deriving terrain models","volume":"2","author":"Ressl","year":"2016","journal-title":"Photogramm. Fernerkund. Geoinf."},{"key":"ref_8","first-page":"259","article-title":"Improved topographic models via concurrent airborne lidar and dense image matching","volume":"IV-2\/W4","author":"Mandlburger","year":"2017","journal-title":"ISPRS Ann. Photogram. Remote Sens. Spat. Inf. Sci."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"328","DOI":"10.1109\/TPAMI.2007.1166","article-title":"Stereo processing by semi-global matching and mutual information","volume":"30","year":"2008","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_10","unstructured":"Rothermel, M., Wenzel, K., Fritsch, D., and Haala, N. (, January December). SURE: Photogrammetric surface reconstruction from imagery. Proceedings of the LC3D Workshop, Berlin, Germany."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"17051","DOI":"10.3390\/rs71215867","article-title":"Detection and classification of changes in buildings from airborne laser scanning data","volume":"7","author":"Xu","year":"2015","journal-title":"Remote Sens."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"989","DOI":"10.1080\/01431168908903939","article-title":"Digital change detection techniques using remotely-sensed data","volume":"10","author":"Singh","year":"1989","journal-title":"Int. J. Remote Sens."},{"key":"ref_13","first-page":"207","article-title":"Change detection for updating medium scale maps using laser altimetry","volume":"34","author":"Vosselman","year":"2004","journal-title":"Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"1845","DOI":"10.1109\/LGRS.2017.2738149","article-title":"Change detection based on deep Siamese Convolutional Network for optical aerial images","volume":"14","author":"Zhan","year":"2017","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"241","DOI":"10.1016\/j.rse.2017.07.009","article-title":"A post-classification change detection method based on iterative slow feature analysis and Bayesian soft fusion","volume":"199","author":"Wu","year":"2017","journal-title":"Remote Sens. Environ."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"924","DOI":"10.1109\/TGRS.2018.2863224","article-title":"Learning spectral-spatial-temporal features via a recurrent convolutional neural network for change detection in multispectral imagery","volume":"57","author":"Mou","year":"2019","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_17","first-page":"259","article-title":"A feature based approach to automatic change detection from LiDAR data in urban areas","volume":"18","author":"Choi","year":"2009","journal-title":"Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"50","DOI":"10.1016\/j.isprsjprs.2015.02.005","article-title":"Spectral alignment of multi-temporal cross-sensor images with automated kernel canonical correlation analysis","volume":"107","author":"Volpi","year":"2015","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"2658","DOI":"10.1109\/TGRS.2017.2650198","article-title":"Superpixel-based difference representation learning for change detection in multispectral remote sensing images","volume":"55","author":"Gong","year":"2017","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_20","first-page":"77","article-title":"Supervised change detection in VHR images using contextual information and support vector machines","volume":"20","author":"Volpi","year":"2013","journal-title":"Int. J. Appl. Earth Obs. Geoinf."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"1652","DOI":"10.1080\/01431161.2012.725483","article-title":"Change detection of buildings from satellite imagery and lidar data","volume":"34","author":"Malpica","year":"2013","journal-title":"Int. J. Remote Sens."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"41870","DOI":"10.1117\/1.3525560","article-title":"Detection of building changes from aerial images and light detection and ranging (LIDAR) data","volume":"4","author":"Chen","year":"2010","journal-title":"J. Appl. Remote Sens."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"406","DOI":"10.1109\/TGRS.2013.2240692","article-title":"Building change detection based on satellite stereo imagery and digital surface models","volume":"52","author":"Tian","year":"2014","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_24","first-page":"90800R","article-title":"Comparison of LiDAR and stereo photogrammetric point clouds for change detection","volume":"Volume 9080","author":"Basgall","year":"2014","journal-title":"Laser Radar Technology and Applications XIX; and Atmospheric Propagation XI"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Du, S., Zhang, Y., Qin, R., Yang, Z., Zou, Z., Tang, Y., and Fan, C. (2016). Building change detection using old aerial images and new LiDAR data. Remote Sens., 8.","DOI":"10.3390\/rs8121030"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Long, J., Shelhamer, E., and Darrell, T. (2015, January 7\u201312). Fully convolutional networks for semantic segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298965"},{"key":"ref_27","unstructured":"Ren, S., He, K., Girshick, R., and Sun, J. (2015). Faster R-CNN: Towards real-time object detection with region proposal networks. Adv. Neural Inf. Process. Syst., 91\u201399."},{"key":"ref_28","unstructured":"Sherrah, J. (2016). Fully convolutional networks for dense semantic labelling of high-resolution aerial imagery. arXiv."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Bromley, J., Guyon, I., LeCun, Y., S\u00e4ckinger, E., and Shah, R. (1994). Signature verification using a \u201cSiamese\u201d time delay Neural Network. Adv. Neural Inf. Process. Syst., 737\u2013744.","DOI":"10.1142\/9789812797926_0003"},{"key":"ref_30","unstructured":"Chopra, S., Hadsell, R., and LeCun, Y. (2005, January 20\u201326). Learning a similarity metric discriminatively, with application to face verification. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Washington, DC, USA."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Taigman, Y., Yang, M., Ranzato, M.A., and Wolf, L. (2014, January 23\u201328). Deepface: Closing the gap to human-level performance in face verification. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Washington, DC, USA.","DOI":"10.1109\/CVPR.2014.220"},{"key":"ref_32","unstructured":"Koch, G., Zemel, R., and Salakhutdinov, R. (2015). Siamese Neural Networks for One-Shot Image Recognition. [Master\u2019s Thesis, University of Toronto]."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Zagoruyko, S., and Komodakis, N. (2015, January 14). Learning to compare image patches via convolutional neural networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2015.7299064"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Eitel, A., Springenberg, J.T., Spinello, L., Riedmiller, M., and Burgard, W. (October, January 28). Multimodal deep learning for robust rgb-d object recognition. Proceedings of the 2015 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Hamburg, Germany.","DOI":"10.1109\/IROS.2015.7353446"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Zbontar, J., and LeCun, Y. (2015, January 7\u201312). Computing the stereo matching cost with a convolutional neural network. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, NA, USA.","DOI":"10.1109\/CVPR.2015.7298767"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Luo, W., Schwing, A.G., and Urtasun, R. (2016, January 27\u201330). Efficient deep learning for stereo matching. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.614"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"He, H., Chen, M., Chen, T., and Li, D. (2018). Matching of remote Sensing Images with Complex Background Variations via Siamese Convolutional Neural Network. Remote Sens., 10.","DOI":"10.3390\/rs10020355"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"1884","DOI":"10.1109\/JPROC.2017.2684300","article-title":"Toward seamless multiview scene analysis from satellite to street level","volume":"105","author":"Tuia","year":"2017","journal-title":"Proc. IEEE"},{"key":"ref_39","unstructured":"Krizhevsky, A., Sutskever, I., and Hinton, G.E. (2012). ImageNet classification with deep convolutional neural networks. Adv. Neural Inf. Process. Syst., 1097\u20131105."},{"key":"ref_40","unstructured":"Mou, L., Schmitt, M., Wang, Y., and Zhu, X.X. (2017, January 6\u20138). A CNN for the identification of corresponding patches in SAR and optical imagery of urban scenes. Proceedings of the Urban Remote Sensing Event (JURSE), Dubai, UAE."},{"key":"ref_41","unstructured":"Daudt, R.C., Le Saux, B., and Boulch, A. (2018, January 7\u201310). Fully convolutional siamese networks for change detection. Proceedings of the 2018 25th IEEE International Conference on Image Processing (ICIP), Athens, Greece."},{"key":"ref_42","unstructured":"Goodfellow, I., Bengio, Y., Courville, A., and Bengio, Y. (2016). Deep Learning, MIT Press."},{"key":"ref_43","unstructured":"(2019, October 11). Cyclomedia. Available online: https:\/\/www.cyclomedia.com."},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Daudt, R.C., Le Saux, B., Boulch, A., and Gousseau, Y. (2018, January 22\u201327). Urban change detection for multispectral earth observation using convolutional neural networks. Proceedings of the International Geoscience and Remote Sensing Symposium (IGARSS), Valencia, Spain.","DOI":"10.1109\/IGARSS.2018.8518015"},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Hu, X., and Yuan, Y. (2016). Deep-learning-based classification for DTM extraction from ALS point cloud. Remote Sens., 8.","DOI":"10.3390\/rs8090730"},{"key":"ref_46","unstructured":"(2019, October 11). PyTorch. Available online: https:\/\/pytorch.org\/."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"453","DOI":"10.5194\/isprs-annals-IV-2-W5-453-2019","article-title":"Change detection between digital surface models from airborne laser scanning and dense image matching using convolutional neural networks","volume":"IV-2\/W5","author":"Zhang","year":"2019","journal-title":"ISPRS Ann. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"62","DOI":"10.1109\/TSMC.1979.4310076","article-title":"A threshold selection method from gray-level histograms","volume":"9","author":"Otsu","year":"1979","journal-title":"IEEE Trans. Syst. Man Cybern."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/11\/20\/2417\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T13:27:32Z","timestamp":1760189252000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/11\/20\/2417"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,10,18]]},"references-count":48,"journal-issue":{"issue":"20","published-online":{"date-parts":[[2019,10]]}},"alternative-id":["rs11202417"],"URL":"https:\/\/doi.org\/10.3390\/rs11202417","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,10,18]]}}}