{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,13]],"date-time":"2026-02-13T06:18:23Z","timestamp":1770963503027,"version":"3.50.1"},"reference-count":46,"publisher":"MDPI AG","issue":"18","license":[{"start":{"date-parts":[[2020,9,18]],"date-time":"2020-09-18T00:00:00Z","timestamp":1600387200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>With the development of remote sensing technologies, change detection in heterogeneous images becomes much more necessary and significant. The main difficulty lies in how to make input heterogeneous images comparable so that the changes can be detected. In this paper, we propose an end-to-end heterogeneous change detection method based on the feature space constraint. First, considering that the input heterogeneous images are in two distinct feature spaces, two encoders with the same structure are used to extract features, respectively. A decoder is used to obtain the change map from the extracted features. Then, the Gram matrices, which include the correlations between features, are calculated to represent different feature spaces, respectively. The squared Euclidean distance between Gram matrices, termed as feature space loss, is used to constrain the extracted features. After that, a combined loss function consisting of the binary cross entropy loss and feature space loss is designed for training the model. Finally, the change detection results between heterogeneous images can be obtained when the model is trained well. The proposed method can constrain the features of two heterogeneous images to the same feature space while keeping their unique features so that the comparability between features can be enhanced and better detection results can be achieved. Experiments on two heterogeneous image datasets consisting of optical and SAR images demonstrate the effectiveness and superiority of the proposed method.<\/jats:p>","DOI":"10.3390\/rs12183057","type":"journal-article","created":{"date-parts":[[2020,9,18]],"date-time":"2020-09-18T10:22:23Z","timestamp":1600424543000},"page":"3057","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":13,"title":["A Feature Space Constraint-Based Method for Change Detection in Heterogeneous Images"],"prefix":"10.3390","volume":"12","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-5737-9846","authenticated-orcid":false,"given":"Nian","family":"Shi","sequence":"first","affiliation":[{"name":"School of Information and Electronics, Beijing Institute of Technology, Beijing 100081, China"},{"name":"Key Laboratory of Network Information System Technology (NIST), Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing 100094, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Keming","family":"Chen","sequence":"additional","affiliation":[{"name":"Key Laboratory of Network Information System Technology (NIST), Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing 100094, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Guangyao","family":"Zhou","sequence":"additional","affiliation":[{"name":"Key Laboratory of Network Information System Technology (NIST), Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing 100094, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0038-9816","authenticated-orcid":false,"given":"Xian","family":"Sun","sequence":"additional","affiliation":[{"name":"Key Laboratory of Network Information System Technology (NIST), Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing 100094, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2020,9,18]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"989","DOI":"10.1080\/01431168908903939","article-title":"Review Article Digital change detection techniques using remotely-sensed data","volume":"10","author":"Singh","year":"1989","journal-title":"Int. J. Remote Sens."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"2417","DOI":"10.1109\/TGRS.2012.2210901","article-title":"A Change Detection Approach to Flood Mapping in Urban Areas Using TerraSAR-X","volume":"51","author":"Giustarini","year":"2013","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"3378","DOI":"10.1109\/TGRS.2016.2516402","article-title":"Toward a Generalizable Image Representation for Large-Scale Change Detection: Application to Generic Damage Analysis","volume":"54","author":"Gueguen","year":"2016","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"142","DOI":"10.1016\/j.rse.2006.06.018","article-title":"Land-cover change detection using multi-temporal MODIS NDVI data","volume":"105","author":"Lunetta","year":"2006","journal-title":"Remote Sens. Environ."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"152","DOI":"10.1016\/j.rse.2014.01.011","article-title":"Continuous change detection and classification of land cover using all available Landsat data","volume":"144","author":"Zhu","year":"2014","journal-title":"Remote Sens. Environ."},{"key":"ref_6","first-page":"60","article-title":"Remote sensing and GIS application in change detection study in urban zone using multi temporal satellite","volume":"1","author":"Manonmani","year":"2010","journal-title":"Int. J. Geomat. Geosci."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Liu, Z., Zhang, L., Li, G., and He, Y. (2017, January 10\u201313). Change Detection in Heterogeneous Remote Sensing Images Based on the Fusion of Pixel Transformation. Proceedings of the 2017 20th International Conference on Information Fusion (Fusion), Xi\u2019an, China.","DOI":"10.23919\/ICIF.2017.8009656"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"1352","DOI":"10.1109\/LGRS.2018.2843385","article-title":"Log-based transformation feature learning for change detection in heterogeneous images","volume":"15","author":"Zhan","year":"2018","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Pang, S., Hu, X., Zhang, M., Cai, Z., and Liu, F. (2019). Co-Segmentation and Superpixel-Based Graph Cuts for Building Change Detection from Bi-Temporal Digital Surface Models and Aerial Images. Remote Sens., 11.","DOI":"10.3390\/rs11060729"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"127","DOI":"10.1109\/LGRS.2019.2916601","article-title":"Convolutional Neural Network-Based Transfer Learning for Optical Aerial Images Change Detection","volume":"17","author":"Liu","year":"2020","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_11","unstructured":"Daudt, R.C., Saux, B.L., and Boulch, A. (2018, January 7\u201310). Fully Convolutional Siamese Networks for Change Detection. Proceedings of the 2018 25th IEEE International Conference on Image Processing (ICIP), Athens, Greece."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"266","DOI":"10.1109\/LGRS.2018.2869608","article-title":"Triplet-based semantic relation learning for aerial remote sensing image change detection","volume":"16","author":"Zhang","year":"2018","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Liu, J., Chen, K., Xu, G., Li, H., Yan, M., Diao, W., and Sun, X. (August, January 28). Semi-Supervised Change Detection Based on Graphs with Generative Adversarial Networks. Proceedings of the 2019 IEEE International Geoscience and Remote Sensing Symposium, Yokohama, Japan.","DOI":"10.1109\/IGARSS.2019.8898913"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"1046","DOI":"10.1109\/TGRS.2017.2758359","article-title":"An energy-based model encoding nonlocal pairwise pixel interactions for multisensor change detection","volume":"56","author":"Touati","year":"2017","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"2403","DOI":"10.1109\/TGRS.2009.2038274","article-title":"Earthquake damage assessment of buildings using VHR optical and SAR imagery","volume":"48","author":"Brunner","year":"2010","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"7066","DOI":"10.1109\/TGRS.2017.2739800","article-title":"Discriminative Feature Learning for Unsupervised Change Detection in Heterogeneous Images Based on a Coupled Neural Network","volume":"55","author":"Zhao","year":"2017","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"4779","DOI":"10.1109\/JSTARS.2017.2723082","article-title":"Simulation-Based Interpretation and Alignment of High-Resolution Optical and SAR Images","volume":"10","author":"Auer","year":"2017","journal-title":"IEEE J. Sel. Top. Appl. Earth Observ. Remote Sens."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"74","DOI":"10.4236\/ars.2012.13008","article-title":"Monitoring Land-Use Change in Nakuru (Kenya) Using Multi-Sensor Satellite Data","volume":"1","author":"Mubea","year":"2012","journal-title":"Adv. Remote Sens."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"1613","DOI":"10.3390\/s8031613","article-title":"Object-based Land Cover Classification and Change Analysis in the Baltimore Metropolitan Area Using Multitemporal High Resolution Remote Sensing Data","volume":"8","author":"Zhou","year":"2008","journal-title":"Sensors"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Prendes, J., Chabert, M., Pascal, F., Giros, A., and Tourneret, J.Y. (2015, January 19\u201324). Change detection for optical and radar images using a Bayesian nonparametric model coupled with a Markov random field. Proceedings of the 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), South Brisbane, Australia.","DOI":"10.1109\/ICASSP.2015.7178223"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"6333","DOI":"10.1109\/TGRS.2016.2580321","article-title":"A New Cascade Model for the Hierarchical Joint Classification of Multitemporal and Multiresolution Remote Sensing Data","volume":"54","author":"Hedhli","year":"2016","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"9941","DOI":"10.1109\/TGRS.2019.2930322","article-title":"An Object-Based Hierarchical Compound Classification Method for Change Detection in Heterogeneous Optical and SAR Images","volume":"57","author":"Wan","year":"2019","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Touati, R., Mignotte, M., and Dahmane, M. (2018, January 7\u201310). Change Detection in Heterogeneous Remote Sensing Images Based on an Imaging Modality-Invariant MDS Representation. Proceedings of the 2018 25th IEEE International Conference on Image Processing (ICIP), Athens, Greece.","DOI":"10.1109\/ICIP.2018.8451184"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"545","DOI":"10.1109\/TNNLS.2016.2636227","article-title":"A deep convolutional coupling network for change detection based on heterogeneous optical and radar images","volume":"29","author":"Liu","year":"2016","journal-title":"IEEE Trans. Neural Netw. Learn. Syst."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"876","DOI":"10.1109\/TNNLS.2019.2910571","article-title":"Bipartite Differential Neural Network for Unsupervised Image Change Detection","volume":"31","author":"Liu","year":"2019","journal-title":"IEEE Trans. Neural Netw. Learn. Syst."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Liu, H., Wang, Z., Shang, F., Zhang, M., Gong, M., Ge, F., and Jiao, L. (2019, January 8\u201311). A Novel Deep Framework for Change Detection of Multi-source Heterogeneous Images. Proceedings of the 2019 International Conference on Data Mining Workshops (ICDMW), Beijing, Chin.","DOI":"10.1109\/ICDMW.2019.00034"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"45","DOI":"10.1109\/LGRS.2018.2868704","article-title":"A Conditional Adversarial Network for Change Detection in Heterogeneous Images","volume":"16","author":"Niu","year":"2019","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"1845","DOI":"10.1109\/LGRS.2017.2738149","article-title":"Change Detection Based on Deep Siamese Convolutional Network for Optical Aerial Images","volume":"14","author":"Zhan","year":"2017","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"1822","DOI":"10.1109\/TIP.2017.2784560","article-title":"Change Detection in Heterogenous Remote Sensing Images via Homogeneous Pixel Transformation","volume":"27","author":"Liu","year":"2018","journal-title":"IEEE Trans. Image Process."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"7077","DOI":"10.1109\/TGRS.2016.2594952","article-title":"Coupled Dictionary Learning for Change Detection From Multisource Data","volume":"54","author":"Gong","year":"2016","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Jiang, X., Li, G., Liu, Y., Zhang, X.P., and He, Y. (August, January 28). Homogeneous Transformation Based on Deep-Level Features in Heterogeneous Remote Sensing Images. Proceedings of the 2019 IEEE International Geoscience and Remote Sensing Symposium, Yokohama, Japan.","DOI":"10.1109\/IGARSS.2019.8899123"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"1551","DOI":"10.1109\/JSTARS.2020.2983993","article-title":"Change Detection in Heterogeneous Optical and SAR Remote Sensing Images Via Deep Homogeneous Feature Fusion","volume":"13","author":"Jiang","year":"2020","journal-title":"IEEE J. Sel. Top. Appl. Earth Observ. Remote Sens."},{"key":"ref_33","unstructured":"Jing, Y., Yang, Y., Feng, Z., Ye, J., Yu, Y., and Song, M. (2019). Neural Style Transfer: A Review. IEEE Trans. Vis. Comput. Graph."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Gatys, L.A., Ecker, A.S., and Bethge, M. (2016, January 27\u201330). Image Style Transfer Using Convolutional Neural Networks. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.265"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Ronneberger, O., Fischer, P., and Brox, T. (2015). U-Net: Convolutional Networks for Biomedical Image Segmentation, Springer International Publishing. Lecture Notes in Computer Science.","DOI":"10.1007\/978-3-319-24574-4_28"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Gatys, L., Ecker, A.S., and Bethge, M. (2015). Texture Synthesis Using Convolutional Neural Networks. Advances in Neural Information Processing Systems 28, Curran Associates, Inc.","DOI":"10.1109\/CVPR.2016.265"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"3966","DOI":"10.1080\/01431161.2011.636081","article-title":"Google Earth as a virtual globe tool for Earth science applications at the global scale: Progress and perspectives","volume":"33","author":"Yu","year":"2012","journal-title":"Int. J. Remote Sens."},{"key":"ref_38","first-page":"269","article-title":"System design and key technologies of the GF-3 satellite","volume":"46","author":"Qingjun","year":"2017","journal-title":"Acta Geod. Et Cartogr. Sin."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2015, January 7\u201313). Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification. Proceedings of the 2015 IEEE International Conference on Computer Vision (ICCV), Santiago, Chile.","DOI":"10.1109\/ICCV.2015.123"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"687","DOI":"10.1177\/001316448104100307","article-title":"Coefficient Kappa: Some Uses, Misuses, and Alternatives","volume":"41","author":"Brennan","year":"1981","journal-title":"Educ. Psychol. Meas."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Li, S., Tang, H., Huang, X., Mao, T., and Niu, X. (2017). Automated Detection of Buildings from Heterogeneous VHR Satellite Images for Rapid Response to Natural Disasters. Remote Sens., 9.","DOI":"10.3390\/rs9111177"},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"El Amin, A.M., Liu, Q., and Wang, Y. (2017, January 2\u20134). Zoom out CNNs features for optical remote sensing change detection. Proceedings of the 2017 2nd International Conference on Image, Vision and Computing (ICIVC), Chengdu, China.","DOI":"10.1109\/ICIVC.2017.7984667"},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Yu, C., Wang, J., Peng, C., Gao, C., Yu, G., and Sang, N. (2018, January 18\u201322). Learning a Discriminative Feature Network for Semantic Segmentation. Proceedings of the 2018 IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00199"},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"116","DOI":"10.1016\/j.compmedimag.2010.09.006","article-title":"Modified watershed technique and post-processing for segmentation of skin lesions in dermoscopy images","volume":"35","author":"Wang","year":"2011","journal-title":"Comput. Med. Imaging Graph."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"6960","DOI":"10.1109\/TGRS.2019.2909781","article-title":"Transferred Deep Learning-Based Change Detection in Remote Sensing Images","volume":"57","author":"Yang","year":"2019","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"834","DOI":"10.1109\/TPAMI.2017.2699184","article-title":"Deeplab: Semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected crfs","volume":"40","author":"Chen","year":"2017","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/12\/18\/3057\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T10:11:19Z","timestamp":1760177479000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/12\/18\/3057"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,9,18]]},"references-count":46,"journal-issue":{"issue":"18","published-online":{"date-parts":[[2020,9]]}},"alternative-id":["rs12183057"],"URL":"https:\/\/doi.org\/10.3390\/rs12183057","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,9,18]]}}}