{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,13]],"date-time":"2026-02-13T05:55:43Z","timestamp":1770962143318,"version":"3.50.1"},"reference-count":56,"publisher":"MDPI AG","issue":"6","license":[{"start":{"date-parts":[[2019,3,14]],"date-time":"2019-03-14T00:00:00Z","timestamp":1552521600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Homogeneous image change detection research has been well developed, and many methods have been proposed. However, change detection between heterogeneous images is challenging since heterogeneous images are in different domains. Therefore, direct heterogeneous image comparison in the way that we do it is difficult. In this paper, a method for heterogeneous synthetic aperture radar (SAR) image and optical image change detection is proposed, which is based on a pixel-level mapping method and a capsule network with a deep structure. The mapping method proposed transforms an image from one feature space to another feature space. Then, the images can be compared directly in a similarly transformed space. In the mapping process, some image blocks in unchanged areas are selected, and these blocks are only a small part of the image. Then, the weighted parameters are acquired by calculating the Euclidean distances between the pixel to be transformed and the pixels in these blocks. The Euclidean distance calculated according to the weighted coordinates is taken as the pixel gray value in another feature space. The other image is transformed in a similar manner. In the transformed feature space, these images are compared, and the fusion of the two different images is achieved. The two experimental images are input to a capsule network, which has a deep structure. The image fusion result is taken as the training labels. The training samples are selected according to the ratio of the center pixel label and its neighboring pixels\u2019 labels. The capsule network can improve the detection result and suppress noise. Experiments on remote sensing datasets show the final detection results, and the proposed method obtains a satisfactory performance.<\/jats:p>","DOI":"10.3390\/rs11060626","type":"journal-article","created":{"date-parts":[[2019,3,15]],"date-time":"2019-03-15T04:12:09Z","timestamp":1552623129000},"page":"626","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":57,"title":["Change Detection in Remote Sensing Images Based on Image Mapping and a Deep Capsule Network"],"prefix":"10.3390","volume":"11","author":[{"given":"Wenping","family":"Ma","sequence":"first","affiliation":[{"name":"Key Laboratory of Intelligent Perception and Image Understanding of Ministry of Education, International Research Center for Intelligent Perception and Computation, Joint International Research Laboratory of Intelligent Perception and Computation, School of Artificial Intelligence, Xidian University, Xi\u2019an 710071, China"}]},{"given":"Yunta","family":"Xiong","sequence":"additional","affiliation":[{"name":"Key Laboratory of Intelligent Perception and Image Understanding of Ministry of Education, International Research Center for Intelligent Perception and Computation, Joint International Research Laboratory of Intelligent Perception and Computation, School of Artificial Intelligence, Xidian University, Xi\u2019an 710071, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3459-5079","authenticated-orcid":false,"given":"Yue","family":"Wu","sequence":"additional","affiliation":[{"name":"School of Computer Science and Technology, Xidian University, Xi\u2019an 710071, China"}]},{"given":"Hui","family":"Yang","sequence":"additional","affiliation":[{"name":"Key Laboratory of Intelligent Perception and Image Understanding of Ministry of Education, International Research Center for Intelligent Perception and Computation, Joint International Research Laboratory of Intelligent Perception and Computation, School of Artificial Intelligence, Xidian University, Xi\u2019an 710071, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0379-2042","authenticated-orcid":false,"given":"Xiangrong","family":"Zhang","sequence":"additional","affiliation":[{"name":"Key Laboratory of Intelligent Perception and Image Understanding of Ministry of Education, International Research Center for Intelligent Perception and Computation, Joint International Research Laboratory of Intelligent Perception and Computation, School of Artificial Intelligence, Xidian University, Xi\u2019an 710071, China"}]},{"given":"Licheng","family":"Jiao","sequence":"additional","affiliation":[{"name":"Key Laboratory of Intelligent Perception and Image Understanding of Ministry of Education, International Research Center for Intelligent Perception and Computation, Joint International Research Laboratory of Intelligent Perception and Computation, School of Artificial Intelligence, Xidian University, Xi\u2019an 710071, China"}]}],"member":"1968","published-online":{"date-parts":[[2019,3,14]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"2403","DOI":"10.1109\/TGRS.2009.2038274","article-title":"Earthquake damage assessment of buildings using VHR optical and SAR imagery","volume":"48","author":"Brunner","year":"2010","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Lv, Z., Liu, T., Wan, Y., Benediktsson, J.A., and Zhang, X. (2018). Post-Processing Approach for Refining Raw Land Cover Change Detection of Very High-Resolution Remote Sensing Images. Remote Sens., 10.","DOI":"10.3390\/rs10030472"},{"key":"ref_3","unstructured":"Mai, D.S., and Long, T.N. (2015, January 2\u20135). Semi-Supervised Fuzzy C-Means Clustering for Change Detection from Multispectral Satellite Image. Proceedings of the 2015 IEEE International Conference on Fuzzy Systems, Istanbul, Turkey."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"463","DOI":"10.1109\/TIP.2006.888195","article-title":"The regularized iteratively reweighted MAD method for change detection in multi-and hyperspectral data","volume":"16","author":"Nielsen","year":"2007","journal-title":"IEEE Trans. Image Process."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"307","DOI":"10.1109\/LGRS.2011.2167211","article-title":"A neighborhood-based ratio approach for change detection in SAR images","volume":"9","author":"Gong","year":"2012","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"4","DOI":"10.1109\/TGRS.2002.808066","article-title":"A test statistic in the complex Wishart distribution and its application to change detection in polarimetric SAR data","volume":"41","author":"Conradsen","year":"2003","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"989","DOI":"10.1080\/01431168908903939","article-title":"Review Article Digital change detection techniques using remotely-sensed data","volume":"10","author":"Singh","year":"1989","journal-title":"Int. J. Remote Sens."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"841","DOI":"10.3390\/rs10060841","article-title":"A Novel Approach to Unsupervised Change Detection Based on Hybrid Spectral Difference","volume":"10","author":"Li","year":"2018","journal-title":"Remote Sens."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Liu, W., Jie, Y., Zhao, J., and Le, Y. (2017). A Novel Method of Unsupervised Change Detection Using Multi-Temporal PolSAR Images. Remote Sens., 9.","DOI":"10.3390\/rs9111135"},{"key":"ref_10","first-page":"1","article-title":"Change detection in SAR images based on matrix factorisation and a Bayes classifier","volume":"40","author":"Ma","year":"2018","journal-title":"Int. J. Remote Sens."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"130","DOI":"10.1016\/j.isprsjprs.2013.06.009","article-title":"Automated detection of slum area change in Hyderabad, India using multitemporal satellite imagery","volume":"83","author":"Kit","year":"2013","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"1877","DOI":"10.1109\/TIP.2010.2045070","article-title":"A context-sensitive technique robust to registration noise for change detection in VHR multispectral images","volume":"19","author":"Marchesi","year":"2010","journal-title":"IEEE Trans. Image Process."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"527","DOI":"10.1109\/TIP.2003.818017","article-title":"Modeling SAR images with a generalization of the Rayleigh distribution","volume":"13","author":"Kuruoglu","year":"2004","journal-title":"IEEE Trans. Image Process."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Dawn, S., Saxena, V., and Sharma, B. (July, January 30). Remote sensing image registration techniques: A survey. Proceedings of the 2010 International Conference on Image and Signal Processing, Quebec, QC, Canada.","DOI":"10.1007\/978-3-642-13681-8_13"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"2365","DOI":"10.1080\/0143116031000139863","article-title":"Change detection techniques","volume":"25","author":"Lu","year":"2004","journal-title":"Int. J. Remote Sens."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"799","DOI":"10.1109\/TIP.2014.2387013","article-title":"A new multivariate statistical model for change detection in images acquired by homogeneous and heterogeneous sensors","volume":"24","author":"Prendes","year":"2015","journal-title":"IEEE Trans. Image Process."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"7483","DOI":"10.1109\/TGRS.2014.2310451","article-title":"Change Detection of Multilook Polarimetric SAR Images Using Heterogeneous Clutter Models","volume":"52","author":"Meng","year":"2014","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"3297","DOI":"10.1109\/JSTARS.2014.2328344","article-title":"Unsupervised change detection in SAR image based on Gauss-log ratio image fusion and compressed projection","volume":"7","author":"Hou","year":"2014","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"2963","DOI":"10.1109\/TGRS.2005.857987","article-title":"A detail-preserving scale-driven approach to change detection in multitemporal SAR images","volume":"43","author":"Bovolo","year":"2005","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"691","DOI":"10.1109\/LGRS.2013.2275738","article-title":"Using Combined Difference Image and k-Means Clustering for SAR Image Change Detection","volume":"11","author":"Zheng","year":"2014","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"41","DOI":"10.1016\/0031-3203(86)90030-0","article-title":"Minimum error thresholding","volume":"19","author":"Kittler","year":"1986","journal-title":"Pattern Recognit."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"62","DOI":"10.1109\/TSMC.1979.4310076","article-title":"A threshold selection method from gray-level histograms","volume":"9","author":"Otsu","year":"1979","journal-title":"IEEE Trans. Syst. Man Cybern."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"772","DOI":"10.1109\/LGRS.2009.2025059","article-title":"Unsupervised change detection in satellite images using principal component analysis and k-means clustering","volume":"6","author":"Celik","year":"2009","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"1919","DOI":"10.1109\/TGRS.2011.2168230","article-title":"Unsupervised Change Detection of Satellite Images Using Local Gradual Descent","volume":"50","author":"Yetgin","year":"2012","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_25","unstructured":"Krizhevsky, A., Sutskever, I., and Hinton, G.E. (2012). Imagenet classification with deep convolutional neural networks. Advances in Neural Information Processing Systems, MIT Press."},{"key":"ref_26","unstructured":"Sermanet, P., Chintala, S., and LeCun, Y. (2012, January 11\u201315). Convolutional neural networks applied to house numbers digit classification. Proceedings of the IEEE 2012 21st International Conference on Pattern Recognition (ICPR), Tsukuba, Japan."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"2310","DOI":"10.1109\/LGRS.2017.2762694","article-title":"Generative Adversarial Networks for Change Detection in Multispectral Imagery","volume":"14","author":"Gong","year":"2017","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"125","DOI":"10.1109\/TNNLS.2015.2435783","article-title":"Change detection in synthetic aperture radar images based on deep neural networks","volume":"27","author":"Gong","year":"2016","journal-title":"IEEE Trans. Neural Netw. Learn. Syst."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"1631","DOI":"10.1162\/neco.2008.04-07-510","article-title":"Representational power of restricted Boltzmann machines and deep belief networks","volume":"20","author":"Bengio","year":"2008","journal-title":"Neural Comput."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"74","DOI":"10.4236\/ars.2012.13008","article-title":"Monitoring land-use change in Nakuru (Kenya) using multi-sensor satellite data","volume":"1","author":"Mubea","year":"2012","journal-title":"Adv. Remote Sens."},{"key":"ref_31","first-page":"521","article-title":"Inland wetland change detection using aircraft MSS (multispectral scanner) data","volume":"53","author":"Jensen","year":"1987","journal-title":"Photogramm. Eng. Remote Sens."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"7077","DOI":"10.1109\/TGRS.2016.2594952","article-title":"Coupled dictionary learning for change detection from multisource data","volume":"54","author":"Gong","year":"2016","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_33","unstructured":"Gens, R., and Domingos, P.M. (2014). Deep symmetry networks. Advances in Neural Information Processing Systems, MIT Press."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"59","DOI":"10.1007\/BF00337288","article-title":"Self-organized formation of topologically correct feature maps","volume":"43","author":"Kohonen","year":"1982","journal-title":"Biol. Cybern."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"284","DOI":"10.3390\/rs9030284","article-title":"Supervised Sub-Pixel Mapping for Change Detection from Remotely Sensed Images with Different Resolutions","volume":"9","author":"Ke","year":"2017","journal-title":"Remote Sens."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"586","DOI":"10.1109\/72.846731","article-title":"Clustering of the self-organizing map","volume":"11","author":"Vesanto","year":"2000","journal-title":"IEEE Trans. Neural Netw."},{"key":"ref_37","unstructured":"Sabour, S., Frosst, N., and Hinton, G.E. (2017). Dynamic routing between capsules. Advances in Neural Information Processing Systems, MIT Press."},{"key":"ref_38","unstructured":"Cohen, T., and Welling, M. (2016, January 19\u201324). Group equivariant convolutional networks. Proceedings of the 2016 International Conference on Machine Learning, New York, NY, USA."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"829","DOI":"10.1142\/S0219530516400042","article-title":"Deep vs. shallow networks: An approximation theory perspective","volume":"14","author":"Mhaskar","year":"2016","journal-title":"Anal. Appl."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"983","DOI":"10.1002\/(SICI)1099-1239(199611)6:9\/10<983::AID-RNC263>3.0.CO;2-C","article-title":"Induced L2-norm control for LPV systems with bounded parameter variation rates","volume":"6","author":"Wu","year":"1996","journal-title":"Int. J. Robust Nonlinear Control"},{"key":"ref_41","unstructured":"Wang, D., and Liu, Q. (May, January 30). An Optimization View on Dynamic Routing Between Capsules. Proceedings of the 6th International Conference on Learning Representations, Vancouver, BC, Canada."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"4700","DOI":"10.1523\/JNEUROSCI.13-11-04700.1993","article-title":"A neurobiological model of visual attention and invariant pattern recognition based on dynamic routing of information","volume":"13","author":"Olshausen","year":"1993","journal-title":"J. Neurosci."},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Jaiswal, A., AbdAlmageed, W., and Natarajan, P. (arXiv, 2018). CapsuleGAN: Generative Adversarial Capsule Network, arXiv.","DOI":"10.1007\/978-3-030-11015-4_38"},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Santos, M.D., Shiguemori, E.H., Mota, R.L., and Ramos, A.C. (2015, January 13\u201315). Change detection in satellite images using self-organizing maps. Proceedings of the IEEE 2015 12th International Conference on Information Technology-New Generations (ITNG), Las Vegas, NV, USA.","DOI":"10.1109\/ITNG.2015.111"},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Lyu, H., Lu, H., and Mou, L. (2016). Learning a Transferable Change Rule from a Recurrent Neural Network for Land Cover Change Detection. Remote Sens., 8.","DOI":"10.3390\/rs8060506"},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"85","DOI":"10.1016\/j.patcog.2015.10.001","article-title":"Adaptive imputation of missing values for incomplete pattern classification","volume":"52","author":"Liu","year":"2016","journal-title":"Pattern Recognit."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"263","DOI":"10.1007\/s00521-009-0295-6","article-title":"Pattern classification with missing data: A review","volume":"19","year":"2010","journal-title":"Neural Comput. Appl."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"2141","DOI":"10.1109\/TIP.2011.2170702","article-title":"Change detection in synthetic aperture radar images based on image fusion and fuzzy clustering","volume":"21","author":"Gong","year":"2012","journal-title":"IEEE Trans. Image Process."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1016\/j.isprsjprs.2013.03.006","article-title":"Change detection from remotely sensed images: From pixel-based to object-based approaches","volume":"80","author":"Hussain","year":"2013","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"2345","DOI":"10.1016\/S0167-8655(03)00060-6","article-title":"Evaluation of global image thresholding for change detection","volume":"24","author":"Rosin","year":"2003","journal-title":"Pattern Recognit. Lett."},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"687","DOI":"10.1177\/001316448104100307","article-title":"Coefficient kappa: Some uses, misuses, and alternatives","volume":"41","author":"Brennan","year":"1981","journal-title":"Educ. Psychol. Meas."},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"2073","DOI":"10.1109\/TGRS.2004.835304","article-title":"Application of log-cumulants to the detection of spatiotemporal discontinuities in multitemporal SAR images","volume":"42","author":"Bujor","year":"2004","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"1432","DOI":"10.1109\/TGRS.2007.893568","article-title":"A New Statistical Similarity Measure for Change Detection in Multitemporal SAR Images and Its Extension to Multiscale Change Analysis","volume":"45","author":"Inglada","year":"2011","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"231","DOI":"10.1016\/0034-4257(94)90144-9","article-title":"Change-vector analysis in multitemporal space: A tool to detect and categorize land-cover change processes using high temporal-resolution satellite data","volume":"48","author":"Lambin","year":"1994","journal-title":"Remote Sens. Environ."},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"411","DOI":"10.1080\/014311698216062","article-title":"Change vector analysis: A technique for the multispectral monitoring of land cover and condition","volume":"19","author":"Johnson","year":"1998","journal-title":"Int. J. Remote Sens."},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"7066","DOI":"10.1109\/TGRS.2017.2739800","article-title":"Discriminative Feature Learning for Unsupervised Change Detection in Heterogeneous Images Based on a Coupled Neural Network","volume":"55","author":"Zhao","year":"2017","journal-title":"IEEE Trans. Geosci. Remote Sens."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/11\/6\/626\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T12:38:49Z","timestamp":1760186329000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/11\/6\/626"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,3,14]]},"references-count":56,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2019,3]]}},"alternative-id":["rs11060626"],"URL":"https:\/\/doi.org\/10.3390\/rs11060626","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,3,14]]}}}