{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,10]],"date-time":"2026-01-10T19:30:11Z","timestamp":1768073411222,"version":"3.49.0"},"reference-count":59,"publisher":"MDPI AG","issue":"14","license":[{"start":{"date-parts":[[2021,7,6]],"date-time":"2021-07-06T00:00:00Z","timestamp":1625529600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Change detection based on deep learning has made great progress recently, but there are still some challenges, such as the small data size in open-labeled datasets, the different viewpoints in image pairs, and the poor similarity measures in feature pairs. To alleviate these problems, this paper presents a novel change capsule network by taking advantage of a capsule network that can better deal with the different viewpoints and can achieve satisfactory performance with small training data for optical remote sensing image change detection. First, two identical non-shared weight capsule networks are designed to extract the vector-based features of image pairs. Second, the unchanged region reconstruction module is adopted to keep the feature space of the unchanged region more consistent. Third, vector cosine and vector difference are utilized to compare the vector-based features in a capsule network efficiently, which can enlarge the separability between the changed pixels and the unchanged pixels. Finally, a binary change map can be produced by analyzing both the vector cosine and vector difference. From the unchanged region reconstruction module and the vector cosine and vector difference module, the extracted feature pairs in a change capsule network are more comparable and separable. Moreover, to test the effectiveness of the proposed change capsule network in dealing with the different viewpoints in multi-temporal images, we collect a new change detection dataset from a taken-over Al Udeid Air Basee (AUAB) using Google Earth. The results of the experiments carried out on the AUAB dataset show that a change capsule network can better deal with the different viewpoints and can improve the comparability and separability of feature pairs. Furthermore, a comparison of the experimental results carried out on the AUAB dataset and SZTAKI AirChange Benchmark Set demonstrates the effectiveness and superiority of the proposed method.<\/jats:p>","DOI":"10.3390\/rs13142646","type":"journal-article","created":{"date-parts":[[2021,7,6]],"date-time":"2021-07-06T11:36:44Z","timestamp":1625571404000},"page":"2646","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":25,"title":["Change Capsule Network for Optical Remote Sensing Image Change Detection"],"prefix":"10.3390","volume":"13","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-0636-0827","authenticated-orcid":false,"given":"Quanfu","family":"Xu","sequence":"first","affiliation":[{"name":"Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing 100190, China"},{"name":"School of Electronic, Electrical and Communication Engineering, University of Chinese Academy of Sciences, Beijing 100190, China"},{"name":"Key Laboratory of Network Information System Technology (NIST), Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing 100190, China"},{"name":"University of Chinese Academy of Sciences, Beijing 100190, China"}]},{"given":"Keming","family":"Chen","sequence":"additional","affiliation":[{"name":"Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing 100190, China"},{"name":"School of Electronic, Electrical and Communication Engineering, University of Chinese Academy of Sciences, Beijing 100190, China"},{"name":"Key Laboratory of Network Information System Technology (NIST), Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing 100190, China"},{"name":"University of Chinese Academy of Sciences, Beijing 100190, China"}]},{"given":"Guangyao","family":"Zhou","sequence":"additional","affiliation":[{"name":"Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing 100190, China"},{"name":"Key Laboratory of Network Information System Technology (NIST), Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing 100190, China"}]},{"given":"Xian","family":"Sun","sequence":"additional","affiliation":[{"name":"Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing 100190, China"},{"name":"School of Electronic, Electrical and Communication Engineering, University of Chinese Academy of Sciences, Beijing 100190, China"},{"name":"Key Laboratory of Network Information System Technology (NIST), Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing 100190, China"},{"name":"University of Chinese Academy of Sciences, Beijing 100190, China"}]}],"member":"1968","published-online":{"date-parts":[[2021,7,6]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"989","DOI":"10.1080\/01431168908903939","article-title":"Review article digital change detection techniques using remotely-sensed data","volume":"10","author":"Singh","year":"1989","journal-title":"Int. J. Remote Sens."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Mehrotra, A., Singh, K.K., and Khandelwal, P. (2014, January 5\u20137). An unsupervised change detection technique based on Ant colony Optimization. Proceedings of the 2014 International Conference on Computing for Sustainable Global Development (INDIACom), New Delhi, India.","DOI":"10.1109\/IndiaCom.2014.6828169"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1199","DOI":"10.1109\/TGRS.2009.2029095","article-title":"Unsupervised change detection for satellite images using dual-tree complex wavelet transform","volume":"48","author":"Celik","year":"2009","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"125","DOI":"10.1109\/TNNLS.2015.2435783","article-title":"Change detection in synthetic aperture radar images based on deep neural networks","volume":"27","author":"Gong","year":"2015","journal-title":"IEEE Trans. Neural Netw. Learn. Syst."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"626","DOI":"10.1080\/22797254.2017.1387505","article-title":"Land use\/land cover change detection combining automatic processing and visual interpretation","volume":"50","author":"Mas","year":"2017","journal-title":"Eur. J. Remote Sens."},{"key":"ref_6","first-page":"1","article-title":"Land use land cover change detection and monitoring of urban growth using remote sensing and GIS techniques: A micro-level study","volume":"656","author":"Das","year":"2021","journal-title":"GeoJournal"},{"key":"ref_7","first-page":"133","article-title":"Land use and land cover change detection using geospatial techniques in the Sikkim Himalaya, India","volume":"23","author":"Mishra","year":"2020","journal-title":"Egypt. J. Remote Sens. Space Sci."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Awrangjeb, M., Gilani, S.A.N., and Siddiqui, F.U. (2018). An effective data-driven method for 3-d building roof reconstruction and robust change detection. Remote Sens., 10.","DOI":"10.3390\/rs10101512"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"14119","DOI":"10.3390\/rs71014119","article-title":"Effective generation and update of a building map database through automatic building change detection from LiDAR point cloud data","volume":"7","author":"Awrangjeb","year":"2015","journal-title":"Remote Sens."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"2417","DOI":"10.1109\/TGRS.2012.2210901","article-title":"A change detection approach to flood mapping in urban areas using TerraSAR-X","volume":"51","author":"Giustarini","year":"2012","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"3378","DOI":"10.1109\/TGRS.2016.2516402","article-title":"Toward a generalizable image representation for large-scale change detection: Application to generic damage analysis","volume":"54","author":"Gueguen","year":"2016","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"6121","DOI":"10.1080\/01431160902810638","article-title":"An onboard automatic change detection system for disaster monitoring","volume":"30","author":"Vladimirova","year":"2009","journal-title":"Int. J. Remote Sens."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Michel, U., Thunig, H., Ehlers, M., and Reinartz, P. (2012). Rapid change detection algorithm for disaster management. ISPRS Ann. Photogramm. Remote Sens. Spat. Inf. Sci., 1.","DOI":"10.1117\/12.897581"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"1845","DOI":"10.1109\/LGRS.2017.2738149","article-title":"Change detection based on deep siamese convolutional network for optical aerial images","volume":"14","author":"Zhan","year":"2017","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"266","DOI":"10.1109\/LGRS.2018.2869608","article-title":"Triplet-based semantic relation learning for aerial remote sensing image change detection","volume":"16","author":"Zhang","year":"2018","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"127","DOI":"10.1109\/LGRS.2019.2916601","article-title":"Convolutional Neural Network-Based Transfer Learning for Optical Aerial Images Change Detection","volume":"17","author":"Liu","year":"2019","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Peng, D., Zhang, Y., and Guan, H. (2019). End-to-end change detection for high resolution satellite images using improved UNet++. Remote Sens., 11.","DOI":"10.3390\/rs11111382"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Xu, Q., Chen, K., Sun, X., Zhang, Y., Li, H., and Xu, G. (2020). Pseudo-Siamese Capsule Network for Aerial Remote Sensing Images Change Detection. IEEE Geosci. Remote Sens. Lett., 1\u20135.","DOI":"10.1109\/LGRS.2020.3022512"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Wang, M., Tan, K., Jia, X., Wang, X., and Chen, Y. (2020). A deep siamese network with hybrid convolutional feature extraction module for change detection based on multi-sensor remote sensing images. Remote Sens., 12.","DOI":"10.3390\/rs12020205"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Caye Daudt, R., Le Saux, B., Boulch, A., and Gousseau, Y. (2019, January 16\u201317). Guided anisotropic diffusion and iterative learning for weakly supervised change detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, Long Beach, CA, USA.","DOI":"10.1109\/CVPRW.2019.00187"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"256","DOI":"10.1016\/j.isprsjprs.2013.10.004","article-title":"Results of the ISPRS benchmark on urban object detection and 3D building reconstruction","volume":"93","author":"Rottensteiner","year":"2014","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"1633","DOI":"10.1109\/JSTARS.2018.2810320","article-title":"Symmetrical dense-shortcut deep fully convolutional networks for semantic segmentation of very-high-resolution remote sensing images","volume":"11","author":"Chen","year":"2018","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"3416","DOI":"10.1109\/TGRS.2009.2022633","article-title":"Change detection in optical aerial images by a multilayer conditional mixed Markov model","volume":"47","author":"Benedek","year":"2009","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Benedek, C., and Szir\u00e1nyi, T. (2008, January 8\u201311). A mixed Markov model for change detection in aerial photos with large time differences. Proceedings of the 2008 19th International Conference on Pattern Recognition, Tampa, FL, USA.","DOI":"10.1109\/ICPR.2008.4761658"},{"key":"ref_25","unstructured":"Daudt, R.C., Le Saux, B., and Boulch, A. (2018, January 7\u201310). Fully convolutional siamese networks for change detection. Proceedings of the 2018 25th IEEE International Conference on Image Processing (ICIP), Athens, Greece."},{"key":"ref_26","unstructured":"Sakurada, K., Wang, W., Kawaguchi, N., and Nakamura, R. (2017). Dense optical flow based change detection network robust to difference of camera viewpoints. arXiv."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Park, D.H., Darrell, T., and Rohrbach, A. (2019, January 27\u201328). Robust change captioning. Proceedings of the IEEE\/CVF International Conference on Computer Vision, Seoul, Korea.","DOI":"10.1109\/ICCV.2019.00472"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"4743","DOI":"10.1109\/LRA.2020.3003290","article-title":"3D-Aware Scene Change Captioning From Multiview Images","volume":"5","author":"Qiu","year":"2020","journal-title":"IEEE Robot. Autom. Lett."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Sakurada, K., Shibuya, M., and Wang, W. (August, January 31). Weakly supervised silhouette-based semantic scene change detection. Proceedings of the 2020 IEEE International Conference on Robotics and Automation (ICRA), Paris, France.","DOI":"10.1109\/ICRA40945.2020.9196985"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Palazzolo, E., and Stachniss, C. (2018, January 21\u201325). Fast image-based geometric change detection given a 3d model. Proceedings of the 2018 IEEE International Conference on Robotics and Automation (ICRA), Brisbane, Australia.","DOI":"10.1109\/ICRA.2018.8461019"},{"key":"ref_31","unstructured":"Malila, W.A. (1980). Change Vector Analysis: An Approach for Detecting Forest Changes with Landsat, LARS."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Shi, N., Chen, K., Zhou, G., and Sun, X. (2020). A Feature Space Constraint-Based Method for Change Detection in Heterogeneous Images. Remote Sens., 12.","DOI":"10.3390\/rs12183057"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Ma, W., Xiong, Y., Wu, Y., Yang, H., Zhang, X., and Jiao, L. (2019). Change detection in remote sensing images based on image mapping and a deep capsule network. Remote Sens., 11.","DOI":"10.3390\/rs11060626"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"3677","DOI":"10.1109\/TGRS.2018.2886643","article-title":"Unsupervised deep change vector analysis for multiple-change detection in VHR images","volume":"57","author":"Saha","year":"2019","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_35","unstructured":"Sabour, S., Frosst, N., and Hinton, G.E. (2017). Dynamic routing between capsules. Advances in Neural Information Processing Systems, MIT Press."},{"key":"ref_36","unstructured":"Neill, J.O. (2018). Siamese capsule networks. arXiv."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Deng, F., Pu, S., Chen, X., Shi, Y., Yuan, T., and Pu, S. (2018). Hyperspectral image classification with capsule network using limited training samples. Sensors, 18.","DOI":"10.3390\/s18093153"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Zagoruyko, S., and Komodakis, N. (2015, January 7\u201312). Learning to compare image patches via convolutional neural networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7299064"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"7232","DOI":"10.1109\/TGRS.2019.2912468","article-title":"Caps-TripleGAN: GAN-assisted CapsNet for hyperspectral image classification","volume":"57","author":"Wang","year":"2019","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Singh, M., Nagpal, S., Singh, R., and Vatsa, M. (2019, January 27\u201328). Dual directed capsule network for very low resolution image recognition. Proceedings of the IEEE\/CVF International Conference on Computer Vision, Seoul, Korea.","DOI":"10.1109\/ICCV.2019.00043"},{"key":"ref_41","unstructured":"McIntosh, B., Duarte, K., Rawat, Y.S., and Shah, M. (2018). Multi-modal capsule routing for actor and action video segmentation conditioned on natural language queries. arXiv."},{"key":"ref_42","unstructured":"Duarte, K., Rawat, Y.S., and Shah, M. (2018). Videocapsulenet: A simplified network for action detection. arXiv."},{"key":"ref_43","unstructured":"Upadhyay, Y., and Schrater, P. (2018). Generative adversarial network architectures for image synthesis using capsule networks. arXiv."},{"key":"ref_44","unstructured":"Bass, C., Dai, T., Billot, B., Arulkumaran, K., Creswell, A., Clopath, C., De Paola, V., and Bharath, A.A. (2019, January 8\u201310). Image synthesis with a convolutional capsule generative adversarial network. Proceedings of the International Conference on Medical Imaging with Deep Learning, PMLR, London, UK."},{"key":"ref_45","first-page":"475","article-title":"Change analysis in the United Arab Emirates: An investigation of techniques","volume":"65","author":"Sohl","year":"1999","journal-title":"Photogramm. Eng. Remote Sens."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"918","DOI":"10.1109\/36.298020","article-title":"Processing of multitemporal Landsat TM imagery to optimize extraction of forest cover change features","volume":"32","author":"Coppin","year":"1994","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"1484","DOI":"10.1109\/36.843048","article-title":"Toward specification-driven change detection","volume":"38","author":"Smits","year":"2000","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"218","DOI":"10.1109\/TGRS.2006.885408","article-title":"A theoretical framework for unsupervised change detection based on change vector analysis in the polar domain","volume":"45","author":"Bovolo","year":"2006","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"4434","DOI":"10.1080\/01431161.2011.648285","article-title":"Object-based change detection","volume":"33","author":"Chen","year":"2012","journal-title":"Int. J. Remote Sens."},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"881","DOI":"10.1109\/TGRS.2016.2616585","article-title":"Dense semantic labeling of subdecimeter resolution images with convolutional neural networks","volume":"55","author":"Volpi","year":"2016","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_51","unstructured":"LaLonde, R., and Bagci, U. (2018). Capsules for object segmentation. arXiv."},{"key":"ref_52","doi-asserted-by":"crossref","unstructured":"Ronneberger, O., Fischer, P., and Brox, T. (2015, January 5\u20139). U-net: Convolutional networks for biomedical image segmentation. Proceedings of the International Conference on Medical Image Computing and Computer-Assisted Intervention, Munich, Germany.","DOI":"10.1007\/978-3-319-24574-4_28"},{"key":"ref_53","doi-asserted-by":"crossref","unstructured":"Lin, T.Y., Goyal, P., Girshick, R., He, K., and Doll\u00e1r, P. (2017, January 22\u201329). Focal loss for dense object detection. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.","DOI":"10.1109\/ICCV.2017.324"},{"key":"ref_54","doi-asserted-by":"crossref","unstructured":"Ketkar, N. (2017). Introduction to keras. Deep Learning with Python, Springer.","DOI":"10.1007\/978-1-4842-2766-4"},{"key":"ref_55","unstructured":"Kingma, D.P., and Ba, J. (2014). Adam: A method for stochastic optimization. arXiv."},{"key":"ref_56","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2015, January 7\u201313). Delving deep into rectifiers: Surpassing human-level performance on imagenet classification. Proceedings of the IEEE International Conference on Computer Vision, Santiago, Chile.","DOI":"10.1109\/ICCV.2015.123"},{"key":"ref_57","doi-asserted-by":"crossref","first-page":"687","DOI":"10.1177\/001316448104100307","article-title":"Coefficient kappa: Some uses, misuses, and alternatives","volume":"41","author":"Brennan","year":"1981","journal-title":"Educ. Psychol. Meas."},{"key":"ref_58","doi-asserted-by":"crossref","unstructured":"Li, S., Tang, H., Huang, X., Mao, T., and Niu, X. (2017). Automated detection of buildings from heterogeneous VHR satellite images for rapid response to natural disasters. Remote Sens., 9.","DOI":"10.3390\/rs9111177"},{"key":"ref_59","doi-asserted-by":"crossref","unstructured":"El Amin, A.M., Liu, Q., and Wang, Y. (2017, January 2\u20134). Zoom out CNNs features for optical remote sensing change detection. Proceedings of the 2017 2nd International Conference on Image, Vision and Computing (ICIVC), Chengdu, China.","DOI":"10.1109\/ICIVC.2017.7984667"}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/13\/14\/2646\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T06:26:35Z","timestamp":1760163995000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/13\/14\/2646"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,7,6]]},"references-count":59,"journal-issue":{"issue":"14","published-online":{"date-parts":[[2021,7]]}},"alternative-id":["rs13142646"],"URL":"https:\/\/doi.org\/10.3390\/rs13142646","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,7,6]]}}}