{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,27]],"date-time":"2026-05-27T18:12:51Z","timestamp":1779905571397,"version":"3.53.1"},"reference-count":61,"publisher":"MDPI AG","issue":"18","license":[{"start":{"date-parts":[[2021,9,16]],"date-time":"2021-09-16T00:00:00Z","timestamp":1631750400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Change detection, i.e., the identification per pixel of changes for some classes of interest from a set of bi-temporal co-registered images, is a fundamental task in the field of remote sensing. It remains challenging due to unrelated forms of change that appear at different times in input images. Here, we propose a deep learning framework for the task of semantic change detection in very high-resolution aerial images. Our framework consists of a new loss function, a new attention module, new feature extraction building blocks, and a new backbone architecture that is tailored for the task of semantic change detection. Specifically, we define a new form of set similarity that is based on an iterative evaluation of a variant of the Dice coefficient. We use this similarity metric to define a new loss function as well as a new, memory efficient, spatial and channel convolution Attention layer: the FracTAL. We introduce two new efficient self-contained feature extraction convolution units: the CEECNet and FracTALResNet units. Further, we propose a new encoder\/decoder scheme, a network macro-topology, that is tailored for the task of change detection. The key insight in our approach is to facilitate the use of relative attention between two convolution layers in order to fuse them. We validate our approach by showing excellent performance and achieving state-of-the-art scores (F1 and Intersection over Union-hereafter IoU) on two building change detection datasets, namely, the LEVIRCD (F1: 0.918, IoU: 0.848) and the WHU (F1: 0.938, IoU: 0.882) datasets.<\/jats:p>","DOI":"10.3390\/rs13183707","type":"journal-article","created":{"date-parts":[[2021,9,22]],"date-time":"2021-09-22T03:47:35Z","timestamp":1632282455000},"page":"3707","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":69,"title":["Looking for Change? Roll the Dice and Demand Attention"],"prefix":"10.3390","volume":"13","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-8788-8174","authenticated-orcid":false,"given":"Foivos I.","family":"Diakogiannis","sequence":"first","affiliation":[{"name":"International Centre for Radio Astronomy Research, University of Western Australia, Perth, WA 6021, Australia"},{"name":"Data61, CSIRO, Kensington, Perth, WA 6151, Australia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5599-7456","authenticated-orcid":false,"given":"Fran\u00e7ois","family":"Waldner","sequence":"additional","affiliation":[{"name":"CSIRO Agriculture & Food, Brisbane, St. Lucia, QLD 4067, Australia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9693-7927","authenticated-orcid":false,"given":"Peter","family":"Caccetta","sequence":"additional","affiliation":[{"name":"Data61, CSIRO, Kensington, Perth, WA 6151, Australia"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2021,9,16]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Chen, H., and Shi, Z. (2020). A Spatial-Temporal Attention-Based Method and a New Dataset for Remote Sensing Image Change Detection. Remote Sens., 12.","DOI":"10.3390\/rs12101662"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"2417","DOI":"10.1109\/TGRS.2012.2210901","article-title":"A change detection approach to flood mapping in urban areas using TerraSAR-X","volume":"51","author":"Giustarini","year":"2012","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1175\/EI139.1","article-title":"Rapid assessment of annual deforestation in the Brazilian Amazon using MODIS data","volume":"9","author":"Morton","year":"2005","journal-title":"Earth Interact."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"L\u00f6w, F., Prishchepov, A.V., Waldner, F., Dubovyk, O., Akramkhanov, A., Biradar, C., and Lamers, J. (2018). Mapping cropland abandonment in the Aral Sea Basin with MODIS time series. Remote Sens., 10.","DOI":"10.3390\/rs10020159"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"102783","DOI":"10.1016\/j.cviu.2019.07.003","article-title":"Multitask learning for large-scale semantic change detection","volume":"187","author":"Boulch","year":"2019","journal-title":"Comput. Vis. Image Underst."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Varghese, A., Gubbi, J., Ramaswamy, A., and Balamuralidhar, P. (2018, January 8\u201314). ChangeNet: A Deep Learning Architecture for Visual Change Detection. Proceedings of the European Conference on Computer Vision (ECCV) Workshops, Munich, Germany.","DOI":"10.1007\/978-3-030-11012-3_10"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"2365","DOI":"10.1080\/0143116031000139863","article-title":"Change detection techniques","volume":"25","author":"Lu","year":"2004","journal-title":"Int. J. Remote Sens."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"1565","DOI":"10.1080\/0143116031000101675","article-title":"Review ArticleDigital change detection methods in ecosystem monitoring: A review","volume":"25","author":"Coppin","year":"2004","journal-title":"Int. J. Remote Sens."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.rse.2015.01.006","article-title":"A critical synthesis of remotely sensed optical image change detection techniques","volume":"160","author":"Tewkesbury","year":"2015","journal-title":"Remote Sens. Environ."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1016\/j.isprsjprs.2013.03.006","article-title":"Change detection from remotely sensed images: From pixel-based to object-based approaches","volume":"80","author":"Hussain","year":"2013","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"97","DOI":"10.1016\/0010-0285(80)90005-5","article-title":"A feature-integration theory of attention","volume":"12","author":"Treisman","year":"1980","journal-title":"Cogn. Psychol."},{"key":"ref_12","unstructured":"Bahdanau, D., Cho, K., and Bengio, Y. (2014). Neural Machine Translation by Jointly Learning to Align and Translate. arXiv."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Cho, K., van Merrienboer, B., Bahdanau, D., and Bengio, Y. (2014). On the Properties of Neural Machine Translation: Encoder-Decoder Approaches. arXiv.","DOI":"10.3115\/v1\/W14-4012"},{"key":"ref_14","unstructured":"Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, L., and Polosukhin, I. (2017). Attention Is All You Need. arXiv."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Hu, J., Shen, L., and Sun, G. (2017). Squeeze-and-Excitation Networks. arXiv.","DOI":"10.1109\/CVPR.2018.00745"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Wang, X., Girshick, R.B., Gupta, A., and He, K. (2017). Non-local Neural Networks. arXiv.","DOI":"10.1109\/CVPR.2018.00813"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Chen, L., Zhang, H., Xiao, J., Nie, L., Shao, J., and Chua, T. (2016). SCA-CNN: Spatial and Channel-wise Attention in Convolutional Networks for Image Captioning. arXiv.","DOI":"10.1109\/CVPR.2017.667"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Ferrari, V., Hebert, M., Sminchisescu, C., and Weiss, Y. (2018, January 8\u201314). CBAM: Convolutional Block Attention Module. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.","DOI":"10.1007\/978-3-030-01234-2"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Bello, I., Zoph, B., Vaswani, A., Shlens, J., and Le, Q.V. (2019). Attention Augmented Convolutional Networks. arXiv.","DOI":"10.1109\/ICCV.2019.00338"},{"key":"ref_20","unstructured":"Katharopoulos, A., Vyas, A., Pappas, N., and Fleuret, F. (2020). Transformers are RNNs: Fast Autoregressive Transformers with Linear Attention. arXiv."},{"key":"ref_21","unstructured":"Li, R., Su, J., Duan, C., and Zheng, S. (2020). Multistage Attention ResU-Net for Semantic Segmentation of Fine-Resolution Remote Sensing Images. arXiv."},{"key":"ref_22","unstructured":"Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., and Gelly, S. (2020). An Image is Worth 16 \u00d7 16 Words: Transformers for Image Recognition at Scale. arXiv."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Sakurada, K., and Okatani, T. (2015, January 7\u201310). Change Detection from a Street Image Pair using CNN Features and Superpixel Segmentation. Proceedings of the BMVC, Swansea, UK.","DOI":"10.5244\/C.29.61"},{"key":"ref_24","unstructured":"Alcantarilla, P.F., Stent, S., Ros, G., Arroyo, R., and Gherardi, R. (2016). Street-View Change Detection with Deconvolutional Networks. Robot. Sci. Syst."},{"key":"ref_25","unstructured":"Guo, E., Fu, X., Zhu, J., Deng, M., Liu, Y., Zhu, Q., and Li, H. (2018). Learning to Measure Change: Fully Convolutional Siamese Metric Networks for Scene Change Detection. arXiv."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"143","DOI":"10.1007\/s12145-019-00380-5","article-title":"Change detection techniques for remote sensing applications: A survey","volume":"12","author":"Asokan","year":"2019","journal-title":"Earth Sci. Inform."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Shi, W., Zhang, M., Zhang, R., Chen, S., and Zhan, Z. (2020). Change Detection Based on Artificial Intelligence: State-of-the-Art and Challenges. Remote Sens., 12.","DOI":"10.3390\/rs12101688"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Ji, S., Shen, Y., Lu, M., and Zhang, Y. (2019). Building Instance Change Detection from Large-Scale Aerial Images using Convolutional Neural Networks and Simulated Samples. Remote Sens., 11.","DOI":"10.3390\/rs11111343"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"He, K., Gkioxari, G., Doll\u00e1r, P., and Girshick, R.B. (2017). Mask R-CNN. arXiv.","DOI":"10.1109\/ICCV.2017.322"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Ronneberger, O., Fischer, P., and Brox, T. (2015). U-Net: Convolutional Networks for Biomedical Image Segmentation. arXiv.","DOI":"10.1007\/978-3-319-24574-4_28"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"1194","DOI":"10.1109\/JSTARS.2020.3037893","article-title":"DASNet: Dual Attentive Fully Convolutional Siamese Networks for Change Detection in High-Resolution Satellite Images","volume":"14","author":"Chen","year":"2021","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2015). Deep Residual Learning for Image Recognition. arXiv.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Jiang, H., Hu, X., Li, K., Zhang, J., Gong, J., and Zhang, M. (2020). PGA-SiamNet: Pyramid Feature-Based Attention-Guided Siamese Network for Remote Sensing Orthoimagery Building Change Detection. Remote Sens., 12.","DOI":"10.3390\/rs12030484"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Lu, X., Wang, W., Ma, C., Shen, J., Shao, L., and Porikli, F. (2019, January 16\u201320). See More, Know More: Unsupervised Video Object Segmentation with Co-Attention Siamese Networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00374"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"94","DOI":"10.1016\/j.isprsjprs.2020.01.013","article-title":"ResUNet-a: A deep learning framework for semantic segmentation of remotely sensed data","volume":"162","author":"Diakogiannis","year":"2020","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"574","DOI":"10.1109\/TGRS.2018.2858817","article-title":"Fully Convolutional Networks for Multisource Building Extraction From an Open Aerial and Satellite Imagery Data Set","volume":"57","author":"Ji","year":"2019","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_37","unstructured":"Zhang, A., Lipton, Z.C., Li, M., and Smola, A.J. (2021, January 01). Dive into Deep Learning. Available online: https:\/\/d2l.ai."},{"key":"ref_38","unstructured":"Kim, Y., Denton, C., Hoang, L., and Rush, A.M. (2017). Structured Attention Networks. arXiv."},{"key":"ref_39","unstructured":"Zhang, H., Goodfellow, I., Metaxas, D., and Odena, A. (2018). Self-Attention Generative Adversarial Networks. arXiv."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016). Identity Mappings in Deep Residual Networks. arXiv.","DOI":"10.1007\/978-3-319-46493-0_38"},{"key":"ref_41","unstructured":"Ioffe, S., and Szegedy, C. (2015). Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift. arXiv."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Newell, A., Yang, K., and Deng, J. (2016). Stacked Hourglass Networks for Human Pose Estimation. arXiv.","DOI":"10.1007\/978-3-319-46484-8_29"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"5573","DOI":"10.1080\/01431161.2020.1734251","article-title":"A deep residual learning serial segmentation network for extracting buildings from remote sensing imagery","volume":"41","author":"Liu","year":"2020","journal-title":"Int. J. Remote Sens."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"107404","DOI":"10.1016\/j.patcog.2020.107404","article-title":"U2-Net: Going deeper with nested U-structure for salient object detection","volume":"106","author":"Qin","year":"2020","journal-title":"Pattern Recognit."},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Lindeberg, T. (1994). Scale-Space Theory in Computer Vision, Kluwer Academic Publishers.","DOI":"10.1007\/978-1-4757-6465-9"},{"key":"ref_46","unstructured":"Wang, Z., Chen, J., and Hoi, S.C.H. (2019). Deep Learning for Image Super-resolution: A Survey. arXiv."},{"key":"ref_47","unstructured":"Tschannen, M., Bachem, O., and Lucic, M. (2018). Recent Advances in Autoencoder-Based Representation Learning. arXiv."},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Kingma, D.P., and Welling, M. (2019). An Introduction to Variational Autoencoders. arXiv.","DOI":"10.1561\/9781680836233"},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Zhao, H., Shi, J., Qi, X., Wang, X., and Jia, J. (2017, January 21\u201326). Pyramid Scene Parsing Network. Proceedings of the CVPR, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.660"},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"111741","DOI":"10.1016\/j.rse.2020.111741","article-title":"Deep learning on edge: Extracting field boundaries from satellite images with a convolutional neural network","volume":"245","author":"Waldner","year":"2020","journal-title":"Remote Sens. Environ."},{"key":"ref_51","doi-asserted-by":"crossref","unstructured":"Wu, Y., and He, K. (2018). Group Normalization. arXiv.","DOI":"10.1007\/978-3-030-01261-8_1"},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"729","DOI":"10.21105\/joss.00729","article-title":"PyCM: Multiclass confusion matrix library in Python","volume":"3","author":"Haghighi","year":"2018","journal-title":"J. Open Source Softw."},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"442","DOI":"10.1016\/0005-2795(75)90109-9","article-title":"Comparison of the predicted and observed secondary structure of T4 phage lysozyme","volume":"405","author":"Matthews","year":"1975","journal-title":"Biochim. Biophys. Acta (BBA) Protein Struct."},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"585","DOI":"10.1007\/s11047-018-9685-y","article-title":"A Tutorial on Multiobjective Optimization: Fundamentals and Evolutionary Methods","volume":"17","author":"Emmerich","year":"2018","journal-title":"Nat. Comput. Int. J."},{"key":"ref_55","unstructured":"Krizhevsky, A. (2009). Learning Multiple Layers of Features from Tiny Images, Citeseer. Technical Report."},{"key":"ref_56","unstructured":"Kingma, D.P., and Ba, J. (2014). Adam: A Method for Stochastic Optimization. arXiv."},{"key":"ref_57","doi-asserted-by":"crossref","first-page":"012017","DOI":"10.1088\/1755-1315\/502\/1\/012017","article-title":"Detection of Small Changed Regions in Remote Sensing Imagery Using Convolutional Neural Network","volume":"502","author":"Cao","year":"2020","journal-title":"IOP Conf. Ser. Earth Environ. Sci."},{"key":"ref_58","unstructured":"Liu, Y., Pang, C., Zhan, Z., Zhang, X., and Yang, X. (2019). Building Change Detection for Remote Sensing Images Using a Dual Task Constrained Deep Siamese Convolutional Network Model. arXiv."},{"key":"ref_59","doi-asserted-by":"crossref","unstructured":"Waldner, F., Diakogiannis, F.I., Batchelor, K., Ciccotosto-Camp, M., Cooper-Williams, E., Herrmann, C., Mata, G., and Toovey, A. (2021). Detect, Consolidate, Delineate: Scalable Mapping of Field Boundaries Using Satellite Images. Remote Sens., 13.","DOI":"10.3390\/rs13112197"},{"key":"ref_60","unstructured":"Chen, T., Li, M., Li, Y., Lin, M., Wang, N., Wang, M., Xiao, T., Xu, B., Zhang, C., and Zhang, Z. (2015). Mxnet: A flexible and efficient machine learning library for heterogeneous distributed systems. arXiv."},{"key":"ref_61","unstructured":"Sergeev, A., and Balso, M.D. (2018). Horovod: Fast and easy distributed deep learning in TensorFlow. arXiv."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/13\/18\/3707\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T07:00:47Z","timestamp":1760166047000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/13\/18\/3707"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,9,16]]},"references-count":61,"journal-issue":{"issue":"18","published-online":{"date-parts":[[2021,9]]}},"alternative-id":["rs13183707"],"URL":"https:\/\/doi.org\/10.3390\/rs13183707","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,9,16]]}}}