{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,27]],"date-time":"2026-01-27T22:00:17Z","timestamp":1769551217443,"version":"3.49.0"},"reference-count":40,"publisher":"MDPI AG","issue":"4","license":[{"start":{"date-parts":[[2021,2,10]],"date-time":"2021-02-10T00:00:00Z","timestamp":1612915200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100004608","name":"Natural Science Foundation of Jiangsu Province","doi-asserted-by":"publisher","award":["BK20190785"],"award-info":[{"award-number":["BK20190785"]}],"id":[{"id":"10.13039\/501100004608","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Startup Project for Introducing Talent of NUIST","award":["2018r031"],"award-info":[{"award-number":["2018r031"]}]},{"DOI":"10.13039\/501100007129","name":"Shandong Provincial Natural Science Foundation","doi-asserted-by":"publisher","award":["ZR2019BD045"],"award-info":[{"award-number":["ZR2019BD045"]}],"id":[{"id":"10.13039\/501100007129","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Unsupervised change detection(CD) from remotely sensed images is a fundamental challenge when the ground truth for supervised learning is not easily available. Inspired by the visual attention mechanism and multi-level sensation capacity of human vision, we proposed a novel multi-scale analysis framework based on multi-scale visual saliency coarse-to-fine fusion (MVSF) for unsupervised CD in this paper. As a preface of MVSF, we generalized the connotations of scale as four classes in the field of remote sensing (RS) covering the RS process from imaging to image processing, including intrinsic scale, observation scale, analysis scale and modeling scale. In MVSF, superpixels were considered as the primitives for analysing the difference image(DI) obtained by the change vector analysis method. Then, multi-scale saliency maps at the superpixel level were generated according to the global contrast of each superpixel. Finally, a weighted fusion strategy was designed to incorporate multi-scale saliency at a pixel level. The fusion weight for the pixel at each scale is adaptively obtained by considering the heterogeneity of the superpixel it belongs to and the spectral distance between the pixel and the superpixel. The experimental study was conducted on three bi-temporal remotely sensed image pairs, and the effectiveness of the proposed MVSF was verified qualitatively and quantitatively. The results suggest that it is not entirely true that finer scale brings better CD result, and fusing multi-scale superpixel based saliency at a pixel level obtained a higher F1 score in the three experiments. MVSF is capable of maintaining the detailed changed areas while resisting image noise in the final change map. Analysis of the scale factors in MVSF implied that the performance of MVSF is not sensitive to the manually selected scales in the MVSF framework.<\/jats:p>","DOI":"10.3390\/rs13040630","type":"journal-article","created":{"date-parts":[[2021,2,12]],"date-time":"2021-02-12T16:12:10Z","timestamp":1613146330000},"page":"630","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":10,"title":["Unsupervised Change Detection from Remotely Sensed Images Based on Multi-Scale Visual Saliency Coarse-to-Fine Fusion"],"prefix":"10.3390","volume":"13","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-2434-8653","authenticated-orcid":false,"given":"Pengfei","family":"He","sequence":"first","affiliation":[{"name":"School of Remote Sensing and Geomatics Engineering, Nanjing University of Information Science and Technology, Nanjing 210044, China"}]},{"given":"Xiangwei","family":"Zhao","sequence":"additional","affiliation":[{"name":"Jiangsu Power Design Institute, Co., Ltd. of China Energy Engineering Group, Nanjing 211102, China"}]},{"given":"Yuli","family":"Shi","sequence":"additional","affiliation":[{"name":"School of Remote Sensing and Geomatics Engineering, Nanjing University of Information Science and Technology, Nanjing 210044, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3346-906X","authenticated-orcid":false,"given":"Liping","family":"Cai","sequence":"additional","affiliation":[{"name":"School of Geography and Tourism, Qufu Normal University, Rizhao 276826, China"}]}],"member":"1968","published-online":{"date-parts":[[2021,2,10]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Goyette, N., Jodoin, P., Porikli, F., Konrad, J., and Ishwar, P. (2012, January 16\u201321). Changedetection.net: A new change detection benchmark dataset. Proceedings of the 2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, Providence, RI, USA.","DOI":"10.1109\/CVPRW.2012.6238919"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"4913","DOI":"10.1109\/TGRS.2019.2894339","article-title":"A novel change detection method for multitemporal hyperspectral images based on binary hyperspectral change vectors","volume":"57","author":"Marinelli","year":"2019","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Shi, W., Zhang, M., Zhang, R., Chen, S., and Zhan, Z. (2020). Change Detection Based on Artificial Intelligence: State-of-the-Art and Challenges. Remote Sens., 12.","DOI":"10.3390\/rs12101688"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1171","DOI":"10.1109\/36.843009","article-title":"Automatic analysis of the difference image for unsupervised change detection","volume":"38","author":"Bruzzone","year":"2000","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"6071","DOI":"10.1080\/01431161.2010.507793","article-title":"Histogram thresholding for unsupervised change detection of remote sensing images","volume":"32","author":"Patra","year":"2011","journal-title":"Int. J. Remote Sens."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"1334","DOI":"10.1109\/LGRS.2019.2896385","article-title":"An approach to multiple change detection in VHR optical images based on iterative clustering and adaptive thresholding","volume":"16","author":"Bovolo","year":"2019","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"432","DOI":"10.1109\/TGRS.2005.861007","article-title":"Unsupervised change detection on SAR images using fuzzy hidden Markov chains","volume":"44","author":"Carincotte","year":"2006","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"2141","DOI":"10.1109\/TIP.2011.2170702","article-title":"Change detection in synthetic aperture radar images based on image fusion and fuzzy clustering","volume":"21","author":"Gong","year":"2011","journal-title":"IEEE Trans. Image Process."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Lei, T., Xue, D., Lv, Z., Li, S., Zhang, Y., and K Nandi, A. (2018). Unsupervised change detection using fast fuzzy clustering for landslide mapping from very high-resolution images. Remote Sens., 10.","DOI":"10.3390\/rs10091381"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"856","DOI":"10.1109\/LGRS.2016.2550666","article-title":"SAR image change detection based on multiple kernel K-means clustering with local-neighborhood information","volume":"13","author":"Jia","year":"2016","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"98","DOI":"10.1109\/TFUZZ.2013.2249072","article-title":"Fuzzy clustering with a modified MRF energy function for change detection in synthetic aperture radar images","volume":"22","author":"Gong","year":"2013","journal-title":"IEEE Trans. Fuzzy Syst."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1016\/j.isprsjprs.2013.03.006","article-title":"Change detection from remotely sensed images: From pixel-based to object-based approaches","volume":"80","author":"Hussain","year":"2013","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Han, Y., Javed, A., Jung, S., and Liu, S. (2020). Object-Based Change Detection of Very High Resolution Images by Fusing Pixel-Based Change Detection Results Using Weighted Dempster\u2013Shafer Theory. Remote Sens., 12.","DOI":"10.3390\/rs12060983"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"8","DOI":"10.1109\/MGRS.2017.2762307","article-title":"Deep learning in remote sensing: A comprehensive review and list of resources","volume":"5","author":"Zhu","year":"2017","journal-title":"IEEE Geosci. Remote Sens. Mag."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"24","DOI":"10.1016\/j.isprsjprs.2016.02.013","article-title":"Change detection based on deep feature representation and mapping transformation for multi-spatial-resolution remote sensing images","volume":"116","author":"Zhang","year":"2016","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"212","DOI":"10.1016\/j.isprsjprs.2017.05.001","article-title":"Feature learning and change feature classification based on deep learning for ternary change detection in SAR images","volume":"129","author":"Gong","year":"2017","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Binder, M.D., Hirokawa, N., and Windhorst, U. (2009). Visual Attention. Encyclopedia of Neuroscience, Springer.","DOI":"10.1007\/978-3-540-29678-2"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"1101","DOI":"10.3390\/s17051101","article-title":"An automatic localization algorithm for ultrasound breast tumors based on human visual mechanism","volume":"17","author":"Xie","year":"2017","journal-title":"Sensors"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"36600","DOI":"10.1109\/ACCESS.2019.2902613","article-title":"Multiscale superpixel segmentation with deep features for change detection","volume":"7","author":"Lei","year":"2019","journal-title":"IEEE Access"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"225","DOI":"10.1080\/757582976","article-title":"Scale-space theory: A basic tool for analyzing structures at different scales","volume":"21","author":"Lindeberg","year":"1994","journal-title":"J. Appl. Stat."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"649","DOI":"10.1109\/LGRS.2011.2177437","article-title":"BFSIFT: A novel method to find feature matches for SAR image registration","volume":"9","author":"Wang","year":"2011","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"1300","DOI":"10.1109\/LGRS.2016.2582528","article-title":"Remote sensing optical image registration using modified uniform robust SIFT","volume":"13","author":"Paul","year":"2016","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"327","DOI":"10.1109\/LGRS.2019.2917825","article-title":"Gaussian Scale-Space Enhanced Local Contrast Measure for Small Infrared Target Detection","volume":"17","author":"Guan","year":"2019","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_24","first-page":"100040B","article-title":"Tree detection in orchards from VHR satellite images using scale-space theory","volume":"Volume 10004","author":"Mahour","year":"2016","journal-title":"Image and Signal Processing for Remote Sensing XXII"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"725","DOI":"10.1109\/LGRS.2010.2102333","article-title":"Multiscale unsupervised change detection on optical images by Markov random fields and wavelets","volume":"8","author":"Moser","year":"2011","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"016518","DOI":"10.1117\/1.JRS.14.016518","article-title":"Remote sensing image fusion method based on discrete wavelet and multiscale morphological transform in the IHS color space","volume":"14","author":"Liu","year":"2020","journal-title":"J. Appl. Remote Sens."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"2905","DOI":"10.1080\/01431161.2019.1698071","article-title":"Optimization of multi-scale segmentation of satellite imagery using fractal geometry","volume":"41","author":"Karydas","year":"2020","journal-title":"Int. J. Remote Sens."},{"key":"ref_28","first-page":"339","article-title":"An automated object-based approach for the multiscale image segmentation of forest scenes","volume":"7","author":"Hay","year":"2005","journal-title":"Int. J. Appl. Earth Obs. Geoinf."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"1700","DOI":"10.1109\/JSTARS.2020.2983439","article-title":"An Object-Based Approach for Mapping Crop Coverage Using Multiscale Weighted and Machine Learning Methods","volume":"13","author":"Tang","year":"2020","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"2274","DOI":"10.1109\/TPAMI.2012.120","article-title":"SLIC superpixels compared to state-of-the-art superpixel methods","volume":"34","author":"Achanta","year":"2012","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"1915","DOI":"10.1109\/TPAMI.2011.272","article-title":"Context-aware saliency detection","volume":"34","author":"Goferman","year":"2011","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"1035","DOI":"10.1109\/LSP.2014.2323407","article-title":"Saliency detection with multi-scale superpixels","volume":"21","author":"Tong","year":"2014","journal-title":"IEEE Signal Process. Lett."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"309","DOI":"10.1016\/j.patcog.2016.07.040","article-title":"Unsupervised saliency-guided SAR image change detection","volume":"61","author":"Zheng","year":"2017","journal-title":"Pattern Recognit."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Zhuge, M., Fan, D.P., Liu, N., Zhang, D., Xu, D., and Shao, L. (2021). Salient Object Detection via Integrity Learning. arXiv.","DOI":"10.1109\/TPAMI.2022.3179526"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"7365","DOI":"10.1109\/TGRS.2019.2913095","article-title":"Saliency-guided deep neural networks for SAR image change detection","volume":"57","author":"Geng","year":"2019","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"402","DOI":"10.1109\/LGRS.2018.2876616","article-title":"SAR image change detection using PCANet guided by saliency detection","volume":"16","author":"Li","year":"2018","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"3677","DOI":"10.1109\/TGRS.2018.2886643","article-title":"Unsupervised deep change vector analysis for multiple-change detection in VHR images","volume":"57","author":"Saha","year":"2019","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.image.2018.07.009","article-title":"A novel superpixel-based saliency detection model for 360-degree images","volume":"69","author":"Fang","year":"2018","journal-title":"Signal Process. Image Commun."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"1522","DOI":"10.1109\/TCSVT.2014.2308642","article-title":"Superpixel-based spatiotemporal saliency detection","volume":"24","author":"Liu","year":"2014","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"e453","DOI":"10.7717\/peerj.453","article-title":"scikit-image: Image processing in Python","volume":"2","author":"Boulogne","year":"2014","journal-title":"PeerJ"}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/13\/4\/630\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T05:22:17Z","timestamp":1760160137000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/13\/4\/630"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,2,10]]},"references-count":40,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2021,2]]}},"alternative-id":["rs13040630"],"URL":"https:\/\/doi.org\/10.3390\/rs13040630","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,2,10]]}}}