{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,3]],"date-time":"2026-04-03T22:11:39Z","timestamp":1775254299649,"version":"3.50.1"},"reference-count":45,"publisher":"MDPI AG","issue":"24","license":[{"start":{"date-parts":[[2024,12,20]],"date-time":"2024-12-20T00:00:00Z","timestamp":1734652800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"National Key Research and Development Program of China","award":["2022ZD0160401"],"award-info":[{"award-number":["2022ZD0160401"]}]},{"name":"National Key Research and Development Program of China","award":["62273282"],"award-info":[{"award-number":["62273282"]}]},{"name":"National Natural Science Foundation of China","award":["2022ZD0160401"],"award-info":[{"award-number":["2022ZD0160401"]}]},{"name":"National Natural Science Foundation of China","award":["62273282"],"award-info":[{"award-number":["62273282"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>In the field of remote sensing, cloud cover severely reduces the quality of satellite observations of the earth. Due to the complete absence of information in cloud-covered regions, cloud removal with a single optical image is an ill-posed problem. Since the synthetic aperture radar (SAR) can effectively penetrate clouds, fusing SAR and optical remote sensing images will effectively alleviate this problem. However, existing SAR-based optical cloud removal methods fail to effectively leverage the global information provided by the SAR image, resulting in limited performance gains. In this paper, we introduce a novel cloud removal method named the Multi-Level SAR-Guided Contextual Attention Network (MSGCA-Net). MSGCA-Net is designed with a multi-level architecture that integrates a SAR-Guided Contextual Attention (SGCA) module to fuse the dependable global contextual information from SAR images with the local features of optical images effectively. In the module of SGCA, the SAR image provides reliable global contextual information and genuine structure of cloud-covered regions, while the optical image provides the local feature information. The proposed model can efficiently extract and fuse global and local contextual information in SAR and optical images. We trained and evaluated the performance of the model on both simulated and real-world datasets. Both qualitative and quantitative experimental evaluation demonstrated that the proposed method can yield high quality cloud-free images and outperform state-of-the-art cloud removal methods.<\/jats:p>","DOI":"10.3390\/rs16244767","type":"journal-article","created":{"date-parts":[[2024,12,23]],"date-time":"2024-12-23T09:13:38Z","timestamp":1734945218000},"page":"4767","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":4,"title":["A Multi-Level SAR-Guided Contextual Attention Network for Satellite Images Cloud Removal"],"prefix":"10.3390","volume":"16","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-0868-9063","authenticated-orcid":false,"given":"Ganchao","family":"Liu","sequence":"first","affiliation":[{"name":"School of Artificial Intelligence, OPtics and ElectroNics (iOPEN), Northwestern Polytechnical University, Xi\u2019an 710072, China"}]},{"given":"Jiawei","family":"Qiu","sequence":"additional","affiliation":[{"name":"School of Artificial Intelligence, OPtics and ElectroNics (iOPEN), Northwestern Polytechnical University, Xi\u2019an 710072, China"}]},{"given":"Yuan","family":"Yuan","sequence":"additional","affiliation":[{"name":"School of Artificial Intelligence, OPtics and ElectroNics (iOPEN), Northwestern Polytechnical University, Xi\u2019an 710072, China"}]}],"member":"1968","published-online":{"date-parts":[[2024,12,20]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Lin, Z., and Leng, B. (2024). SSN: Scale Selection Network for Multi-Scale Object Detection in Remote Sensing Images. Remote Sens., 16.","DOI":"10.3390\/rs16193697"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Mo, N., and Zhu, R. (2024). Semi-Supervised Subcategory Centroid Alignment-Based Scene Classification for High-Resolution Remote Sensing Images. Remote Sens., 16.","DOI":"10.3390\/rs16193728"},{"key":"ref_3","first-page":"5618612","article-title":"VL-MFL: UAV Visual Localization Based on Multi-Source Image Feature Learning","volume":"62","author":"Liu","year":"2024","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Shen, J., Huo, C., and Xiang, S. (2024). Siamese InternImage for Change Detection. Remote Sens., 16.","DOI":"10.3390\/rs16193642"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"3826","DOI":"10.1109\/TGRS.2012.2227333","article-title":"Spatial and temporal distribution of clouds observed by MODIS onboard the Terra and Aqua satellites","volume":"51","author":"King","year":"2013","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"61","DOI":"10.1109\/MGRS.2015.2441912","article-title":"Missing information reconstruction of remote sensing data: A technical review","volume":"3","author":"Shen","year":"2015","journal-title":"IEEE Geosci. Remote Sens. Mag."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"2865","DOI":"10.1109\/TGRS.2019.2956959","article-title":"Thick Cloud Removal with Optical and SAR Imagery via Convolutional-Mapping-Deconvolutional Network","volume":"58","author":"Li","year":"2020","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"5103","DOI":"10.1080\/01431160701250416","article-title":"Gaps-fill of SLC-off Landsat ETM+ satellite image using a geostatistical approach","volume":"28","author":"Zhang","year":"2007","journal-title":"Int. J. Remote Sens."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"2363","DOI":"10.1109\/TGRS.2008.2010454","article-title":"A bandelet-based inpainting technique for clouds removal from remotely sensed images","volume":"47","author":"Maalouf","year":"2009","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"1492","DOI":"10.1109\/TGRS.2008.2005780","article-title":"A MAP-based algorithm for destriping and inpainting of remotely sensed images","volume":"47","author":"Shen","year":"2008","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"1200","DOI":"10.1109\/TIP.2004.833105","article-title":"Region filling and object removal by exemplar-based image inpainting","volume":"13","author":"Criminisi","year":"2004","journal-title":"IEEE Trans. Image Process."},{"key":"ref_12","first-page":"2672","article-title":"Generative adversarial nets","volume":"27","author":"Goodfellow","year":"2014","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"215","DOI":"10.1016\/j.isprsjprs.2019.01.025","article-title":"Thin cloud removal from optical remote sensing images using the noise-adjusted principal components transform","volume":"149","author":"Xu","year":"2019","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"183","DOI":"10.1016\/j.rse.2016.03.034","article-title":"An empirical and radiative transfer model based algorithm to remove thin clouds in visible bands","volume":"179","author":"Lv","year":"2016","journal-title":"Remote Sens. Environ."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Enomoto, K., Sakurada, K., Wang, W., Fukui, H., Matsuoka, M., Nakamura, R., and Kawaguchi, N. (2017, January 21\u201326). Filmy cloud removal on satellite imagery with multispectral conditional generative adversarial nets. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, Honolulu, HI, USA.","DOI":"10.1109\/CVPRW.2017.197"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"373","DOI":"10.1016\/j.isprsjprs.2020.06.021","article-title":"Thin cloud removal in optical remote sensing images based on generative adversarial networks and physical model of cloud distortion","volume":"166","author":"Li","year":"2020","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"232","DOI":"10.1109\/TGRS.2012.2197682","article-title":"Cloud removal from multitemporal satellite images using information cloning","volume":"51","author":"Lin","year":"2012","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"332","DOI":"10.1016\/j.rse.2004.03.014","article-title":"A simple method for reconstructing a high-quality NDVI time-series data set based on the Savitzky\u2013Golay filter","volume":"91","author":"Chen","year":"2004","journal-title":"Remote Sens. Environ."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"7086","DOI":"10.1109\/TGRS.2014.2307354","article-title":"Recovering quantitative remote sensing products contaminated by thick clouds and shadows using multitemporal dictionary learning","volume":"52","author":"Li","year":"2014","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"147","DOI":"10.1023\/A:1006790026612","article-title":"Principles of synthetic aperture radar","volume":"21","author":"Bamler","year":"2000","journal-title":"Surv. Geophys."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"333","DOI":"10.1016\/j.isprsjprs.2020.05.013","article-title":"Cloud Removal in Sentinel-2 Imagery Using a Deep Residual Neural Network and SAR-optical Data Fusion","volume":"166","author":"Meraner","year":"2020","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"182","DOI":"10.1016\/j.rse.2012.12.012","article-title":"Recovering missing pixels for Landsat ETM+ SLC-off imagery using multi-temporal regression analysis and a regularization method","volume":"131","author":"Zeng","year":"2013","journal-title":"Remote Sens. Environ."},{"key":"ref_23","first-page":"1","article-title":"Multimodal and Multiresolution Data Fusion for High-Resolution Cloud Removal: A Novel Baseline and Benchmark","volume":"62","author":"Xu","year":"2024","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_24","first-page":"1","article-title":"DiffCR: A Fast Conditional Diffusion Framework for Cloud Removal From Optical Satellite Images","volume":"62","author":"Zou","year":"2024","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Grohnfeldt, C., Schmitt, M., and Zhu, X. (2018, January 22\u201327). A Conditional Generative Adversarial Network to Fuse Sar and Multispectral Optical Data for Cloud Removal from Sentinel-2 Images. Proceedings of the IGARSS 2018\u20142018 IEEE International Geoscience and Remote Sensing Symposium, IEEE, Valencia, Spain.","DOI":"10.1109\/IGARSS.2018.8519215"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Gao, J., Yuan, Q., Li, J., Zhang, H., and Su, X. (2020). Cloud Removal with Fusion of High Resolution Optical and SAR Images Using Generative Adversarial Networks. Remote Sens., 12.","DOI":"10.3390\/rs12010191"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1109\/TGRS.2021.3131035","article-title":"Cloud Removal in Remote Sensing Images Using Generative Adversarial Networks and SAR-to-Optical Image Translation","volume":"60","author":"Darbaghshahi","year":"2022","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Yu, J., Lin, Z., Yang, J., Shen, X., Lu, X., and Huang, T.S. (2018, January 18\u201323). Generative Image Inpainting with Contextual Attention. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00577"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Zeng, Y., Lin, Z., Lu, H., and Patel, V.M. (2021, January 11\u201317). CR-Fill: Generative Image Inpainting with Auxiliary Contextual Reconstruction. Proceedings of the IEEE\/CVF International Conference on Computer Vision, Montreal, BC, Canada.","DOI":"10.1109\/ICCV48922.2021.01390"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Yi, Z., Tang, Q., Azizi, S., Jang, D., and Xu, Z. (2020, January 13\u201319). Contextual Residual Aggregation for Ultra High-Resolution Image Inpainting. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.00753"},{"key":"ref_31","first-page":"5998","article-title":"Attention is all you need","volume":"30","author":"Vaswani","year":"2017","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"268","DOI":"10.1016\/j.isprsjprs.2022.08.002","article-title":"GLF-CR: SAR-enhanced cloud removal with global\u2013local fusion","volume":"192","author":"Xu","year":"2022","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Han, S., Wang, J., and Zhang, S. (2023). Former-CR: A Transformer-Based Thick Cloud Removal Method with Optical and SAR Imagery. Remote Sens., 15.","DOI":"10.3390\/rs15051196"},{"key":"ref_34","unstructured":"Gu, A., and Dao, T. (2023). Mamba: Linear-time sequence modeling with selective state spaces. arXiv."},{"key":"ref_35","unstructured":"Gu, A., Goel, K., and R\u00e9, C. (2021). Efficiently modeling long sequences with structured state spaces. arXiv."},{"key":"ref_36","unstructured":"Zhu, L., Liao, B., Zhang, Q., Wang, X., Liu, W., and Wang, X. (2024). Vision mamba: Efficient visual representation learning with bidirectional state space model. arXiv."},{"key":"ref_37","unstructured":"Liu, Y., Tian, Y., Zhao, Y., Yu, H., Xie, L., Wang, Y., Ye, Q., and Liu, Y. (2024). VMamba: Visual State Space Model. arXiv."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Zhao, S., Chen, H., Zhang, X., Xiao, P., Bai, L., and Ouyang, W. (2024). Rs-mamba for large remote sensing image dense prediction. arXiv.","DOI":"10.1109\/TGRS.2024.3425540"},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Avidan, S., Brostow, G., Ciss\u00e9, M., Farinella, G.M., and Hassner, T. (2022, January 23\u201327). Simple Baselines for Image Restoration. Proceedings of the Computer Vision\u2013ECCV, Tel Aviv, Israel. Lecture Notes in Computer Science.","DOI":"10.1007\/978-3-031-20068-7"},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Li, W., Lin, Z., Zhou, K., Qi, L., Wang, Y., and Jia, J. (2022, January 18\u201324). MAT: Mask-Aware Transformer for Large Hole Image Inpainting. Proceedings of the 2022 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), New Orleans, LA, USA.","DOI":"10.1109\/CVPR52688.2022.01049"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Guo, X., Yang, H., and Huang, D. (2021, January 11\u201317). Image Inpainting via Conditional Texture and Structure Dual Generation. Proceedings of the IEEE\/CVF International Conference on Computer Vision, Montreal, BC, Canada.","DOI":"10.1109\/ICCV48922.2021.01387"},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Huang, M., Xu, Y., Qian, L., Shi, W., Zhang, Y., Bao, W., Wang, N., Liu, X., and Xiang, X. (2021). The QXS-SAROPT Dataset for Deep Learning in SAR-Optical Data Fusion. arXiv.","DOI":"10.34133\/2021\/9841456"},{"key":"ref_43","unstructured":"Pan, H. (2020). Cloud Removal for Remote Sensing Imagery via Spatial Attention Generative Adversarial Network. arXiv."},{"key":"ref_44","unstructured":"Xu, F., Shi, Y., Ebel, P., Yang, W., and Zhu, X.X. (2023). High-resolution cloud removal with multi-modal and multi-resolution data fusion: A new baseline and benchmark. arXiv."},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Zhang, Y., Tian, Y., Kong, Y., Zhong, B., and Fu, Y. (2018, January 18\u201323). Residual Dense Network for Image Super-Resolution. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00262"}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/16\/24\/4767\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T16:57:09Z","timestamp":1760115429000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/16\/24\/4767"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,12,20]]},"references-count":45,"journal-issue":{"issue":"24","published-online":{"date-parts":[[2024,12]]}},"alternative-id":["rs16244767"],"URL":"https:\/\/doi.org\/10.3390\/rs16244767","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,12,20]]}}}