{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,9]],"date-time":"2026-06-09T15:43:35Z","timestamp":1781019815298,"version":"3.54.1"},"reference-count":47,"publisher":"MDPI AG","issue":"20","license":[{"start":{"date-parts":[[2020,10,20]],"date-time":"2020-10-20T00:00:00Z","timestamp":1603152000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["91738301, 41971422"],"award-info":[{"award-number":["91738301, 41971422"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"name":"land and resources research plan of Hubei Province[2018]","award":["844-11"],"award-info":[{"award-number":["844-11"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>In remote sensing images, the presence of thick cloud accompanying shadow can affect the quality of subsequent processing and limit the scenarios of application. Hence, to make good use of such images, it is indispensable to remove the thick cloud and cloud shadow as well as recover the cloud-contaminated pixels. Generally, the thick cloud and cloud shadow element are not only sparse but also smooth along the spatial horizontal and vertical direction, while the clean element is smooth along the temporal direction. Guided by the above insight, a novel thick cloud removal method for remote sensing images based on temporal smoothness and sparsity regularized tensor optimization (TSSTO) is proposed in this paper. Firstly, the sparsity norm is utilized to boost the sparsity of the cloud and cloud shadow element, and unidirectional total variation (UTV) regularizers are applied to ensure the smoothness in different directions. Then, through thresholding, the cloud mask and the cloud shadow mask can be acquired and used to guide the substitution. Finally, the reference image is selected to reconstruct details of the repairing area. A series of experiments are conducted both on simulated and real cloud-contaminated images from different sensors and with different resolutions, and the results demonstrate the potential of the proposed TSSTO method for removing cloud and cloud shadow from both qualitative and quantitative viewpoints.<\/jats:p>","DOI":"10.3390\/rs12203446","type":"journal-article","created":{"date-parts":[[2020,10,20]],"date-time":"2020-10-20T09:28:23Z","timestamp":1603186103000},"page":"3446","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":42,"title":["Thick Cloud Removal of Remote Sensing Images Using Temporal Smoothness and Sparsity Regularized Tensor Optimization"],"prefix":"10.3390","volume":"12","author":[{"given":"Chenxi","family":"Duan","sequence":"first","affiliation":[{"name":"State Key Laboratory of Information Engineering in Surveying, Mapping and Remote Sensing, Wuhan University, 129 Luoyu Road, Wuhan 430079, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6756-0692","authenticated-orcid":false,"given":"Jun","family":"Pan","sequence":"additional","affiliation":[{"name":"State Key Laboratory of Information Engineering in Surveying, Mapping and Remote Sensing, Wuhan University, 129 Luoyu Road, Wuhan 430079, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7858-3160","authenticated-orcid":false,"given":"Rui","family":"Li","sequence":"additional","affiliation":[{"name":"School of Remote Sensing and Information Engineering, Wuhan University, Wuhan 430079, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2020,10,20]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Li, R., Zheng, S., Duan, C., Yang, Y., and Wang, X. (2020). Classification of hyperspectral image based on double-branch dual-attention mechanism network. Remote Sens., 12.","DOI":"10.20944\/preprints201912.0059.v2"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"127","DOI":"10.1080\/10095020.2017.1399674","article-title":"Object-based classification of hyperspectral data using Random Forest algorithm","volume":"21","author":"Amini","year":"2018","journal-title":"Geo-Spat. Inf. Sci."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"2053","DOI":"10.1109\/JSTARS.2015.2404578","article-title":"Object detection based on sparse representation and Hough voting for optical remote sensing imagery","volume":"8","author":"Yokoya","year":"2015","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Inglada, J., Vincent, A., Arias, M., Tardy, B., Morin, D., and Rodes, I. (2017). Operational high resolution land cover map production at the country scale using satellite image time series. Remote Sens., 9.","DOI":"10.3390\/rs9010095"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Li, Z., Shen, H., Cheng, Q., Li, W., and Zhang, L. (2019). Thick cloud removal in high-resolution satellite images using stepwise radiometric adjustment and residual correction. Remote Sens., 11.","DOI":"10.3390\/rs11161925"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"32","DOI":"10.1016\/0034-4257(94)90057-4","article-title":"Kriging in the shadows: Geostatistical interpolation for remote sensing","volume":"49","author":"Rossi","year":"1994","journal-title":"Remote Sens. Environ."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"5644","DOI":"10.1080\/01431161.2012.666363","article-title":"Remote-sensing image analysis and geostatistics","volume":"33","year":"2012","journal-title":"Int. J. Remote Sens."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"1200","DOI":"10.1109\/TIP.2004.833105","article-title":"Region filling and object removal by exemplar-based image inpainting","volume":"13","author":"Criminisi","year":"2004","journal-title":"IEEE Trans. Image Process."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"2363","DOI":"10.1109\/TGRS.2008.2010454","article-title":"A bandelet-based inpainting technique for clouds removal from remotely sensed images","volume":"47","author":"Maalouf","year":"2009","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_10","first-page":"1490","article-title":"A MAP-based algorithm for destriping and inpainting of remotely sensed images","volume":"47","author":"Shen","year":"2009","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"1163","DOI":"10.1109\/LSP.2017.2703092","article-title":"Missing information reconstruction for single remote sensing images using structure-preserving global optimization","volume":"24","author":"Cheng","year":"2017","journal-title":"IEEE Signal Process. Lett."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"182","DOI":"10.1016\/j.rse.2012.12.012","article-title":"Recovering missing pixels for Landsat ETM+ SLC-off imagery using multi-temporal regression analysis and a regularization method","volume":"131","author":"Zeng","year":"2013","journal-title":"Remote Sens. Environ."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"208","DOI":"10.1109\/TPAMI.2012.39","article-title":"Tensor completion for estimating missing values in visual data","volume":"35","author":"Liu","year":"2013","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"54","DOI":"10.1016\/j.isprsjprs.2014.02.015","article-title":"Cloud removal for remotely sensed images by similar pixel replacement guided with a spatio-temporal mrf model","volume":"92","author":"Cheng","year":"2014","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"613","DOI":"10.1109\/TGRS.2008.2003436","article-title":"Restoration of aqua MODIS band 6 using histogram matching and local least squares fitting","volume":"47","author":"Rakwatin","year":"2009","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"185","DOI":"10.1109\/JSTARS.2010.2077620","article-title":"Recovering reflectance of AQUA MODIS band 6 based on within-class local fitting","volume":"4","author":"Shen","year":"2011","journal-title":"IEEE J. Sel. Top. Appl. Earth Observ. Remote Sens."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"2409","DOI":"10.1109\/TGRS.2011.2173499","article-title":"Quantitative restoration for MODIS band 6 on aqua","volume":"50","author":"Gladkova","year":"2012","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"947","DOI":"10.14358\/PERS.78.9.947","article-title":"A variational gradient-based fusion method for visible and SWIR imagery","volume":"78","author":"Li","year":"2012","journal-title":"Photogramm. Eng. Remote Sens."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"173","DOI":"10.1016\/S0034-4257(02)00034-2","article-title":"An image transform to characterize and compensate for spatial variations in thin cloud contamination of Landsat images","volume":"82","author":"Zhang","year":"2002","journal-title":"Remote Sens. Environ."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"2270","DOI":"10.1109\/TGRS.2017.2777886","article-title":"Reconstructing cloud-contaminated multispectral images with contextualized autoencoder neural networks","volume":"56","author":"Malek","year":"2018","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_21","unstructured":"Storey, J., Scaramuzza, P., Schmidt, G., and Barsi, J. (2005, January 23\u201327). Landsat 7 scan line corrector-off gap-filled product development. Proceedings of the Pecora 16 Conference on Global Priorities in Land Remote Sensing, Sioux Falls, SD, USA."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Zhang, X., Qin, F., and Qin, Y. (2010, January 29\u201331). Study on the thick cloud removal method based on multi-temporal remote sensing images. Proceedings of the 2010 International Conference on Multimedia Technology, Ningbo, China.","DOI":"10.1109\/ICMULT.2010.5631017"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Du, W., Qin, Z., Fan, J., Gao, M., Wang, F., and Abbasi, B. (2019). An efficient approach to remove thick cloud in VNIR bands of multi-temporal remote sensing images. Remote Sens., 11.","DOI":"10.3390\/rs11111284"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"30","DOI":"10.1016\/j.isprsjprs.2018.04.005","article-title":"A two-step framework for reconstructing remotely sensed land surface temperatures contaminated by cloud","volume":"141","author":"Zeng","year":"2018","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"232","DOI":"10.1109\/TGRS.2012.2197682","article-title":"Cloud removal from multitemporal satellite images using information cloning","volume":"51","author":"Lin","year":"2012","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"163","DOI":"10.1109\/TGRS.2012.2237408","article-title":"Patch-based information reconstruction of cloud-contaminated multitemporal images","volume":"52","author":"Lin","year":"2013","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"1090","DOI":"10.1109\/LGRS.2018.2829028","article-title":"Two-pass robust component analysis for cloud removal in satellite image sequence","volume":"15","author":"Wen","year":"2018","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"5963","DOI":"10.1109\/TGRS.2019.2903594","article-title":"A Coarse-to-Fine Framework for Cloud Removal in Remote Sensing Image Sequence","volume":"57","author":"Zhang","year":"2019","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"7086","DOI":"10.1109\/TGRS.2014.2307354","article-title":"Recovering quantitative remote sensing products contaminated by thick clouds and shadows using multitemporal dictionary learning","volume":"52","author":"Li","year":"2014","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.isprsjprs.2015.03.009","article-title":"Sparse-based reconstruction of missing information in remote sensing images from spectral\/temporal complementary information","volume":"106","author":"Li","year":"2015","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"3629","DOI":"10.1109\/JSTARS.2016.2533547","article-title":"Patch matching-based multitemporal group sparse representation for the missing information reconstruction of remote-sensing images","volume":"9","author":"Li","year":"2016","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"2998","DOI":"10.1109\/TGRS.2015.2509860","article-title":"Cloud removal based on sparse representation via multitemporal dictionary learning","volume":"54","author":"Xu","year":"2016","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"103","DOI":"10.1016\/j.isprsjprs.2018.12.013","article-title":"Cloud removal in remote sensing images using nonnegative matrix factorization and error correction","volume":"148","author":"Li","year":"2019","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"3367","DOI":"10.1109\/TGRS.2017.2670021","article-title":"An adaptive weighted tensor completion method for the recovery of remote sensing images with missing data","volume":"55","author":"Ng","year":"2017","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"142339","DOI":"10.1109\/ACCESS.2019.2944577","article-title":"Missing Data Reconstruction for Remote Sensing Images with Weighted Low-Rank Tensor Model","volume":"7","author":"Cheng","year":"2019","journal-title":"IEEE Access"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"3047","DOI":"10.1109\/TGRS.2018.2790262","article-title":"Nonlocal tensor completion for multitemporal remotely sensed images\u2019 inpainting","volume":"56","author":"Ji","year":"2017","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"93","DOI":"10.1016\/j.isprsjprs.2019.09.003","article-title":"Blind cloud and cloud shadow removal of multitemporal images based on total variation regularized low-rank sparsity decomposition","volume":"157","author":"Chen","year":"2019","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"4274","DOI":"10.1109\/TGRS.2018.2810208","article-title":"Missing data reconstruction in remote sensing image with a unified spatial-temporal-spectral deep convolutional neural network","volume":"56","author":"Zhang","year":"2018","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Boyd, S., Parikh, N., Chu, E., Peleato, B., and Eckstein, J. (2010). Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers. Foundations and Trends in Machine Learning, Now Publishers Inc.","DOI":"10.1561\/2200000016"},{"key":"ref_40","unstructured":"Lin, Z., Chen, M., and Ma, Y. (2010). The augmented Lagrange multiplier method for exact recovery of corrupted low-rank matrices. arXiv."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Deng, W., Yin, W.-T., and Zhang, Y. (2013, January 25\u201329). Group sparse optimization by alternating direction method. Proceedings of the International Society of Optics and Photonics (SPIE), San Diego, CA, USA.","DOI":"10.21236\/ADA585746"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"313","DOI":"10.1145\/882262.882269","article-title":"Poisson image editing","volume":"22","author":"Gangnet","year":"2003","journal-title":"ACM Trans. Graph."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"600","DOI":"10.1109\/TIP.2003.819861","article-title":"Image quality assessment: From error visibility to structural similarity","volume":"13","author":"Wang","year":"2004","journal-title":"IEEE Trans. Image Process."},{"key":"ref_44","unstructured":"Wang, Z., Simoncelli, E.P., and Bovik, A.C. (2013, January 9\u201312). Multi-scale structural similarity for image quality assessment. Proceedings of the Thirty-Seventh Asilomar Conference on Signals, Systems and Computers 2003, Pacific Grove, CA, USA."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"1185","DOI":"10.1109\/TIP.2010.2092435","article-title":"Information Content Weighting for Perceptual Image Quality Assessment","volume":"20","author":"Wang","year":"2011","journal-title":"IEEE Trans. Image Process."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"1301","DOI":"10.1109\/TNNLS.2017.2649101","article-title":"Learning a No-Reference Quality Assessment Model of Enhanced Images with Big Data","volume":"29","author":"Gu","year":"2018","journal-title":"IEEE Trans. Neural Netw. Learn. Syst."},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Ying, Z., Niu, H., Gupta, P., Mahajan, D., Ghadiyaram, D., and Bovik, A. (2020, January 13\u201319). From Patches to Pictures (PaQ-2-PiQ): Mapping the Perceptual Space of Picture Quality. Proceedings of the 2020 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.00363"}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/12\/20\/3446\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T10:24:37Z","timestamp":1760178277000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/12\/20\/3446"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,10,20]]},"references-count":47,"journal-issue":{"issue":"20","published-online":{"date-parts":[[2020,10]]}},"alternative-id":["rs12203446"],"URL":"https:\/\/doi.org\/10.3390\/rs12203446","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,10,20]]}}}