{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T04:04:10Z","timestamp":1760241850726,"version":"build-2065373602"},"reference-count":39,"publisher":"MDPI AG","issue":"10","license":[{"start":{"date-parts":[[2018,9,28]],"date-time":"2018-09-28T00:00:00Z","timestamp":1538092800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"the National Key Research and Development Program","award":["2017YFB0503603"],"award-info":[{"award-number":["2017YFB0503603"]}]},{"name":"the National Natural Science Fund of China","award":["41631179 and 41301473"],"award-info":[{"award-number":["41631179 and 41301473"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Clouds, cloud shadows (CCS), and numerous other factors will cause a missing data problem in passive remote sensing images. A well-known reconstruction method is the selection of a similar pixel (with an additional clear reference image) from the remaining clear part of an image to replace the missing pixel. Due to the merit of filling the missing value using a pixel acquired on the same image with the same sensor and the same date, this method is suitable for time-series applications when a time-series profile-based similar measure is utilized for selecting the similar pixel. Since the similar pixel is independently selected, the improper reference pixel or various accuracies obtained by different land covers causes the problem of salt-and-pepper noise in the reconstructed part of an image. To overcome these problems, this paper presents a spectral\u2013temporal patch (STP)-based missing area reconstruction method for time-series images. First, the STP, the pixels of which have similar spectral and temporal evolution characteristics, is extracted using multi-temporal image segmentation. However, some STP have Missing Observations (STPMO) in the time series, which should be reconstructed. Next, for an STPMO, the most similar STP is selected as the reference STP; then, the mean and standard deviation of the STPMO is predicted using a linear regression method with the reference STP. Finally, the textural information, which is denoted by the spatial configuration of color or intensities of neighboring pixels, is extracted from the clear temporal-adjacent STP and \u201cinjected\u201d into the missing area to obtain synthetic cloud-free images. We performed an STP-based missing area reconstruction experiment in Jiangzhou, Chongzuo, Guangxi with time-series images acquired by wide field view (WFV) onboard Chinese Gao Fen 1 on 12 different dates. The results indicate that the proposed method can effectively recover the missing information without salt-and-pepper noise in the reconstructed area; also, the reconstructed part of the image is consistent with the clear part without a false edge. The results confirm that the spectral information from the remaining clear part of the same image and textural information from the temporal-adjacent image can create seamless time-series images.<\/jats:p>","DOI":"10.3390\/rs10101560","type":"journal-article","created":{"date-parts":[[2018,9,28]],"date-time":"2018-09-28T10:31:28Z","timestamp":1538130688000},"page":"1560","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":17,"title":["A Spectral\u2013Temporal Patch-Based Missing Area Reconstruction for Time-Series Images"],"prefix":"10.3390","volume":"10","author":[{"given":"Wei","family":"Wu","sequence":"first","affiliation":[{"name":"College of Computer Science and Technology, Zhejiang University of Technology, Hangzhou 310014, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Luoqi","family":"Ge","sequence":"additional","affiliation":[{"name":"College of Computer Science and Technology, Zhejiang University of Technology, Hangzhou 310014, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jiancheng","family":"Luo","sequence":"additional","affiliation":[{"name":"Institute of Remote Sensing and Digital Earth, Chinese Academy of Sciences, Beijing 100101, China"},{"name":"University of Chinese Academy of Sciences, Beijing 100049, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ruohong","family":"Huan","sequence":"additional","affiliation":[{"name":"College of Computer Science and Technology, Zhejiang University of Technology, Hangzhou 310014, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9345-0075","authenticated-orcid":false,"given":"Yingpin","family":"Yang","sequence":"additional","affiliation":[{"name":"Institute of Remote Sensing and Digital Earth, Chinese Academy of Sciences, Beijing 100101, China"},{"name":"University of Chinese Academy of Sciences, Beijing 100049, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2018,9,28]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"839","DOI":"10.1080\/01431168708948693","article-title":"The effect of subpixel clouds on remote sensing","volume":"8","author":"Kaufman","year":"1987","journal-title":"Int. J. Remote Sens."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"173","DOI":"10.1016\/S0034-4257(02)00034-2","article-title":"An image transform to characterize and compensate for spatial variations in thin cloud contamination of Landsat images","volume":"82","author":"Zhang","year":"2002","journal-title":"Remote Sens. Environ."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"35","DOI":"10.1016\/j.rse.2018.02.045","article-title":"A high-performance and in-season classification system of field-level crop types using time-series Landsat data and a machine learning approach","volume":"210","author":"Cai","year":"2018","journal-title":"Remote Sens. Environ."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"183","DOI":"10.1016\/j.rse.2009.08.017","article-title":"An automated approach for reconstructing recent forest disturbance history using dense Landsat time series stacks","volume":"114","author":"Huang","year":"2010","journal-title":"Remote Sens. Environ."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"49","DOI":"10.1016\/j.rse.2018.05.005","article-title":"Mapping the timing of cropland abandonment and recultivation in northern Kazakhstan using annual Landsat time series","volume":"213","author":"Dara","year":"2018","journal-title":"Remote Sens. Environ."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"478","DOI":"10.1016\/j.rse.2014.11.024","article-title":"Improved time series land cover classification by missing-observation-adaptive nonlinear dimensionality reduction","volume":"158","author":"Yan","year":"2015","journal-title":"Remote Sens. Environ."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"1417","DOI":"10.1080\/01431168608948945","article-title":"Characteristics of maximum-value composite images from temporal AVHRR data","volume":"7","author":"Holben","year":"1986","journal-title":"Int. J. Remote Sens."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"3340","DOI":"10.1109\/TGRS.2012.2183137","article-title":"Fitting the multitemporal curve: A fourier series approach to the missing data problem in remote sensing analysis","volume":"50","author":"Brooks","year":"2012","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_9","first-page":"202","article-title":"Smoothing and gap-filling of high resolution multi-spectral time series: Example of Landsat data","volume":"57","author":"Vuolo","year":"2017","journal-title":"Int. J. Appl. Earth Obs. Geoinf."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"5339","DOI":"10.1080\/01431160601034902","article-title":"A multi-scale segmentation approach to filling gaps in Landsat ETM+ SLC-off images","volume":"28","author":"Maxwell","year":"2007","journal-title":"Int. J. Remote Sens."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"2173","DOI":"10.1080\/01431160802549294","article-title":"Restoration of clouded pixels in multispectral remotely sensed imagery with cokriging","volume":"30","author":"Zhang","year":"2009","journal-title":"Int. J. Remote Sens."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"2363","DOI":"10.1109\/TGRS.2008.2010454","article-title":"A Bandelet-Based inpainting technique for clouds removal from remotely sensed images","volume":"47","author":"Maalouf","year":"2009","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"1079","DOI":"10.14358\/PERS.71.9.1079","article-title":"Cloud-free satellite image mosaics with regression trees and histrogram matching","volume":"71","author":"Helmer","year":"2005","journal-title":"Photogramm. Eng. Remote Sens."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"325","DOI":"10.5589\/m07-028","article-title":"A comparison of radiometric normalization methods when filling cloud gaps in Landsat imagery","volume":"33","author":"Helmer","year":"2007","journal-title":"Can. J. Remote Sens."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"442","DOI":"10.1109\/TGRS.2005.861929","article-title":"Contextual reconstruction of cloud-contaminated multitemporal multispectral images","volume":"44","author":"Melgani","year":"2006","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"232","DOI":"10.1109\/TGRS.2012.2197682","article-title":"Cloud removal from multitemporal satellite images using information cloning","volume":"51","author":"Lin","year":"2013","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"3998","DOI":"10.1109\/TGRS.2012.2227329","article-title":"Missing-Area reconstruction in multispectral images under a compressive sensing perspective","volume":"51","author":"Lorenzi","year":"2013","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"521","DOI":"10.1109\/LGRS.2011.2173290","article-title":"A modified neighborhood similar pixel interpolator approach for removing thick clouds in Landsat images","volume":"9","author":"Zhu","year":"2012","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"54","DOI":"10.1016\/j.isprsjprs.2014.02.015","article-title":"Cloud removal for remotely sensed images by similar pixel replacement guided with a spatio-temporal MRF model","volume":"92","author":"Cheng","year":"2014","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"252","DOI":"10.1109\/TGRS.2015.2453955","article-title":"A multitemporal profile-based interpolation method for gap filling nonstationary data","volume":"54","author":"Malambo","year":"2016","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Yan, L., and Roy, D.P. (2018). Large-area gap filling of Landsat reflectance time series by spectral-angle-mapper based spatio-temporal similarity (SAMSTS). Remote Sens., 10.","DOI":"10.3390\/rs10040609"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"3656","DOI":"10.1109\/TGRS.2017.2656162","article-title":"Multitemporal Landsat missing data recovery based on tempo-spectral angle model","volume":"55","author":"Gao","year":"2017","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"27","DOI":"10.1109\/TGRS.2016.2580576","article-title":"Spatially and temporally weighted regression: A novel method to produce continuous cloud-free landsat imagery","volume":"55","author":"Chen","year":"2017","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"979","DOI":"10.1016\/j.rse.2017.07.036","article-title":"Reconstruction of Landsat time series in the presence of irregular and sparse observations: Development and assessment in north-eastern Alberta, Canada","volume":"204","author":"Pouliot","year":"2018","journal-title":"Remote Sens. Environ."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"2","DOI":"10.1016\/j.isprsjprs.2009.06.004","article-title":"Object based image analysis for remote sensing","volume":"65","author":"Blaschke","year":"2010","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"969","DOI":"10.1109\/TIP.2005.863958","article-title":"Seamless image stitching by minimizing false edges","volume":"15","author":"Zomet","year":"2006","journal-title":"IEEE Trans. Image Process."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"673","DOI":"10.1109\/TPAMI.2006.99","article-title":"Morphological image compositing","volume":"28","author":"Soille","year":"2006","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_28","unstructured":"Shapiro, L.G., and Stockman, G.C. (2001). Computer Vision, Prentice-Hall."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"4454","DOI":"10.1109\/TGRS.2012.2190079","article-title":"Best merge region-growing segmentation with integrated nonadjacent region object aggregation","volume":"50","author":"Tilton","year":"2012","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"2781","DOI":"10.1109\/TIP.2010.2049528","article-title":"An edge embedded marker-based watershed algorithm for high spatial resolution remote sensing image segmentation","volume":"19","author":"Li","year":"2010","journal-title":"IEEE Trans. Image Process."},{"key":"ref_31","first-page":"112","article-title":"Reconstructing land use history from Landsat time-series: Case study of a swidden agriculture system in Brazil","volume":"47","author":"Dutrieux","year":"2016","journal-title":"Int. J. Appl. Earth Obs. Geoinf."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"603","DOI":"10.1109\/34.1000236","article-title":"Mean shift: A robust approach toward feature space analysis","volume":"24","author":"Comaniciu","year":"2002","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"952","DOI":"10.1109\/TGRS.2014.2330857","article-title":"Stable mean-shift algorithm and its application to the segmentation of arbitrarily large remote sensing images","volume":"53","author":"Michel","year":"2015","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.rse.2006.01.013","article-title":"Forest change detection by statistical object-based method","volume":"102","author":"Bogaert","year":"2006","journal-title":"Remote Sens. Environ."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1016\/j.compag.2004.06.003","article-title":"Determining temporal windows for crop discrimination with remote sensing: A case study in south-eastern Australia","volume":"45","author":"Mcvicar","year":"2004","journal-title":"Comput. Electron. Agric."},{"key":"ref_36","first-page":"229","article-title":"Climate suitability analysis for sugarcane planting in Chongzuo city","volume":"3","author":"Leng","year":"2015","journal-title":"Agric. Environ. Resour."},{"key":"ref_37","first-page":"121","article-title":"Analysis on potential productivity of sugarcane in Guangxi Province Based on AEZ Model","volume":"21","author":"Wang","year":"2015","journal-title":"Crops"},{"key":"ref_38","first-page":"119","article-title":"The present situation, problems and countermeasures of sugarcane cultivation in Guangxi","volume":"38","author":"Li","year":"2018","journal-title":"Chin. J. Trop. Agric."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"28","DOI":"10.1016\/j.isprsjprs.2015.04.010","article-title":"Scale parameter selection by spatial statistics for GeOBIA: Using mean-shift based multi-scale segmentation as an example","volume":"106","author":"Ming","year":"2015","journal-title":"ISPRS J. Photogramm. Remote Sens."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/10\/10\/1560\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T15:22:57Z","timestamp":1760196177000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/10\/10\/1560"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,9,28]]},"references-count":39,"journal-issue":{"issue":"10","published-online":{"date-parts":[[2018,10]]}},"alternative-id":["rs10101560"],"URL":"https:\/\/doi.org\/10.3390\/rs10101560","relation":{},"ISSN":["2072-4292"],"issn-type":[{"type":"electronic","value":"2072-4292"}],"subject":[],"published":{"date-parts":[[2018,9,28]]}}}