{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,7]],"date-time":"2025-11-07T09:39:38Z","timestamp":1762508378101,"version":"build-2065373602"},"reference-count":47,"publisher":"MDPI AG","issue":"4","license":[{"start":{"date-parts":[[2021,2,8]],"date-time":"2021-02-08T00:00:00Z","timestamp":1612742400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100004663","name":"Ministry of Science and Technology, Taiwan","doi-asserted-by":"publisher","award":["MOST 108 - 2628 - E - 009 - 002 - MY3"],"award-info":[{"award-number":["MOST 108 - 2628 - E - 009 - 002 - MY3"]}],"id":[{"id":"10.13039\/501100004663","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>The spatiotemporal fusion technique has the advantages of generating time-series images with high-spatial and high-temporal resolution from coarse-resolution to fine-resolution images. A hybrid fusion method that integrates image blending (i.e., spatial and temporal adaptive reflectance fusion model, STARFM) and super-resolution (i.e., very deep super resolution, VDSR) techniques for the spatiotemporal fusion of 8 m Formosat-2 and 30 m Landsat-8 satellite images is proposed. Two different fusion approaches, namely Blend-then-Super-Resolution and Super-Resolution (SR)-then-Blend, were developed to improve the results of spatiotemporal fusion. The SR-then-Blend approach performs SR before image blending. The SR refines the image resampling stage on generating the same pixel-size of coarse- and fine-resolution images. The Blend-then-SR approach is aimed at refining the spatial details after image blending. Several quality indices were used to analyze the quality of the different fusion approaches. Experimental results showed that the performance of the hybrid method is slightly better than the traditional approach. Images obtained using SR-then-Blend are more similar to the real observed images compared with images acquired using Blend-then-SR. The overall mean bias of SR-then-Blend was 4% lower than Blend-then-SR, and nearly 3% improvement for overall standard deviation in SR-B. The VDSR technique reduces the systematic deviation in spectral band between Formosat-2 and Landsat-8 satellite images. The integration of STARFM and the VDSR model is useful for improving the quality of spatiotemporal fusion.<\/jats:p>","DOI":"10.3390\/rs13040606","type":"journal-article","created":{"date-parts":[[2021,2,10]],"date-time":"2021-02-10T04:33:46Z","timestamp":1612931626000},"page":"606","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":9,"title":["Spatiotemporal Fusion of Formosat-2 and Landsat-8 Satellite Images: A Comparison of \u201cSuper Resolution-Then-Blend\u201d and \u201cBlend-Then-Super Resolution\u201d Approaches"],"prefix":"10.3390","volume":"13","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-7625-5662","authenticated-orcid":false,"given":"Tee-Ann","family":"Teo","sequence":"first","affiliation":[{"name":"Department of Civil Engineering, National Yang Ming Chiao Tung University, No. 1001, Daxue Rd., East District, Hsinchu City 300, Taiwan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yu-Ju","family":"Fu","sequence":"additional","affiliation":[{"name":"Department of Civil Engineering, National Yang Ming Chiao Tung University, No. 1001, Daxue Rd., East District, Hsinchu City 300, Taiwan"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2021,2,8]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"366","DOI":"10.1016\/j.rse.2005.03.008","article-title":"A Crop phenology detection method using time-series MODIS data","volume":"96","author":"Sakamoto","year":"2005","journal-title":"Remote Sens. Environ."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"108","DOI":"10.1016\/j.rse.2016.04.011","article-title":"Landsat 8: Providing continuity and increased precision for measuring multi-decadal time series of total suspended matter","volume":"185","author":"Lymburner","year":"2016","journal-title":"Remote Sens. Environ."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"235","DOI":"10.1080\/14498596.2016.1266972","article-title":"Delineating and predicting changes in rice cropping systems using multi-temporal MODIS data in myanmar","volume":"62","author":"Son","year":"2017","journal-title":"J. Spat. Sci."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"556","DOI":"10.1038\/s41561-018-0166-9","article-title":"Highland cropland expansion and forest loss in Southeast Asia in the twenty-first century","volume":"11","author":"Zeng","year":"2018","journal-title":"Nat. Geosci."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"042605","DOI":"10.1117\/1.JRS.12.042605","article-title":"Improving the image fusion procedure for high spatiotemporal aerosol optical depth retrieval: A case study of urban area in Taiwan","volume":"12","author":"Huang","year":"2018","journal-title":"J. Appl. Remote Sens."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"436","DOI":"10.1038\/nature14539","article-title":"Deep learning","volume":"521","author":"LeCun","year":"2015","journal-title":"Nature"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Li, H., Wu, X.J., and Kittler, J. (2018, January 20\u201324). Infrared and visible image fusion using a deep learning framework. Proceedings of the International Conference on Pattern Recognition, Beijing, China.","DOI":"10.1109\/ICPR.2018.8546006"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"3102","DOI":"10.1587\/transinf.2018EDP7175","article-title":"Salient feature selection for CNN-based visual place recognition","volume":"101","author":"Chen","year":"2018","journal-title":"IEICE Trans. Inf. Syst."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"4834","DOI":"10.1109\/TGRS.2019.2893310","article-title":"A novel two-step registration method for remote sensing images based on deep and local features","volume":"57","author":"Ma","year":"2019","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"2207","DOI":"10.1109\/TGRS.2006.872081","article-title":"On the blending of the landsat and MODIS surface reflectance: Predicting daily landsat surface reflectance","volume":"44","author":"Gao","year":"2006","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"121","DOI":"10.1016\/j.rse.2016.08.025","article-title":"A note on the temporary misregistration of Landsat-8 operational land imager (OLI) and sentinel-2 multi-spectral instrument (MSI) imagery","volume":"186","author":"Storey","year":"2016","journal-title":"Remote Sens. Environ."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Weng, Q. (2018). Remote Sensing Time Series Image Processing, CRC Press. [1st ed.].","DOI":"10.1201\/9781315166636"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"165","DOI":"10.1016\/j.rse.2015.11.016","article-title":"A flexible spatiotemporal method for fusing satellite images with different resolutions","volume":"172","author":"Zhu","year":"2016","journal-title":"Remote Sens. Environ."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"527","DOI":"10.3390\/rs10040527","article-title":"Spatiotemporal fusion of multisource remote sensing data: Literature survey, taxonomy, principles, applications, and future directions","volume":"10","author":"Zhu","year":"2018","journal-title":"Remote Sens."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"4476","DOI":"10.1109\/TGRS.2017.2692802","article-title":"A spatial and temporal nonlocal filter-based data fusion method","volume":"55","author":"Cheng","year":"2017","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"1613","DOI":"10.1016\/j.rse.2009.03.007","article-title":"A new data fusion model for high spatial-and temporal-resolution mapping of forest disturbance based on landsat and MODIS","volume":"113","author":"Hilker","year":"2009","journal-title":"Remote Sens. Environ."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"2610","DOI":"10.1016\/j.rse.2010.05.032","article-title":"An enhanced spatial and temporal adaptive reflectance fusion model for complex heterogeneous regions","volume":"114","author":"Zhu","year":"2010","journal-title":"Remote Sens. Environ."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"1883","DOI":"10.1109\/TGRS.2012.2213095","article-title":"Spatiotemporal satellite image fusion through one-pair image learning","volume":"51","author":"Song","year":"2012","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"3707","DOI":"10.1109\/TGRS.2012.2186638","article-title":"Spatiotemporal reflectance fusion via sparse representation","volume":"50","author":"Huang","year":"2012","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"243","DOI":"10.1016\/j.rse.2015.08.015","article-title":"A wavelet-artificial intelligence fusion approach (WAIFA) for blending landsat and MODIS surface temperature","volume":"169","author":"Moosavi","year":"2015","journal-title":"Remote Sens. Environ."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Tan, Z., Di, L., Zhang, M., Guo, L., and Gao, M. (2019). An enhanced deep convolutional model for spatiotemporal image fusion. Remote Sens., 11.","DOI":"10.3390\/rs11242898"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"821","DOI":"10.1109\/JSTARS.2018.2797894","article-title":"Spatiotemporal satellite image fusion using deep convolutional neural networks","volume":"11","author":"Song","year":"2018","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"293","DOI":"10.1016\/j.rse.2017.05.011","article-title":"Generating a series of fine spatial and temporal resolution land cover maps by fusing coarse spatial resolution remotely sensed images and fine spatial resolution land cover maps","volume":"196","author":"Li","year":"2017","journal-title":"Remote Sens. Environ."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"34","DOI":"10.1016\/j.rse.2014.09.012","article-title":"A comparison of STARFM and an unmixing-based algorithm for landsat and MODIS data fusion","volume":"156","author":"Gevaert","year":"2015","journal-title":"Remote Sens. Environ."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Xue, J., Leung, Y., and Fung, T. (2019). An unmixing-based bayesian model for spatio-temporal satellite image fusion in heterogeneous landscapes. Remote Sens., 11.","DOI":"10.3390\/rs11030324"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"541","DOI":"10.1162\/neco.1989.1.4.541","article-title":"Backpropagation applied to handwritten zip code recognition","volume":"1","author":"LeCun","year":"1989","journal-title":"Neural Comp."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Hu, J., Shen, L., and Sun, G. (2018, January 18\u201323). Squeeze-and-excitation networks. Proceedings of the 2018 IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00745"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Girshick, R., Donahue, J., Darrell, T., and Malik, J. (2014, January 23\u201328). Rich feature hierarchies for accurate object detection and semantic segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA.","DOI":"10.1109\/CVPR.2014.81"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"1137","DOI":"10.1109\/TPAMI.2016.2577031","article-title":"Faster R-CNN: Towards real-time object detection with region proposal networks","volume":"39","author":"Ren","year":"2017","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Eigen, D., Krishnan, D., and Fergus, R. (2013, January 1\u20138). Restoring an image taken through a window covered with dirt or rain. Proceedings of the IEEE International Conference on Computer Vision, Sydney, Australia.","DOI":"10.1109\/ICCV.2013.84"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"3142","DOI":"10.1109\/TIP.2017.2662206","article-title":"Beyond a gaussian denoiser: Residual learning of deep CNN for image denoising","volume":"26","author":"Zhang","year":"2017","journal-title":"IEEE Trans. Image Process."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"295","DOI":"10.1109\/TPAMI.2015.2439281","article-title":"Image super-resolution using deep convolutional networks","volume":"38","author":"Dong","year":"2016","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Kim, J., Kwon Lee, J., and Mu Lee, K. (2016, January 27\u201330). Accurate image super-resolution using very deep convolutional networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, USA.","DOI":"10.1109\/CVPR.2016.182"},{"key":"ref_34","first-page":"63","article-title":"Compression artifacts removal using convolutional neural networks","volume":"24","author":"Svoboda","year":"2016","journal-title":"J. WSCG"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"He, W., and Yokoya, N. (2018). Multi-temporal sentinel-1 and-2 data fusion for optical image simulation. ISPRS Int. J. Geoinf., 7.","DOI":"10.3390\/ijgi7100389"},{"key":"ref_36","unstructured":"Nair, V., and Hinton, G.E. (2010, January 21\u201324). Rectified linear units improve restricted boltzmann machines. Proceedings of the International Conference on Machine Learning (ICML-10), Haifa, Israel."},{"key":"ref_37","unstructured":"Ioffe, S., and Szegedy, C. (2015, January 7\u20139). Batch normalization: Accelerating deep network training by reducing internal covariate shift. Proceedings of the 32nd International Conference on Machine Learning, Lille, France."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27\u201330). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"9213","DOI":"10.3390\/rs6109213","article-title":"Blending Landsat and MODIS data to generate multispectral indices: A comparison of \u201cIndex-then-Blend\u201d and \u201cBlend-then-Index\u201d approaches","volume":"6","author":"Jarihani","year":"2014","journal-title":"Remote Sens."},{"key":"ref_40","unstructured":"Teo, T.A., Shih, T.Y., and Chen, B. (2017, January 23\u201327). Automatic georeferencing framework for time series formosat-2 satellite imagery using open source software. Proceedings of the Asian Conference on Remote Sensing, New Delhi, India."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"McInerney, D., and Kempeneers, P. (2015). Orfeo toolbox. Open Source Geospatial Tools, Springer.","DOI":"10.1007\/978-3-319-01824-9"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"2235","DOI":"10.1109\/36.957286","article-title":"A fast direct fourier-based algorithm for subpixel registration of images","volume":"39","author":"Stone","year":"2001","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Randrianjatovo, R.N., Rakotondraompiana, S., and Rakotoniaina, S. (2014, January 1\u20134). Estimation of land surface Temperature over reunion island using the thermal infrared channels of Landsat-8. Proceedings of the IEEE Canada International Humanitarian Technology Conference (IHTC), Montreal, Canada.","DOI":"10.1109\/IHTC.2014.7147516"},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"379","DOI":"10.1002\/j.1538-7305.1948.tb01338.x","article-title":"A mathematical theory of communication","volume":"27","author":"Shannon","year":"1948","journal-title":"Bell. Syst. Tech. J."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"4695","DOI":"10.1109\/TIP.2012.2214050","article-title":"No-reference image quality assessment in the spatial domain","volume":"21","author":"Mittal","year":"2012","journal-title":"IEEE Trans. Image Process."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"600","DOI":"10.1109\/TIP.2003.819861","article-title":"Image quality assessment: From error visibility to structural similarity","volume":"13","author":"Wang","year":"2004","journal-title":"IEEE Trans. Image Process."},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Hore, A., and Ziou, D. (2010, January 23\u201326). Image quality metrics: PSNR vs. SSIM. Proceedings of the International Conference on Pattern Recognition (ICPR 2010), Istanbul, Turkey.","DOI":"10.1109\/ICPR.2010.579"}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/13\/4\/606\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T05:21:32Z","timestamp":1760160092000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/13\/4\/606"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,2,8]]},"references-count":47,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2021,2]]}},"alternative-id":["rs13040606"],"URL":"https:\/\/doi.org\/10.3390\/rs13040606","relation":{},"ISSN":["2072-4292"],"issn-type":[{"type":"electronic","value":"2072-4292"}],"subject":[],"published":{"date-parts":[[2021,2,8]]}}}