{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,5]],"date-time":"2025-11-05T06:49:56Z","timestamp":1762325396267,"version":"build-2065373602"},"reference-count":45,"publisher":"MDPI AG","issue":"17","license":[{"start":{"date-parts":[[2022,8,30]],"date-time":"2022-08-30T00:00:00Z","timestamp":1661817600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"National Natural Science Foundation of China","award":["61972060","62027827","2019YFE0110800","cstc2020jcyj-zdxmX0025","cstc2019cxcyljrc-td0270"],"award-info":[{"award-number":["61972060","62027827","2019YFE0110800","cstc2020jcyj-zdxmX0025","cstc2019cxcyljrc-td0270"]}]},{"name":"National Key Research and Development Program of China","award":["61972060","62027827","2019YFE0110800","cstc2020jcyj-zdxmX0025","cstc2019cxcyljrc-td0270"],"award-info":[{"award-number":["61972060","62027827","2019YFE0110800","cstc2020jcyj-zdxmX0025","cstc2019cxcyljrc-td0270"]}]},{"name":"Natural Science Foundation of Chongqing","award":["61972060","62027827","2019YFE0110800","cstc2020jcyj-zdxmX0025","cstc2019cxcyljrc-td0270"],"award-info":[{"award-number":["61972060","62027827","2019YFE0110800","cstc2020jcyj-zdxmX0025","cstc2019cxcyljrc-td0270"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Popular deep-learning-based spatiotemporal fusion methods for creating high-temporal\u2013high-spatial-resolution images have certain limitations. The reconstructed images suffer from insufficient retention of high-frequency information and the model suffers from poor robustness, owing to the lack of training datasets. We propose a dual-branch remote sensing spatiotemporal fusion network based on a selection kernel mechanism. The network model comprises a super-resolution network module, a high-frequency feature extraction module, and a difference reconstruction module. Convolution kernel adaptive mechanisms are added to the high-frequency feature extraction module and difference reconstruction module to improve robustness. The super-resolution module upgrades the coarse image to a transition image matching the fine image; the high-frequency feature extraction module extracts the high-frequency features of the fine image to supplement the high-frequency features for the difference reconstruction module; the difference reconstruction module uses the structural similarity for fine-difference image reconstruction. The fusion result is obtained by combining the reconstructed fine-difference image with the known fine image. The compound loss function is used to help network training. Experiments are carried out on three datasets and five representative spatiotemporal fusion algorithms are used for comparison. Subjective and objective evaluations validate the superiority of our proposed method.<\/jats:p>","DOI":"10.3390\/rs14174282","type":"journal-article","created":{"date-parts":[[2022,8,31]],"date-time":"2022-08-31T00:13:56Z","timestamp":1661904836000},"page":"4282","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":5,"title":["Dual-Branch Remote Sensing Spatiotemporal Fusion Network Based on Selection Kernel Mechanism"],"prefix":"10.3390","volume":"14","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-9033-8245","authenticated-orcid":false,"given":"Weisheng","family":"Li","sequence":"first","affiliation":[{"name":"College of Computer Science and Technology, Chongqing University of Posts and Telecommunications, Chongqing 400065, China"}]},{"given":"Fengyan","family":"Wu","sequence":"additional","affiliation":[{"name":"College of Computer Science and Technology, Chongqing University of Posts and Telecommunications, Chongqing 400065, China"}]},{"given":"Dongwen","family":"Cao","sequence":"additional","affiliation":[{"name":"College of Computer Science and Technology, Chongqing University of Posts and Telecommunications, Chongqing 400065, China"}]}],"member":"1968","published-online":{"date-parts":[[2022,8,30]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Zhu, X., Cai, F., Tian, J., and Williams, T.K. (2018). Spatiotemporal Fusion of Multisource Remote Sensing Data: Literature Survey, Taxonomy, Principles, Applications, and Future Directions. Remote Sens., 10.","DOI":"10.3390\/rs10040527"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Kumari, N., Srivastava, A., and Dumka, U.C. (2021). A Long-Term Spatiotemporal Analysis of Vegetation Greenness over the Himalayan Region Using Google Earth Engine. Climate, 9.","DOI":"10.3390\/cli9070109"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Mart\u00edn-Ortega, P., Garc\u00eda-Montero, L.G., and Sibelet, N. (2020). Temporal Patterns in Illumination Conditions and Its Effect on Vegetation Indices Using Landsat on Google Earth Engine. Remote Sens., 12.","DOI":"10.3390\/rs12020211"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"689","DOI":"10.1016\/j.rse.2012.06.006","article-title":"Monitoring land cover change in urban and peri-urban areas using dense time stacks of Landsat satellite data and a data mining approach","volume":"124","author":"Schneider","year":"2012","journal-title":"Remote Sens. Environ."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"799","DOI":"10.14358\/PERS.72.7.799","article-title":"Object-based detailed vegetation classification with airborne high spatial resolution remote sensing imagery","volume":"72","author":"Yu","year":"2006","journal-title":"Photogramm. Eng. Remote Sens."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"611","DOI":"10.1080\/014311600210786","article-title":"Using very high spatial resolution multispectral satellite sensor imagery to monitor refugee camps","volume":"21","author":"Bjorgo","year":"2000","journal-title":"Int. J. Remote Sens."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"74","DOI":"10.1016\/j.agrformet.2015.11.003","article-title":"Crop yield forecasting on the Canadian Prairies by remotely sensed vegetation indices and machine learning methods","volume":"218\u2013219","author":"Johnson","year":"2016","journal-title":"Agric. For. Meteorol."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"1212","DOI":"10.1109\/36.763276","article-title":"Unmixing-based multisensor multiresolution image fusion","volume":"37","author":"Zhukov","year":"1999","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"063507","DOI":"10.1117\/1.JRS.6.063507","article-title":"Use of MODIS and Landsat time series data to generate high-resolution temporal synthetic Landsat data using a spatial and temporal reflectance fusion model","volume":"6","author":"Wu","year":"2012","journal-title":"J. Appl. Remote Sens."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"24002","DOI":"10.3390\/s150924002","article-title":"Generating Daily Synthetic Landsat Imagery by Combining Landsat and MODIS Data","volume":"15","author":"Wu","year":"2015","journal-title":"Sensors"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"2207","DOI":"10.1109\/TGRS.2006.872081","article-title":"On the blending of the Landsat and MODIS surface reflectance: Predicting daily Landsat surface reflectance","volume":"44","author":"Gao","year":"2006","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"2610","DOI":"10.1016\/j.rse.2010.05.032","article-title":"An enhanced spatial and temporal adaptive reflectance fusion model for complex heterogeneous regions","volume":"114","author":"Zhu","year":"2010","journal-title":"Remote Sens. Environ."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Liu, M., Liu, X., Wu, L., Zou, X., Jiang, T., and Zhao, B. (2018). A Modified Spatiotemporal Fusion Algorithm Using Phenological Information for Predicting Reflectance of Paddy Rice in Southern China. Remote Sens., 10.","DOI":"10.3390\/rs10050772"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"4476","DOI":"10.1109\/TGRS.2017.2692802","article-title":"A Spatial and Temporal Nonlocal Filter-Based Data Fusion Method","volume":"55","author":"Cheng","year":"2017","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Wang, J., and Huang, B. (2017). A Rigorously-Weighted Spatiotemporal Fusion Model with Uncertainty Analysis. Remote Sens., 9.","DOI":"10.3390\/rs9100990"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Xue, J., Leung, Y., and Fung, T. (2017). A Bayesian Data Fusion Approach to Spatio-Temporal Fusion of Remotely Sensed Images. Remote Sens., 9.","DOI":"10.3390\/rs9121310"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Xue, J., Leung, Y., and Fung, T. (2019). An Unmixing-Based Bayesian Model for Spatio-Temporal Satellite Image Fusion in Heterogeneous Landscapes. Remote Sens., 11.","DOI":"10.3390\/rs11030324"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"He, C., Zhang, Z., Xiong, D., Du, J., and Liao, M. (2017). Spatio-Temporal Series Remote Sensing Image Prediction Based on Multi-Dictionary Bayesian Fusion. ISPRS Int. J. Geo-Inf., 6.","DOI":"10.3390\/ijgi6110374"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"165","DOI":"10.1016\/j.rse.2015.11.016","article-title":"A flexible spatiotemporal method for fusing satellite images with different resolutions","volume":"172","author":"Zhu","year":"2016","journal-title":"Remote Sens. Environ."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"74","DOI":"10.1016\/j.rse.2019.03.012","article-title":"An Improved Flexible Spatiotemporal DAta Fusion (IFSDAF) method for producing high spatiotemporal resolution normalized difference vegetation index time series","volume":"227","author":"Liu","year":"2019","journal-title":"Remote Sens. Environ."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"34","DOI":"10.1016\/j.rse.2014.09.012","article-title":"A comparison of STARFM and an unmixing-based algorithm for Landsat and MODIS data fusion","volume":"156","author":"Gevaert","year":"2015","journal-title":"Remote Sens. Environ."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"3707","DOI":"10.1109\/TGRS.2012.2186638","article-title":"Spatiotemporal reflectance fusion via sparse representation","volume":"50","author":"Huang","year":"2012","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"2039","DOI":"10.1109\/LGRS.2016.2622726","article-title":"Fast and accurate spatiotemporal fusion based upon extreme learning machine","volume":"13","author":"Liu","year":"2016","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"821","DOI":"10.1109\/JSTARS.2018.2797894","article-title":"Spatiotemporal satellite image fusion using deep convolutional neural networks","volume":"11","author":"Song","year":"2018","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"6552","DOI":"10.1109\/TGRS.2019.2907310","article-title":"StfNet: A two-stream convolutional neural network for spatiotemporal image fusion","volume":"57","author":"Liu","year":"2019","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Tan, Z., Yue, P., Di, L., and Tang, J.J.R.S. (2018). Deriving high spatiotemporal remote sensing images using deep convolutional network. Remote Sens., 10.","DOI":"10.3390\/rs10071066"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Tan, Z., Di, L., Zhang, M., Guo, L., and Gao, M.J.R.S. (2019). An enhanced deep convolutional model for spatiotemporal image fusion. Remote Sens., 11.","DOI":"10.3390\/rs11242898"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"1808","DOI":"10.1109\/TGRS.2020.2999943","article-title":"Spatiotemporal fusion of land surface temperature based on a convolutional neural network","volume":"59","author":"Yin","year":"2020","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_29","first-page":"9116","article-title":"Spatiotemporal Remote Sensing Image Fusion Using Multiscale Two-Stream Convolutional Neural Networks","volume":"60","author":"Chen","year":"2021","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Jia, D., Song, C., Cheng, C., Shen, S., Ning, L., and Hui, C. (2020). A Novel Deep Learning-Based Spatiotemporal Fusion Method for Combining Satellite Images with Different Resolutions Using a Two-Stream Convolutional Neural Network. Remote Sens., 12.","DOI":"10.3390\/rs12040698"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"5851","DOI":"10.1109\/TGRS.2020.3023432","article-title":"CycleGAN-STF: Spatiotemporal fusion via CycleGAN-based image generation","volume":"59","author":"Chen","year":"2020","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"5601413","DOI":"10.1109\/TGRS.2021.3050551","article-title":"A Flexible Reference-Insensitive Spatiotemporal Fusion Model for Remote Sensing Images Using Conditional Generative Adversarial Network","volume":"60","author":"Tan","year":"2022","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_33","first-page":"5410618","article-title":"SwinSTFM: Remote Sensing Spatiotemporal Fusion Using Swin Transformer","volume":"60","author":"Chen","year":"2022","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"4653","DOI":"10.1109\/JSTARS.2022.3179415","article-title":"MSFusion: Multistage for Remote Sensing Image Spatiotemporal Fusion Based on Texture Transformer and Convolutional Neural Network","volume":"15","author":"Yang","year":"2022","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Lim, B., Son, S., Kim, H., Nah, S., and Mu Lee, K. (2017, January 21\u201326). Enhanced deep residual networks for single image super-resolution. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, Honolulu, HI, USA.","DOI":"10.1109\/CVPRW.2017.151"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Li, X., Wang, W., Hu, X., and Yang, J. (2019, January 15\u201320). Selective kernel networks. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00060"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"2314","DOI":"10.1109\/TGRS.2013.2259245","article-title":"Hyperspectral Image Denoising With a Spatial\u2013Spectral View Fusion Strategy","volume":"52","author":"Yuan","year":"2014","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"47","DOI":"10.1109\/TCI.2016.2644865","article-title":"Loss Functions for Image Restoration With Neural Networks","volume":"3","author":"Zhao","year":"2017","journal-title":"IEEE Trans. Comput. Imaging"},{"key":"ref_39","unstructured":"Wu, B., Duan, H., Liu, Z., and Sun, G. (2017). SRPGAN: Perceptual generative adversarial network for single image super resolution. arXiv."},{"key":"ref_40","unstructured":"Wang, Z., Simoncelli, E.P., and Bovik, A.C. (2003, January 9\u201312). Multiscale structural similarity for image quality assessment. Proceedings of the Thrity-Seventh Asilomar Conference on Signals, Systems & Computers, 2003, Pacific Grove, CA, USA."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"193","DOI":"10.1016\/j.rse.2013.02.007","article-title":"Assessing the accuracy of blending Landsat\u2013MODIS surface reflectances in two landscapes with contrasting spatial and temporal dynamics: A framework for algorithm selection","volume":"133","author":"Emelyanova","year":"2013","journal-title":"Remote Sens. Environ."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"140301","DOI":"10.1007\/s11432-019-2785-y","article-title":"Spatio-temporal fusion for remote sensing data: An overview and new benchmark","volume":"63","author":"Li","year":"2020","journal-title":"Sci. China Inf. Sci."},{"key":"ref_43","unstructured":"Ponomarenko, N., Ieremeiev, O., Lukin, V., Egiazarian, K., and Carli, M. (2011, January 23\u201325). Modified image visual quality metrics for contrast change and mean shift accounting. Proceedings of the 2011 11th International Conference the Experience of Designing and Application of CAD Systems in Microelectronics (CADSM), Polyana, Ukraine."},{"key":"ref_44","unstructured":"Yuhas, R.H., Goetz, A.F., and Boardman, J.W. (1992, January 1\u20135). Discrimination among semi-arid landscape endmembers using the spectral angle mapper (SAM) algorithm. Proceedings of the Summaries 3rd Annual JPL Airborne Geoscience Workshop, Pasadena, CA, USA."},{"key":"ref_45","unstructured":"Wald, L. (2000, January 26\u201328). Quality of high resolution synthesised images: Is there a simple criterion?. Proceedings of the Third Conference \u201cFusion of Earth Data: Merging Point Measurements, Raster Maps and Remotely Sensed Images\u201d, Sophia Antipolis, France."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/14\/17\/4282\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T00:20:32Z","timestamp":1760142032000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/14\/17\/4282"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,8,30]]},"references-count":45,"journal-issue":{"issue":"17","published-online":{"date-parts":[[2022,9]]}},"alternative-id":["rs14174282"],"URL":"https:\/\/doi.org\/10.3390\/rs14174282","relation":{},"ISSN":["2072-4292"],"issn-type":[{"type":"electronic","value":"2072-4292"}],"subject":[],"published":{"date-parts":[[2022,8,30]]}}}