{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,30]],"date-time":"2026-09-30T17:07:52Z","timestamp":1790788072516,"version":"4.1.0"},"reference-count":56,"publisher":"MDPI AG","issue":"20","license":[{"start":{"date-parts":[[2023,10,12]],"date-time":"2023-10-12T00:00:00Z","timestamp":1697068800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Collaborative Innovation Project of Colleges and Universities of Anhui Province","award":["PA2023AGXC0006"],"award-info":[{"award-number":["PA2023AGXC0006"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>In recent years, convolutional neural network (CNN)-based spatiotemporal fusion (STF) models for remote sensing images have made significant progress. However, existing STF models may suffer from two main drawbacks. Firstly, multi-band prediction often generates a hybrid feature representation that includes information from all bands. This blending of features can lead to the loss or blurring of high-frequency details, making it challenging to reconstruct multi-spectral remote sensing images with significant spectral differences between bands. Another challenge in many STF models is the limited preservation of spectral information during 2D convolution operations. Combining all input channels\u2019 convolution results into a single-channel output feature map can lead to the degradation of spectral dimension information. To address these issues and to strike a balance between avoiding hybrid features and fully utilizing spectral information, we propose a remote sensing image STF model that combines single-band and multi-band prediction (SMSTFM). The SMSTFM initially performs single-band prediction, generating separate predicted images for each band, which are then stacked together to form a preliminary fused image. Subsequently, the multi-band prediction module leverages the spectral dimension information of the input images to further enhance the preliminary predictions. We employ the modern ConvNeXt convolutional module as the primary feature extraction component. During the multi-band prediction phase, we enhance the spatial and channel information captures by replacing the 2D convolutions within ConvNeXt with 3D convolutions. In the experimental section, we evaluate our proposed algorithm on two public datasets with 16x resolution differences and one dataset with a 3x resolution difference. The results demonstrate that our SMSTFM achieves state-of-the-art performance on these datasets and is proven effective and reasonable through ablation studies.<\/jats:p>","DOI":"10.3390\/rs15204936","type":"journal-article","created":{"date-parts":[[2023,10,12]],"date-time":"2023-10-12T12:46:13Z","timestamp":1697114773000},"page":"4936","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":8,"title":["Spatiotemporal Fusion Model of Remote Sensing Images Combining Single-Band and Multi-Band Prediction"],"prefix":"10.3390","volume":"15","author":[{"given":"Zhiyuan","family":"Wang","sequence":"first","affiliation":[{"name":"Key Laboratory of Knowledge Engineering with Big Data, Ministry of Education, Hefei University of Technology, Hefei 230601, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Shuai","family":"Fang","sequence":"additional","affiliation":[{"name":"Key Laboratory of Knowledge Engineering with Big Data, Ministry of Education, Hefei University of Technology, Hefei 230601, China"},{"name":"Anhui Province Key Laboratory of Industry Safety and Emergency Technology, Hefei 230601, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jing","family":"Zhang","sequence":"additional","affiliation":[{"name":"Key Laboratory of Knowledge Engineering with Big Data, Ministry of Education, Hefei University of Technology, Hefei 230601, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2023,10,12]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Nduati, E., Sofue, Y., Matniyaz, A., Park, J.G., Yang, W., and Kondoh, A. (2019). Cropland Mapping Using Fusion of Multi-Sensor Data in a Complex Urban\/Peri-Urban Area. Remote Sens., 11.","DOI":"10.3390\/rs11020207"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"2499","DOI":"10.1016\/j.rse.2011.05.010","article-title":"Downscaling real-time vegetation dynamics by fusing multi-temporal MODIS and Landsat NDVI in topographically complex terrain","volume":"115","author":"Hwang","year":"2011","journal-title":"Remote Sens. Environ."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"111051","DOI":"10.1016\/j.rse.2019.01.013","article-title":"Continuous monitoring of land change activities and post-disturbance dynamics from Landsat time series: A test methodology for REDD+ reporting","volume":"238","author":"Olofsson","year":"2020","journal-title":"Remote Sens. Environ."},{"key":"ref_4","first-page":"102063","article-title":"Space-time detection of deforestation, forest degradation and regeneration in montane forests of Eastern Tanzania","volume":"88","author":"Hamunyela","year":"2020","journal-title":"Int. J. Appl. Earth Obs. Geoinf."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Yin, L., Wang, L., Li, T., Lu, S., Yin, Z., Liu, X., Li, X., and Zheng, W. (2023). U-Net-STN: A Novel End-to-End Lake Boundary Prediction Model. Land, 12.","DOI":"10.3390\/land12081602"},{"key":"ref_6","first-page":"1","article-title":"SwinSUNet: Pure Transformer Network for Remote Sensing Image Change Detection","volume":"60","author":"Zhang","year":"2022","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"747","DOI":"10.1071\/MF22167","article-title":"Remote sensing and geostatistics in urban water-resource monitoring: A review","volume":"74","author":"Liu","year":"2023","journal-title":"Mar. Freshw. Res."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Liu, X., Li, Z., Fu, X., Yin, Z., Liu, M., Yin, L., and Zheng, W. (2023). Monitoring house vacancy dynamics in the pearl river delta region: A method based on NPP-viirs night-time light remote sensing images. Land, 12.","DOI":"10.3390\/land12040831"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1016\/j.isprsjprs.2019.01.011","article-title":"DuPLO: A DUal view Point deep Learning architecture for time series classificatiOn","volume":"149","author":"Interdonato","year":"2019","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_10","first-page":"616","article-title":"Land cover mapping at Alkali Flat and Lake Lucero, White Sands, New Mexico, USA using multi-temporal and multi-spectral remote sensing data","volume":"13","author":"Ghrefat","year":"2011","journal-title":"Int. J. Appl. Earth Obs. Geoinf."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"8096","DOI":"10.1080\/01431161.2020.1771790","article-title":"Multiple-feature-driven co-training method for crop mapping based on remote sensing time series imagery","volume":"41","author":"Jia","year":"2020","journal-title":"Int. J. Remote Sens."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"7135","DOI":"10.1109\/TGRS.2016.2596290","article-title":"An Integrated Framework for the Spatio\u2013Temporal\u2013Spectral Fusion of Remote Sensing Images","volume":"54","author":"Shen","year":"2016","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_13","first-page":"1","article-title":"SwinSTFM: Remote Sensing Spatiotemporal Fusion Using Swin Transformer","volume":"60","author":"Chen","year":"2022","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Fu, Z., Sun, Y., Fan, L., and Han, Y. (2018). Multiscale and Multifeature Segmentation of High-Spatial Resolution Remote Sensing Images Using Superpixels with Mutual Optimal Strategy. Remote Sens., 10.","DOI":"10.3390\/rs10081289"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"75","DOI":"10.1016\/j.inffus.2016.03.003","article-title":"A review of remote sensing image fusion methods","volume":"32","author":"Ghassemian","year":"2016","journal-title":"Inf. Fusion"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Belgiu, M., and Stein, A. (2019). Spatiotemporal Image Fusion in Remote Sensing. Remote Sens., 11.","DOI":"10.3390\/rs11070818"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"2207","DOI":"10.1109\/TGRS.2006.872081","article-title":"On the blending of the Landsat and MODIS surface reflectance: Predicting daily Landsat surface reflectance","volume":"44","author":"Gao","year":"2006","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"374","DOI":"10.1016\/j.rse.2016.07.028","article-title":"Land cover change detection by integrating object-based data blending model of Landsat and MODIS","volume":"184","author":"Lu","year":"2016","journal-title":"Remote Sens. Environ."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"86","DOI":"10.1080\/22797254.2021.1879683","article-title":"An object-based spatiotemporal fusion model for remote sensing images","volume":"54","author":"Zhang","year":"2021","journal-title":"Eur. J. Remote Sens."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"29","DOI":"10.1016\/S0034-4257(00)00153-X","article-title":"Definition of spatially variable spectral endmembers by locally calibrated multivariate regression analyses","volume":"75","author":"Maselli","year":"2001","journal-title":"Remote Sens. Environ."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"118","DOI":"10.1016\/j.rse.2007.04.004","article-title":"Combining medium and coarse spatial resolution satellite data to improve the estimation of sub-pixel NDVI time series","volume":"112","author":"Busetto","year":"2008","journal-title":"Remote Sens. Environ."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"165","DOI":"10.1016\/j.rse.2015.11.016","article-title":"A flexible spatiotemporal method for fusing satellite images with different resolutions","volume":"172","author":"Zhu","year":"2016","journal-title":"Remote Sens. Environ."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"31","DOI":"10.1016\/j.rse.2017.10.046","article-title":"Spatio-temporal fusion for daily Sentinel-2 images","volume":"204","author":"Wang","year":"2018","journal-title":"Remote Sens. Environ."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"3707","DOI":"10.1109\/TGRS.2012.2186638","article-title":"Spatiotemporal Reflectance Fusion via Sparse Representation","volume":"50","author":"Huang","year":"2012","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"1883","DOI":"10.1109\/TGRS.2012.2213095","article-title":"Spatiotemporal satellite image fusion through one-pair image learning","volume":"51","author":"Song","year":"2012","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"6791","DOI":"10.1109\/TGRS.2015.2448100","article-title":"An error-bound-regularized sparse coding for spatiotemporal reflectance fusion","volume":"53","author":"Wu","year":"2015","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_27","first-page":"1","article-title":"Spatiotemporal reflectance fusion via tensor sparse representation","volume":"60","author":"Peng","year":"2021","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_28","first-page":"101005","article-title":"A review of remote sensing image spatiotemporal fusion: Challenges, applications and recent trends","volume":"32","author":"Xiao","year":"2023","journal-title":"Remote Sens. Appl. Soc. Environ."},{"key":"ref_29","first-page":"102926","article-title":"Deep learning in multimodal remote sensing data fusion: A comprehensive review","volume":"112","author":"Li","year":"2022","journal-title":"Int. J. Appl. Earth Obs. Geoinf."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"821","DOI":"10.1109\/JSTARS.2018.2797894","article-title":"Spatiotemporal Satellite Image Fusion Using Deep Convolutional Neural Networks","volume":"11","author":"Song","year":"2018","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Tan, Z., Yue, P., Di, L., and Tang, J. (2018). Deriving High Spatiotemporal Remote Sensing Images Using Deep Convolutional Network. Remote Sens., 10.","DOI":"10.3390\/rs10071066"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Tan, Z., Di, L., Zhang, M., Guo, L., and Gao, M. (2019). An Enhanced Deep Convolutional Model for Spatiotemporal Image Fusion. Remote Sens., 11.","DOI":"10.3390\/rs11242898"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"6552","DOI":"10.1109\/TGRS.2019.2907310","article-title":"StfNet: A Two-Stream Convolutional Neural Network for Spatiotemporal Image Fusion","volume":"57","author":"Liu","year":"2019","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1109\/TGRS.2022.3230439","article-title":"A Flexible Reference-Insensitive Spatiotemporal Fusion Model for Remote Sensing Images Using Conditional Generative Adversarial Network","volume":"60","author":"Tan","year":"2022","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_35","first-page":"1","article-title":"MLFF-GAN: A Multilevel Feature Fusion With GAN for Spatiotemporal Remote Sensing Images","volume":"60","author":"Song","year":"2022","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Li, W., Cao, D., Peng, Y., and Yang, C. (2021). MSNet: A multi-stream fusion network for remote sensing spatiotemporal fusion based on transformer and convolution. Remote Sens., 13.","DOI":"10.3390\/rs13183724"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Liu, Z., Lin, Y., Cao, Y., Hu, H., Wei, Y., Zhang, Z., Lin, S., and Guo, B. (2021, January 10\u201317). Swin transformer: Hierarchical vision transformer using shifted windows. Proceedings of the IEEE\/CVF International Conference on Computer Vision (ICCV), Montreal, QC, Canada.","DOI":"10.1109\/ICCV48922.2021.00986"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Liu, Z., Mao, H., Wu, C.Y., Feichtenhofer, C., Darrell, T., and Xie, S. (2022, January 18\u201324). A ConvNet for the 2020s. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), New Orleans, LA, USA.","DOI":"10.1109\/CVPR52688.2022.01167"},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Cao, J., Liang, J., Zhang, K., Li, Y., Zhang, Y., Wang, W., and Gool, L.V. (2022, January 23\u201327). Reference-based image super-resolution with deformable attention transformer. Proceedings of the European Conference on Computer Vision, Tel Aviv, Israel.","DOI":"10.1007\/978-3-031-19797-0_19"},{"key":"ref_40","unstructured":"Ronneberger, O., Fischer, P., and Brox, T. (2015, January 5\u20139). U-net: Convolutional networks for biomedical image segmentation. Proceedings of the Medical Image Computing and Computer-Assisted Intervention\u2013MICCAI 2015, Proceedings of the 18th International Conference, Munich, Germany. Part III 18."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"113012","DOI":"10.1016\/j.rse.2022.113012","article-title":"A deep learning model for incorporating temporal information in haze removal","volume":"274","author":"Ma","year":"2022","journal-title":"Remote Sens. Environ."},{"key":"ref_42","first-page":"102853","article-title":"HADeenNet: A hierarchical-attention multi-scale deconvolution network for landslide detection","volume":"111","author":"Yu","year":"2022","journal-title":"Int. J. Appl. Earth Obs. Geoinf."},{"key":"ref_43","unstructured":"Bronskill, J., Gordon, J., Requeima, J., Nowozin, S., and Turner, R. (2020, January 13\u201318). Tasknorm: Rethinking batch normalization for meta-learning. Proceedings of the International Conference on Machine Learning, Virtual Event."},{"key":"ref_44","unstructured":"Hendrycks, D., and Gimpel, K. (2016). Gaussian error linear units (GELUs). arXiv."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1109\/TGRS.2022.3230829","article-title":"HCNNet: A Hybrid Convolutional Neural Network for Spatiotemporal Image Fusion","volume":"60","author":"Zhu","year":"2022","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"847","DOI":"10.1109\/TGRS.2017.2755542","article-title":"Spectral\u2013Spatial Residual Network for Hyperspectral Image Classification: A 3-D Deep Learning Framework","volume":"56","author":"Zhong","year":"2018","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Lai, W.S., Huang, J.B., Ahuja, N., and Yang, M.H. (2017, January 21\u201326). Deep Laplacian Pyramid Networks for Fast and Accurate Super-Resolution. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.618"},{"key":"ref_48","unstructured":"Wang, Z., Simoncelli, E., and Bovik, A. (2003, January 9\u201312). Multiscale structural similarity for image quality assessment. Proceedings of the Thrity-Seventh Asilomar Conference on Signals, Systems and Computers, Pacific Grove, CA, USA."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"193","DOI":"10.1016\/j.rse.2013.02.007","article-title":"Assessing the accuracy of blending Landsat\u2013MODIS surface reflectances in two landscapes with contrasting spatial and temporal dynamics: A framework for algorithm selection","volume":"133","author":"Emelyanova","year":"2013","journal-title":"Remote Sens. Environ."},{"key":"ref_50","first-page":"1","article-title":"Spatiotemporal Remote Sensing Image Fusion Using Multiscale Two-Stream Convolutional Neural Networks","volume":"60","author":"Chen","year":"2022","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"111537","DOI":"10.1016\/j.rse.2019.111537","article-title":"SFSDAF: An enhanced FSDAF that incorporates sub-pixel class fraction change information for spatio-temporal image fusion","volume":"237","author":"Li","year":"2020","journal-title":"Remote Sens. Environ."},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"2610","DOI":"10.1016\/j.rse.2010.05.032","article-title":"An enhanced spatial and temporal adaptive reflectance fusion model for complex heterogeneous regions","volume":"114","author":"Zhu","year":"2010","journal-title":"Remote Sens. Environ."},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"600","DOI":"10.1109\/TIP.2003.819861","article-title":"Image quality assessment: From error visibility to structural similarity","volume":"13","author":"Wang","year":"2004","journal-title":"IEEE Trans. Image Process."},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"81","DOI":"10.1109\/97.995823","article-title":"A universal image quality index","volume":"9","author":"Wang","year":"2002","journal-title":"IEEE Signal Process. Lett."},{"key":"ref_55","unstructured":"Yuhas, R.H., Goetz, A.F.H., and Boardman, J.W. (1992). Summaries of the Third Annual JPL Airborne Geoscience Workshop, JPL."},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"3880","DOI":"10.1109\/TGRS.2009.2029094","article-title":"Pansharpening Quality Assessment Using the Modulation Transfer Functions of Instruments","volume":"47","author":"Khan","year":"2009","journal-title":"IEEE Trans. Geosci. Remote Sens."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/15\/20\/4936\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T21:05:48Z","timestamp":1760130348000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/15\/20\/4936"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,10,12]]},"references-count":56,"journal-issue":{"issue":"20","published-online":{"date-parts":[[2023,10]]}},"alternative-id":["rs15204936"],"URL":"https:\/\/doi.org\/10.3390\/rs15204936","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,10,12]]}}}