{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,14]],"date-time":"2026-03-14T02:54:45Z","timestamp":1773456885725,"version":"3.50.1"},"reference-count":36,"publisher":"MDPI AG","issue":"19","license":[{"start":{"date-parts":[[2019,9,20]],"date-time":"2019-09-20T00:00:00Z","timestamp":1568937600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["41701400)"],"award-info":[{"award-number":["41701400)"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>The quality of remotely sensed images is usually determined by their spatial resolution, spectral resolution, and coverage. However, due to limitations in the sensor hardware, the spectral resolution, spatial resolution, and swath width of the coverage are mutually constrained. Remote sensing image fusion aims at overcoming the different constraints of remote sensing images, to achieve the purpose of combining the useful information in the different images. However, the traditional spatial\u2013spectral fusion approach is to use data in the same swath width that covers the same area and only considers the mutually constrained conditions between the spectral resolution and spatial resolution. To simultaneously solve the image fusion problems of the swath width, spatial resolution, and spectral resolution, this paper introduces a method with multi-scale feature extraction and residual learning with recurrent expanding. To discuss the sensitivity of convolution operation to different variables of images in different swath widths, we set the sensitivity experiments in the coverage ratio and offset position. We also performed the simulation and real experiments to verify the effectiveness of the proposed framework with the Sentinel-2 data, which simulated the different widths.<\/jats:p>","DOI":"10.3390\/rs11192203","type":"journal-article","created":{"date-parts":[[2019,9,20]],"date-time":"2019-09-20T10:48:14Z","timestamp":1568976494000},"page":"2203","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":7,"title":["Spatial\u2013Spectral Fusion in Different Swath Widths by a Recurrent Expanding Residual Convolutional Neural Network"],"prefix":"10.3390","volume":"11","author":[{"given":"Jiang","family":"He","sequence":"first","affiliation":[{"name":"School of Geodesy and Geomatics, Wuhan University, Wuhan 430079, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4063-9381","authenticated-orcid":false,"given":"Jie","family":"Li","sequence":"additional","affiliation":[{"name":"School of Geodesy and Geomatics, Wuhan University, Wuhan 430079, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7140-2224","authenticated-orcid":false,"given":"Qiangqiang","family":"Yuan","sequence":"additional","affiliation":[{"name":"School of Geodesy and Geomatics, Wuhan University, Wuhan 430079, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Huifang","family":"Li","sequence":"additional","affiliation":[{"name":"School of Resource and Environmental Sciences, Wuhan University, Wuhan 430079, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Huanfeng","family":"Shen","sequence":"additional","affiliation":[{"name":"School of Resource and Environmental Sciences, Wuhan University, Wuhan 430079, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2019,9,20]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Li, J., Liu, X., Yuan, Q., Shen, H., and Zhang, L. (2019). Antinoise Hyperspectral Image Fusion by Mining Tensor Low-Multilinear-Rank and Variational Properties. IEEE Trans. Geosci. Remote Sens.","DOI":"10.1109\/TGRS.2019.2916654"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"343","DOI":"10.1016\/0034-4257(87)90088-5","article-title":"Color enhancement of highly correlated images. 2. Channel ratio and chromaticity transformation techniques","volume":"22","author":"Gillespie","year":"1987","journal-title":"Remote Sens. Environ."},{"key":"ref_3","first-page":"339","article-title":"Extracting spectral contrast in Landsat thematic mapper image data using selective principal component analysis","volume":"55","author":"Chavez","year":"1989","journal-title":"Photogramm. Eng. Remote Sens."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"309","DOI":"10.1109\/LGRS.2004.834804","article-title":"A fast intensity hue-saturation fusion technique with spectral adjustment for IKONOS imagery","volume":"1","author":"Tu","year":"2004","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_5","unstructured":"Laben, C.A., and Brower, B.V. (2000). Process for enhancing the spatial resolution of multispectral imagery using pan-sharpening. (6,011,875), U.S. Patents."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"2300","DOI":"10.1109\/TGRS.2002.803623","article-title":"Context-driven fusion of high spatial and spectral resolution images based on oversampled multiresolution analysis","volume":"40","author":"Aiazzi","year":"2002","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"143","DOI":"10.1016\/j.inffus.2006.02.001","article-title":"Remote sensing image fusion using the curvelet transform","volume":"8","author":"Nencini","year":"2007","journal-title":"Inf. Fusion"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"591","DOI":"10.14358\/PERS.72.5.591","article-title":"MTF tailored multiscale fusion of high-resolution MS and pan imagery","volume":"72","author":"Aiazzi","year":"2006","journal-title":"Photogramm. Eng. Remote Sens."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"2255","DOI":"10.1109\/JSTARS.2016.2546061","article-title":"MTF-based deblurring using a wiener filter for CS and MRA pansharpening methods","volume":"9","author":"Palsson","year":"2016","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"3461","DOI":"10.1080\/014311600750037499","article-title":"Smoothing filter-based intensity modulation: A spectral preserve image fusion technique for improving spatial details","volume":"21","author":"Liu","year":"2000","journal-title":"Int. J. Remote Sens."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"228","DOI":"10.1109\/TGRS.2007.907604","article-title":"Optimal MMSE pan sharpening of very high resolution multispectral images","volume":"46","author":"Garzelli","year":"2008","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"2096","DOI":"10.1109\/TGRS.2014.2354471","article-title":"Pansharpening of multispectral images based on nonlocal parameter optimization","volume":"53","author":"Garzelli","year":"2015","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"1847","DOI":"10.1109\/TGRS.2008.917131","article-title":"Bayesian data fusion for adaptable image pansharpening","volume":"46","author":"Fasbender","year":"2008","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"1693","DOI":"10.1109\/TSMCB.2012.2198810","article-title":"Adjustable model-based fusion method for multispectral and panchromatic images","volume":"42","author":"Zhang","year":"2012","journal-title":"IEEE Trans. Syst. Man Cybern. B Cybern."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"318","DOI":"10.1109\/LGRS.2013.2257669","article-title":"A new pansharpening algorithm based on total variation","volume":"11","author":"Palsson","year":"2014","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"7135","DOI":"10.1109\/TGRS.2016.2596290","article-title":"An integrated framework for the spatio\u2013temporal\u2013spectral fusion of remote sensing images","volume":"54","author":"Shen","year":"2016","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"629","DOI":"10.1109\/LGRS.2011.2177063","article-title":"A practical compressed sensing-based pan-sharpening method","volume":"9","author":"Jiang","year":"2012","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"1195","DOI":"10.1109\/TGRS.2014.2335818","article-title":"Improving the Spatial Resolution of Landsat TM\/ETM+ Through Fusion With SPOT5 Images via Learning-Based Super-Resolution","volume":"53","author":"Song","year":"2015","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"1037","DOI":"10.1109\/LGRS.2014.2376034","article-title":"A New Pan-Sharpening Method With Deep Neural Networks","volume":"12","author":"Huang","year":"2015","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Masi, G., Cozzolino, D., Verdoliva, L., and Scarpa, G. (2016). Pansharpening by convolutional neural networks. Remote Sens., 8.","DOI":"10.3390\/rs8070594"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"978","DOI":"10.1109\/JSTARS.2018.2794888","article-title":"A Multiscale and Multidepth Convolutional Neural Network for Remote Sensing Imagery Pan-Sharpening","volume":"11","author":"Yuan","year":"2018","journal-title":"IEEE J. Sel. Top. Appl. Earth Observ. Remote Sens."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"1795","DOI":"10.1109\/LGRS.2017.2736020","article-title":"Boosting the Accuracy of Multispectral Image Pansharpening by Learning a Deep Residual Network","volume":"14","author":"Wei","year":"2017","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Palsson, F., Sveinsson, J., and Ulfarsson, M. (2018). Sentinel-2 Image Fusion Using a Deep Residual Network. Remote Sens., 10.","DOI":"10.3390\/rs10081290"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"241","DOI":"10.1016\/j.rse.2016.10.030","article-title":"Fusion of Sentinel-2 images","volume":"187","author":"Wang","year":"2016","journal-title":"Remote Sens. Environ."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"3885","DOI":"10.1109\/TGRS.2017.2683444","article-title":"Fusion of Landsat 8 OLI and Sentinel-2 MSI Data","volume":"55","author":"Wang","year":"2017","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"191","DOI":"10.1016\/j.rse.2015.06.003","article-title":"Downscaling MODIS images with area-to-point regression kriging","volume":"166","author":"Wang","year":"2015","journal-title":"Remote Sens. Environ."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"4165","DOI":"10.1109\/TGRS.2018.2828042","article-title":"Hyperspectral Image Super-Resolution Based on Spatial and Spectral Correlation Fusion","volume":"56","author":"Yi","year":"2018","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"2198","DOI":"10.1109\/JSTARS.2014.2356512","article-title":"Enhancement of Spectral Resolution for Remotely Sensed Multispectral Image","volume":"8","author":"Sun","year":"2015","journal-title":"IEEE J. Sel. Top. Appl. Earth Observ. Remote Sens."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"295","DOI":"10.1109\/TPAMI.2015.2439281","article-title":"Image super-resolution using deep convolutional networks","volume":"38","author":"Dong","year":"2016","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_30","unstructured":"Kim, J., Lee, J.K., and Lee, K.M. (July, January 26). Accurate Image Super-Resolution Using Very Deep Convolutional Networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"305","DOI":"10.1016\/j.isprsjprs.2018.09.018","article-title":"Super-resolution of Sentinel-2 images: Learning a globally applicable deep neural network","volume":"146","author":"Lanaras","year":"2018","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_32","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (July, January 26). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"4274","DOI":"10.1109\/TGRS.2018.2810208","article-title":"Missing data reconstruction in remote sensing image with a unified spatial-temporal-spectral deep convolutional neural network","volume":"56","author":"Zhang","year":"2018","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"1205","DOI":"10.1109\/TGRS.2018.2865197","article-title":"Hyperspectral image denoising employing a spatial-spectral deep residual convolutional neural network","volume":"57","author":"Yuan","year":"2019","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., and Darrell, T. (2014, January 3\u20137). Caffe: Convolutional architecture for fast feature embedding. Proceedings of the 22nd ACM International Conference on Multimedia, Orlando, FL, USA.","DOI":"10.1145\/2647868.2654889"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"1250","DOI":"10.1109\/LGRS.2016.2579661","article-title":"Hyperspectral Image Super-Resolution by Spectral Mixture Analysis and Spatial\u2013Spectral Group Sparsity","volume":"13","author":"Li","year":"2016","journal-title":"IEEE Geosci. Remote Sens. Lett."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/11\/19\/2203\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T13:22:35Z","timestamp":1760188955000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/11\/19\/2203"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,9,20]]},"references-count":36,"journal-issue":{"issue":"19","published-online":{"date-parts":[[2019,10]]}},"alternative-id":["rs11192203"],"URL":"https:\/\/doi.org\/10.3390\/rs11192203","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,9,20]]}}}