{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,14]],"date-time":"2026-02-14T10:24:38Z","timestamp":1771064678954,"version":"3.50.1"},"reference-count":55,"publisher":"MDPI AG","issue":"14","license":[{"start":{"date-parts":[[2023,7,24]],"date-time":"2023-07-24T00:00:00Z","timestamp":1690156800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["42201503"],"award-info":[{"award-number":["42201503"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Youth Innovation Promotion Association, CAS","award":["42201503"],"award-info":[{"award-number":["42201503"]}]},{"name":"Defense Industrial Technology Development Program","award":["42201503"],"award-info":[{"award-number":["42201503"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>In recent years, the development of super-resolution (SR) algorithms based on convolutional neural networks has become an important topic in enhancing the resolution of multi-channel remote sensing images. However, most of the existing SR models suffer from the insufficient utilization of spectral information, limiting their SR performance. Here, we derive a novel hybrid SR network (HSRN) which facilitates the acquisition of joint spatial\u2013spectral information to enhance the spatial resolution of multi-channel remote sensing images. The main contributions of this paper are three-fold: (1) in order to sufficiently extract the spatial\u2013spectral information of multi-channel remote sensing images, we designed a hybrid three-dimensional (3D) and two-dimensional (2D) convolution module which can distill the nonlinear spectral and spatial information simultaneously; (2) to enhance the discriminative learning ability, we designed the attention structure, including channel attention, before the upsampling block and spatial attention after the upsampling block, to weigh and rescale the spectral and spatial features; and (3) to acquire fine quality and clear texture for reconstructed SR images, we introduced a multi-scale structural similarity index into our loss function to constrain the HSRN model. The qualitative and quantitative comparisons were carried out in comparison with other SR methods on public remote sensing datasets. It is demonstrated that our HSRN outperforms state-of-the-art methods on multi-channel remote sensing images.<\/jats:p>","DOI":"10.3390\/rs15143693","type":"journal-article","created":{"date-parts":[[2023,7,25]],"date-time":"2023-07-25T01:27:32Z","timestamp":1690248452000},"page":"3693","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":6,"title":["A Super-Resolution Algorithm Based on Hybrid Network for Multi-Channel Remote Sensing Images"],"prefix":"10.3390","volume":"15","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-2049-2108","authenticated-orcid":false,"given":"Zhen","family":"Li","sequence":"first","affiliation":[{"name":"Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing 100094, China"}]},{"given":"Wenjuan","family":"Zhang","sequence":"additional","affiliation":[{"name":"Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing 100094, China"}]},{"given":"Jie","family":"Pan","sequence":"additional","affiliation":[{"name":"Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing 100094, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5598-8680","authenticated-orcid":false,"given":"Ruiqi","family":"Sun","sequence":"additional","affiliation":[{"name":"Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing 100094, China"},{"name":"University of Chinese Academy of Sciences, Beijing 100049, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3358-3671","authenticated-orcid":false,"given":"Lingyu","family":"Sha","sequence":"additional","affiliation":[{"name":"Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing 100094, China"},{"name":"University of Chinese Academy of Sciences, Beijing 100049, China"}]}],"member":"1968","published-online":{"date-parts":[[2023,7,24]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"2639","DOI":"10.1109\/JSTARS.2013.2272633","article-title":"Analysis of the Proportion of Surface Reflected Radiance in Mid-Infrared Absorption Bands","volume":"7","author":"Zhang","year":"2014","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"6294","DOI":"10.1109\/JSTARS.2022.3194203","article-title":"Learning-Free Hyperspectral Anomaly Detection with Unpredictive Frequency Residual Priors","volume":"15","author":"Zhou","year":"2022","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Li, Z., Zhao, B., and Wang, W. (2020). An Efficient Spectral Feature Extraction Framework for Hyperspectral Images. Remote Sens., 12.","DOI":"10.3390\/rs12233967"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"5966","DOI":"10.1109\/TGRS.2020.3015157","article-title":"Graph Convolutional Networks for Hyperspectral Image Classification","volume":"59","author":"Hong","year":"2021","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Dian, R., Li, S., Fang, L., and Bioucas-Dias, J. (2018, January 22\u201327). Hyperspectral Image Super-Resolution via Local Low-Rank and Sparse Representations. Proceedings of the IEEE International Geoscience and Remote Sensing Symposium, Valencia, Spain.","DOI":"10.1109\/IGARSS.2018.8519213"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.inffus.2019.07.010","article-title":"Remote sensing image fusion based on two-stream fusion network","volume":"55","author":"Liu","year":"2020","journal-title":"Inform. Fusion"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Huang, L., Hu, Z., Luo, X., Zhang, Q., Wang, J., and Wu, G. (2022). Stepwise Fusion of Hyperspectral, Multispectral and Panchromatic Images with Spectral Grouping Strategy: A Comparative Study Using GF5 and GF1 Images. Remote Sens., 14.","DOI":"10.3390\/rs14041021"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"UI Hoque, M.R., Burks, R., Kwan, C., and Li, J. (2019, January 10\u201312). Deep Learning for Remote Sensing Image Super-Resolution. Proceedings of the 2019 IEEE 10th Annual Ubiquitous Computing, Electronics and Mobile Communication Conference (UEMCON), New York, NY, USA.","DOI":"10.1109\/UEMCON47517.2019.8993047"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"873","DOI":"10.1049\/el.2020.1170","article-title":"Boundary-aware vehicle tracking upon UAV","volume":"56","author":"Han","year":"2020","journal-title":"Electron. Lett."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Ayhan, B., and Kwan, C. (2019). Mastcam Image Resolution Enhancement with Application to Disparity Map Generation for Stereo Images with Different Resolutions. Sensors, 19.","DOI":"10.3390\/s19163526"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Wang, L., Li, D., Tian, L., and Shan, Y. (2022, January 19\u201320). Efficient Image Super-Resolution with Collapsible Linear Blocks. Proceedings of the 2022 IEEE\/CVF Conference on Computer Vision and Pattern Recognition Workshops, New Orleans, LA, USA.","DOI":"10.1109\/CVPRW56347.2022.00097"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"1153","DOI":"10.1109\/TASSP.1981.1163711","article-title":"Cubic convolution interpolation for digital image processing","volume":"29","author":"Keys","year":"1981","journal-title":"IEEE Trans. Acoust. Speech Signal Process."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"1357","DOI":"10.1109\/JSTARS.2014.2312887","article-title":"Robust locally weighted regression for superresolution enhancement of multi-angle remote sensing imagery","volume":"7","author":"Ma","year":"2014","journal-title":"IEEE J. Sel. Top. Appl. Earth Observ. Remote Sens."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Schulter, S., Leistner, C., and Bischof, H. (2015, January 7\u201312). Fast and accurate image upscaling with super-resolution forests. Proceedings of the 2015 IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7299003"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Timofte, R., Rothe, R., and Gool, L.V. (2016, January 26\u201330). Seven Ways to Improve Example-Based Single Image Super Resolution. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.206"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"2861","DOI":"10.1109\/TIP.2010.2050625","article-title":"Image super-resolution via sparse representation","volume":"19","author":"Yang","year":"2010","journal-title":"IEEE Trans. Image Process."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"2569","DOI":"10.1109\/TIP.2014.2305844","article-title":"A statistical prediction model based on sparse representations for single image super-resolution","volume":"23","author":"Peleg","year":"2014","journal-title":"IEEE Trans. Image Process."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"2312","DOI":"10.1109\/TGRS.2017.2778191","article-title":"Adaptive Super-Resolution for Remote Sensing Images Based on Sparse Representation with Global Joint Dictionary Model","volume":"56","author":"Hou","year":"2018","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"2663","DOI":"10.1109\/JSTARS.2019.2925456","article-title":"Remote Sensing Image Super-Resolution Using Sparse Representation and Coupled Sparse Autoencoder","volume":"12","author":"Shao","year":"2019","journal-title":"IEEE J. Sel. Top. Appl. Earth Observ. Remote Sens."},{"key":"ref_20","unstructured":"Zhang, L., Yang, M., and Feng, X. (2011, January 20\u201325). Sparse representation or collaborative representation: Which helps face recognition?. Proceedings of the 2011 IEEE International Conference on Computer Vision, Colorado Springs, CO, USA."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Sun, Y., Zhang, Z., Jiang, W., Liu, G., and Yan, S. (2018, January 20\u201324). Robust discriminative projective dictionary pair learning by adaptive representations. Proceedings of the International Conference on Pattern Recognition, Beijing, China.","DOI":"10.1109\/ICPR.2018.8545863"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Huan, H., Li, P., Zou, N., Wang, C., Xie, Y., Xie, Y., and Xu, D. (2021). End-to-End Super-Resolution for Remote-Sensing Images Using an Improved Multi-Scale Residual Network. Remote Sens., 13.","DOI":"10.3390\/rs13040666"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Patil, V.H., Bormane, D.S., and Pawar, V.S. (2008, January 13\u201315). Super Resolution Using Neural Network. Proceedings of the 2008 Second Asia International Conference on Modelling and Simulation, Los Alamitos, CA, USA.","DOI":"10.1109\/AMS.2008.140"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"1403","DOI":"10.1109\/JSTARS.2012.2191537","article-title":"Combining Hopfield Neural Network and Contouring Methods to Enhance Super-Resolution Mapping","volume":"5","author":"Su","year":"2012","journal-title":"IEEE J. Sel. Top. Appl. Earth Observ. Remote Sens."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Dong, C., Loy, C.C., He, K., and Tang, X. (2014, January 6\u201312). Learning a deep convolutional network for image super-resolution. Proceedings of the European Conference on Computer Vision, Zurich, Switzerland.","DOI":"10.1007\/978-3-319-10593-2_13"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Shi, W., Caballero, J., Husz\u00e1r, F., and Wang, Z. (2016, January 26\u201330). Real-time single image and video super-resolution using an efficient sub-pixel convolutional neural network. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.207"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Kim, J., Lee, J.K., and Lee, K.M. (2016, January 26\u201330). Accurate Image Super-Resolution Using Very Deep Convolutional Networks. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.182"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Zhang, Y., Tian, Y., Kong, Y., Zhong, B., and Fu, Y. (2018, January 18\u201322). Residual Dense Network for Image Super-Resolution. Proceedings of the 2018 IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00262"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Zhang, Y., Li, K., Li, K., Wang, L., Zhong, B., and Fu, Y. (2018, January 8\u201314). Image super-resolution using very deep residual channel attention networks. Proceedings of the European Conference on Computer Vision, Munich, Germany.","DOI":"10.1007\/978-3-030-01234-2_18"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Basak, H., Kundu, R., Agarwal, A., and Giri, S. (2020, January 26\u201328). Single Image Super-Resolution using Residual Channel Attention Network. Proceedings of the 2020 IEEE 15th International Conference on Industrial and Information Systems, Rupnagar, India.","DOI":"10.1109\/ICIIS51140.2020.9342688"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Mei, Y., Fan, Y., Zhou, Y., Huang, L., Huang, T.S., and Shi, H. (2020, January 14\u201319). Image Super-Resolution With Cross-Scale Non-Local Attention and Exhaustive Self-Exemplars Mining. Proceedings of the 2020 IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.00573"},{"key":"ref_32","unstructured":"Xia, B., Hang, Y., Tian, Y., Yang, W., Liao, Q., and Zhou, J. (2022, January 19\u201324). Efficient Non-Local Contrastive Attention for Image Super-Resolution. Proceedings of the 2022 IEEE\/CVF Conference on Computer Vision and Pattern Recognition, New Orleans, LA, USA."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Mei, S., Yuan, X., Ji, J., Zhang, Y., Wan, S., and Du, Q. (2017). Hyperspectral Image Spatial Super-Resolution via 3D Full Convolutional Neural Network. Remote Sens., 9.","DOI":"10.3390\/rs9111139"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"14","DOI":"10.1016\/j.isprsjprs.2021.09.023","article-title":"Progressive split-merge super resolution for hyperspectral imagery with group attention and gradient guidance","volume":"182","author":"Li","year":"2021","journal-title":"ISPRS-J. Photogramm. Remote Sens."},{"key":"ref_35","first-page":"5503113","article-title":"Hyperspectral Image Super-Resolution via Recurrent Feedback Embedding and Spatial\u2013Spectral Consistency Regularization","volume":"60","author":"Wang","year":"2021","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_36","first-page":"5401410","article-title":"Hybrid-Scale Self-Similarity Exploitation for Remote Sensing Image Super-Resolution","volume":"60","author":"Lei","year":"2021","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"5615611","DOI":"10.1109\/TGRS.2021.3136190","article-title":"Transformer-Based Multistage Enhancement for Remote Sensing Image Super-Resolution","volume":"60","author":"Lei","year":"2022","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"8389","DOI":"10.1109\/JSTARS.2022.3207777","article-title":"Multiple Frame Splicing and Degradation Learning for Hyperspectral Imagery Super-Resolution","volume":"15","author":"Deng","year":"2022","journal-title":"IEEE J. Sel. Top. Appl. Earth Observ. Remote Sens."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Mather, P.M. (2011). Computer Processing of Remotely-Sensed Images: An Introduction, John Wiley and Sons, Ltd.. [4th ed.].","DOI":"10.1002\/9780470666517"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"4772","DOI":"10.1016\/j.matpr.2022.03.341","article-title":"A review on remote sensing imagery augmentation using deep learning","volume":"62","author":"Lalitha","year":"2022","journal-title":"Mater. Today Proc."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 26\u201330). Deep Residual Learning for Image Recognition. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Dong, C., Loy, C.C., and Tang, X. (2016, January 8\u201316). Accelerating the super-resolution convolutional neural network. Proceedings of the European Conference on Computer Vision, Amsterdam, The Netherlands.","DOI":"10.1007\/978-3-319-46475-6_25"},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Lim, B., Son, S., Kim, H., Nah, S., and Lee, K.M. (2017, January 21\u201326). Enhanced deep residual networks for single image super-resolution. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPRW.2017.151"},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Shi, Z., Chen, C., Xiong, Z., Liu, D., and Wu, F. (2018, January 18\u201322). HSCNN+: Advanced CNN-based hyperspectral recovery from RGB images. Proceedings of the 2018 IEEE Conference on Computer Vision and Pattern Recognition Workshops, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPRW.2018.00139"},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"1489","DOI":"10.1109\/TMM.2020.2999182","article-title":"Coarse-to-fine CNN for image super-resolution","volume":"23","author":"Tian","year":"2020","journal-title":"IEEE Trans. Multimed."},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Hu, J., Shen, L., and Sun, G. (2018, January 18\u201322). Squeeze-and-excitation networks. Proceedings of the 2018 IEEE Conference on Computer Vision and Pattern Recognition Workshops, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00745"},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Jiang, W., Zhao, L., Wang, Y., Liu, W., and Liu, B. (2021). Cross-Dimension Attention Guided Self-Supervised Remote Sensing Single-Image Super-Resolution. Remote Sens., 13.","DOI":"10.3390\/rs13193835"},{"key":"ref_48","first-page":"2321","article-title":"Hybrid 2-D\u20133-D Deep Residual Attentional Network with Structure Tensor Constraints for Spectral Super-Resolution of RGB Images","volume":"59","author":"Li","year":"2021","journal-title":"IEEE Trans. Image Process."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"6069","DOI":"10.1109\/TGRS.2017.2720539","article-title":"Sparse Distributed Multitemporal Hyperspectral Unmixing","volume":"55","author":"Sigurdsson","year":"2017","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_50","unstructured":"Wang, Z., Simoncelli, E.P., and Bovik, A.C. (2003, January 9\u201312). Multiscale structural similarity for image quality assessment. Proceedings of the 37th Asilomar Conference on Signals, Systems and Computers, Pacific Grove, CA, USA."},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"600","DOI":"10.1109\/TIP.2003.819861","article-title":"Image quality assessment: From error visibility to structural similarity","volume":"13","author":"Wang","year":"2004","journal-title":"IEEE Trans. Image Process."},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"145","DOI":"10.1016\/0034-4257(93)90013-N","article-title":"The spectral image processing system\u2014Interactive visualization and analysis of imaging spectrometer data","volume":"44","author":"Kruse","year":"1993","journal-title":"Remote Sens. Environ."},{"key":"ref_53","doi-asserted-by":"crossref","unstructured":"Wang, W., Zhao, B., Feng, F., Nan, J., and Li, C. (2018). Hierarchical Sub-Pixel Anomaly Detection Framework for Hyperspectral Imagery. Sensors, 18.","DOI":"10.3390\/s18113662"},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"333","DOI":"10.1016\/j.isprsjprs.2020.05.013","article-title":"Cloud removal in Sentinel-2 imagery using a deep residual neural network and SAR-optical data fusion","volume":"166","author":"Meraner","year":"2020","journal-title":"ISPRS-J. Photogramm. Remote Sens."},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"574","DOI":"10.1109\/TGRS.2018.2858817","article-title":"Fully convolutional networks for multisource building extraction from an open aerial and satellite imagery dataset","volume":"57","author":"Ji","year":"2019","journal-title":"IEEE Trans. Geosci. Remote Sens."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/15\/14\/3693\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T20:17:56Z","timestamp":1760127476000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/15\/14\/3693"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,7,24]]},"references-count":55,"journal-issue":{"issue":"14","published-online":{"date-parts":[[2023,7]]}},"alternative-id":["rs15143693"],"URL":"https:\/\/doi.org\/10.3390\/rs15143693","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,7,24]]}}}