{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T02:55:52Z","timestamp":1760151352607,"version":"build-2065373602"},"reference-count":64,"publisher":"MDPI AG","issue":"5","license":[{"start":{"date-parts":[[2022,2,24]],"date-time":"2022-02-24T00:00:00Z","timestamp":1645660800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["62061040"],"award-info":[{"award-number":["62061040"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100004772","name":"Natural Science Foundation of Ningxia Province","doi-asserted-by":"publisher","award":["2018AAC03014","2021AAC03045"],"award-info":[{"award-number":["2018AAC03014","2021AAC03045"]}],"id":[{"id":"10.13039\/501100004772","id-type":"DOI","asserted-by":"publisher"}]},{"name":"The Key Research and Development Plan in Ningxia District","award":["2019BEG03056"],"award-info":[{"award-number":["2019BEG03056"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>The pansharpening (PS) of remote-sensing images aims to fuse a high-resolution panchromatic image with several low-resolution multispectral images for obtaining a high-resolution multispectral image. In this work, a two-stage PS model is proposed by integrating the ideas of component replacement and the variational method. The global sparse gradient of the panchromatic image is extracted by variational method, and the weight function is constructed by combining the gradient of multispectral image in which the global sparse gradient can provide more robust gradient information. Furthermore, we refine the results in order to reduce spatial and spectral distortions. Experimental results show that our method had high generalization ability for QuickBird, Gaofen-1, and WorldView-4 satellite data. Experimental results evaluated by seven metrics demonstrate that the proposed two-stage method enhanced spatial details subjective visual effects better than other state-of-the-art methods do. At the same time, in the process of quantitative evaluation, the method in this paper had high improvement compared with that other methods, and some of them can reach a maximal improvement of 60%.<\/jats:p>","DOI":"10.3390\/rs14051121","type":"journal-article","created":{"date-parts":[[2022,2,24]],"date-time":"2022-02-24T21:11:07Z","timestamp":1645737067000},"page":"1121","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["A Two-Stage Pansharpening Method for the Fusion of Remote-Sensing Images"],"prefix":"10.3390","volume":"14","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-2633-3084","authenticated-orcid":false,"given":"Yazhen","family":"Wang","sequence":"first","affiliation":[{"name":"School of Mathematics and Statistics, Ningxia University, Yinchuan 750021, China"}]},{"given":"Guojun","family":"Liu","sequence":"additional","affiliation":[{"name":"School of Mathematics and Statistics, Ningxia University, Yinchuan 750021, China"}]},{"given":"Rui","family":"Zhang","sequence":"additional","affiliation":[{"name":"School of Mathematics and Statistics, Ningxia University, Yinchuan 750021, China"}]},{"given":"Junmin","family":"Liu","sequence":"additional","affiliation":[{"name":"School of Mathematics and Statistics, Xi\u2019an Jiaotong University, Xi\u2019an 710049, China"}]}],"member":"1968","published-online":{"date-parts":[[2022,2,24]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"1323","DOI":"10.1109\/TGRS.2008.916211","article-title":"An efficient pansharpening method via a combined adaptive PCA approach and contourlets","volume":"46","author":"Shah","year":"2008","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"3230","DOI":"10.1109\/TGRS.2007.901007","article-title":"Improving component substitution pansharpening through multivariate regression of MS + Pan data","volume":"45","author":"Aiazzi","year":"2007","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"177","DOI":"10.1016\/S1566-2535(01)00036-7","article-title":"A new look at IHS like image fusion methods","volume":"2","author":"Tu","year":"2001","journal-title":"Inform. Fus."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"5088","DOI":"10.1109\/TGRS.2013.2286827","article-title":"Pansharpening with matting model","volume":"52","author":"Kang","year":"2014","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"746","DOI":"10.1109\/LGRS.2010.2046715","article-title":"An adaptive IHS pansharpening method","volume":"52","author":"Rahmani","year":"2010","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"985","DOI":"10.1109\/LGRS.2013.2284282","article-title":"An improved adaptive intensity hue saturation method for the fusion of remote sensing images","volume":"11","author":"Leung","year":"2013","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"8269078","DOI":"10.1155\/2017\/8269078","article-title":"A pansharpening method based on evolutionary optimization and IHS transformation","volume":"2017","author":"Chen","year":"2017","journal-title":"Math. Probl. Eng."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Chen, Y.X., Liu, C., Zhou, A., and Zhang, G.X. (2019, January 10\u201313). MIHS: A multiobjective pan sharpening method for remote sensing images. Proceedings of the IEEE Congress on Evolutionary Computation, Wellington, New Zealand.","DOI":"10.1109\/CEC.2019.8789901"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"228","DOI":"10.1109\/TGRS.2007.907604","article-title":"Optimal MMSE pansharpening of very high resolution multispectral images","volume":"46","author":"Garzelli","year":"2008","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"6421","DOI":"10.1109\/TGRS.2019.2906073","article-title":"Robust band-dependent spatial-detail approaches for panchromatic sharpening","volume":"57","author":"Vivone","year":"2019","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"295","DOI":"10.1109\/TGRS.2010.2051674","article-title":"A new adaptive component substitution based satellite image fusion by using partial replacement","volume":"49","author":"Choi","year":"2010","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"826","DOI":"10.1109\/LGRS.2017.2682122","article-title":"Pansharpening of clustered MS and PAN images considering mixed pixels","volume":"14","author":"Shahdoosti","year":"2017","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_13","unstructured":"Zhao, X.L. (2010, January 17\u201319). Image fusion based on IHS transform and principal component analysis transform. Proceedings of the International Conference on Computer Technology Electronics and Communication, Allahabad, India."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"2563","DOI":"10.1109\/TGRS.2015.2503045","article-title":"Spatial methods for multi-spectral pansharpening: Multi-resolution analysis demystified","volume":"54","author":"Alparone","year":"2016","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"1391","DOI":"10.1109\/TGRS.2005.846874","article-title":"A comparative analysis of image fusion methods","volume":"43","author":"Wang","year":"2017","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"753","DOI":"10.1109\/TGRS.2016.2614367","article-title":"Context adaptive pansharpening based on image segmentation","volume":"55","author":"Restaino","year":"2016","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"6152","DOI":"10.1109\/TGRS.2020.2974806","article-title":"Pansharpening: Context-based generalized laplacian pyramids by robust regression","volume":"58","author":"Vivone","year":"2020","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_18","first-page":"2882","article-title":"Fusion of multispectral and panchromatic images based on morphological operators","volume":"25","author":"Restaino","year":"2016","journal-title":"Photogramm. Eng. Remote Sens."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"591","DOI":"10.14358\/PERS.72.5.591","article-title":"MTF tailored multiscale fusion of high resolution ms and pan imagery","volume":"72","author":"Aiazzi","year":"2015","journal-title":"Photogramm. Eng. Remote Sens."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"43","DOI":"10.1007\/s11263-006-6852-x","article-title":"A variational model for P+XS Image fusion","volume":"69","author":"Ballester","year":"2006","journal-title":"Int. J. Comput. Vis."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"656","DOI":"10.1109\/LGRS.2019.2926681","article-title":"Model based reduced rank pansharpening","volume":"17","author":"Palsson","year":"2020","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_22","first-page":"408","article-title":"Super resolution of multispectral images using TV image models","volume":"19","author":"Vega","year":"2008","journal-title":"Knowl.-Based Intell. Inf. Eng. Syst."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"761","DOI":"10.1137\/130928625","article-title":"A nonlocal variational model for pansharpening image fusion","volume":"7","author":"Duran","year":"2014","journal-title":"SIAM J. Imaging Sci."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"4118","DOI":"10.1109\/TIP.2018.2836307","article-title":"Fusing hyperspectral and multispectral images via coupled sparse tensor factorization","volume":"27","author":"Li","year":"2018","journal-title":"IEEE Trans. Image Process."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"7654","DOI":"10.1109\/TGRS.2020.2983063","article-title":"Hyperspectral and multisectral image fusion via nonlocal low-rank tensor decomposition and spectral unmixing","volume":"58","author":"Wang","year":"2020","journal-title":"IEEE Geosci. Remote Sens."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"797","DOI":"10.3390\/rs8100797","article-title":"A review of image fusion algorithms based on the super resolution paradigm","volume":"8","author":"Andrea","year":"2016","journal-title":"Remote Sens."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"1180","DOI":"10.1109\/LSP.2020.3007325","article-title":"A variational pansharpening method based on gradient sparse representation","volume":"27","author":"Tian","year":"2020","journal-title":"IEEE Signal Process. Lett."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Fu, X., Lin, Z., Huang, Y., and Ding, X. (2019, January 16\u201320). A variational pansharpening with local gradient constraints. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.01051"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"4330","DOI":"10.1109\/TIP.2018.2839531","article-title":"A variational pansharpening approach based on reproducible kernel Hilbert space and heaviside function","volume":"27","author":"Deng","year":"2018","journal-title":"IEEE Trans. Image Process."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Zhang, Z.Y., Huang, T.Z., Deng, L.J., Huang, J., Zhao, X.L., and Zheng, C.C. (2018). A framelet-based iterative pan-sharpening approach. Remote Sens., 10.","DOI":"10.3390\/rs10040622"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"4381","DOI":"10.1109\/JSTARS.2020.3012566","article-title":"Hyperspectral image superresolution using unidirectional total variation with tucker decomposition","volume":"13","author":"Xu","year":"2020","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"76","DOI":"10.1016\/j.inffus.2018.11.014","article-title":"The fusion of panchromatic and multispectral remote sensing images via tensor-based sparse modeling and hyper-Laplacian prior","volume":"52","author":"Deng","year":"2019","journal-title":"Inf. Fusion"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"1037","DOI":"10.1109\/LGRS.2014.2376034","article-title":"A new pan sharpening method with deep neural networks","volume":"12","author":"Huang","year":"2015","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Masi, G., Cozzolino, D., Verdoliva, L., and Scarpa, G. (2016). Pansharpening by convolutional neural networks. Remote Sens., 8.","DOI":"10.3390\/rs8070594"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"5443","DOI":"10.1109\/TGRS.2018.2817393","article-title":"Target-adaptive CNN-based pansharpening","volume":"56","author":"Scarpa","year":"2018","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"1795","DOI":"10.1109\/LGRS.2017.2736020","article-title":"Boosting the accuracy of multispectral image pansharpening by learning a deep residual network","volume":"14","author":"Wei","year":"2017","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Yang, Y., Tu, W., Huang, S., and Lu, H. (2020). PCDRN: Progressive cascade deep residual network for pansharpening. Remote Sens., 12.","DOI":"10.3390\/rs12040676"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"110","DOI":"10.1016\/j.inffus.2020.04.006","article-title":"Pan-GAN: An unsupervised pansharpening method for remote sensing image fusion","volume":"62","author":"Ma","year":"2020","journal-title":"Inf. Fusion"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"2090","DOI":"10.1109\/TNNLS.2020.2996498","article-title":"Deep multiscale detail networks for multiband spectral image sharpening","volume":"32","author":"Fu","year":"2020","journal-title":"IEEE Trans. Neural Netw. Learn. Syst."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"6995","DOI":"10.1109\/TGRS.2020.3031366","article-title":"Detail injection-based deep convolutional neural networks for pansharpening","volume":"59","author":"Deng","year":"2021","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"158","DOI":"10.1016\/j.inffus.2021.09.002","article-title":"Laplacian pyramid networks: A new approach for multispectral pansharpening","volume":"78","author":"Jin","year":"2022","journal-title":"Inf. Fusion"},{"key":"ref_42","first-page":"1","article-title":"Deep spatial-spectral global reasoning network for hyperspectral image denoising","volume":"60","author":"Cao","year":"2021","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_43","first-page":"1","article-title":"A nonconvex pansharpening model with spatial and spectral gradient difference-induced nonconvex sparsity priors","volume":"60","author":"Liu","year":"2021","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_44","first-page":"1","article-title":"MC-JAFN: Multilevel contexts-based joint attentive fusion network for pansharpening","volume":"19","author":"Xiang","year":"2021","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Li, K., Zhang, W., Tian, X., Ma, J., Zhou, H., and Wang, Z. (2021, January 5\u20139). Variation-Net: Interpretable variation-inspired deep network for pansharpening. Proceedings of the 2021 IEEE International Conference on Multimedia and Expo (ICME), Shenzhen, China.","DOI":"10.1109\/ICME51207.2021.9428314"},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"950","DOI":"10.1109\/JSTARS.2020.2975000","article-title":"Bayesian pan-sharpening with multiorder gradient-based deep network constraints","volume":"13","author":"Guo","year":"2020","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_47","first-page":"2231","article-title":"Multibranch feature extraction and feature multiplexing network for pansharpening","volume":"59","author":"Lei","year":"2021","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"223","DOI":"10.1016\/j.isprsjprs.2020.12.014","article-title":"GTP-PNet: A residual learning network based on gradient transformation prior for pansharpening","volume":"172","author":"Zhang","year":"2021","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"156442","DOI":"10.1109\/ACCESS.2020.3019201","article-title":"Two-stage pansharpening based on multi-level detail injection network","volume":"8","author":"Hu","year":"2020","journal-title":"IEEE Access."},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Wu, Y., Huang, M., Li, Y., Feng, S., and Wu, D. (2021). A distributed fusion framework of multispectral and panchromatic images based on residual network. Remote Sens., 13.","DOI":"10.3390\/rs13132556"},{"key":"ref_51","doi-asserted-by":"crossref","unstructured":"Vitale, S., and Scarpa, G. (2020). A detail-preserving cross-scale learning strategy for CNN-based pansharpening. Remote Sens., 12.","DOI":"10.3390\/rs12030348"},{"key":"ref_52","doi-asserted-by":"crossref","unstructured":"Wang, W., Zhou, Z., Liu, H., and Xie, G. (2021). MSDRN: Pansharpening of multispectral images via multi-scale deep residual network. Remote Sens., 13.","DOI":"10.3390\/rs13061200"},{"key":"ref_53","doi-asserted-by":"crossref","unstructured":"Naushad, R., Kaur, T., and Ghaderpour, E. (2021). Deep transfer learning for land use and land cover classification: A comparative study. Sensors, 21.","DOI":"10.3390\/s21238083"},{"key":"ref_54","doi-asserted-by":"crossref","unstructured":"Xu, H., Le, Z., Huang, J., and Ma, J. (2021). A cross direction and progressive network for pansharpening. Remote Sens., 13.","DOI":"10.3390\/rs13153045"},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"318","DOI":"10.1109\/LGRS.2013.2257669","article-title":"A new pansharpening algorithm based on total variation","volume":"11","author":"Palsson","year":"2013","journal-title":"IEEE Geosci. Remote Sens Lett."},{"key":"ref_56","first-page":"1005","article-title":"Nonlocal operators with applications in imaging","volume":"7","author":"Osher","year":"2008","journal-title":"Multiscale Model. Simul."},{"key":"ref_57","unstructured":"Zhang, R. (2017). Research of Global Sparse Gradient Based Image Processing Methods. [Ph.D. Dissertation, Xidian University]."},{"key":"ref_58","doi-asserted-by":"crossref","first-page":"385","DOI":"10.1016\/j.future.2018.04.096","article-title":"A sparse representation based pansharpening method","volume":"88","author":"Yang","year":"2018","journal-title":"Future Gener. Comput. Syst."},{"key":"ref_59","doi-asserted-by":"crossref","first-page":"313","DOI":"10.1109\/LGRS.2004.836784","article-title":"A global quality measurement of pansharpened multispectral imagery","volume":"1","author":"Alparone","year":"2004","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_60","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/s12518-016-0179-2","article-title":"Evaluation of pansharpening methods for spatial and spectral quality","volume":"9","author":"Pushparaj","year":"2008","journal-title":"Appl. Geomat."},{"key":"ref_61","doi-asserted-by":"crossref","first-page":"1672","DOI":"10.1109\/TGRS.2006.869923","article-title":"A new intensity hue saturation fusion approach to image fusion with a tradeoff parameter","volume":"6","author":"Choi","year":"2006","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_62","doi-asserted-by":"crossref","first-page":"193","DOI":"10.14358\/PERS.74.2.193","article-title":"Multispectral and panchromatic data fusion assessment without reference","volume":"74","author":"Alparone","year":"2008","journal-title":"Photogramm. Eng. Remote Sens."},{"key":"ref_63","first-page":"691","article-title":"Fusion of satellite images of different spatial resolutions: Assessing the quality of resulting images","volume":"63","author":"Wald","year":"1997","journal-title":"Photogramm. Eng. Remote Sens."},{"key":"ref_64","first-page":"1","article-title":"Plug-and-Play image restoration with deep denoiser prior","volume":"99","author":"Zhang","year":"2021","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/14\/5\/1121\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T22:26:42Z","timestamp":1760135202000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/14\/5\/1121"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,2,24]]},"references-count":64,"journal-issue":{"issue":"5","published-online":{"date-parts":[[2022,3]]}},"alternative-id":["rs14051121"],"URL":"https:\/\/doi.org\/10.3390\/rs14051121","relation":{},"ISSN":["2072-4292"],"issn-type":[{"type":"electronic","value":"2072-4292"}],"subject":[],"published":{"date-parts":[[2022,2,24]]}}}