{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,22]],"date-time":"2026-01-22T09:08:02Z","timestamp":1769072882665,"version":"3.49.0"},"reference-count":53,"publisher":"MDPI AG","issue":"17","license":[{"start":{"date-parts":[[2020,8,29]],"date-time":"2020-08-29T00:00:00Z","timestamp":1598659200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Pansharpening is a typical image fusion problem, which aims to produce a high resolution multispectral (HRMS) image by integrating a high spatial resolution panchromatic (PAN) image with a low spatial resolution multispectral (MS) image. Prior arts have used either component substitution (CS)-based methods or multiresolution analysis (MRA)-based methods for this propose. Although they are simple and easy to implement, they usually suffer from spatial or spectral distortions and could not fully exploit the spatial and\/or spectral information existed in PAN and MS images. By considering their complementary performances and with the goal of combining their advantages, we propose a pansharpening weight network (PWNet) to adaptively average the fusion results obtained by different methods. The proposed PWNet works by learning adaptive weight maps for different CS-based and MRA-based methods through an end-to-end trainable neural network (NN). As a result, the proposed PWN inherits the data adaptability or flexibility of NN, while maintaining the advantages of traditional methods. Extensive experiments on data sets acquired by three different kinds of satellites demonstrate the superiority of the proposed PWNet and its competitiveness with the state-of-the-art methods.<\/jats:p>","DOI":"10.3390\/rs12172804","type":"journal-article","created":{"date-parts":[[2020,8,30]],"date-time":"2020-08-30T06:06:22Z","timestamp":1598767582000},"page":"2804","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":15,"title":["PWNet: An Adaptive Weight Network for the Fusion of Panchromatic and Multispectral Images"],"prefix":"10.3390","volume":"12","author":[{"given":"Junmin","family":"Liu","sequence":"first","affiliation":[{"name":"School of Mathematics and Statistics, Xi\u2019an Jiaotong University, Xi\u2019an 710049, China"}]},{"given":"Yunqiao","family":"Feng","sequence":"additional","affiliation":[{"name":"School of Mathematics and Statistics, Xi\u2019an Jiaotong University, Xi\u2019an 710049, China"}]},{"given":"Changsheng","family":"Zhou","sequence":"additional","affiliation":[{"name":"School of Mathematics and Statistics, Xi\u2019an Jiaotong University, Xi\u2019an 710049, China"}]},{"given":"Chunxia","family":"Zhang","sequence":"additional","affiliation":[{"name":"School of Mathematics and Statistics, Xi\u2019an Jiaotong University, Xi\u2019an 710049, China"}]}],"member":"1968","published-online":{"date-parts":[[2020,8,29]]},"reference":[{"key":"ref_1","first-page":"3","article-title":"Spectral imaging for remote sensing","volume":"14","author":"Shaw","year":"2003","journal-title":"Linc. Lab. J."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"102","DOI":"10.1016\/j.inffus.2018.05.006","article-title":"Review of the pansharpening methods for remote sensing images based on the idea of meta-analysis: Practical discussion and challenges","volume":"46","author":"Meng","year":"2019","journal-title":"Inf. Fusion"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"2565","DOI":"10.1109\/TGRS.2014.2361734","article-title":"A critical comparison among pansharpenig algorithms","volume":"53","author":"Vivone","year":"2015","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"25","DOI":"10.1080\/19479830903561985","article-title":"Multi-sensor image fusion for pansharpening in remote sensing","volume":"1","author":"Ehlers","year":"2010","journal-title":"Int. J. Image Data Fusion"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"389","DOI":"10.1016\/j.sigpro.2016.05.002","article-title":"Image super-resolution: The techniques, applications, and future","volume":"128","author":"Yue","year":"2016","journal-title":"Signal Process."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"494","DOI":"10.1016\/j.rse.2002.08.002","article-title":"Mapping forest degradation in the Eastern Amazon from SPOT 4 through spectral mixture models","volume":"87","author":"Souza","year":"2003","journal-title":"Remote Sens. Environ."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"44","DOI":"10.1111\/j.1477-9730.2006.00353.x","article-title":"Synthesis of multispectral images to high spatial resolution: Road extraction based on fuzzy logic and mathematical morphology from pansharpened IKONOS images","volume":"21","author":"Mohammadzadeh","year":"2006","journal-title":"Photogramm. Rec."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"27","DOI":"10.1109\/MGRS.2015.2440094","article-title":"Hyperspectral pansharpening: A review","volume":"3","author":"Loncan","year":"2015","journal-title":"IEEE Geosci. Remote Sens. Mag."},{"key":"ref_9","first-page":"459","article-title":"Synthesis of multispectral images to high spatial resolution: The use of intensity-huesaturation transformations for merging SPOT panchromatic and multispectral image data","volume":"56","author":"Carper","year":"1990","journal-title":"Photogramm. Eng. Remote Sens."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"177","DOI":"10.1016\/S1566-2535(01)00036-7","article-title":"A new look at IHS-like image fusion methods","volume":"2","author":"Tu","year":"2001","journal-title":"Inf. Fusion"},{"key":"ref_11","first-page":"339","article-title":"Extracting spectral contrast in Landsat thematic mapper image data using selective principal component analysis","volume":"55","author":"Chavez","year":"1989","journal-title":"Photogramm. Eng. Remote Sens."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"343","DOI":"10.1016\/0034-4257(87)90088-5","article-title":"Color enhancement of highly correlated images-II. Channel ration and \u201cChromaticity\u201d Transform techniques","volume":"22","author":"Gillespie","year":"1987","journal-title":"Remote Sens. Environ."},{"key":"ref_13","unstructured":"Laben, C.A., and Brower, B.V. (2000). Process for Enhancing the Spatial Resolution of Multispectral Imagery Using Pan-Sharpening. (6011875), U.S. Patent."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"228","DOI":"10.1109\/TGRS.2007.907604","article-title":"Optimal MMSE pan sharpening of very high resolution multispectral images","volume":"46","author":"Garzelli","year":"2008","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"3230","DOI":"10.1109\/TGRS.2007.901007","article-title":"Improving component substitution pansharpening through multivariate regression of MS+Pan data","volume":"45","author":"Aiazzi","year":"2007","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"6421","DOI":"10.1109\/TGRS.2019.2906073","article-title":"Robust band-dependent spatial-detail approaches for panchromatic sharpening","volume":"57","author":"Vivone","year":"2019","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"295","DOI":"10.1109\/TGRS.2010.2051674","article-title":"Synthesis of multispectral images to high spatial resolution: A new adaptive component-substitution based satellite image fusion by using partial replacement","volume":"49","author":"Choi","year":"2011","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_18","first-page":"295","article-title":"Comparison of three different methods to merge multiresolution and multispectral data: Landsat TM and SPOT panchromatic","volume":"57","author":"Chavez","year":"1991","journal-title":"Photogramm. Eng. Remote Sens."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"3461","DOI":"10.1080\/014311600750037499","article-title":"Smoothing filter-based intensity modulation: A spectral preserve image fusion technique for improving spatial details","volume":"21","author":"Liu","year":"2000","journal-title":"Int. J. Remote Sens."},{"key":"ref_20","unstructured":"Aiazzi, B., Alparone, L., Baronti, S., Garzelli, A., and Selva, M. (2003, January 22\u201323). An MTF based spectral distortion minimizing model for pan-sharpening of very high resolution multispectral images of urban areas. Proceedings of the 2nd GRSS\/ ISPRS Joint Workshop Remote Sensing and Data Fusion URBAN Areas, Berlin, Germany."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"591","DOI":"10.14358\/PERS.72.5.591","article-title":"MTF tailored multiscale fusion of high-resolution MS and Pan imagery","volume":"72","author":"Aiazzi","year":"2006","journal-title":"Photogramm. Eng. Remote Sens."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"930","DOI":"10.1109\/LGRS.2013.2281996","article-title":"Contrast and error-based fusion schemes for multispectral image pansharpening","volume":"11","author":"Vivone","year":"2014","journal-title":"IIEEE Trans. Geosci. Remote Sens."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"98","DOI":"10.1109\/LGRS.2007.909934","article-title":"Indusion: Fusion of multispectral and panchromatic images using the induction scaling technique","volume":"5","author":"Khan","year":"2008","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"2376","DOI":"10.1109\/TGRS.2005.856106","article-title":"Introduction of sensor spectral response into image fusion methods. Application to wavelet-based methods","volume":"43","author":"Otazu","year":"2005","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"1323","DOI":"10.1109\/TGRS.2008.916211","article-title":"An efficient pan-sharpening method via a combined adaptive PCA approach and contourlets","volume":"46","author":"Shah","year":"2008","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"2984","DOI":"10.1109\/JSTARS.2015.2420582","article-title":"Processing of Multiresolution Thermal Hyperspectral and Digital Color Data: Outcome of the 2014 IEEE GRSS Data Fusion Contest","volume":"8","author":"Liao","year":"2015","journal-title":"IEEE J. Sel. Top. Appl. Earth Observ. Remote Sens."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"43","DOI":"10.1007\/s11263-006-6852-x","article-title":"A variational model for P+XS image fusion","volume":"69","author":"Ballester","year":"2006","journal-title":"Int. J. Comput. Vis."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"150","DOI":"10.1137\/100810356","article-title":"A variational approach for sharpening high dimensional images","volume":"5","author":"Moller","year":"2012","journal-title":"SIAM J. Imaging Sci."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"2827","DOI":"10.1109\/TGRS.2012.2213604","article-title":"A sparse image fusion algorithm with application to pansharpening","volume":"51","author":"Zhu","year":"2013","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"4330","DOI":"10.1109\/TIP.2018.2839531","article-title":"A variational pansharpening approach based on reproducible kernel hilbert space and heaviside function","volume":"27","author":"Deng","year":"2018","journal-title":"IEEE Trans. Image Process."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"656","DOI":"10.1109\/LGRS.2019.2926681","article-title":"Model-based reduced-rank pansharpening","volume":"17","author":"Palsson","year":"2020","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Masi, G., Cozzolino, D., Verdoliva, L., and Scarpa, G. (2016). Pansharpening by convolutional neural networks. Remote Sens., 8.","DOI":"10.3390\/rs8070594"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Yang, J., Fu, X., Huang, Y., Ding, X., and Paisley, J. (2017, January 22\u201329). PanNet: A deep network architecture for pan-sharpening. Proceedings of the International Conference on Computer Vision, Venice, Italy.","DOI":"10.1109\/ICCV.2017.193"},{"key":"ref_34","first-page":"428","article-title":"Synthesis of multispectral images to high spatial resolution: Remote sensing image fusion based on two-stream fusion network","volume":"46","author":"Liu","year":"2018","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1109\/TGRS.2020.2993861","article-title":"Hyperspectral Pansharpening Using Deep Prior and Dual Attention Residual Network","volume":"10","author":"Zheng","year":"2020","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_36","unstructured":"Han, S., Pool, J., Tran, J., and Dally, W. (2015, January 7\u201312). Learning both weights and connections for efficient neural network. Proceedings of the Advances in Neural Information Processing Systems 2015, Montreal, QC, Canada."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"6","DOI":"10.1109\/MGRS.2018.2890023","article-title":"Multisource and multitemporal data fusion in remote sensing: A comprehensive review of the state of the art","volume":"7","author":"Ghamisi","year":"2019","journal-title":"IEEE Geosci. Remote Sens. Mag."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"3012","DOI":"10.1109\/TGRS.2007.904923","article-title":"Comparison of pansharpening algorithms: Outcome of the 2006 GRS-S DataFusion Contest","volume":"45","author":"Alparone","year":"2007","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_39","first-page":"49","article-title":"Fusion of high spatial and spectral resolution images: The ARSIS concept and its implementation","volume":"66","author":"Ranchin","year":"2000","journal-title":"Photogramm. Eng. Remote Sens."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"2882","DOI":"10.1109\/TIP.2016.2556944","article-title":"Fusion of multispectral and panchromatic images based on morphological operators","volume":"25","author":"Restaino","year":"2016","journal-title":"IEEE Trans. Image Process."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"10","DOI":"10.1007\/s11220-016-0135-6","article-title":"Remote sensing image fusion with convolutional neural network","volume":"17","author":"Zhong","year":"2016","journal-title":"Sens. Imaging"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"1795","DOI":"10.1109\/LGRS.2017.2736020","article-title":"Boosting the Accuracy of Multispectral Image Pansharpening by Learning a Deep Residual Network","volume":"14","author":"Wei","year":"2017","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"978","DOI":"10.1109\/JSTARS.2018.2794888","article-title":"A Multiscale and Multidepth Convolutional Neural Network for Remote Sensing Imagery Pan-Sharpening","volume":"3","author":"Yuan","year":"2018","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27\u201330). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition 2016, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_45","unstructured":"Nair, N., and Hinton, G.E. (2010, January 21\u201324). Rectified linear units improve restricted boltzmann machines. Proceedings of the 27th International Conference on Machine Learning, Haifa, Israel."},{"key":"ref_46","first-page":"691","article-title":"Data fusion: Definitions and architectures: Fusion of satellite images of different spatial resolutions: Assessing the quality of resulting images","volume":"63","author":"Wald","year":"1997","journal-title":"Photogramm. Eng. Remote Sens."},{"key":"ref_47","unstructured":"Kingma, D.P., and Ba, J. (2014). Adam: A Method for Stochastic Optimization. arXiv."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"81","DOI":"10.1109\/97.995823","article-title":"A universal image quality index","volume":"9","author":"Wang","year":"2002","journal-title":"IEEE Signal Process. Lett."},{"key":"ref_49","unstructured":"Yuhas, R.H., Goetz, A.F., and Boardman, J.W. (1992, January 1\u20135). Discrimination among semi-arid landscape endmembers using the Spectral Angle Mapper (sam) algorithm. Proceedings of the Summaries of the Third Annual JPL Airborne Geoscience Workshop, Pasadena, CA, USA."},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"743","DOI":"10.1080\/014311698215973","article-title":"Chanussot, A wavelet transform method to merge landsat tm and spot panchromatic data","volume":"19","author":"Zhou","year":"1998","journal-title":"Int. J. Remote Sens."},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"193","DOI":"10.14358\/PERS.74.2.193","article-title":"Multispectral and panchromatic data fusion assessment without reference","volume":"74","author":"Alparone","year":"2008","journal-title":"Photogramm. Eng. Remote Sens."},{"key":"ref_52","doi-asserted-by":"crossref","unstructured":"Qu, Y., Baghbaderani, R.K., Qi, H., and Kwan, C. (2020). Unsupervised Pansharpening Based on Self-Attention Mechanism. arXiv.","DOI":"10.1109\/TGRS.2020.3009207"},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"27263","DOI":"10.1109\/ACCESS.2017.2765380","article-title":"CUDA-Based Parallelization of Power Iteration Clustering for Large Datasets","volume":"5","author":"Silva","year":"2017","journal-title":"IEEE Access"}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/12\/17\/2804\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T10:04:40Z","timestamp":1760177080000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/12\/17\/2804"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,8,29]]},"references-count":53,"journal-issue":{"issue":"17","published-online":{"date-parts":[[2020,9]]}},"alternative-id":["rs12172804"],"URL":"https:\/\/doi.org\/10.3390\/rs12172804","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,8,29]]}}}