{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,27]],"date-time":"2025-10-27T16:16:49Z","timestamp":1761581809172,"version":"build-2065373602"},"reference-count":56,"publisher":"MDPI AG","issue":"5","license":[{"start":{"date-parts":[[2019,3,7]],"date-time":"2019-03-07T00:00:00Z","timestamp":1551916800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Fusing the panchromatic (PAN) image and low spatial-resolution multispectral (LR MS) images is an effective technology for generating high spatial-resolution MS (HR MS) images. Some image-fusion methods inspired by neighbor embedding (NE) are proposed and produce competitive results. These methods generally adopt Euclidean distance to determinate the neighbors. However, closer Euclidean distance is not equal to greater similarity in spatial structure. In this paper, we propose a spatial weighted neighbor embedding (SWNE) approach for PAN and MS image fusion, by exploring the similar manifold structures existing in the observed LR MS images to those of HR MS images. In SWNE, the spatial neighbors of the LR patch are found first. Second, the weights of these neighbors are estimated by the alternative direction multiplier method (ADMM), in which the neighbors and their weights are determined simultaneously. Finally, the HR patches are reconstructed by the sum of HR patches corresponding to the LR patches multiplying with their weights. Due to the introduction of spatial structures in objective function, outlier patches can be eliminated effectively by ADMM. Compared with other methods based on NE, more reasonable neighbor patches and their weights are estimated simultaneously. Some experiments are conducted on datasets collected by QuickBird and Geoeye-1 satellites to validate the effectiveness of SWNE, and the results demonstrate a better performance of SWNE in spatial and spectral information preservation.<\/jats:p>","DOI":"10.3390\/rs11050557","type":"journal-article","created":{"date-parts":[[2019,3,8]],"date-time":"2019-03-08T04:58:35Z","timestamp":1552021115000},"page":"557","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":17,"title":["Fusion of Multispectral and Panchromatic Images via Spatial Weighted Neighbor Embedding"],"prefix":"10.3390","volume":"11","author":[{"given":"Kai","family":"Zhang","sequence":"first","affiliation":[{"name":"School of Information Science and Engineering, Shandong Normal University, Jinan, Shandong 250014, China"}]},{"given":"Feng","family":"Zhang","sequence":"additional","affiliation":[{"name":"School of Information Science and Engineering, Shandong Normal University, Jinan, Shandong 250014, China"}]},{"given":"Shuyuan","family":"Yang","sequence":"additional","affiliation":[{"name":"Key Laboratory of Intelligent Perception and Image Understanding of Ministry of Education, Xidian University, Xi\u2019an 710071, China"}]}],"member":"1968","published-online":{"date-parts":[[2019,3,7]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"574","DOI":"10.1109\/TGRS.2018.2858817","article-title":"Fully convolutional networks for multisource building extraction from an open aerial and satellite imagery data set","volume":"57","author":"Ji","year":"2019","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Wu, X., Zhang, X., Wang, N., and Cen, Y. (2019). Joint sparse and low-rank multi-task learning with extended multi-attribute profile for hyperspectral target detection. Remote Sens., 11.","DOI":"10.3390\/rs11020150"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"218","DOI":"10.1016\/j.sigpro.2014.12.017","article-title":"Sparse representation based pansharpening with details injection model","volume":"113","author":"Yin","year":"2015","journal-title":"Signal Process."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"6539","DOI":"10.3390\/rs5126539","article-title":"Spatial quality assessment of pan-sharpened high resolution satellite imagery based on an automatically estimated edge based metric","volume":"5","author":"Javan","year":"2013","journal-title":"Remote Sens."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"2565","DOI":"10.1109\/TGRS.2014.2361734","article-title":"A critical comparison among pansharpening algorithms","volume":"53","author":"Vivone","year":"2015","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_6","first-page":"265","article-title":"Comparison of three different methods to merge multiresolution and multispectral data: Landsat TM and SPOT Panchromatic","volume":"57","author":"Chavez","year":"1991","journal-title":"Photogramm. Eng. Remote Sens."},{"key":"ref_7","unstructured":"Laben, C.A., and Brower, B.V. (2000). Process for Enhancing the Spatial Resolution of Multispectral Imagery Using Pan-Sharpening, Eastman Kodak Company. (6011875), U.S. Patent."},{"key":"ref_8","first-page":"177","article-title":"A new look at IHS-like image fusion methods","volume":"3","author":"Tu","year":"2012","journal-title":"Inf. Fusion"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"746","DOI":"10.1109\/LGRS.2010.2046715","article-title":"An adaptive IHS pan-sharpening method","volume":"7","author":"Strait","year":"2010","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"4","DOI":"10.1016\/S0924-2716(03)00013-3","article-title":"Image fusion\u2014The ARSIS concept and some successful implementation schemes","volume":"58","author":"Ranchin","year":"2003","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"3674","DOI":"10.1109\/TGRS.2006.881758","article-title":"Estimation of the number of decomposition levels for a wavelet-based multiresolution multisensor image fusion","volume":"44","author":"Pradhan","year":"2006","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"1313","DOI":"10.1109\/TGRS.2007.912737","article-title":"Remote sensing image fusion using multiscale mapped LS-SVM","volume":"46","author":"Zheng","year":"2008","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"1323","DOI":"10.1109\/TGRS.2008.916211","article-title":"An efficient pan-sharpening method via a combined adaptive PCA approach and contourlets","volume":"46","author":"Shah","year":"2008","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"1009","DOI":"10.1016\/j.neucom.2015.09.106","article-title":"Deformation invariant image matching based on dissimilarity of spatial features","volume":"175","author":"Kahaki","year":"2016","journal-title":"Neurocomputing"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Garzelli, A., Aiazzi, B., Alparone, L., Lolli, S., and Vivone, G. (2018). Multispectral pansharpening with radiative transfer-based detail-injection modeling for preserving changes in vegetation cover. Remote Sens., 10.","DOI":"10.20944\/preprints201805.0149.v1"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"73","DOI":"10.1016\/j.inffus.2013.11.004","article-title":"Fusion of multispectral and panchromatic images via sparse representation and local autoregressive model","volume":"20","author":"Wang","year":"2014","journal-title":"Inf. Fusion"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"1693","DOI":"10.1109\/TSMCB.2012.2198810","article-title":"Adjustable model-based fusion method for multispectral and panchromatic images","volume":"42","author":"Zhang","year":"2012","journal-title":"IEEE Trans. Syst. Man Cybern. B Cybern."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"5740","DOI":"10.1109\/JSTARS.2015.2475754","article-title":"Fusion of panchromatic and multispectral images via coupled sparse non-negative matrix factorization","volume":"9","author":"Zhang","year":"2016","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"736","DOI":"10.1109\/TGRS.2010.2067219","article-title":"A new pan-sharpening method using a compressed sensing technique","volume":"49","author":"Li","year":"2011","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"4779","DOI":"10.1109\/TGRS.2012.2230332","article-title":"Remote sensing image fusion via sparse representations over learned dictionaries","volume":"51","author":"Li","year":"2013","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"4779","DOI":"10.1109\/TGRS.2017.2675961","article-title":"A joint sparse and low-rank decomposition for pansharpening of multispectral images","volume":"55","author":"Yin","year":"2017","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"3647","DOI":"10.1109\/TNNLS.2017.2736011","article-title":"Learning low-rank decomposition for pan-sharpening with spatial-spectral offsets","volume":"29","author":"Yang","year":"2018","journal-title":"IEEE Trans. Neural Netw. Learn. Syst."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"996","DOI":"10.1109\/83.503915","article-title":"Extraction of high-resolution frames from video sequences","volume":"5","author":"Schultz","year":"1996","journal-title":"IEEE Trans. Image Process."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"1289","DOI":"10.1109\/TIT.2006.871582","article-title":"Compressed sensing","volume":"52","author":"Donoho","year":"2006","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Xue, J., Zhao, Y., Liao, W., and Chan, J.-W. (2019). Nonlocal tensor sparse representation and low-rank regularization for hyperspectral image compressive sensing reconstruction. Remote Sens., 11.","DOI":"10.3390\/rs11020193"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Ying, H., Leung, Y., Cao, F., Fung, T., and Xue, J. (2018). Sparsity-based spatiotemporal fusion via adaptive multi-band constraints. Remote Sens., 10.","DOI":"10.3390\/rs10101646"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Zhang, Y., Wang, X., Xie, X., and Li, Y. (2018). Salient object detection via recursive sparse representation. Remote Sens., 10.","DOI":"10.3390\/rs10040652"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Zhou, Z., Wang, M., Cao, Z., and Pi, Y. (2018). SAR image recognition with monogenic scale selection-based weighted multi-task joint sparse representation. Remote Sens., 10.","DOI":"10.3390\/rs10040504"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"2861","DOI":"10.1109\/TIP.2010.2050625","article-title":"Image super-resolution via sparse representation","volume":"19","author":"Yang","year":"2010","journal-title":"IEEE Trans. Image Process."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Gao, D., Hu, Z., and Ye, R. (2018). Self-dictionary regression for hyperspectral image super-resolution. Remote Sens., 10.","DOI":"10.3390\/rs10101574"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"1117","DOI":"10.1109\/TGRS.2018.2864750","article-title":"Convolution structure sparse coding for fusion of panchromatic and multispectral images","volume":"57","author":"Zhang","year":"2019","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"2827","DOI":"10.1109\/TGRS.2012.2213604","article-title":"A sparse image fusion algorithm with application to pan-sharpening","volume":"51","author":"Zhu","year":"2013","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"2664","DOI":"10.1109\/TGRS.2015.2504261","article-title":"Exploiting joint sparsity for pansharpening: The J-SparseFI algorithm","volume":"54","author":"Zhu","year":"2016","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"1792","DOI":"10.1109\/JSTARS.2013.2283236","article-title":"Two-step sparse coding for the pan-sharpening of remote sensing images","volume":"7","author":"Jiang","year":"2014","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"18","DOI":"10.1016\/j.knosys.2018.01.022","article-title":"Sparse tensor neighbor embedding based pan-sharpening via N-way block pursuit","volume":"149","author":"Wang","year":"2018","journal-title":"Knowl. Based Syst."},{"key":"ref_36","first-page":"1","article-title":"Block sparse representations of tensors using Kronecker bases","volume":"7","author":"Caiafa","year":"2012","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"796","DOI":"10.1109\/TPAMI.2007.70735","article-title":"Riemannian manifold learning","volume":"30","author":"Lin","year":"2008","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_38","unstructured":"Chang, H., Yeung, D., and Xiong, Y. (July, January 27). Super-resolution through neighbor embedding. Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR 2004), Washington, DC, USA."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"1363","DOI":"10.1109\/TGRS.2016.2623626","article-title":"Multispectral and hyperspectral image fusion based on group spectral embedding and low-rank factorization","volume":"55","author":"Zhang","year":"2017","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Sun, L., Zhan, T., Wu, Z., Xiao, L., and Jeon, B. (2018). Hyperspectral mixed denoising via spectral difference-induced total variation and low-rank approximation. Remote Sens., 10.","DOI":"10.3390\/rs10121956"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"2323","DOI":"10.1126\/science.290.5500.2323","article-title":"Nonlinear dimensionality reduction by locally linear embedding","volume":"290","author":"Roweis","year":"2000","journal-title":"Science"},{"key":"ref_42","first-page":"119","article-title":"Think globally, fit locally: Unsupervised learning of low dimensional manifolds","volume":"4","author":"Saul","year":"2003","journal-title":"J. Mach. Learn. Res."},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Yu, H., Gao, L., Liao, W., and Zhang, B. (2018). Group Sparse representation based on nonlocal spatial and local spectral similarity for hyperspectral imagery classification. Sensors, 18.","DOI":"10.3390\/s18061695"},{"key":"ref_44","unstructured":"Ehsan, E., and Vidal, R. (2011, January 12\u201315). Sparse manifold clustering and embedding. Proceedings of the Advances in Neural Information Processing Systems 24 (NIPS 2011), Granada, Spain."},{"key":"ref_45","first-page":"1","article-title":"Distributed optimization and statistical learning via the alternating direction method of multipliers","volume":"3","author":"Boyd","year":"2011","journal-title":"Found. Treads Mach. Learn."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"0200676","DOI":"10.1371\/journal.pone.0200676","article-title":"Geometric feature descriptor and dissimilarity-based registration of remotely sensed imagery","volume":"13","author":"Kahaki","year":"2018","journal-title":"PLoS ONE"},{"key":"ref_47","first-page":"634","article-title":"Georeferencing performance of Geoeye-1","volume":"75","author":"Fraser","year":"2009","journal-title":"Photogramm. Eng. Remote Sens."},{"key":"ref_48","first-page":"691","article-title":"Fusion of satellite images of different spatial resolutions: Assessing the quality of resulting images","volume":"63","author":"Wald","year":"1997","journal-title":"Photogramm. Eng. Remote Sens."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"309","DOI":"10.1109\/LGRS.2004.834804","article-title":"A fast Intensity\u2013Hue\u2013Saturation fusion technique with spectral adjustment for IKONOS imagery","volume":"1","author":"Tu","year":"2004","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"2376","DOI":"10.1109\/TGRS.2005.856106","article-title":"Introduction of sensor spectral response into image fusion methods. Application to wavelet-based methods","volume":"43","author":"Otazu","year":"2005","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"313","DOI":"10.1109\/LGRS.2004.836784","article-title":"A global quality measurement of pan-sharpened multispectral imagery","volume":"1","author":"Alparone","year":"2004","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_52","doi-asserted-by":"crossref","unstructured":"Rodriguez-Esparragon, D., Marcello-Ruiz, J., Medina-Mach\u00edn, A., Eugenio-Gonzalez, F., Gonzalo-Mart\u00edn, C., and Garcia-Pedrero, A. (2014, January 13\u201318). Evaluation of the performance of spatial assessments of pansharpened images. Proceedings of the IEEE Geoscience and Remote Sensing Symposium (IGARSS), Quebec City, QC, Canada.","DOI":"10.1109\/IGARSS.2014.6946757"},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"81","DOI":"10.1109\/97.995823","article-title":"A universal image quality index","volume":"9","author":"Wang","year":"2002","journal-title":"IEEE Signal Process. Lett."},{"key":"ref_54","unstructured":"Yuhas, R.H., Goetz, A.F.H., and Boardman, J.W. (1992, January 1\u20135). Discrimination among semi-arid landscape endmembers using the spectral angle mapper (SAM) algorithm. Proceedings of the 4th JPL Airborne Earth Science Workshop, Pasadena, CA, USA."},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"193","DOI":"10.14358\/PERS.74.2.193","article-title":"Multispectral and panchromatic data fusion assessment without reference","volume":"74","author":"Alparone","year":"2008","journal-title":"Photogramm. Eng. Remote Sens."},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"1122","DOI":"10.1109\/TVCG.2010.226","article-title":"Fast exact nearest patch matching for patch-based image editing and processing","volume":"17","author":"Xiao","year":"2011","journal-title":"IEEE Trans. Vis. Comput. Graph."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/11\/5\/557\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T12:37:04Z","timestamp":1760186224000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/11\/5\/557"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,3,7]]},"references-count":56,"journal-issue":{"issue":"5","published-online":{"date-parts":[[2019,3]]}},"alternative-id":["rs11050557"],"URL":"https:\/\/doi.org\/10.3390\/rs11050557","relation":{},"ISSN":["2072-4292"],"issn-type":[{"type":"electronic","value":"2072-4292"}],"subject":[],"published":{"date-parts":[[2019,3,7]]}}}