{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,28]],"date-time":"2026-02-28T17:49:31Z","timestamp":1772300971972,"version":"3.50.1"},"reference-count":27,"publisher":"MDPI AG","issue":"10","license":[{"start":{"date-parts":[[2019,5,16]],"date-time":"2019-05-16T00:00:00Z","timestamp":1557964800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"National Nature Science Foundation","award":["61501008"],"award-info":[{"award-number":["61501008"]}]},{"name":"Beijing Natural Science Foundation of China","award":["4172002"],"award-info":[{"award-number":["4172002"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Fusion of the high-spatial-resolution hyperspectral (HHS) image using low-spatial- resolution hyperspectral (LHS) and high-spatial-resolution multispectral (HMS) image is usually formulated as a spatial super-resolution problem of LHS image with the help of an HMS image, and that may result in the loss of detailed structural information. Facing the above problem, the fusion of HMS with LHS image is formulated as a nonlinear spectral mapping from an HMS to HHS image with the help of an LHS image, and a novel cluster-based fusion method using multi-branch BP neural networks (named CF-BPNNs) is proposed, to ensure a more reasonable spectral mapping for each cluster. In the training stage, considering the intrinsic characteristics that the spectra are more similar within each cluster than that between clusters and so do the corresponding spectral mapping, an unsupervised clustering is used to divide the spectra of the down-sampled HMS image (marked as LMS) into several clusters according to spectral correlation. Then, the spectrum-pairs from the clustered LMS image and the corresponding LHS image are used to train multi-branch BP neural networks (BPNNs), to establish the nonlinear spectral mapping for each cluster. In the fusion stage, a supervised clustering is used to group the spectra of HMS image into the clusters determined during the training stage, and the final HHS image is reconstructed from the clustered HMS image using the trained multi-branch BPNNs accordingly. Comparison results with the related state-of-the-art methods demonstrate that our proposed method achieves a better fusion quality both in spatial and spectral domains.<\/jats:p>","DOI":"10.3390\/rs11101173","type":"journal-article","created":{"date-parts":[[2019,5,16]],"date-time":"2019-05-16T11:21:22Z","timestamp":1558005682000},"page":"1173","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":49,"title":["Hyperspectral and Multispectral Image Fusion Using Cluster-Based Multi-Branch BP Neural Networks"],"prefix":"10.3390","volume":"11","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-9721-5371","authenticated-orcid":false,"given":"Xiaolin","family":"Han","sequence":"first","affiliation":[{"name":"Institute for Artificial Intelligence, Beijing National Research Center for Information Science and Technology, State Key Laboratory of Intelligent Technology and Systems, Department of Electronic Engineering, Tsinghua University, Beijing 100084, China"}]},{"given":"Jing","family":"Yu","sequence":"additional","affiliation":[{"name":"Faculty of Information Technology, Beijing Univ. of Technology, Beijing 100124, China"}]},{"given":"Jiqiang","family":"Luo","sequence":"additional","affiliation":[{"name":"School of Opte-Electronics, Beijing Institute of Technology, Beijing 100081, China"}]},{"given":"Weidong","family":"Sun","sequence":"additional","affiliation":[{"name":"Institute for Artificial Intelligence, Beijing National Research Center for Information Science and Technology, State Key Laboratory of Intelligent Technology and Systems, Department of Electronic Engineering, Tsinghua University, Beijing 100084, China"}]}],"member":"1968","published-online":{"date-parts":[[2019,5,16]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Akhtar, N., Shafait, F., and Mian, A. (2014). Sparse Spatio-Spectral Representation for Hyperspectral Image Super-Resolution, Springer. European Conference on Computer Vision.","DOI":"10.1109\/CVPR.2015.7298986"},{"key":"ref_2","first-page":"457","article-title":"The use of intensity-hue-saturation transformations for merging SPOT panchromatic and multispectral image data","volume":"56","author":"Carper","year":"1990","journal-title":"Photogramm. Eng. Remote Sens."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"629","DOI":"10.1109\/LGRS.2011.2177063","article-title":"A practical compressed sensing-based pan-sharpening method","volume":"9","author":"Jiang","year":"2012","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"27","DOI":"10.1109\/MGRS.2015.2440094","article-title":"Hyperspectral pansharpening: A review","volume":"3","author":"Loncan","year":"2015","journal-title":"IEEE Geosci. Remote Sens. Mag."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"1174","DOI":"10.1109\/TIP.2004.829779","article-title":"Map estimation for hyperspectral image resolution enhancement using an auxiliary sensor","volume":"13","author":"Hardie","year":"2004","journal-title":"IEEE Trans. Image Process."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"1545","DOI":"10.1109\/TGRS.2018.2867284","article-title":"A Novel Sharpening Approach for Superresolving Multiresolution Optical Images","volume":"57","author":"Paris","year":"2019","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Selva, M., Santurri, L., and Baronti, S. (2018). Improving Hypersharpening for WorldView-3 Data. IEEE Geosci. Remote Sens. Lett., 1\u20135.","DOI":"10.1109\/LGRS.2018.2884087"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"2664","DOI":"10.1109\/TGRS.2015.2504261","article-title":"Exploiting joint sparsity for pansharpening: The J-SparseFI algorithm","volume":"54","author":"Zhu","year":"2016","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Kwan, C., Choi, J.H., Chan, S.H., Zhou, J., and Budavari, B. (2018). A super-resolution and fusion approach to enhancing hyperspectral images. Remote Sens., 10.","DOI":"10.3390\/rs10091416"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"3658","DOI":"10.1109\/TGRS.2014.2381272","article-title":"Hyperspectral and Multispectral Image Fusion Based on a Sparse Representation","volume":"53","author":"Wei","year":"2015","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"4109","DOI":"10.1109\/TIP.2015.2458572","article-title":"Fast fusion of multi-band images based on solving a Sylvester equation","volume":"24","author":"Wei","year":"2015","journal-title":"IEEE Trans. Image Process."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"1693","DOI":"10.1109\/TGRS.2013.2253612","article-title":"Spatial and spectral image fusion using sparse matrix factorization","volume":"52","author":"Huang","year":"2014","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"528","DOI":"10.1109\/TGRS.2011.2161320","article-title":"Coupled nonnegative matrix factorization unmixing for hyperspectral and multispectral data fusion","volume":"50","author":"Yokoya","year":"2012","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"3373","DOI":"10.1109\/TGRS.2014.2375320","article-title":"A convex formulation for hyperspectral image superresolution via subspace-based regularization","volume":"53","author":"Simoes","year":"2015","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Han, X., Luo, J., Yu, J., and Sun, W. (2017, January 14\u201316). Hyperspectral image fusion based on non-factorization sparse representation and error matrix estimation. Proceedings of the 2017 IEEE Global Conference on Signal and Information Processing (GlobalSIP), Montreal, QC, Canada.","DOI":"10.1109\/GlobalSIP.2017.8309142"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"2377","DOI":"10.1109\/JSTARS.2016.2528339","article-title":"Fusion of hyperspectral and multispectral images using spectral unmixing and sparse coding","volume":"9","author":"Nezhad","year":"2016","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Mianji, F.A., Zhang, Y., and Babakhani, A. (2009, January 20\u201321). Superresolution of hyperspectral images using backpropagation neural networks. Proceedings of the 2009 2nd International Workshop on Nonlinear Dynamics and Synchronization, Klagenfurt, Austria.","DOI":"10.1109\/INDS.2009.5227984"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Xiu, L., Zhang, H., Guo, Q., Wang, Z., and Liu, X. (2015, January 24\u201326). Estimating nitrogen content of corn based on wavelet energy coefficient and BP neural network. Proceedings of the 2015 2nd International Conference on Information Science and Control Engineering, Shanghai, China.","DOI":"10.1109\/ICISCE.2015.54"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Yang, J., Zhao, Y.Q., and Chan, J. (2018). Hyperspectral and Multispectral Image Fusion via Deep Two-Branches Convolutional Neural Network. Remote Sens., 10.","DOI":"10.3390\/rs10050800"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"639","DOI":"10.1109\/LGRS.2017.2668299","article-title":"Multispectral and hyperspectral image fusion using a 3-D-convolutional neural network","volume":"14","author":"Palsson","year":"2017","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_21","unstructured":"Spath, H. (1985). The Cluster Dissection and Analysis Theory Fortran Programs Examples, Prentice-Hall, Inc."},{"key":"ref_22","unstructured":"Arthur, D., and Vassilvitskii, S. (2007). k-means++: The advantages of careful seeding. Proceedings of the Eighteenth Annual ACM-SIAM Symposium on Discrete Algorithms, Society for Industrial and Applied Mathematics."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"600","DOI":"10.1109\/TIP.2003.819861","article-title":"Image quality assessment: From error visibility to structural similarity","volume":"13","author":"Wang","year":"2004","journal-title":"IEEE Trans. Image Process."},{"key":"ref_24","unstructured":"Wald, L. (2000, January 26\u201328). Quality of high resolution synthesised images: Is there a simple criterion?. Proceedings of the Third Conference Fusion of Earth data: Merging Point Measurements, Raster Maps and Remotely Sensed Images, Sophia Antipolis, France."},{"key":"ref_25","unstructured":"(2018, September 10). AVIRIS Airborne System, Available online: http:\/\/aviris.jpl.nasa.gov."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Aiazzi, B., Selva, M., Arienzo, A., and Baronti, S. (2019). Influence of the System MTF on the On-Board Lossless Compression of Hyperspectral Raw Data. Remote Sens., 11.","DOI":"10.3390\/rs11070791"},{"key":"ref_27","unstructured":"(2018, September 10). ROSIS Pavia Center Dataset. Available online: http:\/\/www.ehu.eus\/ccwintco\/index.php\/Hyperspectral_ Remote_Sensing_Scenes#Pavia_Centre_scene."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/11\/10\/1173\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T12:52:38Z","timestamp":1760187158000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/11\/10\/1173"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,5,16]]},"references-count":27,"journal-issue":{"issue":"10","published-online":{"date-parts":[[2019,5]]}},"alternative-id":["rs11101173"],"URL":"https:\/\/doi.org\/10.3390\/rs11101173","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,5,16]]}}}