{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,21]],"date-time":"2025-12-21T10:04:04Z","timestamp":1766311444982,"version":"build-2065373602"},"reference-count":54,"publisher":"MDPI AG","issue":"15","license":[{"start":{"date-parts":[[2021,7,26]],"date-time":"2021-07-26T00:00:00Z","timestamp":1627257600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Fusing a low spatial resolution hyperspectral image (HSI) with a high spatial resolution multispectral image (MSI), aiming to produce a super-resolution hyperspectral image, has recently attracted increasing research interest. In this paper, a novel approach based on coupled non-negative tensor decomposition is proposed. The proposed method performs a tucker tensor factorization of a low resolution hyperspectral image and a high resolution multispectral image under the constraint of non-negative tensor decomposition (NTD). The conventional matrix factorization methods essentially lose spatio-spectral structure information when stacking the 3D data structure of a hyperspectral image into a matrix form. Moreover, the spectral, spatial, or their joint structural features have to be imposed from the outside as a constraint to well pose the matrix factorization problem. The proposed method has the advantage of preserving the spatio-spectral structure of hyperspectral images. In this paper, the NTD is directly imposed on the coupled tensors of the HSI and MSI. Hence, the intrinsic spatio-spectral structure of the HSI is represented without loss, and spatial and spectral information can be interdependently exploited. Furthermore, multilinear interactions of different modes of the HSIs can be exactly modeled with the core tensor of the Tucker tensor decomposition. The proposed method is straightforward and easy to implement. Unlike other state-of-the-art approaches, the complexity of the proposed approach is linear with the size of the HSI cube. Experiments on two well-known datasets give promising results when compared with some recent methods from the literature.<\/jats:p>","DOI":"10.3390\/rs13152930","type":"journal-article","created":{"date-parts":[[2021,7,26]],"date-time":"2021-07-26T09:25:52Z","timestamp":1627291552000},"page":"2930","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":20,"title":["Hyperspectral and Multispectral Image Fusion Using Coupled Non-Negative Tucker Tensor Decomposition"],"prefix":"10.3390","volume":"13","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-7855-8456","authenticated-orcid":false,"given":"Marzieh","family":"Zare","sequence":"first","affiliation":[{"name":"Department of Electrical and Electronics Engineering, Shiraz University of Technology, Shiraz 13876-71557, Iran"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9095-4913","authenticated-orcid":false,"given":"Mohammad Sadegh","family":"Helfroush","sequence":"additional","affiliation":[{"name":"Department of Electrical and Electronics Engineering, Shiraz University of Technology, Shiraz 13876-71557, Iran"}]},{"given":"Kamran","family":"Kazemi","sequence":"additional","affiliation":[{"name":"Department of Electrical and Electronics Engineering, Shiraz University of Technology, Shiraz 13876-71557, Iran"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2447-4772","authenticated-orcid":false,"given":"Paul","family":"Scheunders","sequence":"additional","affiliation":[{"name":"Imec-Vision Lab, Department of Physics, University of Antwerp, 2610 Antwerp, Belgium"}]}],"member":"1968","published-online":{"date-parts":[[2021,7,26]]},"reference":[{"key":"ref_1","unstructured":"Dian, R., Fang, L., and Li, S. (1997, January 17\u201319). Hyperspectral image super-resolution via non-local sparse tensor factorization. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, San Juan, PR, USA."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Kwan, C., Choi, J.H., Chan, S.H., Zhou, J., and Budavari, B. (2018). A super-resolution and fusion approach to enhancing hyperspectral images. Remote Sens., 10.","DOI":"10.3390\/rs10091416"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Dian, R., Li, S., Fang, L., and Bioucas-Dias, J. (2018, January 22\u201327). Hyperspectral image super-resolution via local Low-rank and sparse representations. Proceedings of the IGARSS 2018\u20132018 IEEE International Geoscience and Remote Sensing Symposium, Valencia, Spain.","DOI":"10.1109\/IGARSS.2018.8519213"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"262","DOI":"10.1016\/j.inffus.2018.11.012","article-title":"Multispectral and hyperspectral image fusion with spatial-spectral sparse representation","volume":"49","author":"Dian","year":"2019","journal-title":"Inf. Fusion"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"2337","DOI":"10.1109\/TIP.2016.2542360","article-title":"Hyperspectral image super-resolution via non-negative structured sparse representation","volume":"25","author":"Dong","year":"2016","journal-title":"IEEE Trans. Image Process."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Ghasrodashti, E., Karami, A., Heylen, R., and Scheunders, P. (2017). Spatial resolution enhancement of hyperspectral images using spectral unmixing and bayesian sparse representation. Remote Sens., 9.","DOI":"10.3390\/rs9060541"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Joshi, M.V., and Upla, K.P. (2019). Multi-Resolution Image Fusion in Remote Sensing, Cambridge University Press.","DOI":"10.1017\/9781108566285"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Lanaras, C., Baltsavias, E., and Schindler, K. (2017). Hyperspectral super-resolution with spectral unmixing constraints. Remote Sens., 9.","DOI":"10.3390\/rs9111196"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"4118","DOI":"10.1109\/TIP.2018.2836307","article-title":"Fusing hyperspectral and multispectral images via coupled sparse tensor factorization","volume":"27","author":"Li","year":"2018","journal-title":"IEEE Trans. Image Process."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"6091","DOI":"10.1080\/01431161.2010.507794","article-title":"A super resolution approach for spectral unmixing of remote sensing images","volume":"32","author":"Li","year":"2011","journal-title":"Int. J. Remote Sens."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"3658","DOI":"10.1109\/TGRS.2014.2381272","article-title":"Hyperspectral and multispectral image fusion based on a sparse representation","volume":"53","author":"Wei","year":"2015","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"7236","DOI":"10.1109\/TGRS.2016.2598784","article-title":"Multiband image fusion based on spectral unmixing","volume":"54","author":"Wei","year":"2016","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Yang, J., Li, Y., Chan, J., and Shen, Q. (2017). Image fusion for spatial enhancement of hyperspectral image via pixel group based non-local sparse representation. Remote Sens., 9.","DOI":"10.3390\/rs9010053"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Akhtar, N., Shafait, F., and Mian, A. (2015, January 7\u201312). Bayesian sparse representation for hyperspectral image super resolution. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298986"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"8610","DOI":"10.1080\/01431161.2020.1782507","article-title":"Fusing hyperspectral and multispectral images using smooth graph signal modelling","volume":"41","author":"Zare","year":"2020","journal-title":"Int. J. Remote Sens."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"1174","DOI":"10.1109\/TIP.2004.829779","article-title":"MAP estimation for hyperspectral image resolution enhancement using an auxiliary sensor","volume":"13","author":"Hardie","year":"2004","journal-title":"IEEE Trans. Image Process."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"2377","DOI":"10.1109\/JSTARS.2016.2528339","article-title":"Fusion of hyperspectral and multispectral images using spectral unmixing and sparse coding","volume":"9","author":"Nezhad","year":"2016","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"1117","DOI":"10.1109\/JSTSP.2015.2407855","article-title":"Bayesian fusion of multi-band images","volume":"9","author":"Wei","year":"2015","journal-title":"IEEE J. Sel. Top. Signal Process."},{"key":"ref_19","first-page":"3373","article-title":"A convex formulation for hyperspectral image superresolution via subspace-based regularization","volume":"53","author":"Almeida","year":"2014","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"274","DOI":"10.1109\/TIP.2015.2496263","article-title":"Hyperspectral super-resolution of locally low rank images from complementary multisource data","volume":"25","author":"Veganzones","year":"2015","journal-title":"IEEE Trans. Image Process."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"528","DOI":"10.1109\/TGRS.2011.2161320","article-title":"Coupled nonnegative matrix factorization unmixing for hyperspectral and multispectral data fusion","volume":"50","author":"Yokoya","year":"2012","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"2672","DOI":"10.1109\/TNNLS.2018.2885616","article-title":"Learning a low tensor-train rank representation for hyperspectral image super-resolution","volume":"30","author":"Dian","year":"2019","journal-title":"IEEE Trans. Neural Netw. Learn. Syst."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"4469","DOI":"10.1109\/TCYB.2019.2951572","article-title":"Nonlocal sparse tensor factorization for semiblind hyperspectral and multispectral image fusion","volume":"50","author":"Dian","year":"2019","journal-title":"IEEE Trans. Cybern."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"348","DOI":"10.1109\/TGRS.2019.2936486","article-title":"Nonlocal coupled tensor cp decomposition for hyperspectral and multispectral image fusion","volume":"58","author":"Xu","year":"2020","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Zhang, G., Fu, X., Huang, K., and Wang, J. (2019, January 15\u201318). Hyperspectral super-resolution: A coupled nonnegative block-term tensor decomposition approach. Proceedings of the 2019 IEEE 8th International Workshop on Computational Advances in Multi-Sensor Adaptive Processing (CAMSAP), Guadeloupe, France.","DOI":"10.1109\/CAMSAP45676.2019.9022476"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Sun, W., Ren, K., Meng, X., Xiao, C., Yang, G., and Peng, J. (2021). A band divide-and-conquer multispectral and hyperspectral image fusion method. IEEE Trans. Geosci. Remote Sens.","DOI":"10.1109\/TGRS.2020.3046321"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Yang, J., Zhao, Y.-Q., and Chan, J.C.-W. (2018). Hyperspectral and multispectral image fusion via deep two-branches convolutional neural network. Remote Sens., 10.","DOI":"10.3390\/rs10050800"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Zhang, L., Nie, J., Wei, W., Li, Y., and Zhang, Y. (2021). Deep blind hyperspectral image super-resolution. IEEE Trans. Neural Netw. Learn. Syst.","DOI":"10.1109\/TNNLS.2020.3005234"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"27","DOI":"10.1109\/MGRS.2015.2440094","article-title":"Hyperspectral pansharpening: A review","volume":"3","author":"Loncan","year":"2015","journal-title":"IEEE Geosci. Remote Sens. Mag."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"788","DOI":"10.1038\/44565","article-title":"Learning the parts of objects by non-negative matrix factorization","volume":"401","author":"Lee","year":"1999","journal-title":"Nature"},{"key":"ref_31","first-page":"1","article-title":"Hyperspectral Image Classification Based on Mathematical Morphology and Using Tensor CP Decomposition","volume":"1","author":"Jouni","year":"2019","journal-title":"Math. Morphol.Theory Appl."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Jouni, M., Dalla Mura, M., and Comon, P. (2019, January 8\u201310). Classification of hyperspectral images as tensors using nonnegative CP decomposition. Proceedings of the International Symposium on Mathematical Morphology and Its Applications to Signal and Image Processing, Saarbr\u00fccken, Germany.","DOI":"10.1007\/978-3-030-20867-7_15"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"68","DOI":"10.1016\/j.neucom.2018.07.052","article-title":"Spatial-spectral classification of hyperspectral image via group tensor decomposition","volume":"316","author":"Zhao","year":"2018","journal-title":"Neurocomputing"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"964","DOI":"10.1049\/ipr2.12077","article-title":"Hyperspectral image, video compression using sparse tucker tensor decomposition","volume":"15","author":"Das","year":"2021","journal-title":"IET Image Process."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"252","DOI":"10.1364\/JOSAA.34.000252","article-title":"CP tensor-based compression of hyperspectral images","volume":"34","author":"Fang","year":"2017","journal-title":"JOSA A"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"233","DOI":"10.1016\/j.jvcir.2018.11.004","article-title":"Hyperspectral remote sensing image change detection based on tensor and deep learning","volume":"58","author":"Huang","year":"2019","journal-title":"J. Vis. Commun. Image Represent."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"674","DOI":"10.1109\/LGRS.2017.2671439","article-title":"Target detection for polarized hyperspectral images based on tensor decomposition","volume":"14","author":"Tan","year":"2017","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Li, S., Wang, W., Qi, H., Ayhan, B., Kwan, C., and Vance, S. (2015, January 27\u201330). Low-rank tensor decomposition based anomaly detection for hyperspectral imagery. Proceedings of the 2015 IEEE International Conference on Image Processing (ICIP), Quebec City, QC, Canada.","DOI":"10.1109\/ICIP.2015.7351663"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"6196","DOI":"10.1109\/TGRS.2018.2833473","article-title":"Spatial\u2013spectral total variation regularized low-rank tensor decomposition for hyperspectral image denoising","volume":"56","author":"Fan","year":"2018","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"3071","DOI":"10.1109\/TGRS.2019.2947333","article-title":"Hyperspectral image denoising with total variation regularization and nonlocal low-rank tensor decomposition","volume":"58","author":"Zhang","year":"2019","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"1776","DOI":"10.1109\/TGRS.2016.2633279","article-title":"Matrix-vector nonnegative tensor factorization for blind unmixing of hyperspectral imagery","volume":"55","author":"Qian","year":"2017","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Kanatsoulis, C.I., Fu, X., Sidiropoulos, N.D., and Ma, W.-K. (2018, January 7\u201310). Hyperspectral super-resolution: Combining low rank tensor and matrix structure. Proceedings of the 2018 25th IEEE International Conference on Image Processing (ICIP), Athens, Greece.","DOI":"10.1109\/ICIP.2018.8451733"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"6503","DOI":"10.1109\/TSP.2018.2876362","article-title":"Hyperspectral super-resolution: A coupled tensor factorization approach","volume":"66","author":"Kanatsoulis","year":"2018","journal-title":"IEEE Trans. Signal Process."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"145","DOI":"10.1109\/MSP.2013.2297439","article-title":"Tensor decompositions for signal processing applications: From two-way to multiway component analysis","volume":"32","author":"Cichocki","year":"2015","journal-title":"IEEE Signal Process. Mag."},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Cichocki, A., Zdunek, R., Phan, A.H., and Amari, S.-I. (2009). Nonnegative Matrix and Tensor Factorizations: Applications to Exploratory Multi-way Data Analysis and Blind Source Separation, John Wiley & Sons.","DOI":"10.1002\/9780470747278"},{"key":"ref_46","first-page":"389","article-title":"Fast and unique Tucker decompositions via multiway blind source separation","volume":"60","author":"Zhou","year":"2012","journal-title":"Bull. Pol. Acad. Sci. Tech. Sci."},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Kim, Y.-D., and Choi, S. (2007, January 17\u201322). Nonnegative tucker decomposition. Proceedings of the 2007 IEEE Conference on Computer Vision and Pattern Recognition, Minneapolis, MN, USA.","DOI":"10.1109\/CVPR.2007.383405"},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"757","DOI":"10.1109\/TGRS.2010.2068053","article-title":"An approach based on constrained nonnegative matrix factorization to unmix hyperspectral data","volume":"49","author":"Liu","year":"2010","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_49","unstructured":"Burred, J.J. (2014). Detailed derivation of multiplicative update rules for NMF. Paris Fr., Available online: https:\/\/www.semanticscholar.org\/paper\/Detailed-derivation-of-multiplicative-update-rules-Burred\/3376b4df752f2428c451e530f9c6e0ce3a3f05e4."},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Bioucas-Dias, J.M. (2009, January 26\u201328). A variable splitting augmented Lagrangian approach to linear spectral unmixing. Proceedings of the 2009 First Workshop on Hyperspectral Image and Signal Processing: Evolution in Remote Sensing, Grenoble, France.","DOI":"10.1109\/WHISPERS.2009.5289072"},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"79","DOI":"10.1109\/LSP.2012.2229976","article-title":"Improving dictionary learning: Multiple dictionary updates and coefficient reuse","volume":"20","author":"Smith","year":"2012","journal-title":"IEEE Signal Process. Lett."},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"322","DOI":"10.1109\/LGRS.2004.837009","article-title":"Exploiting spectral and spatial information in hyperspectral urban data with high resolution","volume":"1","author":"Gamba","year":"2004","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"227","DOI":"10.1016\/S0034-4257(98)00064-9","article-title":"Imaging spectroscopy and the airborne visible\/infrared imaging spectrometer (AVIRIS)","volume":"65","author":"Green","year":"1998","journal-title":"Remote Sens. Environ."},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"81","DOI":"10.1109\/97.995823","article-title":"A universal image quality index","volume":"9","author":"Wang","year":"2002","journal-title":"IEEE Signal Process. Lett."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/13\/15\/2930\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T06:35:05Z","timestamp":1760164505000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/13\/15\/2930"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,7,26]]},"references-count":54,"journal-issue":{"issue":"15","published-online":{"date-parts":[[2021,8]]}},"alternative-id":["rs13152930"],"URL":"https:\/\/doi.org\/10.3390\/rs13152930","relation":{},"ISSN":["2072-4292"],"issn-type":[{"type":"electronic","value":"2072-4292"}],"subject":[],"published":{"date-parts":[[2021,7,26]]}}}