{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,29]],"date-time":"2025-10-29T06:21:52Z","timestamp":1761718912456,"version":"build-2065373602"},"reference-count":51,"publisher":"MDPI AG","issue":"6","license":[{"start":{"date-parts":[[2020,3,19]],"date-time":"2020-03-19T00:00:00Z","timestamp":1584576000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Science Technology and Innovation Commission of Shenzhen Municipality","award":["61771391;61371152"],"award-info":[{"award-number":["61771391;61371152"]}]},{"DOI":"10.13039\/501100003725","name":"National Research Foundation of Korea","doi-asserted-by":"publisher","award":["2016R1D1A1B01008522"],"award-info":[{"award-number":["2016R1D1A1B01008522"]}],"id":[{"id":"10.13039\/501100003725","id-type":"DOI","asserted-by":"publisher"}]},{"name":"China Scholarship Council for joint Ph.D. students under Grant","award":["201706290150"],"award-info":[{"award-number":["201706290150"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>This paper presents a joint spatial-spectral resolution enhancement technique to improve the resolution of multispectral images in the spatial and spectral domain simultaneously. Reconstructed hyperspectral images (HSIs) from an input multispectral image represent the same scene in higher spatial resolution, with more spectral bands of narrower wavelength width than the input multispectral image. Many existing improvement techniques focus on spatial- or spectral-resolution enhancement, which may cause spectral distortions and spatial inconsistency. The proposed scheme introduces virtual intermediate variables to formulate a spectral observation model and a spatial observation model. The models alternately solve spectral dictionary and abundances to reconstruct desired high-resolution HSIs. An initial spectral dictionary is trained from prior HSIs captured in different landscapes. A spatial dictionary trained from a panchromatic image and its sparse coefficients provide high spatial-resolution information. The sparse coefficients are used as constraints to obtain high spatial-resolution abundances. Experiments performed on simulated datasets from AVIRIS\/Landsat 7 and a real Hyperion\/ALI dataset demonstrate that the proposed method outperforms the state-of-the-art spatial- and spectral-resolution enhancement methods. The proposed method also worked well for combination of exiting spatial- and spectral-resolution enhancement methods.<\/jats:p>","DOI":"10.3390\/rs12060993","type":"journal-article","created":{"date-parts":[[2020,3,19]],"date-time":"2020-03-19T10:01:35Z","timestamp":1584612095000},"page":"993","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":5,"title":["Joint Spatial-spectral Resolution Enhancement of Multispectral Images with Spectral Matrix Factorization and Spatial Sparsity Constraints"],"prefix":"10.3390","volume":"12","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-3889-767X","authenticated-orcid":false,"given":"Chen","family":"Yi","sequence":"first","affiliation":[{"name":"Research and Development Institute, Northwestern Polytechnical University, Shenzhen 518057, China"},{"name":"School of Automation, Northwestern Polytechnical University, Xi\u2019an 710072, China"},{"name":"Department of Electronics and Informatics, Vrije Universiteit Brussel, 1050 Brussels, Belgium"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6974-7327","authenticated-orcid":false,"given":"Yong-qiang","family":"Zhao","sequence":"additional","affiliation":[{"name":"Research and Development Institute, Northwestern Polytechnical University, Shenzhen 518057, China"},{"name":"School of Automation, Northwestern Polytechnical University, Xi\u2019an 710072, China"}]},{"given":"Jonathan Cheung-Wai","family":"Chan","sequence":"additional","affiliation":[{"name":"Department of Electronics and Informatics, Vrije Universiteit Brussel, 1050 Brussels, Belgium"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0335-6526","authenticated-orcid":false,"given":"Seong G.","family":"Kong","sequence":"additional","affiliation":[{"name":"Department of Computer Engineering, Sejong University, Seoul 05006, Korea"}]}],"member":"1968","published-online":{"date-parts":[[2020,3,19]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"4729","DOI":"10.1109\/TGRS.2017.2698503","article-title":"Learning and transferring deep joint spectral-spatial features for hyperspectral classification","volume":"55","author":"Yang","year":"2017","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"894","DOI":"10.1109\/TGRS.2016.2616649","article-title":"Joint sparse representation and multitask learning for hyperspectral target detection","volume":"55","author":"Zhang","year":"2017","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1121","DOI":"10.1007\/s11947-011-0725-1","article-title":"Recent advances and applications of hyperspectral imaging for fruit and vegetable quality assessment","volume":"5","author":"Lorente","year":"2012","journal-title":"Food Bioprocess Technol."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Yokoya, N., Chan, J.C.W., and Segl, K. (2016). Potential of resolution-enhanced hyperspectral data for mineral mapping using simulated EnMAP and Sentinel-2 images. Remote Sens., 8.","DOI":"10.3390\/rs8030172"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"4165","DOI":"10.1109\/TGRS.2018.2828042","article-title":"Hyperspectral image superresolution based on spatial and spectral correlation fusion","volume":"56","author":"Yi","year":"2018","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Yang, J., Zhao, Y.Q., Chan, J.C.W., and Xiao, L. (2019). A Multi-Scale Wavelet 3D-CNN for Hyperspectral Image Super-Resolution. Remote Sens., 11.","DOI":"10.3390\/rs11131557"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"27","DOI":"10.1109\/MGRS.2015.2440094","article-title":"Hyperspectral pansharpening: A review","volume":"3","author":"Loncan","year":"2015","journal-title":"IEEE Geosci. Remote Sens. Mag."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Dalla Mura, M., Vivone, G., Restaino, R., Addesso, P., and Chanussot, J. (2015, January 26\u201331). Global and local Gram-Schmidt methods for hyperspectral pansharpening. Proceedings of the IEEE International Geoscience and Remote Sensing Symposium, Milan, Italy.","DOI":"10.1109\/IGARSS.2015.7325691"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"207","DOI":"10.1186\/1687-6180-2012-207","article-title":"Fusion of hyperspectral and panchromatic images using multiresolution analysis and nonlinear PCA band reduction","volume":"1","author":"Licciardi","year":"2012","journal-title":"EURASIP J. Adv. Signal Process."},{"key":"ref_10","first-page":"3647","article-title":"Learning low-rank decomposition for pan-sharpening with spatial- spectral offsets","volume":"20","author":"Yang","year":"2017","journal-title":"IEEE Trans. Neural Netw. Learn. Syst."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"3823","DOI":"10.1109\/TGRS.2017.2681721","article-title":"Joint hyperspectral superresolution and unmixing with interactive feedback","volume":"55","author":"Yi","year":"2017","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"1795","DOI":"10.1109\/LGRS.2017.2736020","article-title":"Boosting the Accuracy of multispectral image pansharpening by learning a deep residual network","volume":"14","author":"Wei","year":"2017","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"978","DOI":"10.1109\/JSTARS.2018.2794888","article-title":"A multiscale and multidepth convolutional neural network for remote sensing imagery pan-sharpening","volume":"11","author":"Yuan","year":"2018","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"1408","DOI":"10.1137\/S1064827500383123","article-title":"Wavelet algorithms for high-resolution image reconstruction","volume":"24","author":"Chan","year":"2003","journal-title":"SIAM J. Sci. Comput."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"455","DOI":"10.1109\/TGRS.2004.837324","article-title":"Hyperspectral resolution enhancement using high-resolution multispectral imagery with arbitrary response functions","volume":"43","author":"Eismann","year":"2005","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"29","DOI":"10.1109\/MGRS.2016.2637824","article-title":"Hyperspectral and multispectral data fusion: A comparative review of the recent literature","volume":"5","author":"Yokoya","year":"2017","journal-title":"IEEE Geosci. Remote Sens. Mag."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"528","DOI":"10.1109\/TGRS.2011.2161320","article-title":"Coupled nonnegative matrix factorization unmixing for hyperspectral and multispectral data fusion","volume":"50","author":"Yokoya","year":"2012","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Akhtar, N., Shafait, F., and Mian, A. (2015, January 7\u201312). Bayesian sparse representation for hyperspectral image super resolution. Proceedings of the 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298986"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"2337","DOI":"10.1109\/TIP.2016.2542360","article-title":"Hyperspectral image super-resolution via non-negative structured sparse representation","volume":"25","author":"Dong","year":"2016","journal-title":"IEEE Trans. Image Process."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"9010","DOI":"10.1109\/TGRS.2019.2924096","article-title":"Spectral super-resolution for multispectral image based on spectral improvement strategy and spatial preservation strategy","volume":"57","author":"Yi","year":"2019","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"140","DOI":"10.1007\/s11263-008-0176-y","article-title":"Multi-spectral imaging by optimized wide band illumination","volume":"86","author":"Chi","year":"2010","journal-title":"Int. J. Comput. Vis."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"50","DOI":"10.1117\/12.381686","article-title":"Imaging spectroscopy using tunable filters: A review","volume":"4056","author":"Gat","year":"2000","journal-title":"Proc. SPIE"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Oh, S.W., Brown, M.S., Pollefeys, M., and Kim, S.J. (2016, January 27\u201330). Do it yourself hyperspectral imaging with everyday digital cameras. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.270"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"2198","DOI":"10.1109\/JSTARS.2014.2356512","article-title":"Enhancement of spectral resolution for remotely sensed multispectral image","volume":"8","author":"Sun","year":"2015","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Arad, B., and Ben-Shahar, O. (2016). Sparse recovery of hyperspectral signal from natural RGB images. Computer Vision\u2014ECCV 2016, Springer.","DOI":"10.1007\/978-3-319-46478-7_2"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Wu, J., Aeschbacher, J., and Timofte, R. (2017, January 22\u201329). In defense of shallow learned spectral reconstruction from RGB images. Proceedings of the 2017 IEEE International Conference on Computer Vision Workshops (ICCVW), Venice, Italy.","DOI":"10.1109\/ICCVW.2017.63"},{"key":"ref_27","unstructured":"Galliani, S., Lanaras, C., Marmanis, D., Baltsavias, E., and Schindler, K. (2017). Learned Spectral Super-Resolution. arXiv, Available online: https:\/\/arxiv.org\/abs\/1703.09470."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"354","DOI":"10.1109\/JSTARS.2012.2194696","article-title":"Hyperspectral unmixing overview: Geometrical, statistical, and sparse regression-based approaches","volume":"5","author":"Plaza","year":"2012","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Chakrabarti, A., and Zickler, T. (2011, January 20\u201325). Statistics of real-world hyperspectral images. Proceedings of the IEEE Conference on Vision Pattern Recognit (CVPR) 2011, Providence, RI, USA.","DOI":"10.1109\/CVPR.2011.5995660"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"2827","DOI":"10.1109\/TGRS.2012.2213604","article-title":"A sparse image fusion algorithm with application to pan-sharpening","volume":"51","author":"Zhu","year":"2013","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Xue, J., Zhao, Y., Liao, W., and Chan, J.C.W. (2019). Nonlocal tensor sparse representation and low-rank regularization for hyperspectral image compressive sensing reconstruction. Remote Sens., 11.","DOI":"10.3390\/rs11020193"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"44","DOI":"10.1109\/79.974727","article-title":"Spectral unmixing","volume":"19","author":"Keshava","year":"2002","journal-title":"IEEE Signal Process. Mag."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Akhtar, N., Shafait, F., and Mian, A. (2014). Sparse spatio-spectral representation for hyperspectral image super-resolution. Computer Vision, Springer.","DOI":"10.1109\/CVPR.2015.7298986"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"296","DOI":"10.1109\/TGRS.2014.2321557","article-title":"Hyperspectral image denoising via sparse representation and low-rank constraint","volume":"53","author":"Zhao","year":"2014","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"2664","DOI":"10.1109\/TGRS.2015.2504261","article-title":"Exploiting joint sparsity for pansharpening: The J-SparseFI algorithm","volume":"54","author":"Zhu","year":"2016","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"4311","DOI":"10.1109\/TSP.2006.881199","article-title":"K-SVD: An algorithm for designing overcomplete dictionaries for sparse representation","volume":"54","author":"Aharon","year":"2006","journal-title":"IEEE Trans. Signal Process."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"681","DOI":"10.1109\/TIP.2010.2076294","article-title":"An augmented Lagrangian approach to the constrained optimization formulation of imaging inverse problems","volume":"20","author":"Afonso","year":"2011","journal-title":"IEEE Trans. Image Process."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1561\/2200000016","article-title":"Distributed optimization and statistical learning via the alternating direction method of multipliers","volume":"3","author":"Boyd","year":"2011","journal-title":"Found. Trends Mach. Learn."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"1413","DOI":"10.1002\/cpa.20042","article-title":"An iterative thresholding algorithm for linear inverse problems with a sparsity constraint","volume":"57","author":"Daubechies","year":"2004","journal-title":"Commun. Pure Appl. Math."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"302","DOI":"10.1214\/07-AOAS131","article-title":"Pathwise coordinate optimization","volume":"1","author":"Friedman","year":"2007","journal-title":"Ann. Appl. Statist."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"907","DOI":"10.1002\/cpa.20131","article-title":"For most large underdetermined systems of equations, the minimal 1-norm near-solution approximates the sparsest nearsolution","volume":"59","author":"Donoho","year":"2006","journal-title":"Commun. Pure Appl. Math."},{"key":"ref_42","unstructured":"Golub, G.H., and Van Loan, C.F. (1983). Matrix Computations, The Johns Hopkins University Press."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"3230","DOI":"10.1109\/TGRS.2007.901007","article-title":"Improving Component Substitution Pansharpening through Multivariate Regression of MS $ + $Pan Data","volume":"45","author":"Aiazzi","year":"2007","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"98","DOI":"10.1109\/LGRS.2007.909934","article-title":"Indusion: Fusion of Multispectral and Panchromatic Images Using the Induction Scaling Technique","volume":"5","author":"Khan","year":"2008","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"5174","DOI":"10.1109\/TGRS.2019.2897316","article-title":"Nonlocal Low-Rank Regularized Tensor Decomposition for Hyperspectral Image Denoising","volume":"57","author":"Xue","year":"2019","journal-title":"IEEE Trans. Geos. Remote Sens."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"600","DOI":"10.1109\/TIP.2003.819861","article-title":"Image quality assessment: From error visibility to structural similarity","volume":"13","author":"Wang","year":"2004","journal-title":"IEEE Trans. Image Process."},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Lanaras, C., Baltsavias, E., and Schindler, K.K. (2017). Hyperspectral Super-Resolution with Spectral Unmixing Constraints. Remote Sens., 9.","DOI":"10.3390\/rs9111196"},{"key":"ref_48","unstructured":"Wald, L. (2002). Data fusion. Definitions and Architectures\u2014Fusion of Images of Different Spatial Resolutions, Ecole de Mines de Paris."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"5969","DOI":"10.1109\/TIP.2018.2862629","article-title":"Exploiting clustering manifold structure for hyperspectral imagery super-resolution","volume":"27","author":"Zhang","year":"2018","journal-title":"IEEE Trans. Image Process."},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"40","DOI":"10.1117\/12.417022","article-title":"EO-1\/hyperion hyperspectral imager design, development, characterization, and calibration","volume":"4151","author":"Folkman","year":"2001","journal-title":"Proc. SPIE"},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"67","DOI":"10.1109\/MSP.2013.2279731","article-title":"A signal processing perspective on hyperspectral unmixing","volume":"31","author":"Ma","year":"2014","journal-title":"IEEE Signal Process. Mag."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/12\/6\/993\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T09:09:45Z","timestamp":1760173785000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/12\/6\/993"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,3,19]]},"references-count":51,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2020,3]]}},"alternative-id":["rs12060993"],"URL":"https:\/\/doi.org\/10.3390\/rs12060993","relation":{},"ISSN":["2072-4292"],"issn-type":[{"type":"electronic","value":"2072-4292"}],"subject":[],"published":{"date-parts":[[2020,3,19]]}}}