{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,6]],"date-time":"2026-04-06T10:12:06Z","timestamp":1775470326917,"version":"3.50.1"},"reference-count":41,"publisher":"MDPI AG","issue":"4","license":[{"start":{"date-parts":[[2023,2,8]],"date-time":"2023-02-08T00:00:00Z","timestamp":1675814400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61635002"],"award-info":[{"award-number":["61635002"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["XDA17040508"],"award-info":[{"award-number":["XDA17040508"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Strategic Priority Research Program of China Academy of Sciences","award":["61635002"],"award-info":[{"award-number":["61635002"]}]},{"name":"Strategic Priority Research Program of China Academy of Sciences","award":["XDA17040508"],"award-info":[{"award-number":["XDA17040508"]}]},{"name":"Central Universities","award":["61635002"],"award-info":[{"award-number":["61635002"]}]},{"name":"Central Universities","award":["XDA17040508"],"award-info":[{"award-number":["XDA17040508"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Hyperspectral images (HSI) frequently have inadequate spatial resolution, which hinders numerous applications for the images. High resolution multispectral image (MSI) has been fused with HSI to reconstruct images with both high spatial and high spectral resolutions. In this paper, we propose a generative adversarial network (GAN)-based unsupervised HSI-MSI fusion network. In the generator, two coupled autoencoder nets decompose HSI and MSI into endmembers and abundances for fusing high resolution HSI through the linear mixing model. The two autoencoder nets are connected by a degradation-generation (DG) block, which further improves the accuracy of the reconstruction. Additionally, a coordinate multi-attention net (CMAN) is designed to extract more detailed features from the input. Driven by the joint loss function, the proposed method is straightforward and easy to execute in an end-to-end training manner. The experimental results demonstrate that the proposed strategy outperforms the state-of-art methods.<\/jats:p>","DOI":"10.3390\/rs15040936","type":"journal-article","created":{"date-parts":[[2023,2,9]],"date-time":"2023-02-09T02:55:54Z","timestamp":1675911354000},"page":"936","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":17,"title":["An Unmixing-Based Multi-Attention GAN for Unsupervised Hyperspectral and Multispectral Image Fusion"],"prefix":"10.3390","volume":"15","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-2653-7175","authenticated-orcid":false,"given":"Lijuan","family":"Su","sequence":"first","affiliation":[{"name":"Key Laboratory of Precision Opto-Mechatronics Technology, Ministry of Education, Beihang University, Beijing 100191, China"}]},{"given":"Yuxiao","family":"Sui","sequence":"additional","affiliation":[{"name":"Key Laboratory of Precision Opto-Mechatronics Technology, Ministry of Education, Beihang University, Beijing 100191, China"}]},{"given":"Yan","family":"Yuan","sequence":"additional","affiliation":[{"name":"Key Laboratory of Precision Opto-Mechatronics Technology, Ministry of Education, Beihang University, Beijing 100191, China"}]}],"member":"1968","published-online":{"date-parts":[[2023,2,8]]},"reference":[{"key":"ref_1","first-page":"349","article-title":"Subspace-based support vector machines for hyperspectral image classification","volume":"12","author":"Gao","year":"2014","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"3791","DOI":"10.1109\/TGRS.2019.2957251","article-title":"Invariant attribute profiles: A spatial-frequency joint feature extractor for hyperspectral image classification","volume":"58","author":"Hong","year":"2020","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"4604","DOI":"10.1109\/TGRS.2020.2964627","article-title":"Hyperspectral image classification with convolutional neural network and active learning","volume":"58","author":"Cao","year":"2020","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1104","DOI":"10.1109\/LGRS.2020.2990407","article-title":"An enhanced 3-D discrete wavelet transform for hyperspectral image classification","volume":"18","author":"Cao","year":"2020","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"2351","DOI":"10.1109\/JSTARS.2014.2302446","article-title":"Weighted-RXD and linear filter-based RXD: Improving background statistics estimation for anomaly detection in hyperspectral imagery","volume":"7","author":"Guo","year":"2014","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"597","DOI":"10.1007\/s11554-017-0742-z","article-title":"A real-time unsupervised background extraction-based target detection method for hyperspectral imagery","volume":"15","author":"Li","year":"2018","journal-title":"J. Real-Time Image Process."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"5146","DOI":"10.1109\/TGRS.2019.2897139","article-title":"ORSIm detector: A novel object detection framework in optical remote sensing imagery using spatial-frequency channel features","volume":"57","author":"Wu","year":"2019","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"302","DOI":"10.1109\/LGRS.2019.2919755","article-title":"Fourier-based rotation-invariant feature boosting: An efficient framework for geospatial object detection","volume":"17","author":"Wu","year":"2019","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"686","DOI":"10.1109\/LGRS.2016.2536658","article-title":"Weighted sparse graph based dimensionality reduction for hyperspectral images","volume":"13","author":"He","year":"2016","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"2960","DOI":"10.1109\/JSTARS.2017.2682189","article-title":"Learning a robust local manifold representation for hyperspectral dimensionality reduction","volume":"10","author":"Hong","year":"2017","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"138","DOI":"10.1016\/j.neucom.2019.06.023","article-title":"Superpixel-based spatial-spectral dimension reduction for hyperspectral imagery classification","volume":"360","author":"Xu","year":"2019","journal-title":"Neurocomputing"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"35","DOI":"10.1016\/j.isprsjprs.2019.09.008","article-title":"Learning to propagate labels on graphs: An iterative multitask regression framework for semi-supervised hyperspectral dimensionality reduction","volume":"158","author":"Hong","year":"2019","journal-title":"Isprs J. Photogramm. Remote Sens."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"1179","DOI":"10.1109\/JSTARS.2017.2771482","article-title":"Integrating spatial information in the normalized P-linear algorithm for nonlinear hyperspectral unmixing","volume":"11","author":"Tang","year":"2017","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"135","DOI":"10.1109\/JSTSP.2018.2877497","article-title":"SULoRA: Subspace unmixing with low-rank attribute embedding for hyperspectral data analysis","volume":"12","author":"Hong","year":"2018","journal-title":"IEEE J. Sel. Top. Signal Process."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"2991","DOI":"10.1109\/TIP.2019.2893068","article-title":"Nonconvex-sparsity and nonlocal-smoothness-based blind hyperspectral unmixings","volume":"28","author":"Yao","year":"2019","journal-title":"IEEE Trans. Image Process."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Gomez, R.B., Jazaeri, A., and Kafatos, M. (2001, January 16\u201320). Wavelet-based hyperspectral and multispectral image fusion. Proceedings of the Geo-Spatial Image and Data Exploitation II, Orlando, FL, USA.","DOI":"10.1117\/12.428249"},{"key":"ref_17","first-page":"218","article-title":"Multi-spectral and hyperspectral image fusion using 3-D wavelet transform","volume":"24","author":"Zhang","year":"2007","journal-title":"J. Electron."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"1418","DOI":"10.1109\/LGRS.2013.2294476","article-title":"Fusion of hyperspectral and multispectral images: A novel framework based on generalization of pan-sharpening methods","volume":"11","author":"Chen","year":"2014","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"3230","DOI":"10.1109\/TGRS.2007.901007","article-title":"Improving component substitution pansharpening through multivariate regression of MS + Pan data","volume":"45","author":"Aiazzi","year":"2007","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"455","DOI":"10.1109\/TGRS.2004.837324","article-title":"Hyperspectral resolution enhancement using high-resolution multispectral imagery with arbitrary response functions","volume":"43","author":"Eismann","year":"2005","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"3658","DOI":"10.1109\/TGRS.2014.2381272","article-title":"Hyperspectral and multispectral image fusion based on a sparse representation","volume":"53","author":"Wei","year":"2015","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"3373","DOI":"10.1109\/TGRS.2014.2375320","article-title":"A convex formulation for hyperspectral image superresolution via subspace-based regularization","volume":"53","author":"Simoes","year":"2014","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Akhtar, N., Shafait, F., and Mian, A. (2015, January 7\u201312). Bayesian sparse representation for hyperspectral image super resolution. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298986"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Kawakami, R., Matsushita, Y., Wright, J., Ben-Ezra, M., Tai, Y.-W., and Ikeuchi, K. (2011, January 20\u201325). High-resolution hyperspectral imaging via matrix factorization. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Colorado Springs, CO, USA.","DOI":"10.1109\/CVPR.2011.5995457"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"528","DOI":"10.1109\/TGRS.2011.2161320","article-title":"Coupled nonnegative matrix factorization unmixing for hyperspectral and multispectral data fusion","volume":"50","author":"Yokoya","year":"2011","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Lanaras, C., Baltsavias, E., and Schindler, K. (2015, January 7\u201312). Hyperspectral super-resolution by coupled spectral unmixing. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.","DOI":"10.1109\/ICCV.2015.409"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Dian, R., Fang, L., and Li, S. (2018, January 18\u201323). Hyperspectral image super-resolution via non-local sparse tensor factorization. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.411"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"5345","DOI":"10.1109\/TNNLS.2018.2798162","article-title":"Deep hyperspectral image sharpening","volume":"29","author":"Dian","year":"2018","journal-title":"IEEE Trans. Neural Netw. Learn. Syst."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Han, X.H., Shi, B., and Zheng, Y.Q. (2018, January 7\u201310). SSF-CNN:Spatial and Spectral Fusion with CNN for Hyperspectral Image Super-Resolution. Proceedings of the 2018 25th IEEE International Conference on Image Processing(ICIP), Athens, Greece.","DOI":"10.1109\/ICIP.2018.8451142"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Yang, Q., Xu, Y., Wu, Z., and Wei, Z. (2019, January 24\u201326). Hyperspectral and multispectral image fusion based on deep attention network. Proceedings of the 2019 10th Workshop on Hyperspectral Imaging and Signal Processing: Evolution in Remote Sensing (WHISPERS), Amsterdam, The Netherlands.","DOI":"10.1109\/WHISPERS.2019.8920825"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"6827","DOI":"10.1109\/JSTARS.2021.3075727","article-title":"Physics-based GAN with iterative refinement unit for hyperspectral and multispectral image fusion","volume":"14","author":"Xiao","year":"2021","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"7373","DOI":"10.1109\/JSTARS.2021.3097178","article-title":"UMAG-Net: A new unsupervised multiattention-guided network for hyperspectral and multispectral image fusion","volume":"14","author":"Liu","year":"2021","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Qu, Y., Qi, H., and Kwan, C. (2018, January 18\u201323). Unsupervised sparse Dirichlet-net for hyperspectral image super-resolution. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00266"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"2487","DOI":"10.1109\/TGRS.2020.3006534","article-title":"Coupled convolutional neural network with adaptive response function learning for unsupervised hyperspectral super resolution","volume":"59","author":"Zheng","year":"2020","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Yao, J., Hong, D., Chanussot, J., Meng, D., Zhu, X., and Xu, Z. (2020, January 23\u201328). Cross-attention in coupled unmixing nets for unsupervised hyperspectral super-resolution. Proceedings of the European Conference on Computer Vision, Glasgow, UK.","DOI":"10.1007\/978-3-030-58526-6_13"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"502","DOI":"10.1109\/TPAMI.2020.3012548","article-title":"U2Fusion: A unified unsupervised image fusion network","volume":"14","author":"Xu","year":"2022","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"1200","DOI":"10.1109\/JAS.2022.105686","article-title":"SwinFusion: Cross-domain long-range learning for general image fusion via Swin transformer","volume":"9","author":"Ma","year":"2022","journal-title":"IEEE\/CAA J. Autom. Sinica"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Hu, J., Shen, L., and Sun, G. (2018, January 18\u201323). Squeeze-and-excitation networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00745"},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Woo, S., Park, J., Lee, J.Y., and Kweon, I.S. (2018, January 8\u201314). Cbam: Convolutional block attention module. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.","DOI":"10.1007\/978-3-030-01234-2_1"},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Fu, J., Liu, J., Tian, H., Li, Y., Bao, Y., Fang, Z., and Lu, H. (2019, January 15\u201320). Dual attention network for scene segmentation. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00326"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Zhang, H., Zu, K., Lu, J., Zou, Y., and Meng, D. (2022, January 4\u20138). EPSANet: An efficient pyramid squeeze attention block on convolutional neural network. Proceedings of the Asian Conference on Computer Vision, Macau, China.","DOI":"10.1007\/978-3-031-26313-2_33"}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/15\/4\/936\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T18:28:32Z","timestamp":1760120912000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/15\/4\/936"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,2,8]]},"references-count":41,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2023,2]]}},"alternative-id":["rs15040936"],"URL":"https:\/\/doi.org\/10.3390\/rs15040936","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,2,8]]}}}