{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,30]],"date-time":"2026-07-30T14:47:28Z","timestamp":1785422848196,"version":"3.56.0"},"reference-count":45,"publisher":"MDPI AG","issue":"4","license":[{"start":{"date-parts":[[2022,2,11]],"date-time":"2022-02-11T00:00:00Z","timestamp":1644537600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>The rapid development of remote sensing technology provides wealthy data for earth observation. Land-cover mapping indirectly achieves biodiversity estimation at a coarse scale. Therefore, accurate land-cover mapping is the precondition of biodiversity estimation. However, the environment of the wetlands is complex, and the vegetation is mixed and patchy, so the land-cover recognition based on remote sensing is full of challenges. This paper constructs a systematic framework for multisource remote sensing image processing. Firstly, the hyperspectral image (HSI) and multispectral image (MSI) are fused by the CNN-based method to obtain the fused image with high spatial-spectral resolution. Secondly, considering the sequentiality of spatial distribution and spectral response, the spatial-spectral vision transformer (SSViT) is designed to extract sequential relationships from the fused images. After that, an external attention module is utilized for feature integration, and then the pixel-wise prediction is achieved for land-cover mapping. Finally, land-cover mapping and benthos data at the sites are analyzed consistently to reveal the distribution rule of benthos. Experiments on ZiYuan1-02D data of the Yellow River estuary wetland are conducted to demonstrate the effectiveness of the proposed framework compared with several related methods.<\/jats:p>","DOI":"10.3390\/rs14040850","type":"journal-article","created":{"date-parts":[[2022,2,13]],"date-time":"2022-02-13T20:34:45Z","timestamp":1644784485000},"page":"850","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":34,"title":["Fusion Classification of HSI and MSI Using a Spatial-Spectral Vision Transformer for Wetland Biodiversity Estimation"],"prefix":"10.3390","volume":"14","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-2896-6902","authenticated-orcid":false,"given":"Yunhao","family":"Gao","sequence":"first","affiliation":[{"name":"School of Information and Electronics, Beijing Institute of Technology, Beijing 100081, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xiukai","family":"Song","sequence":"additional","affiliation":[{"name":"Shandong Provincial Key Laboratory of Restoration for Marine Ecology, Shandong Marine Resources and Environment Research Institute, Yantai 264006, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Wei","family":"Li","sequence":"additional","affiliation":[{"name":"School of Information and Electronics, Beijing Institute of Technology, Beijing 100081, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jianbu","family":"Wang","sequence":"additional","affiliation":[{"name":"Lab of the Marine Physics and Remote Sensing, First Institute of Oceanography, Ministry of Natural Resources, Qingdao 266061, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jianlong","family":"He","sequence":"additional","affiliation":[{"name":"Shandong Provincial Key Laboratory of Restoration for Marine Ecology, Shandong Marine Resources and Environment Research Institute, Yantai 264006, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xiangyang","family":"Jiang","sequence":"additional","affiliation":[{"name":"Shandong Provincial Key Laboratory of Restoration for Marine Ecology, Shandong Marine Resources and Environment Research Institute, Yantai 264006, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yinyin","family":"Feng","sequence":"additional","affiliation":[{"name":"Shandong Provincial Key Laboratory of Restoration for Marine Ecology, Shandong Marine Resources and Environment Research Institute, Yantai 264006, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2022,2,11]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Brisco, B., Ahern, F., Murnaghan, K., White, L., Canisus, F., and Lancaster, P. (2017). Seasonal Change in Wetland Coherence as an Aid to Wetland Monitoring. Remote Sens., 9.","DOI":"10.3390\/rs9020158"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Xia, Y., Fang, C., Lin, H., Li, H., and Wu, B. (2021). Spatiotemporal Evolution of Wetland Eco-Hydrological Connectivity in the Poyang Lake Area Based on Long Time-Series Remote Sensing Images. Remote Sens., 13.","DOI":"10.3390\/rs13234812"},{"key":"ref_3","first-page":"102581","article-title":"Machine learning with high-resolution aerial imagery and data fusion to improve and automate the detection of wetlands","volume":"105","author":"Ruiz","year":"2021","journal-title":"Int. J. Appl. Earth Obs. Geoinf."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Sun, S., Wang, Y., Song, Z., Chen, C., Zhang, Y., Chen, X., Chen, W., Yuan, W., Wu, X., and Ran, X. (2021). Modelling Aboveground Biomass Carbon Stock of the Bohai Rim Coastal Wetlands by Integrating Remote Sensing, Terrain, and Climate Data. Remote Sens., 13.","DOI":"10.3390\/rs13214321"},{"key":"ref_5","first-page":"102611","article-title":"Explicit and stepwise models for spatiotemporal fusion of remote sensing images with deep neural networks","volume":"105","author":"Ma","year":"2021","journal-title":"Int. J. Appl. Earth Obs. Geoinf."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"111218","DOI":"10.1016\/j.rse.2019.111218","article-title":"Remote sensing of terrestrial plant biodiversity","volume":"231","author":"Wang","year":"2019","journal-title":"Remote Sens. Environ."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Filipponi, F., Valentini, E., Nguyen Xuan, A., Guerra, C.A., Wolf, F., Andrzejak, M., and Taramelli, A. (2018). Global MODIS Fraction of Green Vegetation Cover for Monitoring Abrupt and Gradual Vegetation Changes. Remote Sens., 10.","DOI":"10.3390\/rs10040653"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Hong, D., Han, Z., Yao, J., Gao, L., Zhang, B., Plaza, A., and Chanussot, J. (2021). SpectralFormer: Rethinking Hyperspectral Image Classification with Transformers. IEEE Trans. Geosci. Remote Sens., 1.","DOI":"10.1109\/TGRS.2021.3130716"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"238","DOI":"10.1016\/j.isprsjprs.2020.11.018","article-title":"Kernel low-rank representation with elastic net for China coastal wetland land cover classification using GF-5 hyperspectral imagery","volume":"171","author":"Su","year":"2021","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"5966","DOI":"10.1109\/TGRS.2020.3015157","article-title":"Graph Convolutional Networks for Hyperspectral Image Classification","volume":"59","author":"Hong","year":"2021","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"5813","DOI":"10.1109\/TGRS.2019.2902568","article-title":"Hyperspectral Classification Based on Lightweight 3D-CNN With Transfer Learning","volume":"57","author":"Zhang","year":"2019","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"5028","DOI":"10.1109\/TGRS.2020.3011002","article-title":"A Fast Neighborhood Grouping Method for Hyperspectral Band Selection","volume":"59","author":"Wang","year":"2021","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"3251","DOI":"10.1109\/JSTARS.2021.3055784","article-title":"Multitemporal Relearning with Convolutional LSTM Models for Land Use Classification","volume":"14","author":"Zhu","year":"2021","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Zhang, M., and Lin, H. (2022). Wetland Classification Using Parcel-level Ensemble Algorithm based on GaoFen-6 Multispectral Imagery and Sentinel-1 Dataset. J. Hydrol., 127462.","DOI":"10.1016\/j.jhydrol.2022.127462"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Zhang, X., Xu, J., Chen, Y., Xu, K., and Wang, D. (2021). Coastal Wetland Classification with GF-3 Polarimetric SAR Imagery by Using Object-Oriented Random Forest Algorithm. Sensors, 21.","DOI":"10.3390\/s21103395"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Jiao, L., Sun, W., Yang, G., Ren, G., and Liu, Y. (2019). A Hierarchical Classification Framework of Satellite Multispectral\/Hyperspectral Images for Mapping Coastal Wetlands. Remote Sens., 11.","DOI":"10.3390\/rs11192238"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"6690","DOI":"10.1109\/TGRS.2019.2907932","article-title":"Deep Learning for Hyperspectral Image Classification: An Overview","volume":"57","author":"Li","year":"2019","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"5953","DOI":"10.1109\/TGRS.2020.3018732","article-title":"SSR-NET: Spatial\u2013Spectral Reconstruction Network for Hyperspectral and Multispectral Image Fusion","volume":"59","author":"Zhang","year":"2021","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_19","first-page":"5506812","article-title":"Information Fusion for Classification of Hyperspectral and LiDAR Data Using IP-CNN","volume":"60","author":"Zhang","year":"2021","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_20","unstructured":"Meng, Y., Rigall, E., Chen, X., Gao, F., Dong, J., and Chen, S. (2021). Physics-Guided Generative Adversarial Networks for Sea Subsurface Temperature Prediction. IEEE Trans. Neural Netw. Learn. Syst., 1\u201314."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Sahour, H., Kemink, K.M., and O\u2019Connell, J. (2022). Integrating SAR and Optical Remote Sensing for Conservation-Targeted Wetlands Mapping. Remote Sens., 14.","DOI":"10.3390\/rs14010159"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Zhou, R., Yang, C., Li, E., Cai, X., Yang, J., and Xia, Y. (2021). Object-Based Wetland Vegetation Classification Using Multi-Feature Selection of Unoccupied Aerial Vehicle RGB Imagery. Remote Sens., 13.","DOI":"10.3390\/rs13234910"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"521","DOI":"10.1007\/s11707-017-0672-x","article-title":"Remote sensing study of wetlands in the Pearl River Delta during 1995\u20132015 with the support vector machine method","volume":"12","author":"Han","year":"2017","journal-title":"Front. Earth Sci."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"3681","DOI":"10.1109\/TGRS.2014.2381602","article-title":"Local Binary Patterns and Extreme Learning Machine for Hyperspectral Imagery Classification","volume":"53","author":"Li","year":"2015","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"1082","DOI":"10.1109\/JSTARS.2018.2809781","article-title":"Cascaded Random Forest for Hyperspectral Image Classification","volume":"11","author":"Zhang","year":"2018","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Zhong, Y., Cao, Q., Zhao, J., Ma, A., Zhao, B., and Zhang, L. (2017). Optimal Decision Fusion for Urban Land-Use\/Land-Cover Classification Based on Adaptive Differential Evolution Using Hyperspectral and LiDAR Data. Remote Sens., 9.","DOI":"10.3390\/rs9080868"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"3030","DOI":"10.1109\/JSTARS.2018.2846178","article-title":"Deep convolutional neural network for complex wetland classification using optical remote sensing imagery","volume":"11","author":"Rezaee","year":"2018","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"837","DOI":"10.1080\/2150704X.2020.1772518","article-title":"A feature sequence-based 3D convolutional method for wetland classification from multispectral images","volume":"11","author":"Pan","year":"2020","journal-title":"Remote Sens. Lett."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"7355","DOI":"10.1109\/TGRS.2020.2982064","article-title":"Joint Classification of Hyperspectral and LiDAR Data Using Hierarchical Random Walk and Deep CNN Architecture","volume":"58","author":"Zhao","year":"2020","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Li, H., Ghamisi, P., Soergel, U., and Zhu, X. (2018). Hyperspectral and LiDAR Fusion Using Deep Three-Stream Convolutional Neural Networks. Remote Sens., 10.","DOI":"10.3390\/rs10101649"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"937","DOI":"10.1109\/TGRS.2017.2756851","article-title":"Multisource Remote Sensing Data Classification Based on Convolutional Neural Network","volume":"56","author":"Xu","year":"2018","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"982","DOI":"10.1109\/JSTARS.2020.3040305","article-title":"Joint Classification of Hyperspectral and Multispectral Images for Mapping Coastal Wetlands","volume":"14","author":"Liu","year":"2021","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"100","DOI":"10.1109\/TCYB.2018.2864670","article-title":"Feature Extraction for Classification of Hyperspectral and LiDAR Data Using Patch-to-Patch CNN","volume":"50","author":"Zhang","year":"2020","journal-title":"IEEE Trans. Cybern."},{"key":"ref_34","first-page":"5512615","article-title":"Hyperspectral and Multispectral Classification for Coastal Wetland Using Depthwise Feature Interaction Network","volume":"60","author":"Gao","year":"2021","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_35","first-page":"102594","article-title":"Integration of ZiYuan-3 multispectral and stereo imagery for mapping urban vegetation using the hierarchy-based classifier","volume":"105","author":"Zhao","year":"2021","journal-title":"Int. J. Appl. Earth Obs. Geoinf."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Li, C., Zhu, L., Dai, Z., and Wu, Z. (2021). Study on Spatiotemporal Evolution of the Yellow River Delta Coastline from 1976 to 2020. Remote Sens., 13.","DOI":"10.3390\/rs13234789"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Lu, H., Qiao, D., Li, Y., Wu, S., and Deng, L. (2021). Fusion of China ZY-1 02D Hyperspectral Data and Multispectral Data: Which Methods Should Be Used?. Remote Sens., 13.","DOI":"10.3390\/rs13122354"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"2487","DOI":"10.1109\/TGRS.2020.3006534","article-title":"Coupled Convolutional Neural Network with Adaptive Response Function Learning for Unsupervised Hyperspectral Super Resolution","volume":"59","author":"Zheng","year":"2021","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_39","unstructured":"Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, \u0141., and Polosukhin, I. (2017, January 4\u20139). Attention is all you need. Proceedings of the 31st International Conference on Neural Information Processing Systems, Long Beach, CA, USA."},{"key":"ref_40","unstructured":"Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., and Gelly, S. (2020). An image is worth 16x16 words: Transformers for image recognition at scale. arXiv."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"68","DOI":"10.1016\/j.isprsjprs.2021.05.011","article-title":"Multimodal remote sensing benchmark datasets for land cover classification with a shared and specific feature learning model","volume":"178","author":"Hong","year":"2021","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27\u201330). Deep Residual Learning for Image Recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Yin, H., Hu, Y., Liu, M., Li, C., and Chang, Y. (2022). Evolutions of 30-Year Spatio-Temporal Distribution and Influencing Factors of Suaeda salsa in Bohai Bay, China. Remote Sens., 14.","DOI":"10.3390\/rs14010138"},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"2297","DOI":"10.1002\/esp.4642","article-title":"Tidal Inlets in the Anthropocene: Geomorphology and Benthic Habitats of the Chioggia Inlet, Venice Lagoon (Italy)","volume":"44","author":"Fogarin","year":"2019","journal-title":"Earth Surf. Process. Landforms"},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Trzcinska, K., Tegowski, J., Pocwiardowski, P., Janowski, L., Zdroik, J., Kruss, A., Rucinska, M., Lubniewski, Z., and Schneider von Deimling, J. (2021). Measurement of Seafloor Acoustic Backscatter Angular Dependence at 150 kHz Using A Multibeam Echosounder. Remote Sens., 13.","DOI":"10.3390\/rs13234771"}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/14\/4\/850\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T22:17:23Z","timestamp":1760134643000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/14\/4\/850"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,2,11]]},"references-count":45,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2022,2]]}},"alternative-id":["rs14040850"],"URL":"https:\/\/doi.org\/10.3390\/rs14040850","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,2,11]]}}}