{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,13]],"date-time":"2026-03-13T21:44:05Z","timestamp":1773438245142,"version":"3.50.1"},"reference-count":37,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2023,12,25]],"date-time":"2023-12-25T00:00:00Z","timestamp":1703462400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["62101392"],"award-info":[{"award-number":["62101392"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>The joint use of hyperspectral image (HSI) and Light Detection And Ranging (LiDAR) data has been widely applied for land cover classification because it can comprehensively represent the urban structures and land material properties. However, existing methods fail to combine the different image information effectively, which limits the semantic relevance of different data sources. To solve this problem, in this paper, an Attention-guided Fusion and Classification framework based on Convolutional Neural Network (AFC-CNN) is proposed to classify the land cover based on the joint use of HSI and LiDAR data. In the feature extraction module, AFC-CNN employs the three dimensional convolutional neural network (3D-CNN) combined with a multi-scale structure to extract the spatial-spectral features of HSI, and uses a 2D-CNN to extract the spatial features from LiDAR data. Simultaneously, the spectral attention mechanism is adopted to assign weights to the spectral channels, and the cross attention mechanism is introduced to impart significant spatial weights from LiDAR to HSI, which enhance the interaction between HSI and LiDAR data and leverage the fusion information. Then two feature branches are concatenated and transferred to the feature fusion module for higher-level feature extraction and fusion. In the fusion module, AFC-CNN adopts the depth separable convolution connected through the residual structures to obtain the advanced features, which can help reduce computational complexity and improve the fitting ability of the model. Finally, the fused features are sent into the linear classification module for final classification. Experimental results on three datasets, i.e., Houston, MUUFL and Trento datasets show that the proposed AFC-CNN framework achieves better classification accuracy compared with the state-of-the-art algorithms. The overall accuracy of AFC-CNN on Houston, MUUFL and Trento datasets are 94.2%, 95.3% and 99.5%, respectively.<\/jats:p>","DOI":"10.3390\/rs16010094","type":"journal-article","created":{"date-parts":[[2023,12,25]],"date-time":"2023-12-25T23:00:12Z","timestamp":1703545212000},"page":"94","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":18,"title":["Attention-Guided Fusion and Classification for Hyperspectral and LiDAR Data"],"prefix":"10.3390","volume":"16","author":[{"ORCID":"https:\/\/orcid.org\/0009-0005-4243-9235","authenticated-orcid":false,"given":"Jing","family":"Huang","sequence":"first","affiliation":[{"name":"Engineering Research Center of Metallurgical Automation and Measurement Technology, Wuhan University of Science and Technology, Wuhan 430081, China"}]},{"given":"Yinghao","family":"Zhang","sequence":"additional","affiliation":[{"name":"Engineering Research Center of Metallurgical Automation and Measurement Technology, Wuhan University of Science and Technology, Wuhan 430081, China"}]},{"given":"Fang","family":"Yang","sequence":"additional","affiliation":[{"name":"Engineering Research Center of Metallurgical Automation and Measurement Technology, Wuhan University of Science and Technology, Wuhan 430081, China"}]},{"given":"Li","family":"Chai","sequence":"additional","affiliation":[{"name":"State Key Laboratory of Industrial Control Technology, College of Control Science and Engineering, Zhejiang University, Hangzhou 310027, China"}]}],"member":"1968","published-online":{"date-parts":[[2023,12,25]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"171","DOI":"10.1016\/j.isprsjprs.2022.03.010","article-title":"Fusion of optical, radar and waveform LiDAR observations for land cover classification","volume":"187","author":"Jin","year":"2022","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"112780","DOI":"10.1016\/j.rse.2021.112780","article-title":"Land cover classification in an era of big and open data: Optimizing localized implementation and training data selection to improve mapping outcomes","volume":"268","author":"Hermosilla","year":"2022","journal-title":"Remote Sens. Environ."},{"key":"ref_3","first-page":"100248","article-title":"Monitoring and predicting the influences of land use\/land cover change on cropland characteristics and drought severity using remote sensing techniques","volume":"18","author":"Taiwo","year":"2023","journal-title":"Environ. Sustain. Indic."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"40","DOI":"10.1016\/j.inffus.2020.11.001","article-title":"Recent advances and new guidelines on hyperspectral and multispectral image fusion","volume":"69","author":"Dian","year":"2021","journal-title":"Inf. Fusion"},{"key":"ref_5","first-page":"1","article-title":"Interactformer: Interactive transformer and CNN for hyperspectral image super-resolution","volume":"60","author":"Liu","year":"2022","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"3011","DOI":"10.1109\/JSTARS.2016.2634863","article-title":"Hyperspectral and LiDAR data fusion using extinction profiles and deep convolutional neural network","volume":"10","author":"Ghamisi","year":"2016","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"1709","DOI":"10.1109\/JSTARS.2019.2911113","article-title":"Advanced multi-sensor optical remote sensing for urban land use and land cover classification: Outcome of the 2018 IEEE GRSS data fusion contest","volume":"12","author":"Xu","year":"2019","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_8","first-page":"1","article-title":"Information fusion for classification of hyperspectral and LiDAR data using IP-CNN","volume":"60","author":"Zhang","year":"2021","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_9","first-page":"1","article-title":"Hyperspectral and LiDAR data classification using joint CNNs and morphological feature learning","volume":"60","author":"Roy","year":"2022","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.inffus.2021.12.008","article-title":"Multi-attentive hierarchical dense fusion net for fusion classification of hyperspectral and LiDAR data","volume":"82","author":"Wang","year":"2022","journal-title":"Inf. Fusion"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"3173","DOI":"10.1109\/TGRS.2018.2794326","article-title":"Hyperspectral image classification with deep feature fusion network","volume":"56","author":"Song","year":"2018","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"59","DOI":"10.1016\/j.inffus.2020.01.007","article-title":"An overview on spectral and spatial information fusion for hyperspectral image classification: Current trends and challenges","volume":"59","author":"Imani","year":"2020","journal-title":"Inf. Fusion"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Wu, H., Dai, S., Liu, C., Wang, A., and Iwahori, Y. (2023). A novel dual-encoder model for hyperspectral and LiDAR joint classification via contrastive learning. Remote Sens., 15.","DOI":"10.3390\/rs15040924"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Sugumaran, R., and Voss, M. (2007, January 11\u201313). Object-oriented classification of LiDAR-fused hyperspectral imagery for tree species identification in an urban environment. Proceedings of the 2007 Urban Remote Sensing Joint Event, Paris, France.","DOI":"10.1109\/URS.2007.371845"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"1416","DOI":"10.1109\/TGRS.2008.916480","article-title":"Fusion of hyperspectral and LiDAR remote sensing data for classification of complex forest areas","volume":"46","author":"Dalponte","year":"2008","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"5158","DOI":"10.3390\/s110505158","article-title":"Tree classification with fused mobile laser scanning and hyperspectral data","volume":"11","author":"Puttonen","year":"2011","journal-title":"Sensors"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"856","DOI":"10.1109\/JSTSP.2012.2208177","article-title":"Classification of remote sensing optical and LiDAR data using extended attribute profiles","volume":"6","author":"Pedergnana","year":"2012","journal-title":"IEEE J. Sel. Top. Signal Process."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"5631","DOI":"10.1109\/TGRS.2016.2561842","article-title":"Extinction profiles for the classification of remote sensing data","volume":"54","author":"Ghamisi","year":"2016","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"5312","DOI":"10.1109\/TGRS.2015.2421051","article-title":"A novel MKL model of integrating LiDAR data and MSI for urban area classification","volume":"53","author":"Gu","year":"2015","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"937","DOI":"10.1109\/TGRS.2017.2756851","article-title":"Multisource remote sensing data classification based on convolutional neural network","volume":"56","author":"Xu","year":"2017","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Li, Y., Zhang, H., and Shen, Q. (2017). Spectral\u2013spatial classification of hyperspectral imagery with 3D convolutional neural network. Remote Sens., 9.","DOI":"10.3390\/rs9010067"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"100","DOI":"10.1109\/TCYB.2018.2864670","article-title":"Feature extraction for classification of hyperspectral and LiDAR data using patch-to-patch CNN","volume":"50","author":"Zhang","year":"2018","journal-title":"IEEE Trans. Cybern."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"73","DOI":"10.1016\/j.rse.2018.04.050","article-title":"Urban land-use mapping using a deep convolutional neural network with high spatial resolution multispectral remote sensing imagery","volume":"214","author":"Huang","year":"2018","journal-title":"Remote Sens. Environ."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Feng, Q., Zhu, D., Yang, J., and Li, B. (2019). Multisource hyperspectral and LiDAR data fusion for urban land-use mapping based on a modified two-branch convolutional neural network. ISPRS Int. J.-Geo-Inf., 8.","DOI":"10.3390\/ijgi8010028"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"1253","DOI":"10.1109\/LGRS.2017.2704625","article-title":"Deep fusion of remote sensing data for accurate classification","volume":"14","author":"Chen","year":"2017","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Wang, J., Zhang, J., Guo, Q., and Li, T. (August, January 28). Fusion of hyperspectral and lidar data based on dual-branch convolutional neural network. Proceedings of the IGARSS 2019\u20132019 IEEE International Geoscience and Remote Sensing Symposium, Yokohama, Japan.","DOI":"10.1109\/IGARSS.2019.8899332"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"5776","DOI":"10.1109\/JSTARS.2020.3024841","article-title":"Hyperspectral image classification method based on 2D\u20133D CNN and multibranch feature fusion","volume":"13","author":"Ge","year":"2020","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"139","DOI":"10.1007\/s11760-022-02213-3","article-title":"Violent activity classification with transferred deep features and 3D-CNN","volume":"17","author":"Keceli","year":"2023","journal-title":"Signal Image Video Process."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Mohla, S., Pande, S., Banerjee, B., and Chaudhuri, S. (2020, January 14\u201319). FusAtNet: Dual attention based spectrospatial multimodal fusion network for hyperspectral and LiDAR classification. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition Workshops, Seattle, WA, USA.","DOI":"10.21203\/rs.3.rs-32802\/v1"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"747","DOI":"10.1109\/TNNLS.2020.3028945","article-title":"A3CLNN: Spatial, spectral and multiscale attention convLSTM neural network for multisource remote sensing data classification","volume":"33","author":"Li","year":"2020","journal-title":"IEEE Trans. Neural Netw. Learn. Syst."},{"key":"ref_31","first-page":"1","article-title":"A triplet semisupervised deep network for fusion classification of hyperspectral and LiDAR data","volume":"60","author":"Li","year":"2022","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Woo, S., Park, J., Lee, J.Y., and Kweon, I.S. (2018, January 8\u201314). CBAM: Convolutional block attention module. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.","DOI":"10.1007\/978-3-030-01234-2_1"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1109\/TGRS.2022.3210398","article-title":"MAGE: Multisource attention network with discriminative graph and informative entities for classification of hyperspectral and LiDAR data","volume":"60","author":"Xiu","year":"2022","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_34","unstructured":"Gader, P., Zare, A., Close, R., Aitken, J., and Tuell, G. (2023, January 07). MUUFL Gulfport Hyperspectral and LiDAR Airborne Data Set. Univ. Florida, Gainesville, FL, USA, Tech. Rep. REP-2013-570. Available online: https:\/\/github.com\/GatorSense\/MUUFLGulfport\/."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"3997","DOI":"10.1109\/TGRS.2017.2686450","article-title":"Hyperspectral and LiDAR fusion using extinction profiles and total variation component analysis","volume":"55","author":"Rasti","year":"2017","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"4340","DOI":"10.1109\/TGRS.2020.3016820","article-title":"More diverse means better: Multimodal deep learning meets remote-sensing imagery classification","volume":"59","author":"Hong","year":"2020","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_37","unstructured":"Kingma, D.P., and Ba, J. (2014). Adam: A method for stochastic optimization. arXiv."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/16\/1\/94\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T21:41:54Z","timestamp":1760132514000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/16\/1\/94"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,12,25]]},"references-count":37,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2024,1]]}},"alternative-id":["rs16010094"],"URL":"https:\/\/doi.org\/10.3390\/rs16010094","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,12,25]]}}}