{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,25]],"date-time":"2026-02-25T18:13:26Z","timestamp":1772043206086,"version":"3.50.1"},"reference-count":49,"publisher":"MDPI AG","issue":"23","license":[{"start":{"date-parts":[[2024,11,23]],"date-time":"2024-11-23T00:00:00Z","timestamp":1732320000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"National Natural Science Foundation of China","award":["61906198"],"award-info":[{"award-number":["61906198"]}]},{"name":"National Natural Science Foundation of China","award":["BK20190622"],"award-info":[{"award-number":["BK20190622"]}]},{"name":"National Natural Science Foundation of China","award":["KC23237"],"award-info":[{"award-number":["KC23237"]}]},{"DOI":"10.13039\/501100004608","name":"Natural Science Foundation of Jiangsu Province","doi-asserted-by":"publisher","award":["61906198"],"award-info":[{"award-number":["61906198"]}],"id":[{"id":"10.13039\/501100004608","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100004608","name":"Natural Science Foundation of Jiangsu Province","doi-asserted-by":"publisher","award":["BK20190622"],"award-info":[{"award-number":["BK20190622"]}],"id":[{"id":"10.13039\/501100004608","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100004608","name":"Natural Science Foundation of Jiangsu Province","doi-asserted-by":"publisher","award":["KC23237"],"award-info":[{"award-number":["KC23237"]}],"id":[{"id":"10.13039\/501100004608","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Xuzhou Special Fund for Promoting Science and Technology Innovation\u2014Key R&amp;D Program (Social Development)","award":["61906198"],"award-info":[{"award-number":["61906198"]}]},{"name":"Xuzhou Special Fund for Promoting Science and Technology Innovation\u2014Key R&amp;D Program (Social Development)","award":["BK20190622"],"award-info":[{"award-number":["BK20190622"]}]},{"name":"Xuzhou Special Fund for Promoting Science and Technology Innovation\u2014Key R&amp;D Program (Social Development)","award":["KC23237"],"award-info":[{"award-number":["KC23237"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>As remote sensing technology continues to evolve, the integration of multi-view data, including HSI and LiDAR data, has emerged as a pivotal research area aimed at enhancing the precision of classification. However, most current multimodal data fusion methods follow a process of first extracting features from each modality, then combining these features using a fusion strategy, and finally performing classification. This approach may result in the diminution of original information during the feature fusion process and relies heavily on the performance of the Softmax function during classification, without adequately considering the trustworthiness of the results. To address the above issues, this paper presented a hybrid feature and trusted decision fusion (HFTDF) method for dual-view remote sensing data classification. In terms of the research method, the approach first performs preliminary feature extraction on dual-view data using shallow CNN models, while implementing a shallow fusion strategy to integrate original information from different data sources at an early stage. Next, it leverages the proficiency of CNNs in learning localized characteristics and the potential of the Transformer in terms of its handling of overarching information, conducting hybrid feature learning on data from each view. Additionally, a deep fusion strategy serves to investigate the intricate interrelations among diverse perspectives. Finally, evidence theory is applied to model the uncertainty of classification results, generating trusted vectors, and a trusted decision fusion strategy is employed to merge the trusted information from each modality at the decision level, thereby enhancing the reliability of the results. HFTDF achieves overall classification accuracies of 94.68%, 99.17%, and 82.05% on the Houston 2013, Trento, and MUUFL datasets, respectively, when only 20 samples of each class are used for training. The classification results of the experiments reveal that HFTDF outperforms in the classification of dual-view data.<\/jats:p>","DOI":"10.3390\/rs16234381","type":"journal-article","created":{"date-parts":[[2024,11,25]],"date-time":"2024-11-25T08:38:24Z","timestamp":1732523904000},"page":"4381","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["Classification of Hyperspectral-LiDAR Dual-View Data Using Hybrid Feature and Trusted Decision Fusion"],"prefix":"10.3390","volume":"16","author":[{"given":"Jian","family":"Liu","sequence":"first","affiliation":[{"name":"School of Information and Control Engineering, China University of Mining and Technology, Xuzhou 221116, China"}]},{"given":"Xinzheng","family":"Xue","sequence":"additional","affiliation":[{"name":"School of Information and Control Engineering, China University of Mining and Technology, Xuzhou 221116, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3098-128X","authenticated-orcid":false,"given":"Qunyang","family":"Zuo","sequence":"additional","affiliation":[{"name":"School of Information and Control Engineering, China University of Mining and Technology, Xuzhou 221116, China"}]},{"given":"Jie","family":"Ren","sequence":"additional","affiliation":[{"name":"School of Information and Control Engineering, China University of Mining and Technology, Xuzhou 221116, China"}]}],"member":"1968","published-online":{"date-parts":[[2024,11,23]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"303","DOI":"10.1007\/s10712-019-09517-z","article-title":"Earth observation imaging spectroscopy for terrestrial systems: An overview of its history, techniques, and applications of its missions","volume":"40","author":"Rast","year":"2019","journal-title":"Surv. Geophys."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1560","DOI":"10.1109\/JPROC.2015.2449668","article-title":"Multimodal classification of remote sensing images: A review and future directions","volume":"103","author":"Tuia","year":"2015","journal-title":"Proc. IEEE"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"3650","DOI":"10.1109\/TNNLS.2021.3112268","article-title":"Spatial\u2013spectral unified adaptive probability graph convolutional networks for hyperspectral image classification","volume":"34","author":"Ding","year":"2023","journal-title":"IEEE Trans. Neural Netw. Learn. Syst."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"2100511","DOI":"10.1002\/lpor.202100511","article-title":"A progress review on solid-state LiDAR and nanophotonics-based LiDAR sensors","volume":"16","author":"Li","year":"2022","journal-title":"Laser Photon. Rev."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"170","DOI":"10.1016\/j.isprsjprs.2022.02.013","article-title":"DKDFN: Domain knowledge-guided deep collaborative fusion network for multimodal unitemporal remote sensing land cover classification","volume":"186","author":"Li","year":"2022","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"1011","DOI":"10.1109\/JSTARS.2020.2975252","article-title":"Multimodal bilinear fusion network with second-order attention-based channel selection for land cover classification","volume":"13","author":"Li","year":"2020","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"1497","DOI":"10.1109\/JSTARS.2020.3041316","article-title":"YOLOrs: Object detection in multimodal remote sensing imagery","volume":"14","author":"Sharma","year":"2020","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"1976","DOI":"10.1109\/JPROC.2022.3219376","article-title":"Land cover change detection with heterogeneous remote sensing images: Review, progress, and perspective","volume":"110","author":"Lv","year":"2022","journal-title":"Proc. IEEE"},{"key":"ref_9","first-page":"5404418","article-title":"Deep multimodal fusion network for semantic segmentation using remote sensing image and LiDAR data","volume":"60","author":"Sun","year":"2021","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_10","first-page":"102638","article-title":"MCANet: A joint semantic segmentation framework of optical and SAR images for land use classification","volume":"106","author":"Li","year":"2022","journal-title":"Int. J. Appl. Earth Obs. Geoinf."},{"key":"ref_11","first-page":"101093","article-title":"Crop monitoring by multimodal remote sensing: A review","volume":"33","author":"Karmakar","year":"2024","journal-title":"Remote Sens. Appl."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"116696","DOI":"10.1016\/j.geoderma.2023.116696","article-title":"Integration of multimodal data for large-scale rapid agricultural land evaluation using machine learning and deep learning approaches","volume":"439","author":"Li","year":"2023","journal-title":"Geoderma"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Morchhale, S., Pauca, V.P., Plemmons, R.J., and Torgersen, T.C. (2016, January 21\u201324). Classification of pixel-level fused hyperspectral and lidar data using deep convolutional neural networks. Proceedings of the 8th Workshop on Hyperspectral Image and Signal Processing: Evolution in Remote Sensing (WHISPERS), Los Angeles, CA, USA.","DOI":"10.1109\/WHISPERS.2016.8071715"},{"key":"ref_14","unstructured":"Wang, J., Zhang, J., Guo, Q., and Li, T. (August, January 28). Fusion of hyperspectral and lidar data based on dual-branch convolutional neural network. Proceedings of the IEEE International Geoscience and Remote Sensing Symposium (IGARSS), Yokohama, Japan."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"100","DOI":"10.1109\/TCYB.2018.2864670","article-title":"Feature extraction for classification of hyperspectral and LiDAR data using patch-to-patch CNN","volume":"50","author":"Zhang","year":"2018","journal-title":"IEEE Trans. Cybern."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Li, H., Ghamisi, P., Soergel, U., and Zhu, X.X. (2018). Hyperspectral and LiDAR fusion using deep three-stream convolutional neural networks. Remote Sens., 10.","DOI":"10.3390\/rs10101649"},{"key":"ref_17","first-page":"5506812","article-title":"Information fusion for classification of hyperspectral and LiDAR data using IP-CNN","volume":"60","author":"Zhang","year":"2021","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"5541213","DOI":"10.1109\/TGRS.2022.3216319","article-title":"Global\u2013local transformer network for HSI and LiDAR data joint classification","volume":"60","author":"Ding","year":"2022","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"5514415","DOI":"10.1109\/TGRS.2023.3284671","article-title":"Extended vision transformer (ExViT) for land use and land cover classification: A multimodal deep learning framework","volume":"61","author":"Yao","year":"2023","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_20","first-page":"5500716","article-title":"Joint classification of hyperspectral and LiDAR data using a hierarchical CNN and transformer","volume":"61","author":"Zhao","year":"2022","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_21","first-page":"5523216","article-title":"Mixing self-attention and convolution: A unified framework for multi-source remote sensing data classification","volume":"61","author":"Li","year":"2023","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"2551","DOI":"10.1109\/TPAMI.2022.3171983","article-title":"Trusted multi-view classification with dynamic evidential fusion","volume":"45","author":"Han","year":"2022","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Zhao, K., Gao, Q., Hao, S., Sun, J., and Zhou, L. (2023). Credible remote sensing scene classification using evidential fusion on aerial-ground dual-view images. Remote Sens., 15.","DOI":"10.3390\/rs15061546"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Zhou, W., Shi, Y., and Huang, X. (2024). Multi-view scene classification based on feature integration and evidence decision fusion. Remote Sens., 16.","DOI":"10.3390\/rs16050738"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Wang, K., Cheng, L., and Yong, B. (2020). Spectral-similarity-based kernel of SVM for hyperspectral image classification. Remote Sens., 12.","DOI":"10.3390\/rs12132154"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"10419","DOI":"10.1007\/s11042-017-4403-9","article-title":"Spectral-spatial K-Nearest Neighbor approach for hyperspectral image classification","volume":"77","author":"Bo","year":"2018","journal-title":"Multimed. Tools Appl."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"6809","DOI":"10.1007\/s00521-019-04044-9","article-title":"MCK-ELM: Multiple composite kernel extreme learning machine for hyperspectral images","volume":"32","author":"Ergul","year":"2020","journal-title":"Neural Comput. Appl."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"377","DOI":"10.1080\/02564602.2020.1740615","article-title":"PCA-based feature reduction for hyperspectral remote sensing image classification","volume":"38","author":"Uddin","year":"2021","journal-title":"IETE Tech. Rev."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"9474","DOI":"10.1080\/10106049.2021.2020343","article-title":"Improved folded-PCA for efficient remote sensing hyperspectral image classification","volume":"37","author":"Uddin","year":"2022","journal-title":"Geocarto Int."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"e3295","DOI":"10.1002\/cem.3295","article-title":"Exploring local spatial features in hyperspectral images","volume":"34","author":"Ahmad","year":"2020","journal-title":"J. Chemom."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"258619","DOI":"10.1155\/2015\/258619","article-title":"Deep convolutional neural networks for hyperspectral image classification","volume":"2015","author":"Hu","year":"2015","journal-title":"J. Sensors."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Makantasis, K., Karantzalos, K., Doulamis, A., and Doulamis, N. (2015, January 26\u201331). Deep supervised learning for hyperspectral data classification through convolutional neural networks. Proceedings of the IEEE International Geoscience and Remote Sensing Symposium (IGARSS), Milan, Italy.","DOI":"10.1109\/IGARSS.2015.7326945"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"6232","DOI":"10.1109\/TGRS.2016.2584107","article-title":"Deep feature extraction and classification of hyperspectral images based on convolutional neural networks","volume":"54","author":"Chen","year":"2016","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"4544","DOI":"10.1109\/TGRS.2016.2543748","article-title":"Spectral\u2013spatial feature extraction for hyperspectral image classification: A dimension reduction and deep learning approach","volume":"54","author":"Zhao","year":"2016","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"844","DOI":"10.1109\/TGRS.2016.2616355","article-title":"Hyperspectral image classification using deep pixel-pair features","volume":"55","author":"Li","year":"2016","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Li, Y., Zhang, H., and Shen, Q. (2017). Spectral\u2013spatial classification of hyperspectral imagery with 3D convolutional neural network. Remote Sens., 9.","DOI":"10.3390\/rs9010067"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"847","DOI":"10.1109\/TGRS.2017.2755542","article-title":"Spectral\u2013spatial residual network for hyperspectral image classification: A 3-D deep learning framework","volume":"56","author":"Zhong","year":"2017","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"277","DOI":"10.1109\/LGRS.2019.2918719","article-title":"HybridSN: Exploring 3-D\u20132-D CNN feature hierarchy for hyperspectral image classification","volume":"17","author":"Roy","year":"2019","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"87","DOI":"10.1109\/TPAMI.2022.3152247","article-title":"A survey on vision transformer","volume":"45","author":"Han","year":"2022","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"5539014","DOI":"10.1109\/TGRS.2022.3207933","article-title":"Hyperspectral image classification using group-aware hierarchical transformer","volume":"60","author":"Mei","year":"2022","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"12008","DOI":"10.1109\/JSTARS.2024.3419070","article-title":"A light-weighted spectral-spatial transformer model for hyperspectral image classification","volume":"17","author":"Arshad","year":"2024","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_42","first-page":"5527918","article-title":"Hybrid multi-scale spatial-spectral transformer for hyperspectral image classification","volume":"62","author":"He","year":"2024","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"5521312","DOI":"10.1109\/TGRS.2024.3417475","article-title":"Joint classification of hyperspectral image and lidar data based on spectral prompt tuning","volume":"62","author":"Kong","year":"2024","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"123587","DOI":"10.1016\/j.eswa.2024.123587","article-title":"A novel graph-attention based multimodal fusion network for joint classification of hyperspectral image and LiDAR data","volume":"249","author":"Cai","year":"2024","journal-title":"Expert Syst. Appl."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"5512815","DOI":"10.1109\/TGRS.2024.3374324","article-title":"Cross hyperspectral and LiDAR attention transformer: An extended self-attention for land use and land cover classification","volume":"62","author":"Roy","year":"2024","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"2405","DOI":"10.1109\/JSTARS.2014.2305441","article-title":"Hyperspectral and LiDAR data fusion: Outcome of the 2013 GRSS data fusion contest","volume":"7","author":"Debes","year":"2014","journal-title":"IEEE J. Sel. Topics Appl. Earth Observ. Remote Sens."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"6354","DOI":"10.1109\/TGRS.2017.2726901","article-title":"Fusion of hyperspectral and lidar data using sparse and low-rank component analysis","volume":"55","author":"Rasti","year":"2017","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_48","unstructured":"Gader, P., Zare, A., Close, R., Aitken, J., and Tuell, G. (2013). MUUFL Gulfport Hyperspectral and LiDAR Airborne Data Set, University of Florida. Technical Report REP-2013-570."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"4939","DOI":"10.1109\/TGRS.2020.2969024","article-title":"Classification of hyperspectral and LiDAR data using coupled CNNs","volume":"58","author":"Hang","year":"2020","journal-title":"IEEE Trans. Geosci. Remote Sens."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/16\/23\/4381\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T16:38:08Z","timestamp":1760114288000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/16\/23\/4381"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,11,23]]},"references-count":49,"journal-issue":{"issue":"23","published-online":{"date-parts":[[2024,12]]}},"alternative-id":["rs16234381"],"URL":"https:\/\/doi.org\/10.3390\/rs16234381","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,11,23]]}}}