{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,3]],"date-time":"2025-11-03T09:23:30Z","timestamp":1762161810845,"version":"build-2065373602"},"reference-count":44,"publisher":"MDPI AG","issue":"5","license":[{"start":{"date-parts":[[2023,2,25]],"date-time":"2023-02-25T00:00:00Z","timestamp":1677283200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100007129","name":"Natural Science Foundation of Shandong Province","doi-asserted-by":"publisher","award":["ZR2022MD015","U22A20586","41701513","61371189","41772350","2019GGX101033"],"award-info":[{"award-number":["ZR2022MD015","U22A20586","41701513","61371189","41772350","2019GGX101033"]}],"id":[{"id":"10.13039\/501100007129","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Key Program of Joint Fund of the National Natural Science Foundation of China and Shandong Province","award":["ZR2022MD015","U22A20586","41701513","61371189","41772350","2019GGX101033"],"award-info":[{"award-number":["ZR2022MD015","U22A20586","41701513","61371189","41772350","2019GGX101033"]}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["ZR2022MD015","U22A20586","41701513","61371189","41772350","2019GGX101033"],"award-info":[{"award-number":["ZR2022MD015","U22A20586","41701513","61371189","41772350","2019GGX101033"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100014103","name":"Key Research and Development Program of Shandong Province","doi-asserted-by":"publisher","award":["ZR2022MD015","U22A20586","41701513","61371189","41772350","2019GGX101033"],"award-info":[{"award-number":["ZR2022MD015","U22A20586","41701513","61371189","41772350","2019GGX101033"]}],"id":[{"id":"10.13039\/100014103","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>For the remote sensing classification task, the ability of a single data source to identify the ground objects remains limited due to the lack of feature diversity. As the typical remote sensing data sources, hyperspectral imagery (HSI) and light detection and ranging (LiDAR) data can provide complementary spectral features and elevation information, respectively. To enhance classification ability, a multi-scale Pseudo-Siamese Network with attention mechanism (MA-PSNet) is proposed by fusing HSI and LiDAR data. In the network, two sub-branch networks are designed for extracting the features from HSI and LiDAR, respectively, and the connection is further established between these two branches. Specifically, a multi-scale feature learning module is incorporated, enabling the image features to be fully extracted at different scales. Similarly, a convolutional attention module is also embedded to highlight the saliency information of the objects, which makes the network training can be more targeted, thereby eventually improving the model performance for classification. The evaluation experiments of the proposed model are carried out on an urban dataset from Houston, USA, and a rural dataset from Trento, Italy. The overall accuracy (OA) of the model can reach 95.03% on the Houston data and 99.16% on the Trento data. The experimental results fully demonstrate that the proposed model has competitive performance compared with several state-of-the-art methods.<\/jats:p>","DOI":"10.3390\/rs15051283","type":"journal-article","created":{"date-parts":[[2023,2,27]],"date-time":"2023-02-27T01:59:10Z","timestamp":1677463150000},"page":"1283","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":11,"title":["A Multi-Scale Pseudo-Siamese Network with an Attention Mechanism for Classification of Hyperspectral and LiDAR Data"],"prefix":"10.3390","volume":"15","author":[{"given":"Dongmei","family":"Song","sequence":"first","affiliation":[{"name":"College of Oceanography and Space Informatics, China University of Petroleum (East China), Qingdao 266580, China"},{"name":"Laboratory for Marine Mineral Resources, Qingdao National Laboratory for Marine Science and Technology, Qingdao 266071, China"}]},{"given":"Jiacheng","family":"Gao","sequence":"additional","affiliation":[{"name":"College of Oceanography and Space Informatics, China University of Petroleum (East China), Qingdao 266580, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2565-1013","authenticated-orcid":false,"given":"Bin","family":"Wang","sequence":"additional","affiliation":[{"name":"College of Oceanography and Space Informatics, China University of Petroleum (East China), Qingdao 266580, China"}]},{"given":"Mingyue","family":"Wang","sequence":"additional","affiliation":[{"name":"College of Oceanography and Space Informatics, China University of Petroleum (East China), Qingdao 266580, China"}]}],"member":"1968","published-online":{"date-parts":[[2023,2,25]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"906","DOI":"10.1109\/LGRS.2017.2687519","article-title":"Discriminative Graph-Based Fusion of HSI and LiDAR Data for Urban Area Classification","volume":"14","author":"Gu","year":"2017","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"7758","DOI":"10.1109\/TGRS.2020.3034133","article-title":"Deep Multiview Learning for Hyperspectral Image Classification","volume":"59","author":"Liu","year":"2021","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1746","DOI":"10.1109\/LGRS.2019.2906839","article-title":"Efficient Probabilistic Collaborative Representation-Based Classifier for Hyperspectral Image Classification","volume":"16","author":"Xu","year":"2019","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"7152","DOI":"10.1109\/TGRS.2017.2743110","article-title":"Robust Joint Sparse Representation Based on Maximum Correntropy Criterion for Hyperspectral Image Classification","volume":"55","author":"Peng","year":"2017","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_5","first-page":"1","article-title":"Spatial Peak-Aware Collaborative Representation for Hyperspectral Imagery Classification","volume":"19","author":"Zhou","year":"2022","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"107967","DOI":"10.1016\/j.patcog.2021.107967","article-title":"Nonlocal graph theory based transductive learning for hyperspectral image classification","volume":"116","author":"Huang","year":"2021","journal-title":"Pattern Recognit."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"3637","DOI":"10.1109\/JSTARS.2019.2926130","article-title":"Hyperspectral Anomaly Detection via Convolutional Neural Network and Low Rank with Density-Based Clustering","volume":"12","author":"Song","year":"2019","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1109\/TGRS.2018.2849692","article-title":"GETNET: A General End-to-End 2-D CNN Framework for Hyperspectral Image Change Detection","volume":"57","author":"Wang","year":"2018","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"4920","DOI":"10.1109\/JSTARS.2019.2940278","article-title":"Hyperspectral Anomaly Detection by Fractional Fourier Entropy","volume":"12","author":"Tao","year":"2019","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"8503","DOI":"10.1109\/TGRS.2020.2988385","article-title":"Hyperspectral Anomaly Detection Using Dual Window Density","volume":"58","author":"Tu","year":"2020","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Fu, P., Sun, X., and Sun, Q.S. (2017). Hyperspectral Image Segmentation via Frequency-Based Similarity for Mixed Noise Estimation. Remote Sens., 9.","DOI":"10.3390\/rs9121237"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"1419","DOI":"10.1109\/TGRS.2015.2480863","article-title":"Uniformity-Based Superpixel Segmentation of Hyperspectral Images","volume":"54","author":"Saranathan","year":"2016","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"3861","DOI":"10.1109\/TGRS.2018.2815044","article-title":"Hybrid Unmixing Based on Adaptive Region Segmentation for Hyperspectral Imagery","volume":"56","author":"Zhang","year":"2018","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"5847","DOI":"10.1109\/TGRS.2020.2971716","article-title":"Adaptive MultiScale Segmentations for Hyperspectral Image Classification","volume":"58","author":"Leng","year":"2020","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"115745","DOI":"10.1016\/j.image.2019.115745","article-title":"Variational level set method for image segmentation with simplex constraint of landmarks","volume":"82","author":"Huang","year":"2020","journal-title":"Signal Process. Image Commun."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"20","DOI":"10.1002\/rse2.44","article-title":"UAV hyperspectral and lidar data and their fusion for arid and semi-arid land vegetation monitoring","volume":"4","author":"Sankey","year":"2018","journal-title":"Remote Sens. Ecol. Conserv."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"6","DOI":"10.1109\/MGRS.2018.2890023","article-title":"Multisource and Multitemporal Data Fusion in Remote Sensing A comprehensive review of the state of the art","volume":"7","author":"Ghamisi","year":"2019","journal-title":"IEEE Geosci. Remote Sens. Mag."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"2405","DOI":"10.1109\/JSTARS.2014.2305441","article-title":"Hyperspectral and LiDAR Data Fusion: Outcome of the 2013 GRSS Data Fusion Contest","volume":"7","author":"Debes","year":"2014","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"1416","DOI":"10.1109\/TGRS.2008.916480","article-title":"Fusion of hyperspectral and LIDAR remote sensing data for classification of complex forest areas","volume":"46","author":"Dalponte","year":"2008","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"2364","DOI":"10.3390\/rs3112364","article-title":"Fusion of High Resolution Aerial Multispectral and LiDAR Data: Land Cover in the Context of Urban Mosquito Habitat","volume":"3","author":"Hartfield","year":"2011","journal-title":"Remote Sens."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"2971","DOI":"10.1109\/JSTARS.2015.2432037","article-title":"Fusion of Hyperspectral and LiDAR Remote Sensing Data Using Multiple Feature Learning","volume":"8","author":"Khodadadzadeh","year":"2015","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"856","DOI":"10.1109\/JSTSP.2012.2208177","article-title":"Classification of Remote Sensing Optical and LiDAR Data Using Extended Attribute Profiles","volume":"6","author":"Pedergnana","year":"2012","journal-title":"IEEE J. Sel. Top. Signal Process."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"3997","DOI":"10.1109\/TGRS.2017.2686450","article-title":"Hyperspectral and LiDAR Fusion Using Extinction Profiles and Total Variation Component Analysis","volume":"55","author":"Rasti","year":"2017","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"1341","DOI":"10.1109\/JPROC.2018.2848209","article-title":"Extension of PCA to Higher Order Data Structures: An Introduction to Tensors, Tensor Decompositions, and Tensor PCA","volume":"106","author":"Zare","year":"2018","journal-title":"Proc. IEEE"},{"key":"ref_25","unstructured":"Zeng, Y., Zhang, J.X., and Niu, R.C. (2015, January 21\u201323). Research Status and Development Trend of Remote sensing in China using Bibliometric Analysis. Proceedings of the International Workshop on Image and Data Fusion (IWIDF), Kona, HI, USA."},{"key":"ref_26","unstructured":"Liao, W.Z., Bellens, R., Pizurica, A., Gautama, S., Philips, W., and IEEE (2014, January 13\u201318). Combining Feature Fusion and Decision Fusion for Classification of Hyperspectral and Lidar Data. Proceedings of the IEEE Joint International Geoscience and Remote Sensing Symposium (IGARSS) \/ 35th Canadian Symposium on Remote Sensing, Quebec City, QC, Canada."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"845","DOI":"10.1109\/JSTARS.2014.2359136","article-title":"Ensemble Multiple Kernel Active Learning For Classification of Multisource Remote Sensing Data","volume":"8","author":"Zhang","year":"2015","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"868","DOI":"10.3390\/rs9080868","article-title":"Optimal Decision Fusion for Urban Land-Use\/Land-Cover Classification Based on Adaptive Differential Evolution Using Hyperspectral and LiDAR Data","volume":"9","author":"Yanfei","year":"2017","journal-title":"Remote Sens."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"5384","DOI":"10.1109\/TGRS.2019.2899129","article-title":"Cascaded Recurrent Neural Networks for Hyperspectral Image Classification","volume":"57","author":"Hang","year":"2019","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"8","DOI":"10.1109\/MGRS.2017.2762307","article-title":"Deep Learning in Remote Sensing: A Comprehensive Review and List of Resources","volume":"5","author":"Zhu","year":"2018","journal-title":"IEEE Geosci. Remote Sens. Mag."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Morchhale, S., Pauca, V.P., Plemmons, R.J., Torgersen, T.C., and IEEE (2016, January 21\u201324). Classification of pixel-level fused hyperspectral and lidar data using deep convolutional neural networks. Proceedings of the 8th Workshop on Hyperspectral Image and Signal Processing\u2014Evolution in Remote Sensing (WHISPERS), Los Angeles, CA, USA.","DOI":"10.1109\/WHISPERS.2016.8071715"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"1253","DOI":"10.1109\/LGRS.2017.2704625","article-title":"Deep Fusion of Remote Sensing Data for Accurate Classification","volume":"14","author":"Chen","year":"2017","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"747","DOI":"10.1109\/TNNLS.2020.3028945","article-title":"A(3)CLNN: Spatial, Spectral and Multiscale Attention ConvLSTM Neural Network for Multisource Remote Sensing Data Classification","volume":"33","author":"Li","year":"2022","journal-title":"IEEE Trans. Neural Netw. Learn. Syst."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Li, H., Ghamisi, P., Rasti, B., Wu, Z.Y., Shapiro, A., Schultz, M., and Zipf, A. (2020). A Multi-Sensor Fusion Framework Based on Coupled Residual Convolutional Neural Networks. Remote Sens., 12.","DOI":"10.3390\/rs12122067"},{"key":"ref_35","first-page":"1","article-title":"Information Fusion for Classification of Hyperspectral and LiDAR Data Using IP-CNN","volume":"60","author":"Zhang","year":"2022","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Zagoruyko, S., Komodakis, N., and IEEE (2015, January 7\u201312). Learning to Compare Image Patches via Convolutional Neural Networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7299064"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"10270","DOI":"10.1109\/TPAMI.2021.3134200","article-title":"Non-Local Graph Neural Networks","volume":"44","author":"Liu","year":"2022","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"2011","DOI":"10.1109\/TPAMI.2019.2913372","article-title":"Squeeze-and-Excitation Networks","volume":"42","author":"Hu","year":"2020","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Woo, S.H., Park, J., Lee, J.Y., and Kweon, I.S. (2018, January 8\u201314). CBAM: Convolutional Block Attention Module. Proceedings of the 15th European Conference on Computer Vision (ECCV), Munich, Germany.","DOI":"10.1007\/978-3-030-01234-2_1"},{"key":"ref_40","unstructured":"Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, L., and Polosukhin, I. (2017, January 4\u20139). Attention Is All You Need. Proceedings of the 31st Annual Conference on Neural Information Processing Systems (NIPS), Long Beach, CA, USA."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Priem, F., and Canters, F. (2016). Synergistic Use of LiDAR and APEX Hyperspectral Data for High-Resolution Urban Land Cover Mapping. Remote Sens., 8.","DOI":"10.3390\/rs8100787"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"3791","DOI":"10.1109\/TGRS.2019.2957251","article-title":"Invariant Attribute Profiles: A Spatial-Frequency Joint Feature Extractor for Hyperspectral Image Classification","volume":"58","author":"Hong","year":"2020","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"6354","DOI":"10.1109\/TGRS.2017.2726901","article-title":"Fusion of Hyperspectral and LiDAR Data Using Sparse and Low-Rank Component Analysis","volume":"55","author":"Rasti","year":"2017","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1109\/LGRS.2022.3214929","article-title":"Deep EncoderDecoder Networks for Classification of Hyperspectral and LiDAR Data","volume":"19","author":"Hong","year":"2022","journal-title":"IEEE Geosci. Remote Sens. Lett."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/15\/5\/1283\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T18:42:43Z","timestamp":1760121763000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/15\/5\/1283"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,2,25]]},"references-count":44,"journal-issue":{"issue":"5","published-online":{"date-parts":[[2023,3]]}},"alternative-id":["rs15051283"],"URL":"https:\/\/doi.org\/10.3390\/rs15051283","relation":{},"ISSN":["2072-4292"],"issn-type":[{"type":"electronic","value":"2072-4292"}],"subject":[],"published":{"date-parts":[[2023,2,25]]}}}