{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,27]],"date-time":"2026-03-27T20:03:15Z","timestamp":1774641795105,"version":"3.50.1"},"reference-count":63,"publisher":"MDPI AG","issue":"17","license":[{"start":{"date-parts":[[2022,8,31]],"date-time":"2022-08-31T00:00:00Z","timestamp":1661904000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Toronto Metropolitan University","award":["RGPIN-2022-03822"],"award-info":[{"award-number":["RGPIN-2022-03822"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Accurate and up-to-date land cover classification information is essential for many applications, such as land-use change detection, global environmental change, and forest management, among others. Unoccupied aerial systems (UASs) provide the advantage of flexible and rapid data acquisition at low cost compared to conventional platforms, such as satellite and airborne systems. UASs are often equipped with high spatial resolution cameras and\/or light detection and ranging (LiDAR). However, the high spatial resolution imagery has a high information content, which makes land cover classification quite challenging. Recently, deep convolutional neural networks (DCNNs) have been effectively applied to remote sensing applications, which overcome the drawback of traditional techniques. In this research, a low-cost UAV-based multi-sensor data fusion model was developed for land cover classification based on a DCNN. For the purpose of this research, two datasets were collected at two different urban locations using two different UASs. A DCNN model, based on U-net with Resnet101 as a backbone, was used to train and test the fused image\/LiDAR data. The maximum likelihood and support vector machine techniques were used as a reference for classifier comparison. It was shown that the proposed DCNN approach improved the overall accuracy of land cover classification for the first dataset by 15% compared to the reference classifiers. In addition, the overall accuracy of land cover classification improved by 7%, and the precision, recall, and F-measure improved by 18% when the fused image\/LiDAR data were used compared to the images only. The trained DCNN model was also tested on the second dataset, and the obtained results were largely similar to those of the first dataset.<\/jats:p>","DOI":"10.3390\/rs14174298","type":"journal-article","created":{"date-parts":[[2022,9,1]],"date-time":"2022-09-01T03:55:38Z","timestamp":1662004538000},"page":"4298","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":43,"title":["UAV-Based Multi-Sensor Data Fusion for Urban Land Cover Mapping Using a Deep Convolutional Neural Network"],"prefix":"10.3390","volume":"14","author":[{"given":"Ahmed","family":"Elamin","sequence":"first","affiliation":[{"name":"Department of Civil Engineering, Faculty of Engineering and Architectural Science, Toronto Metropolitan University, Toronto, ON M5B 2K3, Canada"},{"name":"Department of Civil Engineering, Faculty of Engineering, Zagazig University, Zagazig 44519, Egypt"}]},{"given":"Ahmed","family":"El-Rabbany","sequence":"additional","affiliation":[{"name":"Department of Civil Engineering, Faculty of Engineering and Architectural Science, Toronto Metropolitan University, Toronto, ON M5B 2K3, Canada"}]}],"member":"1968","published-online":{"date-parts":[[2022,8,31]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.isprsjprs.2015.01.001","article-title":"Global land cover mapping using Earth observation satellite data: Recent progresses and challenges","volume":"103","author":"Yifang","year":"2015","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1674","DOI":"10.1126\/science.1118160","article-title":"The Importance of Land-Cover Change in Simulating Future Climates","volume":"310","author":"Feddema","year":"2005","journal-title":"Science"},{"key":"ref_3","unstructured":"Raid Al-Tahir, M.A. (2012, January 17). Unmanned Aerial Mapping Solution for Small Island Developing States. Proceedings of the global geospatial conference, Quebec City, QC, Canada."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Kalantar, B., Halin, A.A., Al-Najjar HA, H., Mansor, S., van Genderen, J.L., Shafri HZ, M., and Zand, M. (2019). A Framework for Multiple Moving Objects Detection in Aerial Videos, in Spatial Modeling in GIS and R for Earth and Environmental Sciences, Elsevier.","DOI":"10.1016\/B978-0-12-815226-3.00026-0"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Yao, H., Qin, R., and Chen, X.J.R.S. (2019). Unmanned aerial vehicle for remote sensing applications\u2014A review. Remote Sens., 11.","DOI":"10.3390\/rs11121443"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"2427","DOI":"10.1080\/01431161.2016.1252477","article-title":"Forestry applications of UAVs in Europe: A review","volume":"38","author":"Torresan","year":"2017","journal-title":"Int. J. Remote Sens."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Lv, Z., Shi, W., Benediktsson, J.A., and Ning, X. (2016). Novel object-based filter for improving land-cover classification of aerial imagery with very high spatial resolution. Remote Sens., 8.","DOI":"10.3390\/rs8121023"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Natesan, S., Armenakis, C., Benari, G., and Lee, R. (2018). Use of UAV-Borne Spectrometer for Land Cover Classification. Drones, 2.","DOI":"10.3390\/drones2020016"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"186257","DOI":"10.1109\/ACCESS.2020.3030112","article-title":"U-Net convolutional networks for mining land cover classification based on high-resolution UAV imagery","volume":"8","author":"Giang","year":"2020","journal-title":"IEEE Access"},{"key":"ref_10","first-page":"115011F","article-title":"Land cover classification based on machine learning using UAV multi-spectral images","volume":"11501","author":"Pan","year":"2020","journal-title":"SPIE"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Park, G., Park, K., Song, B., and Lee, H. (2022). Analyzing Impact of Types of UAV-Derived Images on the Object-Based Classification of Land Cover in an Urban Area. Drones, 6.","DOI":"10.3390\/drones6030071"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"161","DOI":"10.1016\/j.isprsjprs.2015.01.015","article-title":"A generic framework for image rectification using multiple types of feature","volume":"102","author":"Long","year":"2015","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Megahed, Y., Shaker, A., and Sensing, W.Y.-R. (2021). Fusion of Airborne LiDAR Point Clouds and Aerial Images for Heterogeneous Land-Use Urban Mapping. Remote Sens., 13.","DOI":"10.3390\/rs13040814"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"63","DOI":"10.1016\/j.isprsjprs.2013.05.002","article-title":"Analysis of full-waveform LiDAR data for classification of an orange orchard scene","volume":"82","author":"Fieber","year":"2013","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_15","first-page":"81","article-title":"Combining airborne laser scanning data and optical satellite data for classification of alpine vegetation","volume":"27","author":"Reese","year":"2013","journal-title":"Int. J. Appl. Earth Obs. Geoinfor. ITC J."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"2486","DOI":"10.1016\/j.rse.2011.05.009","article-title":"Fusion of airborne LiDAR and satellite multispectral data for the estimation of timber volume in the Southern Alps","volume":"115","author":"Tonolli","year":"2011","journal-title":"Remote Sens. Environ."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"258","DOI":"10.1016\/j.rse.2012.03.013","article-title":"Tree species classification in the Southern Alps based on the fusion of very high geometrical resolution multispectral\/hyperspectral images and LiDAR data","volume":"123","author":"Dalponte","year":"2012","journal-title":"Remote Sens. Environ."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"4511","DOI":"10.1080\/01431161.2013.776721","article-title":"Fusion of full-waveform lidar and imaging spectroscopy remote sensing data for the characterization of forest stands","volume":"34","author":"Buddenbaum","year":"2013","journal-title":"Int. J. Remote Sens."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"274","DOI":"10.1016\/j.rse.2007.05.005","article-title":"Mapping surface fuel models using lidar and multispectral data fusion for fire behavior","volume":"112","author":"Mutlu","year":"2008","journal-title":"Remote Sens. Environ."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"11","DOI":"10.1016\/j.rse.2007.03.011","article-title":"Integrating LIDAR data and multispectral imagery for enhanced classification of rangeland vegetation: A meta analysis","volume":"111","author":"Bork","year":"2007","journal-title":"Remote Sens. Environ."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"36","DOI":"10.1016\/j.compag.2012.02.020","article-title":"Combining LiDAR intensity with aerial camera data to discriminate agricultural land uses","volume":"84","author":"Porras","year":"2012","journal-title":"Comput. Electron. Agric."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"1145","DOI":"10.1016\/j.rse.2010.12.017","article-title":"Per-pixel vs. object-based classification of urban land cover extraction using high spatial resolution imagery","volume":"115","author":"Myint","year":"2011","journal-title":"Remote Sens. Environ."},{"key":"ref_23","first-page":"555","article-title":"Object-oriented image processing in an integrated GIS\/remote sensing environment and perspectives for environmental applications","volume":"2","author":"Blaschke","year":"2000","journal-title":"Environ. Inf. Plan. Politics Public"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Zhang, P., Ke, Y., Zhang, Z., Wang, M., Li, P., and Zhang, S. (2018). Urban land use and land cover classification using novel deep learning models based on high spatial resolution satellite imagery. Sensors, 18.","DOI":"10.3390\/s18113717"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"1141","DOI":"10.1016\/j.rse.2010.01.002","article-title":"Synergistic use of QuickBird multispectral imagery and LIDAR data for object-based forest species classification","volume":"114","author":"Ke","year":"2010","journal-title":"Remote Sens. Environ."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"16917","DOI":"10.3390\/rs71215861","article-title":"Object-Based Urban Tree Species Classification Using Bi-Temporal WorldView-2 and WorldView-3 Images","volume":"7","author":"Li","year":"2015","journal-title":"Remote Sens."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"259","DOI":"10.1016\/j.rse.2011.11.020","article-title":"A comparison of pixel-based and object-based image analysis with selected machine learning algorithms for the classification of agricultural landscapes using SPOT-5 HRG imagery","volume":"118","author":"Duro","year":"2012","journal-title":"Remote Sens. Environ."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"73","DOI":"10.1016\/j.rse.2018.04.050","article-title":"Urban land-use mapping using a deep convolutional neural network with high spatial resolution multispectral remote sensing imagery","volume":"214","author":"Huang","year":"2018","journal-title":"Remote Sens. Environ."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Audebert, N., Le Saux, B., and Lef\u00e8vre, S. (2016, January 20\u201324). Semantic segmentation of earth observation data using multimodal and multi-scale deep networks. Proceedings of the Asian Conference on Computer Vision, Taipei, Taiwan.","DOI":"10.1007\/978-3-319-54181-5_12"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"60","DOI":"10.1016\/j.isprsjprs.2018.04.014","article-title":"Algorithms for semantic segmentation of multispectral remote sensing imagery using deep learning","volume":"145","author":"Kemker","year":"2018","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"1924","DOI":"10.1109\/JSTARS.2014.2361756","article-title":"Semantic segmentation of remote sensing imagery using object-based Markov random field model with regional penalties","volume":"8","author":"Zheng","year":"2014","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Pinheiro, P.O., Lin, T.Y., Collobert, R., and Doll\u00e1r, P. (2016). Learning to refine object segments. European Conference on Computer Vision, Springer.","DOI":"10.1007\/978-3-319-46448-0_5"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Lin, G., Milan, A., Shen, C., and Reid, I. (2017, January 21\u201326). Refinenet: Multi-path refinement networks for high-resolution semantic segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.549"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Ronneberger, O., Fischer, P., and Brox, T. (2015). U-net: Convolutional networks for biomedical image segmentation. International Conference on Medical Image Computing and Computer-Assisted Intervention, Springer.","DOI":"10.1007\/978-3-319-24574-4_28"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Jakovljevic, G., Govedarica, M., and Alvarez-Taboada, F. (2020). A Deep Learning Model for Automatic Plastic Mapping Using Unmanned Aerial Vehicle (UAV) Data. Remote Sens., 12.","DOI":"10.3390\/rs12091515"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"94","DOI":"10.1016\/j.isprsjprs.2020.01.013","article-title":"ResUNet-a: A deep learning framework for semantic segmentation of remotely sensed data","volume":"162","author":"Diakogiannis","year":"2020","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_37","first-page":"359","article-title":"Land Use Land Cover Classification from Satellite Imagery using mUnet: A Modified Unet Architecture","volume":"4","author":"Garg","year":"2019","journal-title":"VISIGRAPP"},{"key":"ref_38","unstructured":"Hawkins, S. (2016, January 17\u201321). Using a drone and photogrammetry software to create orthomosaic images and 3D models of aircraft accident sites. Proceedings of the ISASI 2016 Seminar, Reykjavik, Iceland."},{"key":"ref_39","unstructured":"Mapper, P.D. (2020, October 07). 2020. Available online: https:\/\/cloud.pix4d.com\/."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1023\/B:VISI.0000029664.99615.94","article-title":"Distinctive Image Features from Scale-Invariant Keypoints","volume":"60","author":"Lowe","year":"2004","journal-title":"Int. J. Comput. Vis."},{"key":"ref_41","unstructured":"K\u00fcng, O., Strecha, C., Beyeler, A., Zufferey, J.-C., Floreano, D., Fua, P., and Gervaix, F. (2011, January 14\u201316). The Accuracy of Automatic Photogrammetric Techniques on Ultra-Light UAV Imagery. Proceedings of the IAPRS, International Conference on Unmanned Aerial Vehicle in Geomatics (UAV-g), Zurich, Switzerland."},{"key":"ref_42","unstructured":"Kitware (2020, March 01). Optimized LOAM SLAM. Available online: https:\/\/gitlab.kitware.com\/keu-computervision\/slam."},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Zhang, J., and Singh, S. (2014). LOAM: Lidar Odometry and Mapping in Real-time. Robotics: Science and Systems, MIT Press.","DOI":"10.15607\/RSS.2014.X.007"},{"key":"ref_44","unstructured":"Rusinkiewicz, S., and Levoy, M. (June, January 28). Efficient variants of the ICP algorithm. Proceedings of the Third International Conference on 3-D Digital Imaging and Modeling, Quebec City, QC, Canada. IEEE."},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Randazzo, G., Cascio, M., Fontana, M., Gregorio, F., Lanza, S., and Muzirafuti, A. (2021). Mapping of Sicilian pocket beaches land use\/land cover with sentinel-2 imagery: A case study of messina Province. Land, 10.","DOI":"10.3390\/land10070678"},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Li, Y., Bai, J., Zhang, L., and Yang, Z. (2022). Mapping and Spatial Variation of Seagrasses in Xincun, Hainan Province, China, Based on Satellite Images. Remote Sens., 14.","DOI":"10.3390\/rs14102373"},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"981","DOI":"10.1109\/36.406684","article-title":"A detailed comparison of backpropagation neural network and maximum-likelihood classifiers for urban land use classification","volume":"33","author":"Paola","year":"1995","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Vapnik, V. (1998). The support vector method of function estimation. Nonlinear Modeling, Springer.","DOI":"10.7551\/mitpress\/1130.003.0006"},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"247","DOI":"10.1016\/j.isprsjprs.2010.11.001","article-title":"Support vector machines in remote sensing: A review","volume":"66","author":"Mountrakis","year":"2011","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27\u201330). Deep residual learning for image recognition. Proceedings of the IEEE conference on computer vision and pattern recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_51","unstructured":"Yakubovskiy, P. (2022, January 17). Segmentation Models. Available online: https:\/\/github.com\/qubvel\/segmentation_models."},{"key":"ref_52","doi-asserted-by":"crossref","unstructured":"Milletari, F., Navab, N., and Ahmadi, S.-A. (2016, January 25\u201328). V-net: Fully convolutional neural networks for volumetric medical image segmentation. Proceedings of the 2016 Fourth International Conference on 3D Vision (3DV), Stanford, CA, USA.","DOI":"10.1109\/3DV.2016.79"},{"key":"ref_53","unstructured":"Reddi, S.J., Kale, S., and Kumar, S. (2019). On the convergence of adam and beyond. arXiv."},{"key":"ref_54","unstructured":"Kingma, D.P., and Ba, J. (2014). Adam: A method for stochastic optimization. arXiv."},{"key":"ref_55","unstructured":"TensorFlow (2021, January 17). TensorFlow. Available online: https:\/\/www.tensorflow.org\/."},{"key":"ref_56","unstructured":"Chollet, F.K. (2015). Keras: Deep Learning for Humans, GitHub. Available online: https:\/\/github.com\/keras-team\/keras."},{"key":"ref_57","unstructured":"Sony (2021, September 19). Sony ILCE-7RM2. Available online: https:\/\/electronics.sony.com\/imaging\/interchangeable-lens-cameras\/full-frame\/p\/ilce7rm2-b."},{"key":"ref_58","unstructured":"RedEdge-M (2022, January 20). MicaSense. Available online: https:\/\/support.micasense.com\/hc\/en-us\/articles\/360001485134-Getting-Started-With-RedEdge-M-Legacy-."},{"key":"ref_59","unstructured":"Velodyne (2021, September 19). VLP-16 User Manual. Available online: https:\/\/velodynelidar.com\/wp-content\/uploads\/2019\/12\/63-9243-Rev-E-VLP-16-User-Manual.pdf."},{"key":"ref_60","unstructured":"(2021, June 20). DJI Zenmuse L1. Available online: www.dji.com\/cz\/zenmuse-l1\/specs."},{"key":"ref_61","unstructured":"(2022, February 01). Labelme. Available online: https:\/\/github.com\/wkentaro\/labelme."},{"key":"ref_62","doi-asserted-by":"crossref","first-page":"71","DOI":"10.1007\/s12524-019-01056-9","article-title":"Comparing support vector machines and maximum likelihood classifiers for mapping of urbanization","volume":"48","author":"Rimal","year":"2020","journal-title":"J. Indian Soc. Remote Sens."},{"key":"ref_63","doi-asserted-by":"crossref","unstructured":"Ghayour, L., Neshat, A., Paryani, S., Shahabi, H., Shirzadi, A., Chen, W., Al-Ansari, N., Geertsema, M., Amiri, M.P., and Gholamnia, M. (2021). Performance evaluation of sentinel-2 and landsat 8 OLI data for land cover\/use classification using a comparison between machine learning algorithms. Remote Sens., 13.","DOI":"10.3390\/rs13071349"}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/14\/17\/4298\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T00:21:16Z","timestamp":1760142076000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/14\/17\/4298"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,8,31]]},"references-count":63,"journal-issue":{"issue":"17","published-online":{"date-parts":[[2022,9]]}},"alternative-id":["rs14174298"],"URL":"https:\/\/doi.org\/10.3390\/rs14174298","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,8,31]]}}}