{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,24]],"date-time":"2026-03-24T19:20:00Z","timestamp":1774380000622,"version":"3.50.1"},"reference-count":39,"publisher":"MDPI AG","issue":"11","license":[{"start":{"date-parts":[[2024,6,3]],"date-time":"2024-06-03T00:00:00Z","timestamp":1717372800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Building land-use type classification using earth observation data is essential for urban planning and emergency management. Municipalities usually do not hold a detailed record of building land-use types in their jurisdictions, and there is a significant need for a detailed classification of this data. Earth observation data can be beneficial in this regard, because of their availability and requiring a reduced amount of fieldwork. In this work, we imported Google Street View (GSV), light detection and ranging-derived (LiDAR-derived) features, and orthophoto images to deep learning (DL) models. The DL models were trained on building land-use type data for the Greater Toronto Area (GTA). The data was created using building land-use type labels from OpenStreetMap (OSM) and web scraping. Then, we classified buildings into apartment, house, industrial, institutional, mixed residential\/commercial, office building, retail, and other. Three DL-derived classification maps from GSV, LiDAR, and orthophoto images were combined at the decision level using the proposed ranking classes based on the F1 score method. For comparison, the classifiers were combined using fuzzy fusion as well. The results of two independent case studies, Vancouver and Fort Worth, showed that the proposed fusion method could achieve an overall accuracy of 75%, up to 8% higher than the previous study using CNNs and the same ground truth data. Also, the results showed that while mixed residential\/commercial buildings were correctly detected using GSV images, the DL models confused many houses in the GTA with mixed residential\/commercial because of their similar appearance in GSV images.<\/jats:p>","DOI":"10.3390\/rs16112011","type":"journal-article","created":{"date-parts":[[2024,6,3]],"date-time":"2024-06-03T08:19:42Z","timestamp":1717402782000},"page":"2011","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":9,"title":["Fusion of Google Street View, LiDAR, and Orthophoto Classifications Using Ranking Classes Based on F1 Score for Building Land-Use Type Detection"],"prefix":"10.3390","volume":"16","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-8907-9784","authenticated-orcid":false,"given":"Nafiseh","family":"Ghasemian Sorboni","sequence":"first","affiliation":[{"name":"Department of Geography and Environment, University of Western Ontario, London, ON N6A 3K7, Canada"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8404-0530","authenticated-orcid":false,"given":"Jinfei","family":"Wang","sequence":"additional","affiliation":[{"name":"Department of Geography and Environment, University of Western Ontario, London, ON N6A 3K7, Canada"},{"name":"Institute for Earth and Space Exploration, University of Western Ontario, London, ON N6A 3K7, Canada"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1652-3135","authenticated-orcid":false,"given":"Mohammad Reza","family":"Najafi","sequence":"additional","affiliation":[{"name":"Department of Civil and Environmental Engineering, University of Western Ontario, London, ON N6A 3K7, Canada"}]}],"member":"1968","published-online":{"date-parts":[[2024,6,3]]},"reference":[{"key":"ref_1","unstructured":"Al-Habashna, A. (2022). Building Type Classification from Street-View Imagery Using Convolutional Neural Networks, Statistics Canada. Available online: https:\/\/www150.statcan.gc.ca\/n1\/en\/pub\/18-001-x\/18-001-x2021003-eng.pdf?st=A02HTs8U."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1347","DOI":"10.3390\/rs6021347","article-title":"Ontology-based classification of building types detected from airborne laser scanning data","volume":"6","author":"Belgiu","year":"2014","journal-title":"Remote Sens."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"134","DOI":"10.1016\/j.landurbplan.2014.07.005","article-title":"Building type classification using spatial and landscape attributes derived from LiDAR remote sensing data","volume":"130","author":"Lu","year":"2014","journal-title":"Landsc. Urban Plan."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1901","DOI":"10.1109\/JSTARS.2015.2465131","article-title":"Building types\u2019 classification using shape-based features and linear discriminant functions","volume":"9","author":"Wurm","year":"2015","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"35","DOI":"10.14358\/PERS.78.1.35","article-title":"Detect residential buildings from lidar and aerial photographs through object-oriented land-use classification","volume":"78","author":"Meng","year":"2012","journal-title":"Photogramm. Eng. Remote Sens."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"165","DOI":"10.1007\/978-3-319-65633-5_8","article-title":"Machine learning applications for earth observation","volume":"165","author":"Lary","year":"2018","journal-title":"Earth Obs. Open Sci. Innov."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Camps-Valls, G. (2009, January 1\u20134). Machine learning in remote sensing data processing. Proceedings of the 2009 IEEE International Workshop on Machine LEARNING for Signal Processing, Grenoble, France.","DOI":"10.1109\/MLSP.2009.5306233"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Yan, L., Zhang, J., Huang, G., and Zhao, Z. (2011, January 9\u201311). Building Footprints Extraction from PolSAR Image Using Multi-Features and Edge Information. Proceedings of the 2011 International Symposium on Image and Data Fusion, Tengchong, China.","DOI":"10.1109\/ISIDF.2011.6024275"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"209517","DOI":"10.1109\/ACCESS.2020.3038225","article-title":"Building footprint extraction from high resolution aerial images using generative adversarial network (GAN) architecture","volume":"8","author":"Abdollahi","year":"2020","journal-title":"IEEE Access"},{"key":"ref_10","first-page":"102768","article-title":"Multi-scale attention integrated hierarchical networks for high-resolution building footprint extraction","volume":"109","author":"Liu","year":"2022","journal-title":"Int. J. Appl. Earth Obs. Geoinf."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"1501","DOI":"10.1080\/10106049.2020.1778100","article-title":"Automatic building footprint extraction from very high-resolution imagery using deep learning techniques","volume":"37","author":"Rastogi","year":"2022","journal-title":"Geocarto Int."},{"key":"ref_12","first-page":"103556","article-title":"SuperpixelGraph: Semi-automatic generation of building footprint through semantic-sensitive superpixel and neural graph networks","volume":"125","author":"Yu","year":"2023","journal-title":"Int. J. Appl. Earth Obs. Geoinf."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"3515","DOI":"10.1109\/JSTARS.2017.2686422","article-title":"Classification of urban building type from high spatial resolution remote sensing imagery using extended MRS and soft BP network","volume":"10","author":"Xie","year":"2017","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Huang, X., Ren, L., Liu, C., Wang, Y., Yu, H., Schmitt, M., H\u00e4nsch, R., Sun, X., Huang, H., and Mayer, H. (2022, January 18\u201324). Urban building classification (ubc)-a dataset for individual building detection and classification from satellite imagery. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR) Workshops, New Orleans, LA, USA.","DOI":"10.1109\/CVPRW56347.2022.00147"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Wang, Q., Zhou, C., and Xu, N. (2017, January 25\u201326). Street view image classification based on convolutional neural network. Proceedings of the 2017 IEEE 2nd Advanced Information Technology, Electronic and Automation Control Conference (IAEAC), Chongqing, China.","DOI":"10.1109\/IAEAC.2017.8054251"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"215","DOI":"10.1016\/j.compenvurbsys.2017.03.001","article-title":"Parcel-based urban land use classification in megacity using airborne LiDAR, high resolution orthoimagery, and Google Street View","volume":"64","author":"Zhang","year":"2017","journal-title":"Comput. Environ. Urban Syst."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"44","DOI":"10.1016\/j.isprsjprs.2018.02.006","article-title":"Building instance classification using street view images","volume":"145","author":"Kang","year":"2018","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"177","DOI":"10.5194\/isprs-annals-IV-2-177-2018","article-title":"Neural networks for the classification of building use from street-view imagery","volume":"4","author":"Laupheimer","year":"2018","journal-title":"ISPRS Ann. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_19","first-page":"103591","article-title":"Mixed land use measurement and mapping with street view images and spatial context-aware prompts via zero-shot multimodal learning","volume":"125","author":"Wu","year":"2023","journal-title":"Int. J. Appl. Earth Obs. Geoinf."},{"key":"ref_20","first-page":"102678","article-title":"Automatic generation of land use maps using aerial orthoimages and building floor data with a Conv-Depth Block (CDB) ResU-Net architecture","volume":"107","author":"Yoo","year":"2022","journal-title":"Int. J. Appl. Earth Obs. Geoinf."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Hoffmann, E.J., Wang, Y., Werner, M., Kang, J., and Zhu, X.X. (2019). Model fusion for building type classification from aerial and street view images. Remote Sens., 11.","DOI":"10.3390\/rs11111259"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Cao, R., Zhu, J., Tu, W., Li, Q., Cao, J., Liu, B., Zhang, Q., and Qiu, G. (2018). Integrating aerial and street view images for urban land use classification. Remote Sens., 10.","DOI":"10.3390\/rs10101553"},{"key":"ref_23","unstructured":"Government of Canada (2024, February 01). Census Profile, 2021 Census of Population. Profile Table, Available online: https:\/\/www12.statcan.gc.ca\/census-recensement\/2021\/dp-pd\/prof\/details\/page.cfm?Lang=E&DGUIDlist=2021A00053519038&GENDERlist=1&STATISTIClist=1&HEADERlist=0."},{"key":"ref_24","unstructured":"Vaughan Economic Development (2024, February 14). 2021 Census Insights and Findings\u2014Population and Dwellings. Available online: https:\/\/vaughanbusiness.ca\/insights\/2021-census-insights-and-findings-population-and-dwellings\/."},{"key":"ref_25","unstructured":"Government of Canada (2024, February 14). Focus on Geography Series, 2016 Census, Available online: https:\/\/www12.statcan.gc.ca\/census-recensement\/2016\/as-sa\/fogs-spg\/Facts-cd-eng.cfm?LANG=Eng&GK=CD&GC=3521&TOPIC=1."},{"key":"ref_26","unstructured":"Government of Canada (2024, May 30). Population and Dwelling Counts: Canada and Population Centres, Available online: https:\/\/www12.statcan.gc.ca\/census-recensement\/2016\/as-sa\/fogs-spg\/Facts-csd-eng.cfm?LANG=Eng&GK=CSD&GC=3520005&TOPIC=1."},{"key":"ref_27","unstructured":"City of Fort Worth (2024, February 28). Chapter 1 Population Trends, Available online: https:\/\/www.fortworthtexas.gov\/files\/assets\/public\/v\/1\/the-fwlab\/documents\/comprehensive-planning\/pdf-adopted\/01_populationtrends.pdf."},{"key":"ref_28","unstructured":"United States Census Bureau (2024, February 28). QuickFacts, Fort Worth City, Texas; Texas, Available online: https:\/\/www.census.gov\/quickfacts\/fact\/table\/fortworthcitytexas."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Deng, J., Dong, W., Socher, R., Li, L.J., Li, K., and Li, F.F. (2009, January 20\u201325). Imagenet: A large-scale hierarchical image database. Proceedings of the 2009 IEEE Conference on Computer Vision and Pattern Recognition, Miami, FL, USA.","DOI":"10.1109\/CVPR.2009.5206848"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Chen, C., and Fan, L. (2021, January 27\u201329). Scene segmentation of remotely sensed images with data augmentation using U-net++. Proceedings of the 2021 International Conference on Computer Engineering and Artificial Intelligence (ICCEAI), Shanghai, China.","DOI":"10.1109\/ICCEAI52939.2021.00039"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"115659","DOI":"10.1016\/j.eswa.2021.115659","article-title":"Automated classification of remote sensing images using multileveled MobileNetV2 and DWT techniques","volume":"185","author":"Karadal","year":"2021","journal-title":"Expert Syst. Appl."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"e3988","DOI":"10.1002\/ett.3988","article-title":"Multilabel classification of remote sensed satellite imagery","volume":"32","author":"Kumar","year":"2021","journal-title":"Trans. Emerg. Telecommun. Technol."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"4738","DOI":"10.1109\/JSTARS.2020.3017676","article-title":"An improved InceptionV3 network for obscured ship classification in remote sensing images","volume":"13","author":"Liu","year":"2020","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Sandler, M., Howard, A., Zhu, M., Zhmoginov, A., and Chen, L.-C. (2018, January 18\u201323). Mobilenetv2: Inverted residuals and linear bottlenecks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00474"},{"key":"ref_35","unstructured":"Simonyan, K., and Zisserman, A. (2014). Very deep convolutional networks for large-scale image recognition. arXiv."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27\u201330). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., and Wojna, Z. (2016, January 27\u201330). Rethinking the inception architecture for computer vision. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.308"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"84","DOI":"10.1145\/3065386","article-title":"ImageNet classification with deep convolutional neural networks","volume":"60","author":"Krizhevsky","year":"2017","journal-title":"Commun. ACM"},{"key":"ref_39","unstructured":"Zeiler, M.D., and Fergus, R. (2014). Computer Vision\u2013ECCV 2014: Proceedings of the 13th European Conference on Computer Vision (ECCV), Zurich, Switzerland, 6\u201312 September 2014, Springer. Proceedings, Part I 13."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/16\/11\/2011\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T14:53:00Z","timestamp":1760107980000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/16\/11\/2011"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,6,3]]},"references-count":39,"journal-issue":{"issue":"11","published-online":{"date-parts":[[2024,6]]}},"alternative-id":["rs16112011"],"URL":"https:\/\/doi.org\/10.3390\/rs16112011","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,6,3]]}}}