{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,31]],"date-time":"2025-10-31T06:59:02Z","timestamp":1761893942482,"version":"build-2065373602"},"reference-count":38,"publisher":"MDPI AG","issue":"11","license":[{"start":{"date-parts":[[2025,10,29]],"date-time":"2025-10-29T00:00:00Z","timestamp":1761696000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"the National Natural Science Foundation of China","doi-asserted-by":"crossref","award":["grant No. 42371420"],"award-info":[{"award-number":["grant No. 42371420"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["IJGI"],"abstract":"<jats:p>Building function identification plays a crucial role in providing basic data for urban planning, management, and various intelligent applications. Today, building function identification methods using Street View Images (SVIs) have made significant progress. However, these methods use the visual features of SVIs to infer building functions, which ignores the contributions of the multiple potential semantics of SVIs, resulting in suboptimal identification accuracy. To address this issue, this study proposes a multi-semantic semi-supervised building function identification (MS-SS-BFI) method, which integrates multi-level visual semantics and spatial contextual semantics to improve building function identification from SVIs. Specifically, a location mapping module was designed to align SVIs with buildings. Additionally, a multi-level visual semantic extraction module was developed to integrate the visual semantics and visual-textual semantics of SVIs. In addition, a semi-supervised spatial interaction module was designed to characterize the spatial context of buildings. Extensive experiments on the Brooklyn dataset show that the proposed method achieves 7.98% improvement in F1-score over the state-of-the-art baseline, demonstrating superior performance and robustness. This work explores a novel approach to building function identification and provides a methodological reference for various SVI-based applications.<\/jats:p>","DOI":"10.3390\/ijgi14110423","type":"journal-article","created":{"date-parts":[[2025,10,30]],"date-time":"2025-10-30T00:50:19Z","timestamp":1761785419000},"page":"423","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Integrating Multiple Semantics of Street View Imagery for Semi-Supervised Building Function Identification"],"prefix":"10.3390","volume":"14","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-8969-8879","authenticated-orcid":false,"given":"Fang","family":"Fang","sequence":"first","affiliation":[{"name":"School of Computer Science, China University of Geosciences, Wuhan 430074, China"},{"name":"Engineering Research Center of Natural Resource Information Management and Digital Twin Engineering Software, Ministry of Education, Wuhan 430074, China"}]},{"ORCID":"https:\/\/orcid.org\/0009-0002-2217-5584","authenticated-orcid":false,"given":"Nan","family":"Min","sequence":"additional","affiliation":[{"name":"School of Computer Science, China University of Geosciences, Wuhan 430074, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1829-4006","authenticated-orcid":false,"given":"Shengwen","family":"Li","sequence":"additional","affiliation":[{"name":"School of Computer Science, China University of Geosciences, Wuhan 430074, China"},{"name":"Engineering Research Center of Natural Resource Information Management and Digital Twin Engineering Software, Ministry of Education, Wuhan 430074, China"}]},{"ORCID":"https:\/\/orcid.org\/0009-0009-5986-0172","authenticated-orcid":false,"given":"Yuxiang","family":"Zhao","sequence":"additional","affiliation":[{"name":"School of Computer Science, China University of Geosciences, Wuhan 430074, China"}]},{"ORCID":"https:\/\/orcid.org\/0009-0005-9404-426X","authenticated-orcid":false,"given":"Sishi","family":"Gong","sequence":"additional","affiliation":[{"name":"School of Computer Science, China University of Geosciences, Wuhan 430074, China"}]},{"ORCID":"https:\/\/orcid.org\/0009-0009-6141-9466","authenticated-orcid":false,"given":"Yu","family":"Wang","sequence":"additional","affiliation":[{"name":"School of Computer Science, China University of Geosciences, Wuhan 430074, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2697-3383","authenticated-orcid":false,"given":"Shunping","family":"Zhou","sequence":"additional","affiliation":[{"name":"School of Computer Science, China University of Geosciences, Wuhan 430074, China"},{"name":"Engineering Research Center of Natural Resource Information Management and Digital Twin Engineering Software, Ministry of Education, Wuhan 430074, China"}]}],"member":"1968","published-online":{"date-parts":[[2025,10,29]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"31","DOI":"10.1111\/j.1467-9671.2008.01085.x","article-title":"An Approach for the Classification of Urban Building Structures Based on Discriminant Analysis Techniques","volume":"12","author":"Steiniger","year":"2008","journal-title":"Trans. GIS"},{"key":"ref_2","first-page":"209","article-title":"Classification of Building Function Using Available Sources of VGI","volume":"IV-4","author":"Fonte","year":"2018","journal-title":"ISPRS Ann. Photogramm. Remote Sens. Spatial Inf. Sci."},{"key":"ref_3","unstructured":"Smith, D., and Crooks, A. (2010). From Buildings to Cities: Techniques for the Multi-Scale Analysis of Urban Form and Function, Centre for Advanced Spatial Analysis (UCL). Unpublished work."},{"key":"ref_4","first-page":"1309","article-title":"Efficient Building Category Classification with Fa\u00e7ade Information from Oblique Aerial Images","volume":"V-2-2020","author":"Xiao","year":"2020","journal-title":"ISPRS Ann. Photogramm. Remote Sens. Spatial Inf. Sci."},{"key":"ref_5","first-page":"18","article-title":"A Feasibility Study of Occupancy Measurement Using Environmental Sensors for Building Energy Management","volume":"149","author":"Kang","year":"2015","journal-title":"Appl. Energy"},{"key":"ref_6","first-page":"104","article-title":"Building Function Classification from High-Spatial Resolution Imagery and Geographic Data Using Deep Learning","volume":"149","author":"Zhong","year":"2019","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_7","first-page":"578","article-title":"Robust Building Identification from Street Views Using Deep Convolutional Neural Networks","volume":"13","author":"Sarmadi","year":"2023","journal-title":"Buildings"},{"key":"ref_8","unstructured":"Zhao, K., Liu, Y., Hao, S., Lu, S., Liu, H., and Zhou, L. (2020, January 13\u201319). Bounding Boxes Are All We Need: Street View Image Classification via Context Encoding of Detected Buildings. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Seattle, WA, USA."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"44","DOI":"10.1016\/j.isprsjprs.2018.02.006","article-title":"Building Instance Classification Using Street View Images","volume":"145","author":"Kang","year":"2018","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"2520","DOI":"10.1002\/eqe.3805","article-title":"Instance Segmentation of Soft-Story Buildings from Street-View Images with Semiautomatic Annotation","volume":"52","author":"Wang","year":"2023","journal-title":"Earthq. Eng. Struct. Dyn."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"1949","DOI":"10.1007\/s11760-023-02882-8","article-title":"Residential building type classification from street-view imagery with convolutional neural networks","volume":"18","author":"Murdoch","year":"2024","journal-title":"Signal Image Video Process."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Xie, X., Liu, Y., Xu, Y., He, Z., Chen, X., Zheng, X., and Xie, Z. (2022). Building Function Recognition Using the Semi-Supervised Classification. Appl. Sci., 12.","DOI":"10.3390\/app12199900"},{"key":"ref_13","first-page":"567","article-title":"Building Type Classification with Incomplete Labels","volume":"14","author":"Skuppin","year":"2022","journal-title":"Remote Sens."},{"key":"ref_14","first-page":"104386","article-title":"Fine-Grained Building Function Recognition with Street-View Images and GIS Map Data via Geometry-Aware Semi-Supervised Learning","volume":"137","author":"Li","year":"2025","journal-title":"Int. J. Appl. Earth Obs. Geoinf."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"107","DOI":"10.1016\/j.isprsjprs.2015.03.011","article-title":"Semantic Classification of Urban Buildings Combining VHR Image and GIS Data: An Improved Random Forest Approach","volume":"105","author":"Du","year":"2015","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"2145","DOI":"10.1111\/tgis.12934","article-title":"Building Function Classification in Nanjing, China, Using Deep Learning","volume":"26","author":"Xu","year":"2022","journal-title":"Trans. GIS"},{"key":"ref_17","first-page":"937","article-title":"Classification of Buildings from VHR Satellite Images Using Ensemble of U-Net and ResNet","volume":"26","author":"Vasavi","year":"2023","journal-title":"Egypt. J. Remote Sens. Space Sci."},{"key":"ref_18","unstructured":"Li, Z., Su, Y., Zhu, C., and Zhao, W. (2024). BuildingView: Constructing Urban Building Exteriors Databases with Street View Imagery and Multimodal Large Language Models. arXiv."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Liang, X., Xie, J., Zhao, T., Stouffs, R., and Biljecki, F. (2025). OpenFACADES: An Open Framework for Architectural Caption and Attribute Data Enrichment via Street View Imagery. arXiv.","DOI":"10.1016\/j.isprsjprs.2025.10.014"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"177","DOI":"10.5194\/isprs-annals-IV-2-177-2018","article-title":"Neural Networks for the Classification of Building Use from Street-View Imagery","volume":"IV-2","author":"Laupheimer","year":"2018","journal-title":"ISPRS Ann. Photogramm. Remote Sens. Spatial Inf. Sci."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Protopapadakis, E., Doulamis, A., Doulamis, N., and Maltezos, E. (2021). Stacked Autoencoders Driven by Semi-Supervised Learning for Building Extraction from Near Infrared Remote Sensing Imagery. Remote Sens., 13.","DOI":"10.3390\/rs13030371"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"101583","DOI":"10.1016\/j.compenvurbsys.2020.101583","article-title":"A graph-based semi-supervised approach to classification learning in digital geographies","volume":"86","author":"Liu","year":"2021","journal-title":"Comput. Environ. Urban Syst."},{"key":"ref_23","first-page":"162","article-title":"Geostatistical semi-supervised learning for spatial prediction","volume":"3","author":"Fouedjio","year":"2022","journal-title":"Artif. Intell. Geosci."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Wilson, D., Alshaabi, T., Van Oort, C., Zhang, X., Nelson, J., and Wshah, S. (2022). Object Tracking and Geo-Localization from Street Images. Remote Sens., 14.","DOI":"10.3390\/rs14112575"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Anderson, P., He, X., Buehler, C., Teney, D., Johnson, M., Gould, S., and Zhang, L. (2018, January 18\u201323). Bottom-Up and Top-Down Attention for Image Captioning and Visual Question Answering. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00636"},{"key":"ref_26","unstructured":"Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., and Gelly, S. (2021, January 3\u20137). An Image is Worth 16\u00d716 Words: Transformers for Image Recognition at Scale. Proceedings of the 9th International Conference on Learning Representations (ICLR), Virtual."},{"key":"ref_27","unstructured":"Devlin, J., Chang, M.-W., Lee, K., and Toutanova, K. (2019, January 2\u20137). BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Minneapolis, MN, USA."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Yang, Y.-H., Huang, T.E., Sun, M., Rota Bul\u00f2, S., Kontschieder, P., and Yu, F. (2023, January 4\u20138). Dense Prediction with Attentive Feature Aggregation. Proceedings of the 2024 IEEE\/CVF Winter Conference on Applications of Computer Vision (WACV), Waikoloa, HI, USA.","DOI":"10.1109\/WACV56688.2023.00018"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Guo, G., Wang, H., Bell, D., Bi, Y., and Greer, K. (2003). KNN Model-Based Approach in Classification. OTM Confederated International Conferences on the Move to Meaningful Internet Systems, Springer.","DOI":"10.1007\/978-3-540-39964-3_62"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"174","DOI":"10.1016\/j.chaos.2015.05.022","article-title":"The Distance-Decay Function of Geographical Gravity Model: Power Law or Exponential Law?","volume":"77","author":"Chen","year":"2015","journal-title":"Chaos Solitons Fractals"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Li, W., Lai, Y., Xu, L., Xiangli, Y., Yu, J., He, C., Xia, G.-S., and Lin, D. (2023, January 18\u201322). OmniCity: Omnipotent City Understanding with Multi-Level and Multi-View Images. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Vancouver, BC, Canada.","DOI":"10.1109\/CVPR52729.2023.01669"},{"key":"ref_32","unstructured":"Simonyan, K., and Zisserman, A. (2015, January 7\u20139). Very Deep Convolutional Networks for Large-Scale Image Recognition. Proceedings of the 3rd International Conference on Learning Representations, San Diego, CA, USA."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27\u201330). Deep Residual Learning for Image Recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_34","unstructured":"Kipf, T.N., and Welling, M. (2017, January 24\u201326). Semi-Supervised Classification with Graph Convolutional Networks. Proceedings of the 9th International Conference on Learning Representations (ICLR), Toulon, France."},{"key":"ref_35","unstructured":"Hamilton, W.L., Ying, R., and Leskovec, J. (2017, January 4\u20139). Inductive Representation Learning on Large Graphs. Proceedings of the 31st Conference on Neural Information Processing Systems (NeurIPS), Long Beach, CA, USA."},{"key":"ref_36","unstructured":"Veli\u010dkovi\u0107, P., Cucurull, G., Casanova, A., Romero, A., Li\u00f2, P., and Bengio, Y. (May, January 30). Graph Attention Networks. Proceedings of the 9th International Conference on Learning Representations (ICLR), Vancouver, BC, Canada."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Zhang, P., Yan, Y., Zhang, X., Li, C., Wang, S., Huang, F., and Kim, S. (2024, January 14\u201318). TransGNN: Harnessing the Collaborative Power of Transformers and Graph Neural Networks for Recommender Systems. Proceedings of the 47th International ACM SIGIR Conference on Research and Development in Information Retrieval, Washington DC, USA.","DOI":"10.1145\/3626772.3657721"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Anselin, L. (1988). Spatial Econometrics: Methods and Models, Kluwer Academic Publishers.","DOI":"10.1007\/978-94-015-7799-1"}],"container-title":["ISPRS International Journal of Geo-Information"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2220-9964\/14\/11\/423\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,31]],"date-time":"2025-10-31T05:13:40Z","timestamp":1761887620000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2220-9964\/14\/11\/423"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,10,29]]},"references-count":38,"journal-issue":{"issue":"11","published-online":{"date-parts":[[2025,11]]}},"alternative-id":["ijgi14110423"],"URL":"https:\/\/doi.org\/10.3390\/ijgi14110423","relation":{},"ISSN":["2220-9964"],"issn-type":[{"type":"electronic","value":"2220-9964"}],"subject":[],"published":{"date-parts":[[2025,10,29]]}}}