{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,19]],"date-time":"2026-02-19T02:01:16Z","timestamp":1771466476638,"version":"3.50.1"},"reference-count":38,"publisher":"MDPI AG","issue":"2","license":[{"start":{"date-parts":[[2023,1,11]],"date-time":"2023-01-11T00:00:00Z","timestamp":1673395200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"National Natural Science Foundation of China (NSFC)","award":["41801291"],"award-info":[{"award-number":["41801291"]}]},{"name":"National Natural Science Foundation of China (NSFC)","award":["61806018"],"award-info":[{"award-number":["61806018"]}]},{"name":"National Natural Science Foundation of China (NSFC)","award":["42071297"],"award-info":[{"award-number":["42071297"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>The local climate zone (LCZ) scheme is of great value for urban heat island (UHI) effect studies by providing a standard classification framework to describe the local physical structure at a global scale. In recent years, with the rapid development of satellite imaging techniques, both multi-spectral (MS) and synthetic aperture radar (SAR) data have been widely used in LCZ classification tasks. However, the fusion of MS and SAR data still faces the challenges of the different imaging mechanisms and the feature heterogeneity. In this study, to fully exploit and utilize the features of SAR and MS data, a data-grouping method was firstly proposed to divide multi-source data into several band groups according to the spectral characteristics of different bands. Then, a novel network architecture, namely Multi-source data Fusion Network for Local Climate Zone (MsF-LCZ-Net), was introduced to achieve high-precision LCZ classification, which contains a multi-branch CNN for multi-modal feature extraction and fusion, followed by a classifier for LCZ prediction. In the proposed multi-branch structure, a split\u2013fusion-aggregate strategy was adopted to capture multi-level information and enhance the feature representation. In addition, a self channel attention (SCA) block was introduced to establish long-range spatial and inter-channel dependencies, which made the network pay more attention to informative features. Experiments were conducted on the So2Sat LCZ42 dataset, and the results show the superiority of our proposed method when compared with state-of-the-art methods. Moreover, the LCZ maps of three main cities in China were generated and analyzed to demonstrate the effectiveness of our proposed method.<\/jats:p>","DOI":"10.3390\/rs15020434","type":"journal-article","created":{"date-parts":[[2023,1,11]],"date-time":"2023-01-11T05:26:31Z","timestamp":1673414791000},"page":"434","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":12,"title":["SAR and Multi-Spectral Data Fusion for Local Climate Zone Classification with Multi-Branch Convolutional Neural Network"],"prefix":"10.3390","volume":"15","author":[{"given":"Guangjun","family":"He","sequence":"first","affiliation":[{"name":"State Key Laboratory of Space-Ground Integrated Information Technology, Space Star Technology Co., Ltd., Beijing 100095, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9734-4904","authenticated-orcid":false,"given":"Zhe","family":"Dong","sequence":"additional","affiliation":[{"name":"School of Electronics and Information Engineering, Harbin Institute of Technology, Harbin 150001, China"}]},{"given":"Jian","family":"Guan","sequence":"additional","affiliation":[{"name":"Group of Intelligent Signal Processing, College of Computer Science and Technology, Harbin Engineering University, Harbin 150001, China"}]},{"given":"Pengming","family":"Feng","sequence":"additional","affiliation":[{"name":"State Key Laboratory of Space-Ground Integrated Information Technology, Space Star Technology Co., Ltd., Beijing 100095, China"}]},{"given":"Shichao","family":"Jin","sequence":"additional","affiliation":[{"name":"State Key Laboratory of Space-Ground Integrated Information Technology, Space Star Technology Co., Ltd., Beijing 100095, China"}]},{"given":"Xueliang","family":"Zhang","sequence":"additional","affiliation":[{"name":"School of Geography and Ocean Science, Nanjing University, Nanjing 210023, China"}]}],"member":"1968","published-online":{"date-parts":[[2023,1,11]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"92","DOI":"10.1016\/j.landurbplan.2017.08.009","article-title":"Evaluating urban heat island in the critical local climate zones of an Indian city","volume":"169","author":"Kotharkar","year":"2018","journal-title":"Landsc. Urban Plan."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1879","DOI":"10.1175\/BAMS-D-11-00019.1","article-title":"Local Climate Zones for Urban Temperature Studies","volume":"93","author":"Stewart","year":"2012","journal-title":"Bull. Am. Meteorol. Soc."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"480","DOI":"10.1016\/j.buildenv.2006.10.055","article-title":"Temperature decreases in an urban canyon due to green walls and green roofs in diverse climates","volume":"43","author":"Alexandri","year":"2008","journal-title":"Build. Environ."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"210","DOI":"10.1002\/joc.3415","article-title":"How much can air conditioning increase air temperatures for a city like Paris, France?","volume":"33","author":"Pigeon","year":"2013","journal-title":"Int. J. Climatol."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"1191","DOI":"10.1109\/JSTARS.2012.2189873","article-title":"Classification of local climate zones based on multiple earth observation data","volume":"5","author":"Bechtel","year":"2012","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote. Sens."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Xu, Y., Ren, C., Cai, M., and Wang, R. (2017, January 6\u20138). Issues and challenges of remote sensing-based local climate zone mapping for high-density cities. Proceedings of the 2017 Joint Urban Remote Sensing Event (JURSE), Dubai, United Arab Emirates.","DOI":"10.1109\/JURSE.2017.7924558"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"141","DOI":"10.5194\/isprs-annals-IV-1-141-2018","article-title":"The SEN1-2 dataset for deep learning in SAR-optical data fusion","volume":"4","author":"Schmitt","year":"2018","journal-title":"ISPRS Ann. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_8","unstructured":"Mills, G., Ching, J., See, L., Bechtel, B., and Foley, M. (2015, January 20\u201324). An introduction to the WUDAPT project. Proceedings of the the 9th International Conference on Urban Climate, Toulouse, France."},{"key":"ref_9","unstructured":"Bechtel, B., Foley, M., Mills, G., Ching, J., See, L., Alexander, P., O\u2019Connor, M., Albuquerque, T., de Fatima Andrade, M., and Brovelli, M. (2015, January 20\u201324). CENSUS of Cities: LCZ Classification of Cities (Level 0)\u2014Workflow and Initial Results From Various Cities. Proceedings of the ICUC9-9th International Conference on Urban Climate Jointly with 12th Symposium on the Urban Environment, Toulouse, France."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Seo, D., Kim, Y., Eo, Y., Lee, M., and Park, W. (2018). Fusion of SAR and Multispectral Images Using Random Forest Regression for Change Detection. ISPRS Int. J.-Geo-Inf., 7.","DOI":"10.3390\/ijgi7100401"},{"key":"ref_11","unstructured":"Oliver, C., and Quegan, S. (2004). Understanding Synthetic Aperture Radar Images, SciTech Publishing."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"352","DOI":"10.1016\/j.rse.2005.03.010","article-title":"Efficiency of crop identification based on optical and SAR image time series","volume":"96","author":"Blaes","year":"2005","journal-title":"Remote. Sens. Environ."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"410","DOI":"10.1177\/0309133319837711","article-title":"Urban climate zone classification using convolutional neural network and ground-level images","volume":"43","author":"Xu","year":"2019","journal-title":"Prog. Phys. Geogr. Earth Environ."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"1213","DOI":"10.14358\/PERS.75.10.1213","article-title":"A wavelet and IHS integration method to fuse high resolution SAR with moderate resolution multispectral images","volume":"75","author":"Hong","year":"2009","journal-title":"Photogramm. Eng. Remote Sens."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Liu, G., Li, L., Gong, H., Jin, Q., Li, X., Song, R., Chen, Y., Chen, Y., He, C., and Huang, Y. (2016). Multisource remote sensing imagery fusion scheme based on bidimensional empirical mode decomposition (BEMD) and its application to the extraction of bamboo forest. Remote. Sens., 9.","DOI":"10.3390\/rs9010019"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Jian, S. (2016, January 11\u201314). Identity Mappings in Deep Residual Networks. Proceedings of the European Conference on Computer Vision, Amsterdam, The Netherlands.","DOI":"10.1007\/978-3-319-46493-0_38"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Chunping, Q., Schmitt, M., Lichao, M., and Xiaoxiang, Z. (2018, January 19\u201320). Urban local climate zone classification with a residual convolutional neural network and multi-seasonal Sentinel-2 images. Proceedings of the 2018 10th IAPR Workshop on Pattern Recognition in Remote Sensing (PRRS), Beijing, China.","DOI":"10.1109\/PRRS.2018.8486155"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"2793","DOI":"10.1109\/JSTARS.2020.2995711","article-title":"Multilevel Feature Fusion-based CNN for Local Climate Zone Classification from Sentinel-2 Images: Benchmark Results on the So2Sat LCZ42 Dataset","volume":"13","author":"Qiu","year":"2020","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"4194","DOI":"10.1109\/JSTARS.2021.3071577","article-title":"A Parcel-Based Deep-Learning Classification to Map Local Climate Zones From Sentinel-2 Images","volume":"14","author":"Zhou","year":"2021","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote. Sens."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Yang, R., Zhang, Y., Zhao, P., Ji, Z., and Deng, W. (August, January 28). MSPPF-Nets: A Deep Learning Architecture for Remote Sensing Image Classification. Proceedings of the IGARSS 2019 IEEE International Geoscience and Remote Sensing Symposium, Yokohama, Japan.","DOI":"10.1109\/IGARSS.2019.8899068"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Fiaschi, S., Holohan, E.P., Sheehy, M., and Floris, M. (2019). PS-InSAR analysis of Sentinel-1 data for detecting ground motion in temperate oceanic climate zones: A case study in the Republic of Ireland. Remote Sens., 11.","DOI":"10.3390\/rs11030348"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"3097","DOI":"10.1109\/JSTARS.2016.2531420","article-title":"Classification of local climate zones using SAR and multispectral data in an arid environment","volume":"9","author":"Bechtel","year":"2016","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Shi, L., and Ling, F. (2021). Local Climate Zone Mapping Using Multi-Source Free Available Datasets on Google Earth Engine Platform. Land, 10.","DOI":"10.3390\/land10050454"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Yan, Z., Ma, L., He, W., Zhou, L., Lu, H., Liu, G., and Huang, G. (2022). Comparing Object-Based and Pixel-Based Methods for Local Climate Zones Mapping with Multi-Source Data. Remote Sens., 14.","DOI":"10.3390\/rs14153744"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Feng, P., Lin, Y., Guan, J., Dong, Y., He, G., Xia, Z., and Shi, H. (August, January 28). Embranchment CNN Based Local Climate Zone Classification Using Sar And Multispectral Remote Sensing Data. Proceedings of the IGARSS 2019 IEEE International Geoscience and Remote Sensing Symposium, Yokohama, Japan.","DOI":"10.1109\/IGARSS.2019.8898703"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Feng, P., Lin, Y., He, G., Guan, J., Wang, J., and Shi, H. (October, January 26). A Dynamic End-to-End Fusion Filter for Local Climate Zone Classification Using SAR and Multi-Spectrum Remote Sensing Data. Proceedings of the IGARSS 2020\u20142020 IEEE International Geoscience and Remote Sensing Symposium, Waikoloa, HI, USA.","DOI":"10.1109\/IGARSS39084.2020.9324427"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Hu, J., Shen, L., and Sun, G. (2018, January 18\u201323). Squeeze-and-excitation networks. Proceedings of the the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00745"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"76","DOI":"10.1109\/MGRS.2020.2964708","article-title":"So2Sat LCZ42: A benchmark data set for the classification of global local climate zones [Software and Data Sets]","volume":"8","author":"Zhu","year":"2020","journal-title":"IEEE Geosci. Remote Sens. Mag."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"24","DOI":"10.1016\/j.uclim.2018.10.001","article-title":"Generating WUDAPT Level 0 data\u2013Current status of production and evaluation","volume":"27","author":"Bechtel","year":"2019","journal-title":"Urban Clim."},{"key":"ref_30","unstructured":"Kingma, D.P., and Ba, J. (2015, January 7\u20139). Adam: A method for stochastic optimization. Proceedings of the International Conference on Learning Representations (ICLR), San Diego, CA, USA."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Fu, J., Liu, J., Tian, H., Li, Y., Bao, Y., Fang, Z., and Lu, H. (2019, January 15\u201320). Dual attention network for scene segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00326"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"164","DOI":"10.1504\/IJSISE.2018.093268","article-title":"Evaluating compressive sensing algorithms in through-the-wall radar via F1-score","volume":"11","author":"AlBeladi","year":"2018","journal-title":"Int. J. Signal Imaging Syst. Eng."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"276","DOI":"10.11613\/BM.2012.031","article-title":"Interrater reliability: The kappa statistic","volume":"22","author":"McHugh","year":"2012","journal-title":"Biochem. Med. Biochem. Med."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Gawlikowski, J., Schmitt, M., Kruspe, A., and Zhu, X.X. (October, January 26). On the fusion strategies of Sentinel-1 and Sentinel-2 data for local climate zone classification. Proceedings of the IGARSS 2020\u20142020 IEEE International Geoscience and Remote Sensing Symposium, Waikoloa, HI, USA.","DOI":"10.1109\/IGARSS39084.2020.9324234"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"229","DOI":"10.1016\/j.isprsjprs.2020.04.008","article-title":"Local climate zone mapping as remote sensing scene classification using deep learning: A case study of metropolitan China","volume":"164","author":"Liu","year":"2020","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"449","DOI":"10.1109\/JSTARS.2022.3226524","article-title":"Multicascaded Feature Fusion-Based Deep Learning Network for Local Climate Zone Classification Based on the So2Sat LCZ42 Benchmark Dataset","volume":"16","author":"Ji","year":"2022","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1080\/10095020.2022.2030654","article-title":"Deep learning-based local climate zone classification using Sentinel-1 SAR and Sentinel-2 multispectral imagery","volume":"25","author":"Zhou","year":"2022","journal-title":"Geo-Spat. Inf. Sci."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"7102","DOI":"10.1109\/TGRS.2018.2848285","article-title":"Polarimetric radar vegetation index for biomass estimation in desert fringe ecosystems","volume":"56","author":"Chang","year":"2018","journal-title":"IEEE Trans. Geosci. Remote Sens."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/15\/2\/434\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T18:03:03Z","timestamp":1760119383000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/15\/2\/434"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,1,11]]},"references-count":38,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2023,1]]}},"alternative-id":["rs15020434"],"URL":"https:\/\/doi.org\/10.3390\/rs15020434","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,1,11]]}}}