{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,12]],"date-time":"2026-02-12T17:39:24Z","timestamp":1770917964486,"version":"3.50.1"},"reference-count":48,"publisher":"MDPI AG","issue":"16","license":[{"start":{"date-parts":[[2019,8,17]],"date-time":"2019-08-17T00:00:00Z","timestamp":1566000000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Semantic segmentation in high-resolution remote-sensing (RS) images is a fundamental task for RS-based urban understanding and planning. However, various types of artificial objects in urban areas make this task quite challenging. Recently, the use of Deep Convolutional Neural Networks (DCNNs) with multiscale information fusion has demonstrated great potential in enhancing performance. Technically, however, existing fusions are usually implemented by summing or concatenating feature maps in a straightforward way. Seldom do works consider the spatial importance for global-to-local context-information aggregation. This paper proposes a Learnable-Gated CNN (L-GCNN) to address this issue. Methodologically, the Taylor expression of the information-entropy function is first parameterized to design the gate function, which is employed to generate pixelwise weights for coarse-to-fine refinement in the L-GCNN. Accordingly, a Parameterized Gate Module (PGM) was designed to achieve this goal. Then, the single PGM and its densely connected extension were embedded into different levels of the encoder in the L-GCNN to help identify the discriminative feature maps at different scales. With the above designs, the L-GCNN is finally organized as a self-cascaded end-to-end architecture that is able to sequentially aggregate context information for fine segmentation. The proposed model was evaluated on two public challenging benchmarks, the ISPRS 2Dsemantic segmentation challenge Potsdam dataset and the Massachusetts building dataset. The experiment results demonstrate that the proposed method exhibited significant improvement compared with several related segmentation networks, including the FCN, SegNet, RefineNet, PSPNet, DeepLab and GSN.For example, on the Potsdam dataset, our method achieved a 93.65%     F 1     score and 88.06%     I o U     score for the segmentation of tiny cars in high-resolution RS images. As a conclusion, the proposed model showed potential for object segmentation from the RS images of buildings, impervious surfaces, low vegetation, trees and cars in urban settings, which largely varies in size and have confusing appearances.<\/jats:p>","DOI":"10.3390\/rs11161922","type":"journal-article","created":{"date-parts":[[2019,8,19]],"date-time":"2019-08-19T06:10:14Z","timestamp":1566195014000},"page":"1922","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":31,"title":["Learnable Gated Convolutional Neural Network for Semantic Segmentation in Remote-Sensing Images"],"prefix":"10.3390","volume":"11","author":[{"given":"Shichen","family":"Guo","sequence":"first","affiliation":[{"name":"Computer Network Information Center, Chinese Academy of Sciences, 4 Zhongguancun Nansi Street, Beijing 100190, China"},{"name":"School of Computer Science and Technology, University of Chinese Academy of Sciences, Beijing 100049, China"}]},{"given":"Qizhao","family":"Jin","sequence":"additional","affiliation":[{"name":"National Laboratory of Pattern Recognition, Institute of Automation, Chinese Academy of Sciences, 95# Zhongguancun East Road, Beijing 100190, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9190-582X","authenticated-orcid":false,"given":"Hongzhen","family":"Wang","sequence":"additional","affiliation":[{"name":"National Laboratory of Pattern Recognition, Institute of Automation, Chinese Academy of Sciences, 95# Zhongguancun East Road, Beijing 100190, China"}]},{"given":"Xuezhi","family":"Wang","sequence":"additional","affiliation":[{"name":"Computer Network Information Center, Chinese Academy of Sciences, 4 Zhongguancun Nansi Street, Beijing 100190, China"}]},{"given":"Yangang","family":"Wang","sequence":"additional","affiliation":[{"name":"Computer Network Information Center, Chinese Academy of Sciences, 4 Zhongguancun Nansi Street, Beijing 100190, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2089-9733","authenticated-orcid":false,"given":"Shiming","family":"Xiang","sequence":"additional","affiliation":[{"name":"National Laboratory of Pattern Recognition, Institute of Automation, Chinese Academy of Sciences, 95# Zhongguancun East Road, Beijing 100190, China"}]}],"member":"1968","published-online":{"date-parts":[[2019,8,17]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Bruzzone, L., and Demir, B. (2014). A review of modern approaches to classification of remote sensing data. Land Use and Land Cover Mapping in Europe, Springer.","DOI":"10.1007\/978-94-007-7969-3_9"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"2335","DOI":"10.1109\/TGRS.2014.2358934","article-title":"A survey on spectral\u2013spatial classification techniques based on attribute profiles","volume":"53","author":"Ghamisi","year":"2015","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"22","DOI":"10.1109\/MGRS.2016.2540798","article-title":"Deep learning for remote sensing data: A technical tutorial on the state of the art","volume":"4","author":"Zhang","year":"2016","journal-title":"IEEE Geosci. Remote Sens. Mag."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Cheng, G., Han, J., and Lu, X. (2017). Remote Sensing Image Scene Classification: Benchmark and State of the Art. arXiv.","DOI":"10.1109\/JPROC.2017.2675998"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"3289801","DOI":"10.1155\/2016\/3289801","article-title":"Deep Neural Networks Based Recognition of Plant Diseases by Leaf Image Classification","volume":"2016","author":"Sladojevic","year":"2016","journal-title":"Comput. Intell. Neurosci."},{"key":"ref_6","first-page":"41","article-title":"Detection of plant leaf diseases using image segmentation and soft computing techniques","volume":"4","author":"Singh","year":"2017","journal-title":"Inf. Process. Agric."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"369","DOI":"10.1016\/j.compag.2017.09.012","article-title":"An in-field automatic wheat disease diagnosis system","volume":"142","author":"Lu","year":"2017","journal-title":"Comput. Electron. Agric."},{"key":"ref_8","first-page":"354","article-title":"A review of neural networks in plant disease detection using hyperspectral data","volume":"5","author":"Golhani","year":"2018","journal-title":"Inf. Proc. Agric."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Al-Saddik, H., Laybros, A., Billiot, B., and Cointault, F. (2018). Using Image Texture and Spectral Reflectance Analysis to Detect Yellowness and Esca in Grapevines at Leaf-Level. Remote Sens., 10.","DOI":"10.3390\/rs10040618"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Dang, L.M., Hassan, S.I., Suhyeon, I., Sangaiah, A.K., Mehmood, I., Rho, S., Seo, S., and Moon, H. (2019). UAV based wilt detection system via convolutional neural networks. Sustain. Comput. Inf. Syst.","DOI":"10.1016\/j.suscom.2018.05.010"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"1777","DOI":"10.3390\/rs3081777","article-title":"Segment-based land cover mapping of a suburban area-comparison of high-resolution remotely sensed datasets using classification trees and test field points","volume":"3","author":"Matikainen","year":"2011","journal-title":"Remote Sens."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"1413","DOI":"10.1109\/JSTARS.2016.2645798","article-title":"Semantic Classification of Urban Trees Using Very High Resolution Satellite Imagery","volume":"10","author":"Wen","year":"2017","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"3631","DOI":"10.1109\/JSTARS.2017.2686488","article-title":"Multilevel Cloud Detection in Remote Sensing Images Based on Deep Learning","volume":"10","author":"Xie","year":"2017","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Liu, C.C., Zhang, Y.C., Chen, P.Y., Lai, C.C., Chen, Y.H., Cheng, J.H., and Ko, M.H. (2019). Clouds Classification from Sentinel-2 Imagery with Deep Residual Learning and Semantic Image Segmentation. Remote Sens., 11.","DOI":"10.3390\/rs11020119"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"24","DOI":"10.1016\/j.isprsjprs.2016.02.013","article-title":"Change detection based on deep feature representation and mapping transformation for multi-spatial-resolution remote sensing images","volume":"116","author":"Zhang","year":"2016","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"884","DOI":"10.1109\/TCYB.2016.2531179","article-title":"Joint Dictionary Learning for Multispectral Change Detection","volume":"47","author":"Lu","year":"2017","journal-title":"IEEE Trans. Cybern."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Tang, Y., and Zhang, L. (2017). Urban change analysis with multi-sensor multispectral imagery. Remote Sens., 9.","DOI":"10.3390\/rs9030252"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Audebert, N., Saux, B.L., and Lefevre, S. (2017). Segment-before-Detect: Vehicle Detection and Classification through Semantic Segmentation of Aerial Images. Remote Sens., 9.","DOI":"10.3390\/rs9040368"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"4483","DOI":"10.1109\/TGRS.2015.2400462","article-title":"Robust Rooftop Extraction From Visible Band Images Using Higher Order CRF","volume":"53","author":"Li","year":"2015","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"7369","DOI":"10.1109\/TGRS.2018.2850972","article-title":"Automatic Building Rooftop Extraction From Aerial Images via Hierarchical RGB-D Priors","volume":"56","author":"Xu","year":"2018","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"749","DOI":"10.1109\/LGRS.2018.2802944","article-title":"Road Extraction by Deep Residual U-Net","volume":"15","author":"Zhang","year":"2018","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Xu, Y., Xie, Z., Feng, Y., and Chen, Z. (2018). Road Extraction from High-Resolution Remote Sensing Imagery Using Deep Learning. Remote Sens., 10.","DOI":"10.3390\/rs10091461"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"2278","DOI":"10.1109\/5.726791","article-title":"Gradient-Based Learning Applied to Document Recognition","volume":"86","author":"LeCun","year":"1998","journal-title":"Proc. IEEE"},{"key":"ref_24","first-page":"1337","article-title":"Fully convolutional networks for semantic segmentation","volume":"79","author":"Long","year":"2015","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Ronneberger, O., Fischer, P., and Brox, T. (2015, January 5\u20139). U-net: Convolutional networks for biomedical image segmentation. Proceedings of the International Conference on Medical Image Computing and Computer-Assisted Intervention, Munich, Germany.","DOI":"10.1007\/978-3-319-24574-4_28"},{"key":"ref_26","unstructured":"Badrinarayanan, V., Kendall, A., and Cipolla, R. (2015). Segnet: A deep convolutional encoder-decoder architecture for image segmentation. arXiv."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Noh, H., Hong, S., and Han, B. (2015, January 11\u201318). Learning Deconvolution Network for Semantic Segmentation. Proceedings of the IEEE International Conference on Computer Vision, Las Condes, Chile.","DOI":"10.1109\/ICCV.2015.178"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Lin, G., Milan, A., Shen, C., and Reid, I.D. (2016). RefineNet: Multi-Path Refinement Networks for High-Resolution Semantic Segmentation. arXiv.","DOI":"10.1109\/CVPR.2017.549"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"834","DOI":"10.1109\/TPAMI.2017.2699184","article-title":"Deeplab: Semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected crfs","volume":"40","author":"Chen","year":"2018","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"446","DOI":"10.3390\/rs9050446","article-title":"Gated Convolutional Neural Network for Semantic Segmentation in High-Resolution Images","volume":"9","author":"Wang","year":"2017","journal-title":"Remote Sens."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"78","DOI":"10.1016\/j.isprsjprs.2017.12.007","article-title":"Semantic Labeling in very High Resolution Images via A Self-cascaded Convolutional Neural Network","volume":"145","author":"Liu","year":"2018","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Li, L., Yao, J., Liu, Y., Yuan, W., Shi, S., and Yuan, S. (2017). Optimal Seamline Detection for Orthoimage Mosaicking by Combining Deep Convolutional Neural Network and Graph Cuts. Remote Sens., 9.","DOI":"10.3390\/rs9070701"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Panboonyuen, T., Jitkajornwanich, K., Lawawirojwong, S., Srestasathiern, P., and Vateekul, P. (2019). Semantic Segmentation on Remotely Sensed Images Using an Enhanced Global Convolutional Network with Channel Attention and Domain Specific Transfer Learning. Remote Sens., 11.","DOI":"10.20944\/preprints201812.0090.v3"},{"key":"ref_34","unstructured":"Goodfellow, I., Bengio, Y., and Courville, A. (2016). Deep Learning, MIT Press."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Zhao, H., Shi, J., Qi, X., Wang, X., and Jia, J. (2016). Pyramid Scene Parsing Network. arXiv.","DOI":"10.1109\/CVPR.2017.660"},{"key":"ref_36","unstructured":"Sherrah, J. (2016). Fully convolutional networks for dense semantic labelling of highresolution aerial imagery. arXiv."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"139","DOI":"10.1016\/j.isprsjprs.2017.05.002","article-title":"Simultaneous extraction of roads and buildings in remote sensing imagery with convolutional neural networks","volume":"130","author":"Alshehhi","year":"2017","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"173","DOI":"10.1109\/LGRS.2017.2778181","article-title":"Semantic Segmentation of Aerial Images With Shuffling Convolutional Neural Networks","volume":"15","author":"Chen","year":"2018","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"1633","DOI":"10.1109\/JSTARS.2018.2810320","article-title":"Symmetrical Dense-Shortcut Deep Fully Convolutional Networks for Semantic Segmentation of Very-High-Resolution Remote Sensing Images","volume":"11","author":"Chen","year":"2018","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"2325","DOI":"10.1109\/LGRS.2017.2763738","article-title":"Deep Fully Convolutional Networks for the Detection of Informal Settlements in VHR Images","volume":"14","author":"Persello","year":"2017","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"2793","DOI":"10.1109\/TPAMI.2017.2750680","article-title":"Learning Building Extraction in Aerial Scenes with Convolutional Networks","volume":"40","author":"Yuan","year":"2018","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_42","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (July, January 26). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA."},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Hu, J., Shen, L., and Sun, G. (2018, January 18\u201322). Squeeze-and-Excitation Networks. Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00745"},{"key":"ref_44","unstructured":"ISPRS (2019, August 16). 2D Semantic Labeling Challenge by International Society for Photogrammetry and Remote Sensing. Available online: http:\/\/www2.isprs.org\/commissions\/comm3\/wg4\/semantic-labeling.html."},{"key":"ref_45","unstructured":"Mnih, V. (2013). Machine Learning for Aerial Image Labeling. [Ph.D. Thesis, University of Toronto]."},{"key":"ref_46","unstructured":"Yosinski, J., Clune, J., Bengio, Y., and Lipson, H. (2014). How Transferable are Features in Deep Neural Networks. Neural Information Processing Systems, Mit Press."},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Penatti, O.A., Nogueira, K., and dos Santos, J.A. (2015, January 7\u201312). Do deep features generalize from everyday objects to remote sensing and aerial scenes domains. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshop, Boston, MA, USA.","DOI":"10.1109\/CVPRW.2015.7301382"},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"98","DOI":"10.1007\/s11263-014-0733-5","article-title":"The Pascal Visual Object Classes Challenge: A Retrospective","volume":"111","author":"Everingham","year":"2015","journal-title":"Int. J. Comput. Vis."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/11\/16\/1922\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T13:11:48Z","timestamp":1760188308000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/11\/16\/1922"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,8,17]]},"references-count":48,"journal-issue":{"issue":"16","published-online":{"date-parts":[[2019,8]]}},"alternative-id":["rs11161922"],"URL":"https:\/\/doi.org\/10.3390\/rs11161922","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,8,17]]}}}