{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,13]],"date-time":"2026-10-13T17:03:59Z","timestamp":1791911039072,"version":"4.3.4"},"reference-count":47,"publisher":"MDPI AG","issue":"5","license":[{"start":{"date-parts":[[2017,5,5]],"date-time":"2017-05-05T00:00:00Z","timestamp":1493942400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["91646207"],"award-info":[{"award-number":["91646207"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["91338202"],"award-info":[{"award-number":["91338202"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["91438105"],"award-info":[{"award-number":["91438105"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100004826","name":"Beijing Natural Science Foundation","doi-asserted-by":"publisher","award":["4162064"],"award-info":[{"award-number":["4162064"]}],"id":[{"id":"10.13039\/501100004826","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Semantic segmentation is a fundamental task in remote sensing image processing. The large appearance variations of ground objects make this task quite challenging. Recently, deep convolutional neural networks (DCNNs) have shown outstanding performance in this task. A common strategy of these methods (e.g., SegNet) for performance improvement is to combine the feature maps learned at different DCNN layers. However, such a combination is usually implemented via feature map summation or concatenation, indicating that the features are considered indiscriminately. In fact, features at different positions contribute differently to the final performance. It is advantageous to automatically select adaptive features when merging different-layer feature maps. To achieve this goal, we propose a gated convolutional neural network to fulfill this task. Specifically, we explore the relationship between the information entropy of the feature maps and the label-error map, and then a gate mechanism is embedded to integrate the feature maps more effectively. The gate is implemented by the entropy maps, which are generated to assign adaptive weights to different feature maps as their relative importance. Generally, the entropy maps, i.e., the gates, guide the network to focus on the highly-uncertain pixels, where detailed information from lower layers is required to improve the separability of these pixels. The selected features are finally combined to feed into the classifier layer, which predicts the semantic label of each pixel. The proposed method achieves competitive segmentation accuracy on the public ISPRS 2D Semantic Labeling benchmark, which is challenging for segmentation by only using the RGB images.<\/jats:p>","DOI":"10.3390\/rs9050446","type":"journal-article","created":{"date-parts":[[2017,5,5]],"date-time":"2017-05-05T10:31:08Z","timestamp":1493980268000},"page":"446","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":174,"title":["Gated Convolutional Neural Network for Semantic Segmentation in High-Resolution Images"],"prefix":"10.3390","volume":"9","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-9190-582X","authenticated-orcid":false,"given":"Hongzhen","family":"Wang","sequence":"first","affiliation":[{"name":"National Laboratory of Pattern Recognition, Institute of Automation, Chinese Academy of Sciences, 95 Zhongguancun East Road, Beijing 100190, China"},{"name":"University of Chinese Academy of Sciences, Beijing 101408, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ying","family":"Wang","sequence":"additional","affiliation":[{"name":"National Laboratory of Pattern Recognition, Institute of Automation, Chinese Academy of Sciences, 95 Zhongguancun East Road, Beijing 100190, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Qian","family":"Zhang","sequence":"additional","affiliation":[{"name":"Alibaba Group, Beijing 100102, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2089-9733","authenticated-orcid":false,"given":"Shiming","family":"Xiang","sequence":"additional","affiliation":[{"name":"National Laboratory of Pattern Recognition, Institute of Automation, Chinese Academy of Sciences, 95 Zhongguancun East Road, Beijing 100190, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chunhong","family":"Pan","sequence":"additional","affiliation":[{"name":"National Laboratory of Pattern Recognition, Institute of Automation, Chinese Academy of Sciences, 95 Zhongguancun East Road, Beijing 100190, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2017,5,5]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"1279","DOI":"10.1109\/TNNLS.2015.2477537","article-title":"Salient band selection for hyperspectral image classification via manifold ranking","volume":"27","author":"Wang","year":"2016","journal-title":"IEEE Trans. Neural Netw. Learn. Syst."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"407","DOI":"10.1016\/j.neucom.2016.04.026","article-title":"Accurate urban road centerline extraction from VHR imagery via multiscale segmentation and tensor voting","volume":"205","author":"Cheng","year":"2016","journal-title":"Neurocomputing"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1431","DOI":"10.1109\/TGRS.2015.2480866","article-title":"Dual-clustering-based hyperspectral band selection by contextual analysis","volume":"54","author":"Yuan","year":"2016","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1777","DOI":"10.3390\/rs3081777","article-title":"egment-based land cover mapping of a suburban area\u2014Comparison of high-resolution remotely sensed datasets using classification trees and test field points","volume":"3","author":"Matikainen","year":"2011","journal-title":"Remote Sens."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Tang, Y., and Zhang, L. (2017). Urban change analysis with multi-sensor multispectral imagery. Remote Sens., 9.","DOI":"10.3390\/rs9030252"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"2966","DOI":"10.1109\/TCYB.2015.2484324","article-title":"Hyperspectral image classification via multitask joint sparse representation and stepwise MRF optimization","volume":"46","author":"Yuan","year":"2016","journal-title":"IEEE Trans. Cybern."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"2320","DOI":"10.1016\/j.rse.2011.04.032","article-title":"Mapping urbanization dynamics at regional and global scales using multi-temporal DMSP\/OLS nighttime light data","volume":"115","author":"Zhang","year":"2011","journal-title":"Remote Sens. Environ."},{"key":"ref_8","unstructured":"Sherrah, J. (2016). Fully convolutional networks for dense semantic labelling of highresolution aerial imagery. arXiv."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Girshick, R. (2015, January 13\u201316). Fast r-cnn. Proceedings of the IEEE International Conference on Computer Vision, Santiago, Chile.","DOI":"10.1109\/ICCV.2015.169"},{"key":"ref_10","unstructured":"Goodfellow, I., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., Courville, A., and Bengio, Y. (2014, January 8\u201313). Generative adversarial nets. Proceedings of the Advances in Neural Information Processing Systems, Montreal, QC, Canada."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Yang, S., Luo, P., Loy, C.C., and Tang, X. (2015, January 13\u201316). From facial parts responses to face detection: A deep learning approach. Proceedings of the IEEE International Conference on Computer Vision, Santiago, Chile.","DOI":"10.1109\/ICCV.2015.419"},{"key":"ref_12","first-page":"1337","article-title":"Fully convolutional networks for semantic segmentation","volume":"79","author":"Long","year":"2015","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Ronneberger, O., Fischer, P., and Brox, T. (2015, January 5\u20139). U-net: Convolutional networks for biomedical image segmentation. Proceedings of the International Conference on Medical Image Computing and Computer-Assisted Intervention, Munich, Germany.","DOI":"10.1007\/978-3-319-24574-4_28"},{"key":"ref_14","unstructured":"Badrinarayanan, V., Kendall, A., and Cipolla, R. (2015). Segnet: A deep convolutional encoder-decoder architecture for image segmentation. arXiv."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Lin, G., Milan, A., Shen, C., and Reid, I. (2016). RefineNet: Multi-path refinement networks with identity mappings for high-resolution semantic segmentation. arXiv.","DOI":"10.1109\/CVPR.2017.549"},{"key":"ref_16","unstructured":"Krizhevsky, A., Sutskever, I., and Hinton, G.E. (2012, January 3\u20136). Imagenet classification with deep convolutional neural networks. Proceedings of the Advances in Neural Information Processing Systems, Lake Tahoe, NV, USA."},{"key":"ref_17","unstructured":"Simonyan, K., and Zisserman, A. (2014). Very deep convolutional networks for large-scale image recognition. arXiv."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., and Rabinovich, A. (2015, January 7\u201312). Going deeper with convolutions. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298594"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27\u201330). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_20","unstructured":"Ren, S., He, K., Girshick, R., and Sun, J. (2015, January 7\u201312). Faster r-cnn: Towards real-time object detection with region proposal networks. Proceedings of the Advances in Neural Information Processing Systems, Montreal, QC, Canada."},{"key":"ref_21","unstructured":"Chen, L.C., Papandreou, G., Kokkinos, I., Murphy, K., and Yuille, A.L. (2016). Deeplab: Semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected crfs. arXiv."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Zhou, B., Khosla, A., Lapedriza, A., Oliva, A., and Torralba, A. (2016, January 27\u201330). Learning deep features for discriminative localization. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.","DOI":"10.1109\/CVPR.2016.319"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"2335","DOI":"10.1109\/TGRS.2014.2358934","article-title":"A survey on spectral\u2013spatial classification techniques based on attribute profiles","volume":"53","author":"Ghamisi","year":"2015","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Bruzzone, L., and Demir, B. (2014). A review of modern approaches to classification of remote sensing data. Land Use and Land Cover Mapping in Europe, Springer.","DOI":"10.1007\/978-94-007-7969-3_9"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"22","DOI":"10.1109\/MGRS.2016.2540798","article-title":"Deep learning for remote sensing data: A technical tutorial on the state of the art","volume":"4","author":"Zhang","year":"2016","journal-title":"IEEE Geosci. Remote Sens. Mag."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Paisitkriangkrai, S., Sherrah, J., Janney, P., and van-Den Hengel, A. (2015, January 7\u201312). Effective semantic pixel labelling with convolutional networks and Conditional Random Fields. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, Boston, MA, USA.","DOI":"10.1109\/CVPRW.2015.7301381"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Audebert, N., Le Saux, B., and Lefevre, S. (2016, January 10\u201315). How useful is region-based classification of remote sensing images in a deep learning framework?. Proceedings of the IEEE Conference on Geoscience and Remote Sensing Symposium, Beijing, China.","DOI":"10.1109\/IGARSS.2016.7730327"},{"key":"ref_28","unstructured":"Marmanis, D., Schindler, K., Wegner, J.D., Galliani, S., Datcu, M., and Stilla, U. (2016). Classification with an edge: Improving semantic image segmentation with boundary detection. arXiv."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Kampffmeyer, M., Salberg, A.B., and Jenssen, R. (2016, January 27\u201330). Semantic segmentation of small objects and modeling of uncertainty in urban remote sensing images using deep convolutional neural networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, Seattle, WA, USA.","DOI":"10.1109\/CVPRW.2016.90"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Arnab, A., Jayasumana, S., Zheng, S., and Torr, P.H. (2016, January 8\u201316). Higher order conditional random fields in deep neural networks. Proceedings of the European Conference on Computer Vision, Amsterdam, The Netherlands.","DOI":"10.1007\/978-3-319-46475-6_33"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Zheng, S., Jayasumana, S., Romera-Paredes, B., Vineet, V., Su, Z., Du, D., Huang, C., and Torr, P.H. (2015, January 7\u201313). Conditional random fields as recurrent neural networks. Proceedings of the IEEE Conference on International Conference on Computer Vision, Los Alamitos, CA, USA.","DOI":"10.1109\/ICCV.2015.179"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"1735","DOI":"10.1162\/neco.1997.9.8.1735","article-title":"Long short-term memory","volume":"9","author":"Hochreiter","year":"1997","journal-title":"Neural Comput."},{"key":"ref_33","unstructured":"Dauphin, Y.N., Fan, A., Auli, M., and Grangier, D. (2016). Language modeling with gated convolutional networks. arXiv."},{"key":"ref_34","unstructured":"Zeng, X., Ouyang, W., Yan, J., Li, H., Xiao, T., Wang, K., Liu, Y., Zhou, Y., Yang, B., and Wang, Z. (2016). Crafting GBD-Net for Object Detection. arXiv."},{"key":"ref_35","first-page":"3","article-title":"A mathematical theory of communication","volume":"5","author":"Shannon","year":"1948","journal-title":"Bell Syst. Tech. J."},{"key":"ref_36","unstructured":"Ioffe, S., and Szegedy, C. (2015). Batch normalization: Accelerating deep network training by reducing internal covariate shift. arXiv."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"533","DOI":"10.1038\/323533a0","article-title":"Learning representations by back-propagating errors","volume":"323","author":"Rumelhart","year":"1986","journal-title":"Nature"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"211","DOI":"10.1007\/s11263-015-0816-y","article-title":"ImageNet large scale visual recognition challenge","volume":"115","author":"Russakovsky","year":"2015","journal-title":"Int. J. Comput. Vis."},{"key":"ref_39","first-page":"212","article-title":"Improving neural networks by preventing co-adaptation of feature detectors","volume":"3","author":"Hinton","year":"2012","journal-title":"Comput. Sci."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., and Darrell, T. (2014). Caffe: Convolutional architecture for fast feature embedding. arXiv, 675\u2013678.","DOI":"10.1145\/2647868.2654889"},{"key":"ref_41","unstructured":"International Society for Photogrammetry and Remote Sensing (ISPRS) (2015, April 01). 2D Semantic Labeling Contest. Available online: http:\/\/www2.isprs.org\/commissions\/comm3\/wg4\/semantic-labeling.html."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Vedaldi, A., and Lenc, K. (2015, January 26\u201330). Matconvnet: Convolutional neural networks for matlab. Proceedings of the 23rd ACM international conference on Multimedia, Brisbane, Australia.","DOI":"10.1145\/2733373.2807412"},{"key":"ref_43","unstructured":"Marcu, A., and Leordeanu, M. (2016). Dual local-global contextual pathways for recognition in aerial imagery. arXiv."},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Tschannen, M., Cavigelli, L., Mentzer, F., Wiatowski, T., and Benini, L. (2016). Deep structured features for semantic segmentation. arXiv.","DOI":"10.23919\/EUSIPCO.2017.8081169"},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Lin, G., Shen, C., van den Hengel, A., and Reid, I. (2016, January 27\u201330). Efficient piecewise training of deep structured models for semantic segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.","DOI":"10.1109\/CVPR.2016.348"},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Piramanayagam, S., Schwartzkopf, W., Koehler, F., and Saber, E. (2016). Classification of remote sensed images using random forests and deep learning framework. Proceedings of the SPIE Remote Sensing, International Society for Optics and Photonics.","DOI":"10.1117\/12.2243169"},{"key":"ref_47","unstructured":"Audebert, N., Saux, B.L., and Lef\u00e8vre, S. (2016). Semantic segmentation of earth observation data using multimodal and multi-scale deep networks. arXiv."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/9\/5\/446\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T18:34:45Z","timestamp":1760207685000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/9\/5\/446"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2017,5,5]]},"references-count":47,"journal-issue":{"issue":"5","published-online":{"date-parts":[[2017,5]]}},"alternative-id":["rs9050446"],"URL":"https:\/\/doi.org\/10.3390\/rs9050446","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2017,5,5]]}}}