{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,16]],"date-time":"2026-07-16T21:14:24Z","timestamp":1784236464175,"version":"3.55.0"},"reference-count":35,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2022,2,25]],"date-time":"2022-02-25T00:00:00Z","timestamp":1645747200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["42075130"],"award-info":[{"award-number":["42075130"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["IJGI"],"abstract":"<jats:p>Extracting buildings and roads from remote sensing images is very important in the area of land cover monitoring, which is of great help to urban planning. Currently, a deep learning method is used by the majority of building and road extraction algorithms. However, for existing semantic segmentation, it has a limitation on the receptive field of high-resolution remote sensing images, which means that it can not show the long-distance scene well during pixel classification, and the image features is compressed during down-sampling, meaning that the detailed information is lost. In order to address these issues, Hybrid Multi-resolution and Transformer semantic extraction Network (HMRT) is proposed in this paper, by which a global receptive field for each pixel can be provided, a small receptive field of convolutional neural networks (CNN) can be overcome, and the ability of scene understanding can be enhanced well. Firstly, we blend the features by branches of different resolutions to keep the high-resolution and multi-resolution during down-sampling and fully retain feature information. Secondly, we introduce the Transformer sequence feature extraction network and use encoding and decoding to realize that each pixel has the global receptive field. The recall, F1, OA and MIoU of HMPR obtain 85.32%, 84.88%, 85.99% and 74.19%, respectively, in the main experiment and reach 91.29%, 90.41%, 91.32% and 84.00%, respectively, in the generalization experiment, which prove that the method proposed is better than existing methods.<\/jats:p>","DOI":"10.3390\/ijgi11030165","type":"journal-article","created":{"date-parts":[[2022,2,25]],"date-time":"2022-02-25T10:00:40Z","timestamp":1645783240000},"page":"165","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":65,"title":["Multi-Resolution Transformer Network for Building and Road Segmentation of Remote Sensing Image"],"prefix":"10.3390","volume":"11","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-9223-491X","authenticated-orcid":false,"given":"Zhongyu","family":"Sun","sequence":"first","affiliation":[{"name":"Jiangsu Key Laboratory of Big Data Analysis Technology, Nanjing University of Information Science and Technology, Nanjing 210044, China"},{"name":"Jiangsu Collaborative Innovation Center on Atmospheric Environment and Equipment Technology, Nanjing University of Information Science and Technology, Nanjing 210044, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Wangping","family":"Zhou","sequence":"additional","affiliation":[{"name":"Jiangsu Key Laboratory of Big Data Analysis Technology, Nanjing University of Information Science and Technology, Nanjing 210044, China"},{"name":"Jiangsu Collaborative Innovation Center on Atmospheric Environment and Equipment Technology, Nanjing University of Information Science and Technology, Nanjing 210044, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chen","family":"Ding","sequence":"additional","affiliation":[{"name":"Jiangsu Collaborative Innovation Center on Atmospheric Environment and Equipment Technology, Nanjing University of Information Science and Technology, Nanjing 210044, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4681-9129","authenticated-orcid":false,"given":"Min","family":"Xia","sequence":"additional","affiliation":[{"name":"Jiangsu Key Laboratory of Big Data Analysis Technology, Nanjing University of Information Science and Technology, Nanjing 210044, China"},{"name":"Jiangsu Collaborative Innovation Center on Atmospheric Environment and Equipment Technology, Nanjing University of Information Science and Technology, Nanjing 210044, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2022,2,25]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"223","DOI":"10.1016\/j.landurbplan.2010.12.009","article-title":"A case study on the relation between city planning and urban growth using remote sensing and spatial metrics","volume":"100","author":"Pham","year":"2011","journal-title":"Landsc. Urban Plan."},{"key":"ref_2","first-page":"102597","article-title":"SUACDNet: Attentional change detection network based on siamese U-shaped structure","volume":"105","author":"Song","year":"2021","journal-title":"Int. J. Appl. Earth Obs. Geoinf."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"046512","DOI":"10.1117\/1.JRS.15.046512","article-title":"PADANet: Parallel asymmetric double attention network for clouds and its shadow detection","volume":"15","author":"Xia","year":"2021","journal-title":"J. Appl. Remote Sens."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Wen, Q., Jiang, K., Wang, W., Liu, Q., Guo, Q., Li, L., and Wang, P. (2019). Automatic building extraction from google earth images under complex backgrounds based on deep instance segmentation network. Sensors, 19.","DOI":"10.3390\/s19020333"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"401","DOI":"10.1007\/s10661-018-6770-8","article-title":"Use of satellite remote sensing as a monitoring tool for land and water resources development activities in an Indian tropical site","volume":"190","author":"Behera","year":"2018","journal-title":"Environ. Monit. Assess."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"104940","DOI":"10.1016\/j.cageo.2021.104940","article-title":"Strip pooling channel spatial attention network for the segmentation of cloud and cloud shadow","volume":"157","author":"Qu","year":"2021","journal-title":"Comput. Geosci."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"16","DOI":"10.1109\/TGRS.2012.2234755","article-title":"Remote sensing image segmentation by combining spectral and texture features","volume":"52","author":"Yuan","year":"2013","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"2781","DOI":"10.1109\/TIP.2010.2049528","article-title":"An edge embedded marker-based watershed algorithm for high spatial resolution remote sensing image segmentation","volume":"19","author":"Li","year":"2010","journal-title":"IEEE Trans. Image Process."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"2527","DOI":"10.1016\/j.patcog.2009.04.013","article-title":"Single point iterative weighted fuzzy C-means clustering algorithm for remote sensing image segmentation","volume":"42","author":"Fan","year":"2009","journal-title":"Pattern Recognit."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Panboonyuen, T., Vateekul, P., Jitkajornwanich, K., and Lawawirojwong, S. (2017, January 21\u201323). An enhanced deep convolutional encoder-decoder network for road segmentation on aerial imagery. Proceedings of the International Conference on Computing and Information Technology 2017, Helsinki, Finland.","DOI":"10.1007\/978-3-319-60663-7_18"},{"key":"ref_11","unstructured":"Clevert, D.A., Unterthiner, T., and Hochreiter, S. (2015). Fast and accurate deep network learning by exponential linear units (elus). arXiv."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"2481","DOI":"10.1109\/TPAMI.2016.2644615","article-title":"Segnet: A deep convolutional encoder-decoder architecture for image segmentation","volume":"39","author":"Badrinarayanan","year":"2017","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"474","DOI":"10.1109\/LGRS.2018.2795531","article-title":"Fully convolutional networks for semantic segmentation of very high resolution remotely sensed images combined with DSM","volume":"15","author":"Sun","year":"2018","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"131814","DOI":"10.1109\/ACCESS.2020.3009976","article-title":"A New Multi-Channel Deep Convolutional Neural Network for Semantic Segmentation of Remote Sensing Image","volume":"8","author":"Liu","year":"2020","journal-title":"IEEE Access"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"146627","DOI":"10.1109\/ACCESS.2020.3015587","article-title":"Deep Attention and Multi-Scale Networks for Accurate Remote Sensing Image Segmentation","volume":"8","author":"Qi","year":"2020","journal-title":"IEEE Access"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Li, J., Xiu, J., Yang, Z., and Liu, C. (2020). Dual Path Attention Net for Remote Sensing Semantic Image Segmentation. ISPRS Int. J. Geo-Inf., 9.","DOI":"10.3390\/ijgi9100571"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"156","DOI":"10.1016\/j.ins.2020.05.062","article-title":"Global Context based Automatic Road Segmentation via Dilated Convolutional Neural Network","volume":"535","author":"Lan","year":"2020","journal-title":"Inf. Sci."},{"key":"ref_18","first-page":"140305","article-title":"Hybrid first and second order attention Unet for building segmentation in remote sensing images","volume":"63","author":"He","year":"2020","journal-title":"Inf. Sci."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"2417","DOI":"10.1109\/TIFS.2020.2969552","article-title":"Multi-stage Feature Constraints Learning for Age Estimation","volume":"15","author":"Xia","year":"2020","journal-title":"IEEE Trans. Inf. Forensics Secur."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Wang, P., Chen, P., Yuan, Y., Liu, D., Huang, Z., Hou, X., and Cottrell, G. (2018, January 12\u201315). Understanding convolution for semantic segmentation. Proceedings of the 2018 IEEE Winter Conference on Applications of Computer Vision (WACV), Lake Tahoe, NV, USA.","DOI":"10.1109\/WACV.2018.00163"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27\u201330). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_22","unstructured":"Simonyan, K., and Zisserman, A. (2014). Very deep convolutional networks for large-scale image recognition. arXiv."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., and Rabinovich, A. (2015, January 7\u201312). Going deeper with convolutions. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298594"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"113669","DOI":"10.1016\/j.eswa.2020.113669","article-title":"Non-intrusive load disaggregation based on composite deep long short-term memory network","volume":"160","author":"Xia","year":"2020","journal-title":"Expert Syst. Appl."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Xie, E., Wang, W., Wang, W., Sun, P., Xu, H., Liang, D., and Luo, P. (2021). Segmenting transparent object in the wild with transformer. arXiv.","DOI":"10.24963\/ijcai.2021\/165"},{"key":"ref_26","unstructured":"Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., and Gelly, S. (2020). An image is worth 16x16 words: Transformers for image recognition at scale. arXiv."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Carion, N., Massa, F., Synnaeve, G., Usunier, N., Kirillov, A., and Zagoruyko, S. (2020, January 23\u201328). End-to-end object detection with transformers. Proceedings of the European Conference on Computer Vision, Glasgow, UK.","DOI":"10.1007\/978-3-030-58452-8_13"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Zheng, S., Lu, J., Zhao, H., Zhu, X., Luo, Z., Wang, Y., Fu, Y., Feng, J., Xiang, T., and Torr, P.H.S. (2020). Rethinking Semantic Segmentation from a Sequence-to-Sequence Perspective with Transformers. arXiv.","DOI":"10.1109\/CVPR46437.2021.00681"},{"key":"ref_29","unstructured":"Vaswani, A., Shazeer, N., and Parmar, N. (2017). Attention is all you need. Advances in Neural Information Processing Systems, Curran Associates Inc."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"6054","DOI":"10.1109\/TGRS.2017.2719738","article-title":"Learning aerial image segmentation from online maps","volume":"55","author":"Kaiser","year":"2017","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_31","first-page":"4","article-title":"ISPRS Semantic Labeling Contest","volume":"1","author":"Rottensteiner","year":"2014","journal-title":"ISPRS"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Long, J., Shelhamer, E., and Darrell, T. (2015, January 7\u201312). Fully convolutional networks for semantic segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298965"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Ronneberger, O., Fischer, P., and Brox, T. (2015, January 5\u20139). U-net: Convolutional networks for biomedical image segmentation. Proceedings of the International Conference on Medical Image Computing and Computer-Assisted Intervention, Munich, Germany.","DOI":"10.1007\/978-3-319-24574-4_28"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Zhao, H., Shi, J., Qi, X., Wang, X., and Jia, J. (2017, January 21\u201326). Pyramid scene parsing network. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition(ECCV), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.660"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Chen, L.C., Zhu, Y., Papandreou, G., Schroff, F., and Adam, H. (2018, January 8\u201314). Encoder-decoder with atrous separable convolution for semantic image segmentation. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.","DOI":"10.1007\/978-3-030-01234-2_49"}],"container-title":["ISPRS International Journal of Geo-Information"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2220-9964\/11\/3\/165\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T22:27:09Z","timestamp":1760135229000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2220-9964\/11\/3\/165"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,2,25]]},"references-count":35,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2022,3]]}},"alternative-id":["ijgi11030165"],"URL":"https:\/\/doi.org\/10.3390\/ijgi11030165","relation":{},"ISSN":["2220-9964"],"issn-type":[{"value":"2220-9964","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,2,25]]}}}