{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,18]],"date-time":"2026-04-18T16:30:18Z","timestamp":1776529818568,"version":"3.51.2"},"reference-count":57,"publisher":"MDPI AG","issue":"2","license":[{"start":{"date-parts":[[2021,1,12]],"date-time":"2021-01-12T00:00:00Z","timestamp":1610409600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"the National Key Research and Development Program of China","award":["2018YFB0505401"],"award-info":[{"award-number":["2018YFB0505401"]}]},{"name":"the Key Research and Development Program of Yunnan province in China","award":["2018IB023"],"award-info":[{"award-number":["2018IB023"]}]},{"name":"the Research Project from the Ministry of Natural Resources of China under Grant","award":["4201\u2043240100123"],"award-info":[{"award-number":["4201\u2043240100123"]}]},{"name":"the National Natural Science Foundation of China under Grants","award":["41771452, 41771454, 41890820, and 41901340"],"award-info":[{"award-number":["41771452, 41771454, 41890820, and 41901340"]}]},{"name":"the Natural Science Fund of Hubei Province in China under Grant","award":["2018CFA007"],"award-info":[{"award-number":["2018CFA007"]}]},{"name":"National Major Project on High Resolution Earth Observation System","award":["GFZX0403260306"],"award-info":[{"award-number":["GFZX0403260306"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Automatic extraction of the road surface and road centerline from very high-resolution (VHR) remote sensing images has always been a challenging task in the field of feature extraction. Most existing road datasets are based on data with simple and clear backgrounds under ideal conditions, such as images derived from Google Earth. Therefore, the studies on road surface extraction and road centerline extraction under complex scenes are insufficient. Meanwhile, most existing efforts addressed these two tasks separately, without considering the possible joint extraction of road surface and centerline. With the introduction of multitask convolutional neural network models, it is possible to carry out these two tasks simultaneously by facilitating information sharing within a multitask deep learning model. In this study, we first design a challenging dataset using remote sensing images from the GF-2 satellite. The dataset contains complex road scenes with manually annotated images. We then propose a two-task and end-to-end convolution neural network, termed Multitask Road-related Extraction Network (MRENet), for road surface extraction and road centerline extraction. We take features extracted from the road as the condition of centerline extraction, and the information transmission and parameter sharing between the two tasks compensate for the potential problem of insufficient road centerline samples. In the network design, we use atrous convolutions and a pyramid scene parsing pooling module (PSP pooling), aiming to expand the network receptive field, integrate multilevel features, and obtain more abundant information. In addition, we use a weighted binary cross-entropy function to alleviate the background imbalance problem. Experimental results show that the proposed algorithm outperforms several comparative methods in the aspects of classification precision and visual interpretation.<\/jats:p>","DOI":"10.3390\/rs13020239","type":"journal-article","created":{"date-parts":[[2021,1,12]],"date-time":"2021-01-12T20:11:31Z","timestamp":1610482291000},"page":"239","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":72,"title":["MRENet: Simultaneous Extraction of Road Surface and Road Centerline in Complex Urban Scenes from Very High-Resolution Images"],"prefix":"10.3390","volume":"13","author":[{"given":"Zhenfeng","family":"Shao","sequence":"first","affiliation":[{"name":"The State Key Laboratory of Information Engineering in Surveying, Mapping and Remote Sensing, Wuhan University, Wuhan 430079, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5751-3905","authenticated-orcid":false,"given":"Zifan","family":"Zhou","sequence":"additional","affiliation":[{"name":"The State Key Laboratory of Information Engineering in Surveying, Mapping and Remote Sensing, Wuhan University, Wuhan 430079, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4323-382X","authenticated-orcid":false,"given":"Xiao","family":"Huang","sequence":"additional","affiliation":[{"name":"Department of Geosciences, University of Arkansas, Fayetteville, AR 72701, USA"}]},{"given":"Ya","family":"Zhang","sequence":"additional","affiliation":[{"name":"The State Key Laboratory of Information Engineering in Surveying, Mapping and Remote Sensing, Wuhan University, Wuhan 430079, China"}]}],"member":"1968","published-online":{"date-parts":[[2021,1,12]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"623","DOI":"10.1109\/TSMC.1976.4309568","article-title":"Computer Recognition of Roads from Satellite Pictures","volume":"6","author":"Bajcsy","year":"1976","journal-title":"IEEE Trans. Syst. Man Cybern."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"232","DOI":"10.4314\/ejesm.v5i3.3","article-title":"Impact of Road Transport on Agricultural Development: A Nigerian Example","volume":"5","author":"Tunde","year":"2012","journal-title":"Ethiop. J. Environ. Stud. Manag."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/1476-072X-8-24","article-title":"The importance of accurate road data for spatial applications in public health: Customizing a road network","volume":"8","author":"Frizzelle","year":"2009","journal-title":"Int. J. Health Geogr."},{"key":"ref_4","first-page":"271","article-title":"A review of road extraction from remote sensing images","volume":"3","author":"Wang","year":"2016","journal-title":"J. Traffic Transp. Eng."},{"key":"ref_5","first-page":"217","article-title":"Region-based urban road extraction from VHR satellite images using Binary Partition Tree","volume":"44","author":"Li","year":"2016","journal-title":"Int. J. Appl. Earth Obs. Geoinf."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"749","DOI":"10.1109\/LGRS.2018.2802944","article-title":"Road extraction by deep residual u-net","volume":"15","author":"Zhang","year":"2018","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"3906","DOI":"10.1109\/TGRS.2011.2136381","article-title":"Use of salient features for the design of a multistage framework to extract roads from high-resolution multispectral satellite images","volume":"49","author":"Das","year":"2011","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"506","DOI":"10.1080\/01431161.2018.1513666","article-title":"Very high resolution remote sensing image classification with SEEDS-CNN and scale effect analysis for superpixel CNN classification","volume":"40","author":"Lv","year":"2019","journal-title":"Int. J. Remote Sens."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Lv, X., Ming, D., Lu, T., Zhou, K., Wang, M., and Bao, H. (2018). A new method for region-based majority voting CNNs for very high resolution image classification. Remote Sens., 10.","DOI":"10.3390\/rs10121946"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"1382","DOI":"10.1080\/17538947.2018.1512662","article-title":"Challenges and opportunities for the development of MEGACITIES","volume":"12","author":"Li","year":"2019","journal-title":"Int. J. Digit. Earth"},{"key":"ref_11","unstructured":"McKeown, D.M., and Denlinger, J.L. (1988, January 5\u20139). Cooperative methods for road tracking in aerial imagery. Proceedings of the CVPR\u201988: The Computer Society Conference on Computer Vision and Pattern Recognition, Ann Arbor, MI, USA."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"8331","DOI":"10.1080\/01431161.2010.540587","article-title":"Semi-automatic road tracking by template matching and distance transformation in Urban areas","volume":"32","author":"Zhang","year":"2011","journal-title":"Int. J. Remote Sens."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"819","DOI":"10.1007\/s12524-013-0295-y","article-title":"Road Detection from Optical Remote Sensing Imagery Using Circular Projection Matching and Tracking Strategy","volume":"41","author":"Fu","year":"2013","journal-title":"J. Indian Soc. Remote Sens."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"60","DOI":"10.1061\/(ASCE)0887-3801(2000)14:1(60)","article-title":"Automatic Road Detection in Grayscale Aerial Images","volume":"14","author":"Treash","year":"2000","journal-title":"J. Comput. Civ. Eng."},{"key":"ref_15","first-page":"189","article-title":"Efficient Computation of Greyscale Path Openings","volume":"1","author":"Schubert","year":"2016","journal-title":"Math. Morphol. Theory Appl."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Maboudi, M., Amini, J., Hahn, M., and Saati, M. (2016). Road network extraction from VHR satellite images using context aware object feature integration and tensor voting. Remote Sens., 8.","DOI":"10.3390\/rs8080637"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"259","DOI":"10.1049\/iet-cvi.2014.0103","article-title":"Perceptual grouping by tensor voting: A comparative survey of recent approaches","volume":"9","author":"Maggiori","year":"2015","journal-title":"IET Comput. Vis."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"245","DOI":"10.1016\/j.isprsjprs.2017.02.008","article-title":"Hierarchical graph-based segmentation for extracting road networks from high-resolution satellite images","volume":"126","author":"Alshehhi","year":"2017","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_19","first-page":"106","article-title":"Automatic Road Extraction Based On Multi-Scale Modeling, Context, And Snakes","volume":"32","author":"Mayer","year":"1997","journal-title":"Int. Arch. Photogramm. Remote Sens."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"215","DOI":"10.1006\/dspr.1998.0322","article-title":"Automatic road extraction from aerial images","volume":"8","author":"Trinder","year":"1998","journal-title":"Digit. Signal Process. Rev. J."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"239","DOI":"10.1134\/S1054661806020118","article-title":"Automated extraction of road network from medium-and high-resolution images","volume":"16","author":"Zanin","year":"2006","journal-title":"Pattern Recognit. Image Anal."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"9014","DOI":"10.3390\/rs6099014","article-title":"Automatic road centerline extraction from imagery using road GPS data","volume":"6","author":"Cao","year":"2014","journal-title":"Remote Sens."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Liu, W., Zhang, Z., Li, S., and Tao, D. (2017). Road detection by using a generalized hough transform. Remote Sens., 9.","DOI":"10.3390\/rs9060590"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Mnih, V., and Hinton, G.E. (2010). Learning to Detect Roads in High-Resolution Aerial Images. European Conference on Computer Vision, Springer.","DOI":"10.1007\/978-3-642-15567-3_16"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"709","DOI":"10.1109\/LGRS.2017.2672734","article-title":"Road Structure Refined CNN for Road Extraction in Aerial Image","volume":"14","author":"Wei","year":"2017","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Ronneberger, O., Fischer, P., and Brox, T. (2015). U-net: Convolutional networks for biomedical image segmentation. International Conference on Medical Image Computing and Computer-Assisted Intervention, Springer.","DOI":"10.1007\/978-3-319-24574-4_28"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"3322","DOI":"10.1109\/TGRS.2017.2669341","article-title":"Automatic Road Detection and Centerline Extraction via Cascaded End-to-End Convolutional Neural Network","volume":"55","author":"Cheng","year":"2017","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"2043","DOI":"10.1109\/TGRS.2018.2870871","article-title":"RoadNet: Learning to Comprehensively Analyze Road Networks in Complex Urban Scenes from High-Resolution Remotely Sensed Images","volume":"57","author":"Liu","year":"2019","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"9362","DOI":"10.1109\/TGRS.2019.2926397","article-title":"Multi-Scale and Multi-Task Deep Learning Framework for Automatic Road Extraction","volume":"57","author":"Lu","year":"2019","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Batra, A., Singh, S., Pang, G., Basu, S., Jawahar, C.V., and Paluri, M. (2019, January 16\u201320). Improved road connectivity by joint learning of orientation and segmentation. Proceedings of the 32nd IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.01063"},{"key":"ref_31","unstructured":"Qi, J., Tao, C., Wang, H., Tang, Y., and Cui, Z. (August, January 28). Spatial Information Inference Net: Road Extraction Using Road-Specific Contextual Information. Proceedings of the IEEE International Geoscience and Remote Sensing Symposium (IGARSS), Yokohama, Japan."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Zhang, X., Han, X., Li, C., Tang, X., Zhou, H., and Jiao, L. (2019). Aerial image road extraction based on an improved generative adversarial network. Remote Sens., 11.","DOI":"10.3390\/rs11080930"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Liu, B., Wu, H., Wang, Y., and Liu, W. (2015). Main road extraction from ZY-3 grayscale imagery based on directional mathematical morphology and VGI prior knowledge in Urban areas. PLoS ONE, 10.","DOI":"10.1371\/journal.pone.0138071"},{"key":"ref_34","first-page":"95","article-title":"Automatic road-side extraction from large scale imagemaps","volume":"4","author":"Amini","year":"2002","journal-title":"Int. J. Appl. Earth Obs. Geoinf."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Zheng, S., Liu, J., Shi, W.Z., and Zhu, G.X. (2006, January 13\u201316). Road central contour extraction from high resolution satellite image using tensor voting framework. Proceedings of the 5th International Conference on Machine Learning and Cybernetics, Dalian, China.","DOI":"10.1109\/ICMLC.2006.258435"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"583","DOI":"10.1109\/LGRS.2012.2214761","article-title":"Road Centerline Extraction From High-Resolution Imagery Based on Shape Features and Multivariate Adaptive Regression Splines","volume":"10","author":"Miao","year":"2013","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"407","DOI":"10.1016\/j.neucom.2016.04.026","article-title":"Accurate urban road centerline extraction from VHR imagery via multiscale segmentation and tensor voting","volume":"205","author":"Cheng","year":"2016","journal-title":"Neurocomputing"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"545","DOI":"10.1109\/LGRS.2016.2524025","article-title":"Road Centerline Extraction via Semisupervised Segmentation and Multidirection Nonmaximum Suppression","volume":"13","author":"Cheng","year":"2016","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Gao, L., Shi, W., Miao, Z., and Lv, Z. (2018). Method based on edge constraint and fast marching for road centerline extraction from very high-resolution remote sensing images. Remote Sens., 10.","DOI":"10.3390\/rs10060900"},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Zhou, T., Sun, C., and Fu, H. (2019). Road information extraction from high-resolution remote sensing images based on road reconstruction. Remote Sens., 11.","DOI":"10.3390\/rs11010079"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Yujun, W., Xiangyun, H., and Jinqi, G. (2018, January 19\u201320). End-to-end road centerline extraction via learning a confidence map. Proceedings of the 2018 10th IAPR Workshop on Pattern Recognition in Remote Sensing, PRRS 2018, Beijing, China.","DOI":"10.1109\/PRRS.2018.8486185"},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Zhang, Y., Xiong, Z., Zang, Y., Wang, C., Li, J., and Li, X. (2019). Topology-aware road network extraction via Multi-supervised Generative Adversarial Networks. Remote Sens., 11.","DOI":"10.3390\/rs11091017"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"94","DOI":"10.1016\/j.isprsjprs.2020.01.013","article-title":"ResUNet-a: A deep learning framework for semantic segmentation of remotely sensed data","volume":"162","author":"Diakogiannis","year":"2020","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Xia, G.S., Bai, X., Ding, J., Zhu, Z., Belongie, S., Luo, J., Datcu, M., Pelillo, M., and Zhang, L. (2018, January 18\u201323). DOTA: A Large-Scale Dataset for Object Detection in Aerial Images. Proceedings of the 31st IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00418"},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"5535","DOI":"10.1109\/TGRS.2019.2900302","article-title":"Hierarchical and Robust Convolutional Neural Network for Very High-Resolution Remote Sensing Object Detection","volume":"57","author":"Zhang","year":"2019","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Zhang, R., Shao, Z., Huang, X., Wang, J., and Li, D. (2020). Object detection in UAV images via global density fused convolutional network. Remote Sens., 12.","DOI":"10.3390\/rs12193140"},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"310","DOI":"10.1109\/LGRS.2018.2872355","article-title":"Multiscale Visual Attention Networks for Object Detection in VHR Remote Sensing Images","volume":"16","author":"Wang","year":"2019","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"3965","DOI":"10.1109\/TGRS.2017.2685945","article-title":"AID: A benchmark data set for performance evaluation of aerial scene classification","volume":"55","author":"Xia","year":"2017","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Hu, F., Xia, G.S., Yang, W., and Zhang, L. (2018, January 22\u201327). Recent advances and opportunities in scene classification of aerial images with deep models. Proceedings of the International Geoscience and Remote Sensing Symposium (IGARSS), Valencia, Spain.","DOI":"10.1109\/IGARSS.2018.8518336"},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Shao, Z., Tang, P., Wang, Z., Saleem, N., Yam, S., and Sommai, C. (2020). BRRNet: A fully convolutional neural network for automatic building extraction from high-resolution remote sensing images. Remote Sens., 12.","DOI":"10.3390\/rs12061050"},{"key":"ref_51","doi-asserted-by":"crossref","unstructured":"Zhao, H., Shi, J., Qi, X., Wang, X., and Jia, J. (2017, January 21\u201326). Pyramid scene parsing network. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.660"},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"4062","DOI":"10.1109\/TGRS.2018.2889677","article-title":"Cloud detection in remote sensing images based on multiscale features-convolutional neural network","volume":"57","author":"Shao","year":"2019","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_53","doi-asserted-by":"crossref","unstructured":"Qi, K., Liu, W., Yang, C., Guan, Q., and Wu, H. (2017). Multi-task joint sparse and low-rank representation for the scene classification of high-resolution remote sensing image. Remote Sens., 9.","DOI":"10.3390\/rs9010010"},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"41","DOI":"10.1023\/A:1007379606734","article-title":"Multitask Learning","volume":"28","author":"Caruana","year":"1997","journal-title":"Mach. Learn."},{"key":"ref_55","doi-asserted-by":"crossref","unstructured":"Davis, J., and Goadrich, M. (2006, January 25\u201329). The relationship between precision-recall and ROC curves. Proceedings of the ICML 2006: 23rd International Conference on Machine Learning, Pittsburgh, PA, USA.","DOI":"10.1145\/1143844.1143874"},{"key":"ref_56","doi-asserted-by":"crossref","unstructured":"Khryashchev, V., and Larionov, R. (2020, January 11\u201313). Wildfire Segmentation on Satellite Images using Deep Learning. Proceedings of the 2020 Moscow Workshop on Electronic and Networking Technologies, MWENT 2020, Moscow, Russia.","DOI":"10.1109\/MWENT47943.2020.9067475"},{"key":"ref_57","doi-asserted-by":"crossref","unstructured":"Redmon, J., Divvala, S., Girshick, R., and Farhadi, A. (July, January 26). You only look once: Unified, real-time object detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2016), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.91"}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/13\/2\/239\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T05:10:15Z","timestamp":1760159415000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/13\/2\/239"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,1,12]]},"references-count":57,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2021,1]]}},"alternative-id":["rs13020239"],"URL":"https:\/\/doi.org\/10.3390\/rs13020239","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,1,12]]}}}