{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,7]],"date-time":"2026-07-07T17:06:57Z","timestamp":1783444017230,"version":"3.54.6"},"reference-count":40,"publisher":"MDPI AG","issue":"18","license":[{"start":{"date-parts":[[2020,9,4]],"date-time":"2020-09-04T00:00:00Z","timestamp":1599177600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100010014","name":"Six Talent Peaks Project in Jiangsu Province","doi-asserted-by":"publisher","award":["XYDXX-098"],"award-info":[{"award-number":["XYDXX-098"]}],"id":[{"id":"10.13039\/501100010014","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["41971414;41671454"],"award-info":[{"award-number":["41971414;41671454"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>The up-to-date and information-accurate road database plays a significant role in many applications. Recently, with the improvement in image resolutions and quality, remote sensing images have provided an important data source for road extraction tasks. However, due to the topology variations, spectral diversities, and complex scenarios, it is still challenging to realize fully automated and highly accurate road extractions from remote sensing images. This paper proposes a novel dual-attention capsule U-Net (DA-CapsUNet) for road region extraction by combining the advantageous properties of capsule representations and the powerful features of attention mechanisms. By constructing a capsule U-Net architecture, the DA-CapsUNet can extract and fuse multiscale capsule features to recover a high-resolution and semantically strong feature representation. By designing the multiscale context-augmentation and two types of feature attention modules, the DA-CapsUNet can exploit multiscale contextual properties at a high-resolution perspective and generate an informative and class-specific feature encoding. Quantitative evaluations on a large dataset showed that the DA-CapsUNet provides a competitive road extraction performance with a precision of 0.9523, a recall of 0.9486, and an F-score of 0.9504, respectively. Comparative studies with eight recently developed deep learning methods also confirmed the applicability and superiority or compatibility of the DA-CapsUNet in road extraction tasks.<\/jats:p>","DOI":"10.3390\/rs12182866","type":"journal-article","created":{"date-parts":[[2020,9,4]],"date-time":"2020-09-04T11:24:24Z","timestamp":1599218664000},"page":"2866","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":69,"title":["DA-CapsUNet: A Dual-Attention Capsule U-Net for Road Extraction from Remote Sensing Imagery"],"prefix":"10.3390","volume":"12","author":[{"given":"Yongfeng","family":"Ren","sequence":"first","affiliation":[{"name":"School of Energy and Power Engineering, Nanjing Institute of Technology, Nanjing 211167, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7204-9346","authenticated-orcid":false,"given":"Yongtao","family":"Yu","sequence":"additional","affiliation":[{"name":"Faculty of Computer and Software Engineering, Huaiyin Institute of Technology, Huaian 223003, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Haiyan","family":"Guan","sequence":"additional","affiliation":[{"name":"School of Remote Sensing and Geomatics Engineering, Nanjing University of Information Science and Technology, Nanjing 210044, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2020,9,4]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"166","DOI":"10.1016\/j.isprsjprs.2019.04.015","article-title":"Deep learning in remote sensing applications: A meta-analysis and review","volume":"152","author":"Ma","year":"2019","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"3735","DOI":"10.1109\/JSTARS.2020.3005403","article-title":"Remote sensing image scene classification meets deep learning: Challenges, methods, benchmarks, and opportunities","volume":"13","author":"Cheng","year":"2020","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Abdollahi, A., Pradhan, B., Shukla, N., Chakraborty, S., and Alamri, A. (2020). Deep learning approaches applied to remote sensing datasets for road extraction: A state-of-the-art review. Remote Sens., 12.","DOI":"10.3390\/rs12091444"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"173377","DOI":"10.1109\/ACCESS.2019.2956725","article-title":"Multiscale residual convolution neural network and sector descriptor-based road detection method","volume":"7","author":"Dai","year":"2019","journal-title":"IEEE Access"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"151764","DOI":"10.1109\/ACCESS.2019.2928882","article-title":"Dense refinement residual network for road extraction from aerial imagery data","volume":"7","author":"Eerapu","year":"2019","journal-title":"IEEE Access"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"613","DOI":"10.1109\/LGRS.2018.2878771","article-title":"Road segmentation based on hybrid convolutional network for high-resolution visible remote sensing image","volume":"16","author":"Li","year":"2019","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"2043","DOI":"10.1109\/TGRS.2018.2870871","article-title":"RoadNet: Learning to comprehensively analyze road networks in complex urban scenes from high-resolution remotely sensed images","volume":"57","author":"Liu","year":"2019","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"155","DOI":"10.1016\/j.isprsjprs.2019.10.001","article-title":"Spatial information inference net: Road extraction using road-specific contextual information","volume":"158","author":"Tao","year":"2019","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Senthilnath, J., Varia, N., Dokania, A., Anand, G., and Benediktsson, J.A. (2020). Deep TEC: Deep transfer learning with ensemble classifier for road extraction from UAV imagery. Remote Sens., 12.","DOI":"10.3390\/rs12020245"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"39401","DOI":"10.1109\/ACCESS.2018.2856088","article-title":"An end-to-end neural network for road extraction from remote sensing imagery by multiple feature pyramid network","volume":"6","author":"Gao","year":"2018","journal-title":"IEEE Access"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Zhang, X., Ma, W., Li, C., Wu, J., Tang, X., and Jiao, L. (2019). Fully convolutional network-based ensemble method for road extraction from aerial images. IEEE Geosci. Remote Sens. Lett.","DOI":"10.1109\/LGRS.2019.2953523"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"He, H., Yang, D., Wang, S., Wang, S., and Li, Y. (2019). Road extraction by using atrous spatial pyramid pooling integrated encoder-decoder network and structural similarity loss. Remote Sens., 11.","DOI":"10.3390\/rs11091015"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Tan, X., Xiao, Z., Wan, Q., and Shao, W. (2020). Scale sensitive neural network for road segmentation in high-resolution remote sensing images. IEEE Geosci. Remote Sens. Lett.","DOI":"10.1109\/LGRS.2020.2976551"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Zhang, Z., and Wang, Y. (2019). JointNet: A common neural network for road and building extraction. Remote Sens., 11.","DOI":"10.3390\/rs11060696"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Xin, J., Zhang, X., Zhang, Z., and Fang, W. (2019). Road extraction of high-resolution remote sensing images derived from DenseUNet. Remote Sens., 11.","DOI":"10.3390\/rs11212499"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"7209","DOI":"10.1109\/TGRS.2019.2912301","article-title":"Road detection and centerline extraction via deep recurrent convolutional neural network U-Net","volume":"57","author":"Yang","year":"2019","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Zhang, Y., Xiong, Z., Zang, Y., Wang, C., Li, J., and Li, X. (2019). Topology-aware road network extraction via multi-supervised generative adversarial networks. Remote Sens., 11.","DOI":"10.3390\/rs11091017"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Zhang, X., Han, X., Li, C., Tang, X., Zhou, H., and Jiao, L. (2019). Aerial image road extraction based on an improved generative adversarial network. Remote Sens., 11.","DOI":"10.3390\/rs11080930"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"1905","DOI":"10.1109\/JSTARS.2020.2983788","article-title":"DeepWindow: Sliding window based on deep learning for road extraction from remote sensing images","volume":"13","author":"Lian","year":"2020","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Wang, S., Yang, H., Wu, Q., Zheng, Z., Wu, Y., and Li, J. (2020). An improved method for road extraction from high-resolution remote-sensing images that enhances boundary information. Sensors, 20.","DOI":"10.3390\/s20072064"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Hinton, G.E., Krizhevsky, A., and Wang, S.D. (2011). Transforming auto-encoders. Lecture Notes in Computer Science, Proceedings of the International Conference on Artificial Neural Networks \u2013 ICANN 2011, Espoo, Finland, 14\u201317 June 2011, Springer.","DOI":"10.1007\/978-3-642-21735-7_6"},{"key":"ref_22","unstructured":"Sabour, S., Frosst, N., and Hinton, G.E. (2017, January 4\u201310). Dynamic routing between capsules. Proceedings of the 31st Conference on Neural Information Processing Systems, Long Beach, CA, USA."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"1894","DOI":"10.1109\/LGRS.2019.2912582","article-title":"Vehicle detection from high-resolution remote sensing imagery using convolutional capsule networks","volume":"16","author":"Yu","year":"2019","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Gao, Y., Gao, F., Dong, J., and Li, H.C. (2020). SAR image change detection based on multiscale capsule network. IEEE Geosci. Remote Sens. Lett.","DOI":"10.1109\/LGRS.2020.2977838"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Ma, L., Li, Y., Li, J., Yu, Y., Junior, J.M., Gon\u00e7alves, W.N., and Chapman, M.A. (2020). Capsule-based networks for road marking extraction and classification from mobile LiDAR point clouds. IEEE Trans. Intell. Transp. Syst.","DOI":"10.1109\/TITS.2020.2990120"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"1067","DOI":"10.1109\/LGRS.2019.2939354","article-title":"A convolutional capsule network for traffic-sign recognition using mobile LiDAR data with digital images","volume":"17","author":"Guan","year":"2020","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"2145","DOI":"10.1109\/TGRS.2018.2871782","article-title":"Capsule networks for hyperspectral image classification","volume":"57","author":"Paoletti","year":"2019","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Xu, Q., Wang, D.Y., and Luo, B. (2020). Faster multiscale capsule network with octave convolution for hyperspectral image classification. IEEE Geosci. Remote Sens. Lett.","DOI":"10.1109\/LGRS.2020.2970079"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"1263","DOI":"10.1109\/LGRS.2019.2940505","article-title":"A hybrid capsule network for land cover classification using multispectral LiDAR data","volume":"17","author":"Yu","year":"2020","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_30","unstructured":"LaLonde, R., and Bagci, U. (2018, January 4\u20136). Capsules for object segmentation. Proceedings of the 1st Conference on Medical Imaging with Deep Learning, Amsterdam, The Netherlands."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Yu, Y., Ren, Y., Guan, H., Li, D., Yu, C., Jin, S., and Wang, L. (2020). Capsule feature pyramid network for building footprint extraction from high-resolution aerial imagery. IEEE Geosci. Remote Sens. Lett.","DOI":"10.1109\/LGRS.2020.2986380"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"70874","DOI":"10.1109\/ACCESS.2018.2881280","article-title":"Capsules based Chinese word segmentation for ancient Chinese medical books","volume":"6","author":"Li","year":"2018","journal-title":"IEEE Access"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Ma, X., Zhong, H., Li, Y., Ma, J., Cui, Z., and Wang, Y. (2020). Forecasting transportation network speed using deep capsule networks with nested LSTM models. IEEE Trans. Intell. Transp. Syst.","DOI":"10.1109\/TITS.2020.2984813"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"143114","DOI":"10.1109\/ACCESS.2020.3014506","article-title":"Multi-element hierarchical attention capsule network for stock prediction","volume":"8","author":"Liu","year":"2020","journal-title":"IEEE Access"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"9751","DOI":"10.1109\/ACCESS.2020.2964292","article-title":"Image super-resolution using capsule neural networks","volume":"8","author":"Hsu","year":"2020","journal-title":"IEEE Access"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"37014","DOI":"10.1109\/ACCESS.2020.2973711","article-title":"A sentiment analysis method of capsule network based on BiLSTM","volume":"8","author":"Dong","year":"2020","journal-title":"IEEE Access"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"6466","DOI":"10.1109\/TII.2020.2964117","article-title":"A robust weight-shared capsule network for intelligent machinery fault diagnosis","volume":"16","author":"Huang","year":"2020","journal-title":"IEEE Trans. Indust. Inform."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Rajasegaran, J., Jayasundara, V., Jayasekara, S., Jayasekara, H., Seneviratne, S., and Rodrigo, R. (2019, January 16\u201320). DeepCaps: Going deeper with capsule networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.01098"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"834","DOI":"10.1109\/TPAMI.2017.2699184","article-title":"Deeplab: Semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected CRFs","volume":"40","author":"Chen","year":"2018","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"318","DOI":"10.1109\/TPAMI.2018.2858826","article-title":"Focal loss for dense object detection","volume":"42","author":"Lin","year":"2020","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/12\/18\/2866\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T10:06:37Z","timestamp":1760177197000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/12\/18\/2866"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,9,4]]},"references-count":40,"journal-issue":{"issue":"18","published-online":{"date-parts":[[2020,9]]}},"alternative-id":["rs12182866"],"URL":"https:\/\/doi.org\/10.3390\/rs12182866","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,9,4]]}}}