{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,19]],"date-time":"2026-05-19T14:47:52Z","timestamp":1779202072183,"version":"3.51.4"},"reference-count":39,"publisher":"MDPI AG","issue":"16","license":[{"start":{"date-parts":[[2021,8,9]],"date-time":"2021-08-09T00:00:00Z","timestamp":1628467200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["41801356"],"award-info":[{"award-number":["41801356"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100012166","name":"National Key Research and Development Program of China","doi-asserted-by":"publisher","award":["2018YFC1505100"],"award-info":[{"award-number":["2018YFC1505100"]}],"id":[{"id":"10.13039\/501100012166","id-type":"DOI","asserted-by":"publisher"}]},{"name":"China Academy of Railway Sciences Fund","award":["2019YJ028"],"award-info":[{"award-number":["2019YJ028"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Road detection from images has emerged as an important way to obtain road information, thereby gaining much attention in recent years. However, most existing methods only focus on extracting road information from single temporal intensity images, which may cause a decrease in image resolution due to the use of spatial filter methods to avoid coherent speckle noises. Some newly developed methods take into account the multi-temporal information in the preprocessing stage to filter the coherent speckle noise in the SAR imagery. They ignore the temporal characteristic of road objects such as the temporal consistency for the road objects in the multitemporal SAR images that cover the same area and are taken at adjacent times, causing the limitation in detection performance. In this paper, we propose a multiscale and multitemporal network (MSMTHRNet) for road detection from SAR imagery, which contains the temporal consistency enhancement module (TCEM) and multiscale fusion module (MSFM) that are based on attention mechanism. In particular, we propose the TCEM to make full use of multitemporal information, which contains temporal attention submodule that applies attention mechanism to capture temporal contextual information. We enforce temporal consistency constraint by the TCEM to obtain the enhanced feature representations of SAR imagery that help to distinguish the real roads. Since the width of roads are various, incorporating multiscale features is a promising way to improve the results of road detection. We propose the MSFM that applies learned weights to combine predictions of different scale features. Since there is no public dataset, we build a multitemporal road detection dataset to evaluate our methods. State-of-the-art semantic segmentation network HRNetV2 is used as a baseline method to compare with MSHRNet that only has MSFM and the MSMTHRNet. The MSHRNet(TAF) whose input is the SAR image after the temporal filter is adopted to compare with our proposed MSMTHRNet. On our test dataset, MSHRNet and MSMTHRNet improve over the HRNetV2 by 2.1% and 14.19%, respectively, in the IoU metric and by 3.25% and 17.08%, respectively, in the APLS metric. MSMTHRNet improves over the MSMTHRNet(TAF) by 8.23% and 8.81% in the IoU metric and APLS metric, respectively.<\/jats:p>","DOI":"10.3390\/rs13163149","type":"journal-article","created":{"date-parts":[[2021,8,9]],"date-time":"2021-08-09T09:03:53Z","timestamp":1628499833000},"page":"3149","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":6,"title":["Multiscale and Multitemporal Road Detection from High Resolution SAR Images Using Attention Mechanism"],"prefix":"10.3390","volume":"13","author":[{"given":"Xiaochen","family":"Wei","sequence":"first","affiliation":[{"name":"Key Laboratory of Technology in Geo-Spatial Information Processing and Application System, Chinese Academy of Sciences, Beijing 100190, China"},{"name":"Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing 100094, China"},{"name":"School of Electronic, Electrical and Communication Engineering, University of Chinese Academy of Sciences, Beijing 100049, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xikai","family":"Fu","sequence":"additional","affiliation":[{"name":"Key Laboratory of Technology in Geo-Spatial Information Processing and Application System, Chinese Academy of Sciences, Beijing 100190, China"},{"name":"Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing 100094, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ye","family":"Yun","sequence":"additional","affiliation":[{"name":"Key Laboratory of Technology in Geo-Spatial Information Processing and Application System, Chinese Academy of Sciences, Beijing 100190, China"},{"name":"Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing 100094, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xiaolei","family":"Lv","sequence":"additional","affiliation":[{"name":"Key Laboratory of Technology in Geo-Spatial Information Processing and Application System, Chinese Academy of Sciences, Beijing 100190, China"},{"name":"Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing 100094, China"},{"name":"School of Electronic, Electrical and Communication Engineering, University of Chinese Academy of Sciences, Beijing 100049, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2021,8,9]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"3359","DOI":"10.1109\/TGRS.2013.2272593","article-title":"An Integrated Method for Urban Main-Road Centerline Extraction From Optical Remotely Sensed Imagery","volume":"52","author":"Shi","year":"2014","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"807","DOI":"10.1109\/TGRS.2009.2037919","article-title":"Automatic Extraction of Traffic Flows Using TerraSAR-X Along-Track Interferometry","volume":"48","author":"Suchandt","year":"2010","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"4772","DOI":"10.1109\/JSTARS.2014.2340394","article-title":"A New Region Growing-Based Method for Road Network Extraction and Its Application on Different Resolution SAR Images","volume":"7","author":"Lu","year":"2015","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Li, Y., Zhang, R., and Wu, Y. (2017, January 23\u201328). Road network extraction in high-resolution SAR images based CNN features. Proceedings of the 2017 IEEE International Geoscience and Remote Sensing Symposium (IGARSS), Fort Worth, TX, USA.","DOI":"10.1109\/IGARSS.2017.8127293"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Xu, R., He, C., Liu, X., Dong, C., and Qin, Q. (2017). Bayesian Fusion of Multi-Scale Detectors for Road Extraction from SAR Images. Int. J. Geo-Inform., 6.","DOI":"10.3390\/ijgi6010026"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"434","DOI":"10.1109\/36.662728","article-title":"Detection of linear features in SAR images: Application to road network extraction","volume":"36","author":"Tupin","year":"1998","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"1867","DOI":"10.1109\/LGRS.2018.2864342","article-title":"Road Segmentation in SAR Satellite Images with Deep Fully Convolutional Neural Networks","volume":"15","author":"Henry","year":"2018","journal-title":"IEEE Trans. Geosci. Remote Sens. Lett."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Wei, X., Lv, X., and Zhang, K. (2021). Road Extraction in SAR Images Using Ordinal Regression and Road-Topology Loss. Remote Sens., 13.","DOI":"10.3390\/rs13112080"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"3611","DOI":"10.1109\/TGRS.2017.2677260","article-title":"Application of Multitemporal InSAR Covariance and Information Fusion to Robust Road Extraction","volume":"99","author":"Jiang","year":"2017","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"2962","DOI":"10.1109\/TGRS.2006.877289","article-title":"Junction-aware extraction and regularization of urban road networks in high-resolution SAR images","volume":"44","author":"Negri","year":"2006","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"2405","DOI":"10.1109\/TGRS.2002.803732","article-title":"Road detection in dense urban areas using SAR imagery and the usefulness of multiple views","volume":"40","author":"Tupin","year":"2002","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_12","unstructured":"He, C., Bo, S., Zhang, Y., Xu, X., and Liao, M.S. (2014, January 13\u201318). Road extraction for SAR imagery based on the combination of beamlet and a selected kernel. Proceedings of the Geoscience and Remote Sensing Symposium, Quebec City, QC, Canada."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"3322","DOI":"10.1109\/TGRS.2017.2669341","article-title":"Automatic Road Detection and Centerline Extraction via Cascaded End-to-End Convolutional Neural Network","volume":"55","author":"Cheng","year":"2017","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"7209","DOI":"10.1109\/TGRS.2019.2912301","article-title":"Road Detection and Centerline Extraction Via Deep Recurrent Convolutional Neural Network U-Net","volume":"57","author":"Yang","year":"2019","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"8919","DOI":"10.1109\/TGRS.2020.2991733","article-title":"Simultaneous Road Surface and Centerline Extraction From Large-Scale Remote Sensing Images Using CNN-Based Segmentation and Tracing","volume":"58","author":"Wei","year":"2020","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"640","DOI":"10.1109\/TPAMI.2016.2572683","article-title":"Fully Convolutional Networks for Semantic Segmentation","volume":"39","author":"Shelhamer","year":"2017","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Buslaev, A., Seferbekov, S., Iglovikov, V., and Shvets, A. (2018, January 18\u201322). Fully Convolutional Network for Automatic Road Extraction from Satellite Imagery. Proceedings of the 2018 IEEE\/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Salt Lake City, UT, USA.","DOI":"10.1109\/CVPRW.2018.00035"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Han, X., Lu, J., Zhao, C., and Li, H. (2018, January 21\u201325). Fully Convolutional Neural Networks for Road Detection with Multiple Cues Integration. Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), Brisbane, QLD, Australia.","DOI":"10.1109\/ICRA.2018.8460663"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Navab, N., Hornegger, J., Wells, W.M., and Frangi, A.F. (2015). U-Net: Convolutional Networks for Biomedical Image Segmentation. Medical Image Computing and Computer-Assisted Intervention\u2014MICCAI 2015, Springer International Publishing.","DOI":"10.1007\/978-3-319-24553-9"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"749","DOI":"10.1109\/LGRS.2018.2802944","article-title":"Road Extraction by Deep Residual U-Net","volume":"15","author":"Zhang","year":"2018","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Sun, T., Chen, Z., Yang, W., and Wang, Y. (2018, January 18\u201322). Stacked U-Nets with Multi-Output for Road Extraction. Proceedings of the 2018 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Salt Lake City, UT, USA.","DOI":"10.1109\/CVPRW.2018.00033"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"94","DOI":"10.1016\/j.isprsjprs.2020.01.013","article-title":"ResUNet-a: A deep learning framework for semantic segmentation of remotely sensed data","volume":"162","author":"Diakogiannis","year":"2020","journal-title":"ISPRS J. Photogram. Remote Sens."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"9362","DOI":"10.1109\/TGRS.2019.2926397","article-title":"Multi-Scale and Multi-Task Deep Learning Framework for Automatic Road Extraction","volume":"57","author":"Lu","year":"2019","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Zhou, L., Zhang, C., and Wu, M. (2018, January 18\u201322). D-LinkNet: LinkNet with Pretrained Encoder and Dilated Convolution for High Resolution Satellite Imagery Road Extraction. Proceedings of the 2018 IEEE\/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Salt Lake City, UT, USA.","DOI":"10.1109\/CVPRW.2018.00034"},{"key":"ref_25","first-page":"1","article-title":"MSACon: Mining Spatial Attention-Based Contextual Information for Road Extraction","volume":"99","author":"Xu","year":"2021","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"2043","DOI":"10.1109\/TGRS.2018.2870871","article-title":"RoadNet: Learning to Comprehensively Analyze Road Networks in Complex Urban Scenes From High-Resolution Remotely Sensed Images","volume":"57","author":"Liu","year":"2019","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"1292","DOI":"10.1109\/36.763290","article-title":"Fuzzy fusion techniques for linear features detection in multitemporal SAR images","volume":"37","author":"Chanussot","year":"1999","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"755","DOI":"10.1109\/TPAMI.2017.2680444","article-title":"Reconstructing Evolving Tree Structures in Time Lapse Sequences by Enforcing Time-Consistency","volume":"40","author":"Pinheiro","year":"2018","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"8807","DOI":"10.1109\/TGRS.2020.2990978","article-title":"SAR Image Despeckling by Noisy Reference-Based Deep Learning Method","volume":"58","author":"Ma","year":"2020","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Lu, X., Zhong, Y., and Zhao, J. (August, January 28). Multi-Scale Enhanced Deep Network for Road Detection. Proceedings of the 2019 IEEE International Geoscience and Remote Sensing Symposium (IGARSS 2019), Yokohama, Japan.","DOI":"10.1109\/IGARSS.2019.8899115"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"173377","DOI":"10.1109\/ACCESS.2019.2956725","article-title":"Multiscale Residual Convolution Neural Network and Sector Descriptor-Based Road Detection Method","volume":"7","author":"Dai","year":"2019","journal-title":"IEEE Access"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Batra, A., Singh, S., Pang, G., Basu, S., Jawahar, C., and Paluri, M. (2019, January 15\u201320). Improved Road Connectivity by Joint Learning of Orientation and Segmentation. Proceedings of the 2019 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.01063"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Wang, J., Sun, K., Cheng, T., Jiang, B., Deng, C., Zhao, Y., Liu, D., Mu, Y., Tan, M., and Wang, X. (2020). Deep High-Resolution Representation Learning for Visual Recognition. IEEE Trans. Pattern Anal. Mach. Intell.","DOI":"10.1109\/TPAMI.2020.2983686"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Huang, Z., Wang, X., Wei, Y., Huang, L., Shi, H., Liu, W., and Huang, T.S. (2020). CCNet: Criss-Cross Attention for Semantic Segmentation. IEEE Trans. Pattern Anal. Mach. Intell., 603\u2013612.","DOI":"10.1109\/ICCV.2019.00069"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Chen, L.C., Yi, Y., Jiang, W., Wei, X., and Yuille, A.L. (2016, January 27\u201330). Attention to Scale: Scale-Aware Semantic Image Segmentation. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.396"},{"key":"ref_36","first-page":"151","article-title":"Evaluation of Automatic Road Extraction","volume":"32","author":"Heipke","year":"1997","journal-title":"Int. Arch. Photogram. Remote Sens."},{"key":"ref_37","unstructured":"Mnih, V., and Hinton, G. (July, January 26). Learning to Label Aerial Images from Noisy Data. Proceedings of the International Conference on Machine Learning, Edinburgh, UK."},{"key":"ref_38","unstructured":"Etten, A.V., Lindenbaum, D., and Bacastow, T.M. (2018). SpaceNet: A Remote Sensing Dataset and Challenge Series. arXiv."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"61","DOI":"10.3141\/2291-08","article-title":"Inferring Road Maps from Global Positioning System Traces: Survey and Comparative Evaluation","volume":"2291","author":"Biagioni","year":"2014","journal-title":"Transp. Res. Rec. J. Transp. Res. Board"}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/13\/16\/3149\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T06:42:58Z","timestamp":1760164978000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/13\/16\/3149"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,8,9]]},"references-count":39,"journal-issue":{"issue":"16","published-online":{"date-parts":[[2021,8]]}},"alternative-id":["rs13163149"],"URL":"https:\/\/doi.org\/10.3390\/rs13163149","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,8,9]]}}}