{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,28]],"date-time":"2026-01-28T08:13:28Z","timestamp":1769588008111,"version":"3.49.0"},"reference-count":59,"publisher":"MDPI AG","issue":"16","license":[{"start":{"date-parts":[[2021,8,12]],"date-time":"2021-08-12T00:00:00Z","timestamp":1628726400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Deep learning techniques have greatly improved the efficiency and accuracy of building extraction using remote sensing images. However, high-quality building outline extraction results that can be applied to the field of surveying and mapping remain a significant challenge. In practice, most building extraction tasks are manually executed. Therefore, an automated procedure of a building outline with a precise position is required. In this study, we directly used the U2-net semantic segmentation model to extract the building outline. The extraction results showed that the U2-net model can provide the building outline with better accuracy and a more precise position than other models based on comparisons with semantic segmentation models (Segnet, U-Net, and FCN) and edge detection models (RCF, HED, and DexiNed) applied for two datasets (Nanjing and Wuhan University (WHU)). We also modified the binary cross-entropy loss function in the U2-net model into a multiclass cross-entropy loss function to directly generate the binary map with the building outline and background. We achieved a further refined outline of the building, thus showing that with the modified U2-net model, it is not necessary to use non-maximum suppression as a post-processing step, as in the other edge detection models, to refine the edge map. Moreover, the modified model is less affected by the sample imbalance problem. Finally, we created an image-to-image program to further validate the modified U2-net semantic segmentation model for building outline extraction.<\/jats:p>","DOI":"10.3390\/rs13163187","type":"journal-article","created":{"date-parts":[[2021,8,12]],"date-time":"2021-08-12T02:40:14Z","timestamp":1628736014000},"page":"3187","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":18,"title":["Building Outline Extraction Directly Using the U2-Net Semantic Segmentation Model from High-Resolution Aerial Images and a Comparison Study"],"prefix":"10.3390","volume":"13","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-2540-0794","authenticated-orcid":false,"given":"Xinchun","family":"Wei","sequence":"first","affiliation":[{"name":"School of Geography, Geomatics and Planning, Jiangsu Normal University, Xuzhou 221116, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3793-1581","authenticated-orcid":false,"given":"Xing","family":"Li","sequence":"additional","affiliation":[{"name":"School of Geography, Geomatics and Planning, Jiangsu Normal University, Xuzhou 221116, China"}]},{"given":"Wei","family":"Liu","sequence":"additional","affiliation":[{"name":"School of Geography, Geomatics and Planning, Jiangsu Normal University, Xuzhou 221116, China"}]},{"given":"Lianpeng","family":"Zhang","sequence":"additional","affiliation":[{"name":"School of Geography, Geomatics and Planning, Jiangsu Normal University, Xuzhou 221116, China"}]},{"given":"Dayu","family":"Cheng","sequence":"additional","affiliation":[{"name":"School of Mining and Geomatics, Hebei University of Engineering, Handan 056038, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7522-6168","authenticated-orcid":false,"given":"Hanyu","family":"Ji","sequence":"additional","affiliation":[{"name":"School of Geography, Geomatics and Planning, Jiangsu Normal University, Xuzhou 221116, China"}]},{"given":"Wenzheng","family":"Zhang","sequence":"additional","affiliation":[{"name":"School of Geography, Geomatics and Planning, Jiangsu Normal University, Xuzhou 221116, China"}]},{"given":"Kai","family":"Yuan","sequence":"additional","affiliation":[{"name":"School of Geography, Geomatics and Planning, Jiangsu Normal University, Xuzhou 221116, China"}]}],"member":"1968","published-online":{"date-parts":[[2021,8,12]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Zhang, Y., Gong, W., Sun, J., and Li, W. (2019). Web-Net: A novel nest networks with ultra-hierarchical sampling for building extraction from aerial imageries. Remote Sens., 11.","DOI":"10.3390\/rs11161897"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"101","DOI":"10.1006\/cviu.1998.0724","article-title":"Building detection and description from a single intensity image","volume":"72","author":"Lin","year":"1998","journal-title":"Comput. Vis. Image Underst."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Awrangjeb, M., Hu, X., Yang, B., and Tian, J. (2020). Editorial for Special Issue: \u201cRemote Sensing based Building Extraction\u201d. Rmote Sens., 12.","DOI":"10.3390\/rs12030549"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"2403","DOI":"10.1109\/TGRS.2009.2038274","article-title":"Earthquake Damage Assessment of Buildings Using VHR Optical and SAR Imagery","volume":"48","author":"Brunner","year":"2010","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Yang, W., Zhang, X., and Luo, P. (2021). Transferability of Convolutional Neural Network Models for Identifying Damaged Buildings Due to Earthquake. Remote Sens., 13.","DOI":"10.3390\/rs13030504"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Rashidian, V., Baise, L.G., and Koch, M. (August, January 28). Detecting Collapsed Buildings After a Natural Hazard on Vhr Optical Satellite Imagery Using U-Net Convolutional Neural Networks. Proceedings of the IGARSS 2019\u20132019 IEEE International Geoscience and Remote Sensing Symposium, Yokohama, Japan.","DOI":"10.1109\/IGARSS.2019.8899121"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"640","DOI":"10.1080\/2150704X.2020.1750729","article-title":"Automatic building detection from very high-resolution images using multiscale morphological attribute profiles","volume":"11","author":"Li","year":"2020","journal-title":"Remote Sens. Lett."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"1199","DOI":"10.1109\/TGRS.2017.2761402","article-title":"Local feature-based attribute profiles for optical remote sensing image classification","volume":"56","author":"Pham","year":"2017","journal-title":"IEEE Trans. Geosc. Remote Sens."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"2991","DOI":"10.1109\/TIP.2019.2893068","article-title":"Nonconvex-Sparsity and Nonlocal-Smoothness-Based Blind Hyperspectral Unmixing","volume":"28","author":"Yao","year":"2019","journal-title":"IEEE Trans. Image Process."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"114","DOI":"10.1016\/j.isprsjprs.2020.10.008","article-title":"An end-to-end shape modeling framework for vectorized building outline generation from aerial images","volume":"170","author":"Chen","year":"2020","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"119","DOI":"10.1016\/j.isprsjprs.2021.02.014","article-title":"Building outline delineation: From aerial images to polygons with an improved end-to-end learning framework","volume":"175","author":"Zhao","year":"2021","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Lu, T., Ming, D., Lin, X., Hong, Z., Bai, X., and Fang, J. (2018). Detecting building edges from high spatial resolution remote sensing imagery using richer convolution features network. Remote Sens., 10.","DOI":"10.3390\/rs10091496"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"2254","DOI":"10.1109\/TGRS.2011.2172995","article-title":"Three-Dimensional Polygonal Building Model Estimation from Single Satellite Images","volume":"50","author":"Izadi","year":"2012","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"487","DOI":"10.1109\/LGRS.2014.2347332","article-title":"An Efficient Approach for Automatic Rectangular Building Extraction from Very High Resolution Optical Satellite Imagery","volume":"12","author":"Wang","year":"2015","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_15","first-page":"58","article-title":"Building extraction from high-resolution optical spaceborne images using the integration of support vector machine (SVM) classification, Hough transformation and perceptual grouping","volume":"34","author":"Turker","year":"2015","journal-title":"Int. J. Appl. Earth Obs. Geoinf."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"133","DOI":"10.1109\/TGRS.2008.2002027","article-title":"Recognition-Driven Two-Dimensional Competing Priors Toward Automatic and Accurate Building Detection","volume":"47","author":"Karantzalos","year":"2009","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_17","first-page":"150","article-title":"Automatic urban building boundary extraction from high resolution aerial images using an innovative model of active contours","volume":"12","author":"Ahmadi","year":"2010","journal-title":"Int. J. Appl. Earth Obs. Geoinf."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"169","DOI":"10.1007\/s12524-017-0694-6","article-title":"Object-Based Rule Sets and Its Transferability for Building Extraction from High Resolution Satellite Imagery","volume":"46","author":"Attarzadeh","year":"2018","journal-title":"J. Indian Soc. Remote Sens."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"706","DOI":"10.1109\/LGRS.2013.2276936","article-title":"Template-Based Hierarchical Building Extraction","volume":"11","author":"Sellaouti","year":"2014","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"541","DOI":"10.1162\/neco.1989.1.4.541","article-title":"Backpropagation applied to handwritten zip code recognition","volume":"1","author":"LeCun","year":"1989","journal-title":"Neural Comput."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27\u201330). Deep Residual Learning for Image Recognition. Proceedings of the Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Pan, Z., Xu, J., Guo, Y., Hu, Y., and Wang, G. (2020). Deep learning segmentation and classification for urban village using a worldview satellite image based on U-Net. Remote Sens., 12.","DOI":"10.3390\/rs12101574"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"645","DOI":"10.1109\/TGRS.2016.2612821","article-title":"Convolutional Neural Networks for Large-Scale Remote-Sensing Image Classification","volume":"55","author":"Maggiori","year":"2017","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_24","first-page":"1097","article-title":"Imagenet classification with deep convolutional neural networks","volume":"25","author":"Krizhevsky","year":"2012","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Girshick, R. (2015, January 7\u201313). Fast r-cnn. Proceedings of the Proceedings of the IEEE International Conference on Computer Vision (ICCV), Santiago, Chile.","DOI":"10.1109\/ICCV.2015.169"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S., Fu, C.-Y., and Berg, A.C. (2016). SSD: Single shot multibox detector. European Conference on Computer Vision, Springer.","DOI":"10.1007\/978-3-319-46448-0_2"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"34","DOI":"10.1016\/j.ins.2018.05.006","article-title":"Efficient saliency detection using convolutional neural networks with feature selection","volume":"456","author":"Cao","year":"2018","journal-title":"Inf. Sci."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"66","DOI":"10.1016\/j.ins.2017.08.050","article-title":"Automated segmentation of exudates, haemorrhages, microaneurysms using single convolutional neural network","volume":"420","author":"Tan","year":"2017","journal-title":"Inf. Sci."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Long, J., Shelhamer, E., and Darrell, T. (2015, January 7\u201312). Fully convolutional networks for semantic segmentation. Proceedings of the Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298965"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Agravat, R.R., and Raval, M.S. (2018). Deep learning for automated brain tumor segmentation in mri images. Soft Computing Based Medical Image Analysis, Elsevier.","DOI":"10.1016\/B978-0-12-813087-2.00010-5"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"3325","DOI":"10.1109\/TGRS.2014.2374218","article-title":"Object detection in optical remote sensing images based on weakly supervised learning and high-level feature learning","volume":"53","author":"Han","year":"2014","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Ronneberger, O., Fischer, P., and Brox, T. (2015). U-Net: Convolutional Networks for Biomedical Image Segmentation. International Conference on Medical Image Computing and Computer-Assisted Intervention, Springer.","DOI":"10.1007\/978-3-319-24574-4_28"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"2481","DOI":"10.1109\/TPAMI.2016.2644615","article-title":"Segnet: A deep convolutional encoder-decoder architecture for image segmentation","volume":"39","author":"Badrinarayanan","year":"2017","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"712","DOI":"10.1109\/JSTARS.2016.2598859","article-title":"Active Deep Learning for Classification of Hyperspectral Images","volume":"10","author":"Liu","year":"2017","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Huang, Z., Cheng, G., Wang, H., Li, H., Shi, L., and Pan, C. (2016, January 10\u201315). Building extraction from multi-source remote sensing images via deep deconvolution neural networks. Proceedings of the 2016 IEEE International Geoscience and Remote Sensing Symposium (IGARSS), Beijing, China.","DOI":"10.1109\/IGARSS.2016.7729471"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"2615","DOI":"10.1109\/JSTARS.2018.2849363","article-title":"Building footprint extraction from VHR remote sensing images combined with normalized DSMs using fused fully convolutional networks","volume":"11","author":"Bittner","year":"2018","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"5966","DOI":"10.1109\/TGRS.2020.3015157","article-title":"Graph Convolutional Networks for Hyperspectral Image Classification","volume":"59","author":"Hong","year":"2021","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Ji, S., Zhang, C., Xu, A., Shi, Y., and Duan, Y. (2018). 3D convolutional neural networks for crop classification with multi-temporal remote sensing images. Remote Sens., 10.","DOI":"10.3390\/rs10010075"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"1915","DOI":"10.1109\/TPAMI.2012.231","article-title":"Learning hierarchical features for scene labeling","volume":"35","author":"Farabet","year":"2012","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Vakalopoulou, M., Karantzalos, K., Komodakis, N., and Paragios, N. (2015, January 26\u201331). Building Detection in Very High Resolution Multispectral Data with Deep Learning Features. Proceedings of the 2015 IEEE International Geoscience and Remote Sensing Symposium (IGARSS), Milan, Italy.","DOI":"10.1109\/IGARSS.2015.7326158"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"94","DOI":"10.1016\/j.isprsjprs.2020.01.013","article-title":"Resunet-a: A deep learning framework for semantic segmentation of remotely sensed data","volume":"162","author":"Diakogiannis","year":"2020","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Li, Y., He, B., Long, T., and Bai, X. (2017, January 23\u201328). Evaluation the performance of fully convolutional networks for building extraction compared with shallow models. Proceedings of the 2017 IEEE International Geoscience and Remote Sensing Symposium (IGARSS), Fort Worth, TX, USA.","DOI":"10.1109\/IGARSS.2017.8127086"},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Liu, P., Liu, X., Liu, M., Shi, Q., Yang, J., Xu, X., and Zhang, Y. (2019). Building Footprint Extraction from High-Resolution Images via Spatial Residual Inception Convolutional Neural Network. Remote Sens., 11.","DOI":"10.3390\/rs11070830"},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Bischke, B., Helber, P., Folz, J., Borth, D., and Dengel, A. (2019, January 22\u201325). Multi-task learning for segmentation of building footprints with deep neural networks. Proceedings of the 2019 IEEE International Conference on Image Processing (ICIP), Taipei, Taiwan.","DOI":"10.1109\/ICIP.2019.8803050"},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"834","DOI":"10.1109\/TPAMI.2017.2699184","article-title":"Deeplab: Semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected crfs","volume":"40","author":"Chen","year":"2017","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_46","unstructured":"Chen, L.-C., Papandreou, G., Kokkinos, I., Murphy, K., and Yuille, A.L. (2014). Semantic image segmentation with deep convolutional nets and fully connected crfs. arXiv."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"906","DOI":"10.1109\/JSTARS.2016.2603184","article-title":"Building extraction from remotely sensed images by integrating saliency cue","volume":"10","author":"Li","year":"2016","journal-title":"IEEE J.Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Shrestha, S., and Vanneschi, L. (2018). Improved fully convolutional network with conditional random fields for building extraction. Remote Sens., 10.","DOI":"10.3390\/rs10071135"},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Liu, Y., Cheng, M.-M., Hu, X., Wang, K., and Bai, X. (2017, January 21\u201326). Richer Convolutional Features for Edge Detection. Proceedings of the Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.622"},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Li, Q., Mou, L., Hua, Y., Sun, Y., Jin, P., Shi, Y., and Zhu, X.X. (October, January 26). Instance Segmentation of Buildings Using Keypoints. Proceedings of the IGARSS 2020\u20142020 IEEE International Geoscience and Remote Sensing Symposium, Waikoloa, HI, USA.","DOI":"10.1109\/IGARSS39084.2020.9324457"},{"key":"ref_51","doi-asserted-by":"crossref","unstructured":"Zorzi, S., Bittner, K., and Fraundorfer, F. (2021, January 10\u201315). Machine-Learned Regularization and Polygonization of Building Segmentation Masks. Proceedings of the 2020 25th International Conference on Pattern Recognition (ICPR), Milan, Italy.","DOI":"10.1109\/ICPR48806.2021.9412866"},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"12","DOI":"10.1016\/j.patcog.2020.107404","article-title":"U-2-Net: Going deeper with nested U-structure for salient object detection","volume":"106","author":"Qin","year":"2020","journal-title":"Pattern Recognit."},{"key":"ref_53","unstructured":"Qin, X.B. (2021, July 15). Available online: https:\/\/github.com\/xuebinqin\/U-2-Net."},{"key":"ref_54","unstructured":"(2021, July 15). Available online: https:\/\/github.com\/ecsplendid\/rembg-greenscreen."},{"key":"ref_55","doi-asserted-by":"crossref","unstructured":"Xie, S., and Tu, Z. (2015, January 7\u201313). Holistically-Nested Edge Detection. Proceedings of the Proceedings of the IEEE International Conference on Computer Vision, Santiago, Chile.","DOI":"10.1109\/ICCV.2015.164"},{"key":"ref_56","unstructured":"Poma, X.S., Riba, E., and Sappa, A. (2020, January 1\u20135). Dense extreme inception network: Towards a robust cnn model for edge detection. Proceedings of the Proceedings of the IEEE\/CVF Winter Conference on Applications of Computer Vision, Snowmass Village, CO, USA."},{"key":"ref_57","doi-asserted-by":"crossref","first-page":"574","DOI":"10.1109\/TGRS.2018.2858817","article-title":"Fully convolutional networks for multisource building extraction from an open aerial and satellite imagery data set","volume":"57","author":"Ji","year":"2018","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_58","doi-asserted-by":"crossref","unstructured":"Zhou, D., Wang, G., He, G., Long, T., Yin, R., Zhang, Z., Chen, S., and Luo, B. (2020). Robust Building Extraction for High Spatial Resolution Remote Sensing Images with Self-Attention Network. Sensors, 20.","DOI":"10.3390\/s20247241"},{"key":"ref_59","doi-asserted-by":"crossref","unstructured":"Zhang, Z., Schwing, A.G., Fidler, S., and Urtasun, R. (2015, January 7\u201313). Monocular object instance segmentation and depth ordering with cnns. Proceedings of the Proceedings of the IEEE International Conference on Computer Vision, Santiago, Chile.","DOI":"10.1109\/ICCV.2015.300"}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/13\/16\/3187\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T06:44:28Z","timestamp":1760165068000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/13\/16\/3187"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,8,12]]},"references-count":59,"journal-issue":{"issue":"16","published-online":{"date-parts":[[2021,8]]}},"alternative-id":["rs13163187"],"URL":"https:\/\/doi.org\/10.3390\/rs13163187","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,8,12]]}}}