{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,13]],"date-time":"2026-04-13T23:44:03Z","timestamp":1776123843083,"version":"3.50.1"},"reference-count":28,"publisher":"MDPI AG","issue":"22","license":[{"start":{"date-parts":[[2021,11,20]],"date-time":"2021-11-20T00:00:00Z","timestamp":1637366400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Deep learning-based models for building delineation from remotely sensed images face the challenge of producing precise and regular building outlines. This study investigates the combination of normalized digital surface models (nDSMs) with aerial images to optimize the extraction of building polygons using the frame field learning method. Results are evaluated at pixel, object, and polygon levels. In addition, an analysis is performed to assess the statistical deviations in the number of vertices of building polygons compared with the reference. The comparison of the number of vertices focuses on finding the output polygons that are the easiest to edit by human analysts in operational applications. It can serve as guidance to reduce the post-processing workload for obtaining high-accuracy building footprints. Experiments conducted in Enschede, the Netherlands, demonstrate that by introducing nDSM, the method could reduce the number of false positives and prevent missing the real buildings on the ground. The positional accuracy and shape similarity was improved, resulting in better-aligned building polygons. The method achieved a mean intersection over union (IoU) of 0.80 with the fused data (RGB + nDSM) against an IoU of 0.57 with the baseline (using RGB only) in the same area. A qualitative analysis of the results shows that the investigated model predicts more precise and regular polygons for large and complex structures.<\/jats:p>","DOI":"10.3390\/rs13224700","type":"journal-article","created":{"date-parts":[[2021,11,21]],"date-time":"2021-11-21T21:00:50Z","timestamp":1637528450000},"page":"4700","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":9,"title":["Building Polygon Extraction from Aerial Images and Digital Surface Models with a Frame Field Learning Framework"],"prefix":"10.3390","volume":"13","author":[{"given":"Xiaoyu","family":"Sun","sequence":"first","affiliation":[{"name":"Faculty of Geo-Information Science and Earth Observation (ITC), University of Twente, 7522 NB Enschede, The Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0265-3465","authenticated-orcid":false,"given":"Wufan","family":"Zhao","sequence":"additional","affiliation":[{"name":"Faculty of Geo-Information Science and Earth Observation (ITC), University of Twente, 7522 NB Enschede, The Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4983-2700","authenticated-orcid":false,"given":"Raian V.","family":"Maretto","sequence":"additional","affiliation":[{"name":"Faculty of Geo-Information Science and Earth Observation (ITC), University of Twente, 7522 NB Enschede, The Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3742-5398","authenticated-orcid":false,"given":"Claudio","family":"Persello","sequence":"additional","affiliation":[{"name":"Faculty of Geo-Information Science and Earth Observation (ITC), University of Twente, 7522 NB Enschede, The Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2021,11,20]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"7212307","DOI":"10.1155\/2018\/7212307","article-title":"Deep Learning Approach for Building Detection Using LiDAR-Orthophoto Fusion","volume":"2018","author":"Nahhas","year":"2018","journal-title":"J. Sens."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"43","DOI":"10.1016\/j.isprsjprs.2007.01.001","article-title":"Data Fusion of High-Resolution Satellite Imagery and LiDAR Data for Automatic Building Extraction","volume":"62","author":"Sohn","year":"2007","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"119","DOI":"10.1016\/j.isprsjprs.2021.02.014","article-title":"Building Outline Delineation: From Aerial Images to Polygons with an Improved End-to-End Learning Framework","volume":"175","author":"Zhao","year":"2021","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_4","unstructured":"Shelhamer, E., Long, J., and Darrell, T. (2015, January 7\u201312). Fully Convolutional Networks for Semantic Segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Shao, Z., Tang, P., Wang, Z., Saleem, N., Yam, S., and Sommai, C. (2020). BRRNet: A Fully Convolutional Neural Network for Automatic Building Extraction from High-Resolution Remote Sensing Images. Remote Sens., 12.","DOI":"10.3390\/rs12061050"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"2178","DOI":"10.1109\/TGRS.2019.2954461","article-title":"Toward Automatic Building Footprint Delineation from Aerial Images Using CNN and Regularization","volume":"58","author":"Wei","year":"2020","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"He, K., Gkioxari, G., Doll\u00e1r, P., and Girshick, R. (2017, January 22\u201329). Mask R-CNN. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.","DOI":"10.1109\/ICCV.2017.322"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Zhang, L., Wu, J., Fan, Y., Gao, H., and Shao, Y. (2020). An Efficient Building Extraction Method from High Spatial Resolution Remote Sensing Images Based on Improved Mask R-CNN. Sensors, 20.","DOI":"10.3390\/s20051465"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Girard, N., Smirnov, D., Solomon, J., and Tarabalka, Y. (2021, January 19\u201325). Polygonal Building Extraction by Frame Field Learning. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Nashville, TN, USA.","DOI":"10.1109\/CVPR46437.2021.00583"},{"key":"ref_10","first-page":"1715","article-title":"Topological Map Extraction from Overhead Images","volume":"Volume 2019","author":"Li","year":"2019","journal-title":"Proceedings of the IEEE International Conference on Computer Vision"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"545","DOI":"10.1111\/cgf.12864","article-title":"Directional Field Synthesis, Design, and Processing","volume":"35","author":"Vaxman","year":"2016","journal-title":"Comput. Graph. Forum"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1016\/j.isprsjprs.2019.02.019","article-title":"Automatic Building Extraction from High-Resolution Aerial Images and LiDAR Data Using Gated Residual Refinement Network","volume":"151","author":"Huang","year":"2019","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Hong, D., Gao, L., Yokoya, N., Yao, J., Chanussot, J., Du, Q., and Zhang, B. (2020). More Diverse Means Better: Multimodal Deep Learning Meets Remote Sensing Imagery Classification. IEEE Trans. Geosci. Remote Sensing.","DOI":"10.1109\/WHISPERS52202.2021.9484057"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Al-Najjar, H.A.H., Kalantar, B., Pradhan, B., Saeidi, V., Halin, A.A., Ueda, N., and Mansor, S. (2019). Land Cover Classification from Fused DSM and UAV Images Using Convolutional Neural Networks. Remote Sens., 11.","DOI":"10.3390\/rs11121461"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"2615","DOI":"10.1109\/JSTARS.2018.2849363","article-title":"Building Footprint Extraction From VHR Remote Sensing Images Combined With Normalized DSMs Using Fused Fully Convolutional Networks","volume":"11","author":"Bittner","year":"2018","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Schuegraf, P., and Bittner, K. (2019). Automatic Building Footprint Extraction from Multi-Resolution Remote Sensing Images Using a Hybrid FCN. ISPRS Int. J. Geo-Inf., 8.","DOI":"10.3390\/ijgi8040191"},{"key":"ref_17","first-page":"234","article-title":"U-Net: Convolutional Networks for Biomedical Image Segmentation","volume":"Volume 9351","author":"Ronneberger","year":"2015","journal-title":"Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)"},{"key":"ref_18","first-page":"1","article-title":"Designing N-Polyvector Fields with Complex Polynomials","volume":"33","author":"Diamanti","year":"2014","journal-title":"Eurograph. Symp. Geom. Process."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"163","DOI":"10.1145\/37402.37422","article-title":"Marching Cubes: A High Resolution 3d Surface Construction Algorithm","volume":"21","author":"Lorensen","year":"1987","journal-title":"Comput. Graph."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Kass, M., and Witkin, A. (1988). Snakes: Active Contour Models, KIuwer Academic Publishers.","DOI":"10.1007\/BF00133570"},{"key":"ref_21","unstructured":"Hashemi, S.R., Sadegh, S., Salehi, M., Erdogmus, D., Prabhu, S.P., Warfield, S.K., Gholipour, A., and Hashemi, S.R. (2018). Tversky as a Loss Function for Highly Unbalanced Image Segmentation Using 3D Fully Convolutional Deep Networks, Springer International Publishing."},{"key":"ref_22","unstructured":"(2019, May 19). Kadaster (The Netherlands\u2019 Cadastre, Land Registry and Mapping Agency). Available online: https:\/\/www.devex.com\/organizations\/the-netherlands-cadastre-land-registry-and-mapping-agency-kadaster-29602."},{"key":"ref_23","unstructured":"(2019, May 19). PDOK (the Public Services On the Map). Available online: https:\/\/www.pdok.nl\/."},{"key":"ref_24","unstructured":"(2019, May 19). AHN ((Het Actueel Hoogtebestand Nederland). Available online: https:\/\/www.ahn.nl\/."},{"key":"ref_25","unstructured":"(2019, May 19). BAG (Basisregistratie Adressen en Gebouwen). Available online: https:\/\/www.geobasisregistraties.nl\/basisregistraties\/adressen-en-gebouwen."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"170","DOI":"10.1109\/LGRS.2014.2330695","article-title":"A Metric for Polygon Comparison and Building Extraction Evaluation","volume":"12","author":"Avbelj","year":"2015","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"794","DOI":"10.1109\/LGRS.2018.2806945","article-title":"IMG2DSM: Height Simulation from Single Imagery Using Conditional Generative Adversarial Net","volume":"15","author":"Ghamisi","year":"2018","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"1288","DOI":"10.1109\/LGRS.2020.2997295","article-title":"U-IMG2DSM: Unpaired Simulation of Digital Surface Models with Generative Adversarial Networks","volume":"18","author":"Paoletti","year":"2021","journal-title":"IEEE Geosci. Remote Sens. Lett."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/13\/22\/4700\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T07:33:27Z","timestamp":1760168007000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/13\/22\/4700"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,11,20]]},"references-count":28,"journal-issue":{"issue":"22","published-online":{"date-parts":[[2021,11]]}},"alternative-id":["rs13224700"],"URL":"https:\/\/doi.org\/10.3390\/rs13224700","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,11,20]]}}}