{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,14]],"date-time":"2025-10-14T00:41:17Z","timestamp":1760402477669,"version":"build-2065373602"},"reference-count":32,"publisher":"MDPI AG","issue":"8","license":[{"start":{"date-parts":[[2021,4,7]],"date-time":"2021-04-07T00:00:00Z","timestamp":1617753600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100002322","name":"Coordena\u00e7\u00e3o de Aperfei\u00e7oamento de Pessoal de N\u00edvel Superior","doi-asserted-by":"publisher","award":["1481336"],"award-info":[{"award-number":["1481336"]}],"id":[{"id":"10.13039\/501100002322","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>The accelerated urban development over the last decades has made it necessary to update spatial information rapidly and constantly. Therefore, cities\u2019 three-dimensional models have been widely used as a study base for various urban problems. However, although many efforts have been made to develop new building extraction methods, reliable and automatic extraction is still a major challenge for the remote sensing and computer vision communities, mainly due to the complexity and variability of urban scenes. This paper presents a method to extract building roof boundaries in the object space by integrating a high-resolution aerial images stereo pair, three-dimensional roof models reconstructed from light detection and ranging (LiDAR) data, and contextual information of the scenes involved. The proposed method focuses on overcoming three types of common problems that can disturb the automatic roof extraction in the urban environment: perspective occlusions caused by high buildings, occlusions caused by vegetation covering the roof, and shadows that are adjacent to the roofs, which can be misinterpreted as roof edges. For this, an improved Snake-based mathematical model is developed considering the radiometric and geometric properties of roofs to represent the roof boundary in the image space. A new approach for calculating the corner response and a shadow compensation factor was added to the model. The created model is then adapted to represent the boundaries in the object space considering a stereo pair of aerial images. Finally, the optimal polyline, representing a selected roof boundary, is obtained by optimizing the proposed Snake-based model using a dynamic programming (DP) approach considering the contextual information of the scene. The results showed that the proposed method works properly in boundary extraction of roofs with occlusion and shadows areas, presenting completeness and correctness average values above 90%, RMSE average values below 0.5 m for E and N components, and below 1 m for H component.<\/jats:p>","DOI":"10.3390\/rs13081429","type":"journal-article","created":{"date-parts":[[2021,4,7]],"date-time":"2021-04-07T21:49:06Z","timestamp":1617832146000},"page":"1429","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["Snake-Based Model for Automatic Roof Boundary Extraction in the Object Space Integrating a High-Resolution Aerial Images Stereo Pair and 3D Roof Models"],"prefix":"10.3390","volume":"13","author":[{"given":"Michelle S. Y.","family":"Ywata","sequence":"first","affiliation":[{"name":"Department of Cartography, School of Sciences and Technology, S\u00e3o Paulo State University (UNESP), Presidente Prudente 19060-900, SP, Brazil"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2534-1229","authenticated-orcid":false,"given":"Aluir P.","family":"Dal Poz","sequence":"additional","affiliation":[{"name":"Department of Cartography, School of Sciences and Technology, S\u00e3o Paulo State University (UNESP), Presidente Prudente 19060-900, SP, Brazil"}]},{"given":"Milton H.","family":"Shimabukuro","sequence":"additional","affiliation":[{"name":"Department of Mathematics and Computer Science, School of Sciences and Technology, S\u00e3o Paulo State University (UNESP), Presidente Prudente 19060-900, SP, Brazil"}]},{"given":"Henrique C.","family":"de Oliveira","sequence":"additional","affiliation":[{"name":"Department of Infrastructure and Environment, School of Civil Engineering, Architecture, Urban Planning, University of Campinas (UNICAMP), Campinas 13083-889, SP, Brazil"}]}],"member":"1968","published-online":{"date-parts":[[2021,4,7]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1016\/j.isprsjprs.2015.09.008","article-title":"Information from imagery: ISPRS scientific vision and research agenda","volume":"115","author":"Chen","year":"2016","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"101","DOI":"10.1016\/j.isprsjprs.2018.01.022","article-title":"Roof planes detection via a second-order variational model","volume":"138","author":"Benciolini","year":"2018","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1016\/j.isprsjprs.2019.02.019","article-title":"Automatic building extraction from high-resolution aerial images and LiDAR data using gated residual refinement network","volume":"151","author":"Huang","year":"2019","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"5234","DOI":"10.1080\/01431161.2016.1230287","article-title":"Building extraction from high-resolution satellite images in urban areas: Recent methods and strategies against significant challenges","volume":"37","author":"Ghanea","year":"2016","journal-title":"Int. J. Remote Sens."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"139","DOI":"10.1016\/j.isprsjprs.2017.05.002","article-title":"Simultaneous extraction of roads and buildings in remote sensing imagery with convolutional neural networks","volume":"130","author":"Alshehhi","year":"2017","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Xu, Y., Wu, L., Xie, Z., and Chen, Z. (2018). Building extraction in very high resolution remote sensing imagery using deep learning and guided filters. Remote Sens., 10.","DOI":"10.3390\/rs10010144"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Wu, G., Shao, X., Guo, Z., Chen, Q., Yuan, W., Shi, X., Xu, Y., and Shibasaki, R. (2018). Automatic building segmentation of aerial imagery using multi-constraint fully convolutional networks. Remote Sens., 10.","DOI":"10.3390\/rs10030407"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Nguyen, T.H., Daniel, S., Gu\u00e9riot, D., Sint\u00e8s, C., and Le Caillec, J.-M. (2020). Super-resolution-based Snake model\u2014An unsupervised method for large-scale building extraction using airborne LiDAR data and optical image. Remote Sens., 12.","DOI":"10.3390\/rs12111702"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"1399","DOI":"10.1109\/LGRS.2013.2258887","article-title":"Automated extraction of building outlines from airborne laser scanning point clouds","volume":"10","author":"Yang","year":"2013","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"3826","DOI":"10.3390\/rs70403826","article-title":"Building extraction from airborne laser scanning data: An analysis of the state of the art","volume":"7","author":"Tomljenovic","year":"2015","journal-title":"Remote Sens."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"294","DOI":"10.1016\/j.isprsjprs.2017.06.005","article-title":"Automatic building extraction from LiDAR data fusion of point and grid-based features","volume":"130","author":"Du","year":"2017","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Pirasteh, S., Rashidi, P., Rastiveis, H., Huang, S., Zhu, Q., Liu, G., Li, Y., Li, J., and Seydipour, E. (2019). Developing an algorithm for buildings extraction and determining changes from airborne LiDAR, and comparing with R-CNN method from drone images. Remote Sens., 11.","DOI":"10.3390\/rs11111272"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"1864","DOI":"10.1109\/JSTARS.2015.2470547","article-title":"A novel building and tree detection method from LiDAR data and aerial images","volume":"9","author":"Zarea","year":"2016","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Gilani, S.A.N., Awrangjeb, M., and Lu, G. (2016). An automatic building extraction and regularisation technique using LiDAR point cloud data and orthoimage. Remote Sens., 8.","DOI":"10.3390\/rs8030258"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Lari, Z., El-Sheimy, N., and Habib, A. (2017). A new approach for realistic 3D reconstruction of planar surfaces from laser scanning data and imagery collected onboard modern low-cost aerial mapping systems. Remote Sens., 9.","DOI":"10.3390\/rs9030212"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"263","DOI":"10.1080\/19479832.2018.1487885","article-title":"Extraction of building roof contours from the integration of high-resolution aerial imagery and laser data using Markov random fields","volume":"9","author":"Fernandes","year":"2018","journal-title":"Int. J. Image Data Fusion"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"583","DOI":"10.5194\/isprs-archives-XLI-B3-583-2016","article-title":"An improved Snake model for refinement of LiDAR-derived building roof contours using aerial images","volume":"XLI-B3","author":"Chen","year":"2016","journal-title":"Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Sun, Y., Zhang, X., Zhao, X., and Xin, Q. (2018). Extracting building boundaries from high resolution optical images and LiDAR data by integrating the convolutional neural network and the active contour model. Remote Sens., 10.","DOI":"10.3390\/rs10091459"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"70","DOI":"10.1016\/j.isprsjprs.2019.05.013","article-title":"Improving public data for building segmentation from Convolutional Neural Networks (CNNs) for fused airborne LIDAR and image data using active contours","volume":"154","author":"Griffiths","year":"2019","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"443","DOI":"10.1109\/JSTARS.2017.2786162","article-title":"Surface gradient approach for occlusion detection based on triangulated irregular network for true orthophoto generation","volume":"11","author":"Oliveira","year":"2018","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"587","DOI":"10.5194\/isprsarchives-XL-7-W3-587-2015","article-title":"Shadow detection improvement using spectral indices and morphological operators in urban areas in high resolution images","volume":"XL-7\/W3","author":"Azevedo","year":"2015","journal-title":"Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Soille, P. (2004). Morphological Image Analysis, Springer.","DOI":"10.1007\/978-3-662-05088-0"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"62","DOI":"10.1109\/TSMC.1979.4310076","article-title":"A threshold Selection Method from Gray-Level Histograms","volume":"9","author":"Otsu","year":"1979","journal-title":"IEEE Trans. Syst. Man Cybern."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"138","DOI":"10.1016\/S0924-2716(99)00008-8","article-title":"Processing of laser scanner data: Algorithms and applications","volume":"54","author":"Axelsson","year":"1999","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_25","unstructured":"Wolf, P.R., and Dewitt, B.A. (2000). Elements of Photogrammetry\u2013with Applications in GIS, McGraw-Hill. [3rd ed.]."},{"key":"ref_26","unstructured":"Mikhail, E.M., Bethel, J.S., and McGlone, J.C. (2001). Introduction to Modern Photogrammetry, John Wiley & Sons."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"321","DOI":"10.1007\/BF00133570","article-title":"Snakes: Active contour models","volume":"1","author":"Kass","year":"1988","journal-title":"Int. J. Comput. Vis."},{"key":"ref_28","first-page":"1","article-title":"Rectilinear building roof contour extraction based on snakes and dynamic programming","volume":"25","author":"Fazan","year":"2013","journal-title":"Int. J. Appl. Earth Obs. Geoinf."},{"key":"ref_29","unstructured":"Moravec, H.P. (1977, January 22\u201325). Towards automatic visual obstacle avoidance. Proceedings of the 5th International Joint Conference on Artificial Intelligence, Cambridge, MA, USA."},{"key":"ref_30","unstructured":"Ballard, D., and Brown, C.M. (1982). Computer Vision, Prentice Hall."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"192","DOI":"10.1109\/LGRS.2017.2779559","article-title":"Development and assessment of a dataset containing frame images and dense airborne laser scanning point clouds","volume":"15","author":"Tommaselli","year":"2018","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Jovanovic, D., Milovanov, S., Ruskovski, I., Govedarica, M., Sladic, D., Radulovic, A., and Pajic, V. (2020). Building virtual 3D city model for Smart Cities applications: A case study on campus area of the University of Novi Sad. ISPRS Int. J. Geo Inf., 9.","DOI":"10.3390\/ijgi9080476"}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/13\/8\/1429\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,13]],"date-time":"2025-10-13T13:34:19Z","timestamp":1760362459000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/13\/8\/1429"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,4,7]]},"references-count":32,"journal-issue":{"issue":"8","published-online":{"date-parts":[[2021,4]]}},"alternative-id":["rs13081429"],"URL":"https:\/\/doi.org\/10.3390\/rs13081429","relation":{},"ISSN":["2072-4292"],"issn-type":[{"type":"electronic","value":"2072-4292"}],"subject":[],"published":{"date-parts":[[2021,4,7]]}}}