{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,24]],"date-time":"2026-08-24T16:41:21Z","timestamp":1787589681116,"version":"build-2736575974"},"reference-count":42,"publisher":"MDPI AG","issue":"8","license":[{"start":{"date-parts":[[2020,8,11]],"date-time":"2020-08-11T00:00:00Z","timestamp":1597104000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["IJGI"],"abstract":"<jats:p>The proliferation of high-resolution remote sensing sensors and platforms imposes the need for effective analyses and automated processing of high volumes of aerial imagery. The recent advance of artificial intelligence (AI) in the form of deep learning (DL) and convolutional neural networks (CNN) showed remarkable results in several image-related tasks, and naturally, gain the focus of the remote sensing community. In this paper, we focus on specifying the processing pipeline that relies on existing state-of-the-art DL segmentation models to automate building footprint extraction. The proposed pipeline is organized in three stages: image preparation, model implementation and training, and predictions fusion. For the first and third stages, we introduced several techniques that leverage remote sensing imagery specifics, while for the selection of the segmentation model, we relied on empirical examination. In the paper, we presented and discussed several experiments that we conducted on Inria Aerial Image Labeling Dataset. Our findings confirmed that automatic processing of remote sensing imagery using DL semantic segmentation is both possible and can provide applicable results. The proposed pipeline can be potentially transferred to any other remote sensing imagery segmentation task if the corresponding dataset is available.<\/jats:p>","DOI":"10.3390\/ijgi9080486","type":"journal-article","created":{"date-parts":[[2020,8,11]],"date-time":"2020-08-11T10:56:12Z","timestamp":1597143372000},"page":"486","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":25,"title":["Automated Processing of Remote Sensing Imagery Using Deep Semantic Segmentation: A Building Footprint Extraction Case"],"prefix":"10.3390","volume":"9","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-3057-7727","authenticated-orcid":false,"given":"Aleksandar","family":"Milosavljevi\u0107","sequence":"first","affiliation":[{"name":"Faculty of Electronic Engineering, University of Ni\u0161, Aleksandra Medvedeva 14, 18000 Ni\u0161, Serbia"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2020,8,11]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Zhang, Y., Gong, W., Sun, J., and Li, W. (2019). Web-Net: A Novel Nest Networks with Ultra-Hierarchical Sampling for Building Extraction from Aerial Imageries. Remote Sens., 11.","DOI":"10.3390\/rs11161897"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"4852","DOI":"10.1080\/01431161.2018.1490504","article-title":"The impact of small unmanned airborne platforms on passive optical remote sensing: A conceptual perspective","volume":"39","author":"Lippitt","year":"2018","journal-title":"Int. J. Remote Sens."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Yi, Y., Zhang, Z., Zhang, W., Zhang, C., Li, W., and Zhao, T. (2019). Semantic Segmentation of Urban Buildings from VHR Remote Sensing Imagery Using a Deep Convolutional Neural Network. Remote Sens., 11.","DOI":"10.3390\/rs11151774"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Gao, L., Shi, W., Miao, Z., and Lv, Z. (2018). Method Based on Edge Constraint and Fast Marching for Road Centerline Extraction from Very High-Resolution Remote Sensing Images. Remote Sens., 10.","DOI":"10.3390\/rs10060900"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"6699","DOI":"10.1109\/TGRS.2018.2841808","article-title":"Vehicle Instance Segmentation from Aerial Image and Video Using a Multitask Learning Residual Fully Convolutional Network","volume":"56","author":"Mou","year":"2018","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"9325","DOI":"10.1109\/ACCESS.2020.2964540","article-title":"Attention Mask R-CNN for Ship Detection and Segmentation from Remote Sensing Images","volume":"8","author":"Nie","year":"2020","journal-title":"IEEE Access"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"637","DOI":"10.1080\/13658816.2018.1542697","article-title":"Automated terrain feature identification from remote sensing imagery: A deep learning approach","volume":"34","author":"Li","year":"2020","journal-title":"Int. J. Geogr. Inf. Sci."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Ye, Z., Fu, Y., Gan, M., Deng, J., Comber, A., and Wang, K. (2019). Building Extraction from Very High Resolution Aerial Imagery Using Joint Attention Deep Neural Network. Remote Sens., 11.","DOI":"10.3390\/rs11242970"},{"key":"ref_9","unstructured":"LeCun, Y., Boser, B., Denker, J., Henderson, D., Howard, R., Hubbard, W., and Jackel, L. (1990). Handwritten digit recognition with a back-propagation network. Advances in Neural Information Processing Systems, MIT Press. Papers NIPS. CC."},{"key":"ref_10","unstructured":"Simonyan, K., and Zisserman, A. (2015, January 7\u20139). Very deep convolutional networks for large-scale image recognition. Proceedings of the 3rd International Conference on Learning Representations, ICLR 2015\u2014Conference Track Proceedings, San Diego, CA, USA."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Maggiori, E., Tarabalka, Y., Charpiat, G., and Alliez, P. (2017, January 23\u201328). Can Semantic Labeling Methods Generalize to Any City? The Inria Aerial Image Labeling Benchmark. Proceedings of the IEEE International Geoscience and Remote Sensing Symposium (IGARSS), Fort Worth, TX, USA.","DOI":"10.1109\/IGARSS.2017.8127684"},{"key":"ref_12","unstructured":"Castelluccio, M., Poggi, G., Sansone, C., and Verdoliva, L. (2020, January 27). Land Use Classification in Remote Sensing Images by Convolutional Neural Networks. Available online: http:\/\/arxiv.org\/abs\/1508.00092."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"105","DOI":"10.1109\/LGRS.2015.2499239","article-title":"Deep learning earth observation classification using ImageNet pretrained networks","volume":"13","author":"Marmanis","year":"2016","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"1117","DOI":"10.1080\/13658816.2018.1542698","article-title":"Fine-grained landuse characterization using ground-based pictures: A deep learning solution based on globally available data","volume":"34","author":"Srivastava","year":"2020","journal-title":"Int. J. Geogr. Inf. Sci."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Wojek, C., Dork\u00f3, G., Schulz, A., and Schiele, B. (2008, January 10\u201313). Sliding-windows for rapid object class localization: A parallel technique. Proceedings of the Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), Munich, Germany.","DOI":"10.1007\/978-3-540-69321-5_8"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Long, J., Shelhamer, E., and Darrell, T. (2015, January 7\u201312). Fully Convolutional Networks for Semantic Segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298965"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Hariharan, B., Arbel\u00e1ez, P., Girshick, R., and Malik, J. (2015, January 7\u201312). Hypercolumns for Object Segmentation and Fine-grained Localization. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298642"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"834","DOI":"10.1109\/TPAMI.2017.2699184","article-title":"DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs","volume":"40","author":"Chen","year":"2018","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Noh, H., Hong, S., and Han, B. (2015, January 7\u201313). Learning Deconvolution Network for Semantic Segmentation. Proceedings of the IEEE International Conference on Computer Vision (ICCV), Santiago, Chile.","DOI":"10.1109\/ICCV.2015.178"},{"key":"ref_20","first-page":"234","article-title":"U-Net: Convolutional Networks for Biomedical Image Segmentation","volume":"Volume 9351","author":"Ronneberger","year":"2015","journal-title":"Proceedings of the Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"2481","DOI":"10.1109\/TPAMI.2016.2644615","article-title":"SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation","volume":"39","author":"Badrinarayanan","year":"2017","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_22","unstructured":"Kirillov, A., He, K., Girshick, R., and Doll\u00e1r, P. (2020, January 24). A Unified Architecture for Instance and Semantic Segmentation. Available online: http:\/\/presentations.cocodataset.org\/COCO17-Stuff-FAIR.pdf."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Sun, G., Huang, H., Zhang, A., Li, F., Zhao, H., and Fu, H. (2019). Fusion of Multiscale Convolutional Neural Networks for Building Extraction in Very High-Resolution Images. Remote Sens., 11.","DOI":"10.3390\/rs11030227"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Feng, Y., Thiemann, F., and Sester, M. (2019). Learning Cartographic Building Generalization with Deep Convolutional Neural Networks. ISPRS Int. J. Geo-Inf., 8.","DOI":"10.3390\/ijgi8060258"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Schuegraf, P., and Bittner, K. (2019). Automatic Building Footprint Extraction from Multi-Resolution Remote Sensing Images Using a Hybrid FCN. ISPRS Int. J. Geo-Inf., 8.","DOI":"10.3390\/ijgi8040191"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Xu, Y., Wu, L., Xie, Z., and Chen, Z. (2018). Building Extraction in Very High Resolution Remote Sensing Imagery Using Deep Learning and Guided Filters. Remote Sens., 10.","DOI":"10.3390\/rs10010144"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Guo, R., Liu, J., Li, N., Liu, S., Chen, F., Cheng, B., Duan, J., Li, X., and Ma, C. (2018). Pixel-Wise Classification Method for High Resolution Remote Sensing Imagery Using Deep Neural Networks. ISPRS Int. J. Geo-Inf., 7.","DOI":"10.3390\/ijgi7030110"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"777","DOI":"10.1080\/13658816.2019.1624761","article-title":"A locally-constrained YOLO framework for detecting small and densely-distributed building footprints","volume":"34","author":"Xie","year":"2020","journal-title":"Int. J. Geogr. Inf. Sci."},{"key":"ref_29","unstructured":"(2020, August 11). Inria Aerial Image Labeling Dataset. Available online: https:\/\/project.inria.fr\/aerialimagelabeling\/."},{"key":"ref_30","unstructured":"(2020, January 24). Keras: The Python Deep Learning Library. Available online: https:\/\/keras.io."},{"key":"ref_31","unstructured":"(2020, January 24). TensorFlow: An End-To-End Open Source Machine Learning Platform. Available online: https:\/\/www.tensorflow.org\/."},{"key":"ref_32","unstructured":"Milosavljevi\u0107, A. (2020, August 11). Inria Aerial Image Labeling\u2014Building Footprint Extraction Using Deep Semantic Segmentation. Available online: https:\/\/github.com\/a-milosavljevic\/inria-aerial-image-labeling."},{"key":"ref_33","unstructured":"Yakubovskiy, P. (2020, January 24). Segmentation Models, Github Library. Available online: https:\/\/github.com\/qubvel\/segmentation_models."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Chaurasia, A., and Culurciello, E. (2017, January 10\u201313). LinkNet: Exploiting encoder representations for efficient semantic segmentation. Proceedings of the 2017 IEEE Visual Communications and Image Processing, VCIP 2017, St. Petersburg, FL, USA.","DOI":"10.1109\/VCIP.2017.8305148"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Zhao, H., Shi, J., Qi, X., Wang, X., and Jia, J. (2017, January 21\u201326). Pyramid Scene Parsing Network. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.660"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27\u201330). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Hu, J., Shen, L., and Sun, G. (2018, January 18\u201323). Squeeze-and-Excitation Networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00745"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Xie, S., Girshick, R., Doll\u00e1r, P., Tu, Z., He, K., and San Diego, U. (2017, January 21\u201326). Aggregated Residual Transformations for Deep Neural Networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.634"},{"key":"ref_39","first-page":"240","article-title":"Generalised dice overlap as a deep learning loss function for highly unbalanced segmentations","volume":"Volume 10553","author":"Sudre","year":"2017","journal-title":"Proceedings of the Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)"},{"key":"ref_40","unstructured":"Hinton, G., Srivastava, N., and Swersky, K. (2020, January 24). Neural Networks for Machine Learning, Lecture 6a Overview of Mini-Batch Gradient Descent. Available online: http:\/\/www.cs.toronto.edu\/~hinton\/coursera\/lecture6\/lec6.pdf."},{"key":"ref_41","unstructured":"Jordan, J. (2020, January 24). Setting the Learning Rate of Your Neural Network. Available online: https:\/\/www.jeremyjordan.me\/nn-learning-rate\/."},{"key":"ref_42","unstructured":"Milosavljevi\u0107, A. (2020, August 11). Building Footprint Extraction Using Deep Semantic Segmentation. Figshare. Figure. Available online: https:\/\/doi.org\/10.6084\/m9.figshare.11816616.v1."}],"container-title":["ISPRS International Journal of Geo-Information"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2220-9964\/9\/8\/486\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T09:59:21Z","timestamp":1760176761000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2220-9964\/9\/8\/486"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,8,11]]},"references-count":42,"journal-issue":{"issue":"8","published-online":{"date-parts":[[2020,8]]}},"alternative-id":["ijgi9080486"],"URL":"https:\/\/doi.org\/10.3390\/ijgi9080486","relation":{},"ISSN":["2220-9964"],"issn-type":[{"value":"2220-9964","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,8,11]]}}}