{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,6]],"date-time":"2026-01-06T13:12:38Z","timestamp":1767705158394,"version":"build-2065373602"},"reference-count":23,"publisher":"MDPI AG","issue":"16","license":[{"start":{"date-parts":[[2020,8,6]],"date-time":"2020-08-06T00:00:00Z","timestamp":1596672000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Maintenance and expansion of transport and communications infrastructure requires ongoing construction work on a large scale. To plan and execute these in the best possible way, up-to-date and highly detailed digital maps are needed. For example, until recently, telecommunication companies have performed documentation and mapping of as-built urban structures for construction work manually and with great time expense. Mobile mapping systems offer a solution for documenting urban environments fast and mostly automated. In consequence, large amounts of recorded data emerge in short time, creating the need for automated processing and modeling of these data to provide reliable foundations for digital planning in reasonable time. We present (a) a procedure for fully automated processing of mobile mapping data for digital construction planning in the context of nationwide broadband network expansion and (b) an in-depth study of the performance of this procedure on real-world data. Our multi-stage pipeline segments georeferenced images and fuses segmentations with 3D data, which allows exact localization of surfaces and objects, which can then be passed via interface, e.g., to a geographic information system (GIS). The final system is able to distinguish between similar looking surfaces, such as concrete and asphalt, with a precision between 80% and 95%, regardless of setting or season.<\/jats:p>","DOI":"10.3390\/rs12162530","type":"journal-article","created":{"date-parts":[[2020,8,6]],"date-time":"2020-08-06T09:41:21Z","timestamp":1596706881000},"page":"2530","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":16,"title":["Fully Automated Segmentation of 2D and 3D Mobile Mapping Data for Reliable Modeling of Surface Structures Using Deep Learning"],"prefix":"10.3390","volume":"12","author":[{"given":"Alexander","family":"Reiterer","sequence":"first","affiliation":[{"name":"Fraunhofer Institute for Physical Measurement Techniques IPM, 79110 Freiburg, Germany"},{"name":"Department of Sustainable Systems Engineering INATECH, University of Freiburg, 79110 Freiburg, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Katharina","family":"W\u00e4schle","sequence":"additional","affiliation":[{"name":"Fraunhofer Institute for Physical Measurement Techniques IPM, 79110 Freiburg, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Dominik","family":"St\u00f6rk","sequence":"additional","affiliation":[{"name":"Fraunhofer Institute for Physical Measurement Techniques IPM, 79110 Freiburg, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Achim","family":"Leydecker","sequence":"additional","affiliation":[{"name":"Fraunhofer Institute for Physical Measurement Techniques IPM, 79110 Freiburg, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Niko","family":"Gitzen","sequence":"additional","affiliation":[{"name":"FTTH Factory Produktion, Deutsche Telekom Technik GmbH, 53227 Bonn, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2020,8,6]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"172","DOI":"10.1016\/j.aei.2015.01.009","article-title":"As-built data acquisition and its use in production monitoring and automated layout of civil infrastructure: A survey","volume":"29","author":"Son","year":"2015","journal-title":"Adv. Eng. Inform."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Walker, J., and Awange, J.L. (2018). Surveying for Civil and Mine Engineers. Theory, Workshops, and Practicals, Springer.","DOI":"10.1007\/978-3-319-53129-8"},{"key":"ref_3","unstructured":"El-Sheimy, N. (2005, January 16\u201321). An overview of mobile mapping systems. Proceedings of the FIG Working Week 2005 and GSDI-8, Cairo, Egypt."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"2127","DOI":"10.1016\/j.measurement.2013.03.006","article-title":"Review of mobile mapping and surveying technologies","volume":"46","author":"Puente","year":"2013","journal-title":"Measurement"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., and Darrell, T. (2014). Caffe: Convolutional architecture for fast feature embedding. arXiv.","DOI":"10.1145\/2647868.2654889"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Ma, L., Li, Y., Li, J., Wang, C., Wang, R., and Chapman, M. (2018). Mobile Laser scanned point-clouds for road object detection and extraction: A review. Remote Sens., 10.","DOI":"10.3390\/rs10101531"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Che, E., Jung, J., and Olsen, M.J. (2019). Object recognition, segmentation, and classification of mobile laser scanning point clouds: A state of the art review. Sensors, 19.","DOI":"10.3390\/s19040810"},{"key":"ref_8","unstructured":"Krizhevsky, A., Sutskever, I., and Hinton, G.E. (2012). ImageNet classification with deep convolutional neural networks. Advances in Neural Information Processing Systems, Tahoe City, CA, USA, 2012, Curran Associates Inc."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Long, J., Shelhamer, E., and Darrell, T. (2015). Fully convolutional networks for semantic segmentation. Proceedings of the 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, USA, 7\u201312 June 2015, IEEE.","DOI":"10.1109\/CVPR.2015.7298965"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Chen, L.-C., Zhu, Y., Papandreou, G., Schroff, F., and Adam, H. (2018). Encoder-decoder with atrous separable convolution for semantic image segmentation. arXiv.","DOI":"10.1007\/978-3-030-01234-2_49"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Maturana, D., and Scherer, S. (October, January 28). VoxNet: A 3D convolutional neural network for real-time object recognition. Proceedings of the 2015 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Hamburg, Germany.","DOI":"10.1109\/IROS.2015.7353481"},{"key":"ref_12","unstructured":"Qi, C.R., Su, H., Mo, K., and Guibas, L.J. (2016). PointNet: Deep learning on point sets for 3D classification and segmentation. arXiv."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Ding, Z., Han, X., and Niethammer, M. (2019). VoteNet: A deep learning label fusion method for multi-atlas segmentation. arXiv.","DOI":"10.1007\/978-3-030-32248-9_23"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Shi, S., Guo, C., Jiang, L., Wang, Z., Shi, J., Wang, X., and Li, H. (2019). PV-RCNN: Point-voxel feature set abstraction for 3D object detection. arXiv.","DOI":"10.1109\/CVPR42600.2020.01054"},{"key":"ref_15","unstructured":"Guo, Y., Wang, H., Hu, Q., Liu, H., Liu, L., and Bennamoun, M. (2019). Deep learning for 3D point clouds: A survey. arXiv."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Qi, C.R., Chen, X., Litany, O., and Guibas, L.J. (2020). ImVoteNet: Boosting 3D object detection in point clouds with image votes. arXiv.","DOI":"10.1109\/CVPR42600.2020.00446"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"85","DOI":"10.1016\/j.isprsjprs.2018.04.022","article-title":"Fusion of images and point clouds for the semantic segmentation of large-scale 3D scenes based on deep learning","volume":"143","author":"Zhang","year":"2018","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Cordts, M., Omran, M., Ramos, S., Rehfeld, T., Enzweiler, M., Benenson, R., Franke, U., Roth, S., and Schiele, B. (2016). The cityscapes dataset for semantic urban scene understanding. arXiv.","DOI":"10.1109\/CVPR.2016.350"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"166","DOI":"10.1016\/j.isprsjprs.2019.04.015","article-title":"Deep learning in remote sensing applications: A meta-analysis and review","volume":"152","author":"Ma","year":"2019","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Tao, C.V. (2007). Advances in Mobile Mapping Technology, Taylor & Francis.","DOI":"10.4324\/9780203961872"},{"key":"ref_21","unstructured":"Kingma, D.P., and Ba, J. (2014). Adam: A method for stochastic optimization. arXiv."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"381","DOI":"10.1145\/358669.358692","article-title":"Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography","volume":"24","author":"Fischler","year":"1981","journal-title":"Commun. ACM"},{"key":"ref_23","unstructured":"Moreira, A.J.C., and Santos, M.Y. (2007). Concave hull: A k-nearest neighbours approach for the computation of the region occupied by a set of points. GRAPP 2007, Proceedings of the Second International Conference on Computer Graphics Theory and Applications, Barcelona, Spain, 8\u201311 March 2007, Institute for Systems and Technologies of Information, Control and Communication."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/12\/16\/2530\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T09:57:11Z","timestamp":1760176631000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/12\/16\/2530"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,8,6]]},"references-count":23,"journal-issue":{"issue":"16","published-online":{"date-parts":[[2020,8]]}},"alternative-id":["rs12162530"],"URL":"https:\/\/doi.org\/10.3390\/rs12162530","relation":{},"ISSN":["2072-4292"],"issn-type":[{"type":"electronic","value":"2072-4292"}],"subject":[],"published":{"date-parts":[[2020,8,6]]}}}