{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,23]],"date-time":"2025-12-23T10:45:41Z","timestamp":1766486741205,"version":"build-2065373602"},"reference-count":21,"publisher":"MDPI AG","issue":"24","license":[{"start":{"date-parts":[[2022,12,15]],"date-time":"2022-12-15T00:00:00Z","timestamp":1671062400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Mobile mapping is an application field of ever-increasing relevance. Data of the surrounding environment is typically captured using combinations of LiDAR systems and cameras. The large amounts of measurement data are then processed and interpreted, which is often done automated using neural networks. For the evaluation the data of the LiDAR and the cameras needs to be fused, which requires a reliable calibration of the sensors. Segmentation solemnly on the LiDAR data drastically decreases the amount of data and makes the complex data fusion process obsolete but on the other hand often performs poorly due to the lack of information about the surface remission properties. The work at hand evaluates the effect of a novel multispectral LiDAR system on automated semantic segmentation of 3D-point clouds to overcome this downside. Besides the presentation of the multispectral LiDAR system and its implementation on a mobile mapping vehicle, the point cloud processing and the training of the CNN are described in detail. The results show a significant increase in the mIoU when using the additional information from the multispectral channel compared to just 3D and intensity information. The impact on the IoU was found to be strongly dependent on the class.<\/jats:p>","DOI":"10.3390\/rs14246349","type":"journal-article","created":{"date-parts":[[2022,12,15]],"date-time":"2022-12-15T04:54:14Z","timestamp":1671080054000},"page":"6349","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":6,"title":["A Study on the Effect of Multispectral LiDAR Data on Automated Semantic Segmentation of 3D-Point Clouds"],"prefix":"10.3390","volume":"14","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-9887-9337","authenticated-orcid":false,"given":"Valentin","family":"Vierhub-Lorenz","sequence":"first","affiliation":[{"name":"Fraunhofer Institute for Physical Measurement Techniques IPM, 79110 Freiburg, Germany"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1184-5346","authenticated-orcid":false,"given":"Maximilian","family":"Kellner","sequence":"additional","affiliation":[{"name":"Fraunhofer Institute for Physical Measurement Techniques IPM, 79110 Freiburg, Germany"}]},{"given":"Oliver","family":"Zipfel","sequence":"additional","affiliation":[{"name":"Fraunhofer Institute for Physical Measurement Techniques IPM, 79110 Freiburg, Germany"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3196-3876","authenticated-orcid":false,"given":"Alexander","family":"Reiterer","sequence":"additional","affiliation":[{"name":"Fraunhofer Institute for Physical Measurement Techniques IPM, 79110 Freiburg, Germany"},{"name":"Department of Sustainable Systems Engineering INATECH, University of Freiburg, 79110 Freiburg, Germany"}]}],"member":"1968","published-online":{"date-parts":[[2022,12,15]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"31","DOI":"10.1515\/jag-2020-0004","article-title":"Fusion of ground penetrating radar and laser scanning for infrastructure mapping","volume":"15","author":"Merkle","year":"2021","journal-title":"J. Appl. Geodesy"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Reiterer, A., W\u00e4schle, K., St\u00f6rk, D., Leydecker, A., and Gitzen, N. (2020). Fully Automated Segmentation of 2D and 3D Mobile Mapping Data for Reliable Modeling of Surface Structures Using Deep Learning. Remote Sens., 12.","DOI":"10.3390\/rs12162530"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Ponciano, J.-J., Roetner, M., Reiterer, A., and Boochs, F. (2021). Object Semantic Segmentation in Point Clouds\u2014Comparison of a Deep Learning and a Knowledge-Based Method. ISPRS Int. J. Geo-Inf., 10.","DOI":"10.3390\/ijgi10040256"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1408","DOI":"10.1364\/OE.379491","article-title":"Potential of active multispectral lidar for detecting low reflectance targets","volume":"28","author":"Kaasalainen","year":"2020","journal-title":"Opt. Express"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"32","DOI":"10.1016\/j.rse.2013.01.001","article-title":"The potential of dual-wavelength laser scanning for estimating vegetation moisture content","volume":"132","author":"Gaulton","year":"2013","journal-title":"Remote Sens. Environ."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"7119","DOI":"10.1364\/OE.20.007119","article-title":"Full waveform hyperspectral LiDAR for terrestrial laser scanning","volume":"20","author":"Hakala","year":"2012","journal-title":"Opt. Express"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"20170039","DOI":"10.1098\/rsfs.2017.0039","article-title":"On the utilization of novel spectral laser scanning for three-dimensional classification of vegetation elements","volume":"8","author":"Li","year":"2018","journal-title":"Interface Focus"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"136","DOI":"10.1016\/j.jag.2015.08.008","article-title":"Estimation of rice leaf nitrogen contents based on hyperspectral LIDAR","volume":"44","author":"Du","year":"2016","journal-title":"Int. J. Appl. Earth Observ. Geoinformat."},{"key":"ref_9","unstructured":"Chrysoulakis, N., Erbertseder, T., Zhang, Y., and Baier, F. (2019, January 9\u201312). A multispectral tunnel inspection system for simultaneous moisture and shape detection. Proceedings of the Remote Sensing Technologies and Applications in Urban Environments IV, Strasbourg, France."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Jing, Z., Guan, H., Zhao, P., Li, D., Yu, Y., Zang, Y., Wang, H., and Li, J. (2021). Multispectral LiDAR Point Cloud Classification Using SE-PointNet++. Remote Sens., 13.","DOI":"10.3390\/rs13132516"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Zhang, Z., Li, T., Tang, X., Lei, X., and Peng, Y. (2022). Introducing Improved Transformer to Land Cover Classification Using Multispectral LiDAR Point Clouds. Remote Sens., 14.","DOI":"10.3390\/rs14153808"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"147","DOI":"10.1016\/j.isprsjprs.2013.12.004","article-title":"Application of multispectral LiDAR to automated virtual outcrop geology","volume":"88","author":"Hartzell","year":"2014","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Chen, B., Shi, S., Gong, W., Zhang, Q., Yang, J., Du, L., Sun, J., Zhang, Z., and Song, S. (2017). Multispectral LiDAR Point Cloud Classification: A Two-Step Approach. Remote Sens., 9.","DOI":"10.3390\/rs9040373"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"1047","DOI":"10.1366\/0003702963905385","article-title":"Infrared Intensities of Liquids XX: The Intensity of the OH Stretching Band of Liquid Water Revisited, and the Best Current Values of the Optical Constants of H2O(l) at 25 \u00b0C between 15,000 and 1 cm\u22121","volume":"50","author":"Bertie","year":"1996","journal-title":"Appl. Spectrosc."},{"key":"ref_15","unstructured":"Fraunhofer IPM (2022, May 27). Tunnel Inspection System Simultaneous Geometry and Moisture Measurement. Available online: https:\/\/www.ipm.fraunhofer.de\/content\/dam\/ipm\/en\/PDFs\/product-information\/OF\/MTS\/Tunnel-Inspection-System-TIS.pdf."},{"key":"ref_16","unstructured":"(2022, May 27). CloudCompare Version 2.10. GPL Software. Available online: http:\/\/www.cloudcompare.org\/."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Ourselin, S., Joskowicz, L., Sabuncu, M.R., Unal, G., and Wells, W. (2016). 3D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotation. Medical Image Computing and Computer-Assisted Intervention\u2014MICCAI 2016, Springer International Publishing.","DOI":"10.1016\/j.media.2017.06.012"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2015). Deep Residual Learning for Image Recognition. arXiv.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Berman, M., Triki, A.R., and Blaschko, M.B. (2017). The Lov\u00e1sz-Softmax loss: A tractable surrogate for the optimization of the intersection-over-union measure in neural networks. arXiv.","DOI":"10.1109\/CVPR.2018.00464"},{"key":"ref_20","unstructured":"Paszke, A., Gross, S., Massa, F., Lerer, A., Bradbury, J., Chanan, G., Killeen, T., Lin, Z., Gimelshein, N., and Antiga, L. (2019). PyTorch: An Imperative Style, High-Performance Deep Learning Library. arXiv."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"400","DOI":"10.1214\/aoms\/1177729586","article-title":"A Stochastic Approximation Method","volume":"22","author":"Robbins","year":"1951","journal-title":"Ann. Math. Statist."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/14\/24\/6349\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T01:41:53Z","timestamp":1760146913000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/14\/24\/6349"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,12,15]]},"references-count":21,"journal-issue":{"issue":"24","published-online":{"date-parts":[[2022,12]]}},"alternative-id":["rs14246349"],"URL":"https:\/\/doi.org\/10.3390\/rs14246349","relation":{},"ISSN":["2072-4292"],"issn-type":[{"type":"electronic","value":"2072-4292"}],"subject":[],"published":{"date-parts":[[2022,12,15]]}}}