{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,16]],"date-time":"2026-06-16T04:53:04Z","timestamp":1781585584865,"version":"3.54.5"},"reference-count":35,"publisher":"MDPI AG","issue":"8","license":[{"start":{"date-parts":[[2018,8,6]],"date-time":"2018-08-06T00:00:00Z","timestamp":1533513600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Semantic 3D maps are required for various applications including robot navigation and surveying, and their importance has significantly increased. Generally, existing studies on semantic mapping were camera-based approaches that could not be operated in large-scale environments owing to their computational burden. Recently, a method of combining a 3D Lidar with a camera was introduced to address this problem, and a 3D Lidar and a camera were also utilized for semantic 3D mapping. In this study, our algorithm consists of semantic mapping and map refinement. In the semantic mapping, a GPS and an IMU are integrated to estimate the odometry of the system, and subsequently, the point clouds measured from a 3D Lidar are registered by using this information. Furthermore, we use the latest CNN-based semantic segmentation to obtain semantic information on the surrounding environment. To integrate the point cloud with semantic information, we developed incremental semantic labeling including coordinate alignment, error minimization, and semantic information fusion. Additionally, to improve the quality of the generated semantic map, the map refinement is processed in a batch. It enhances the spatial distribution of labels and removes traces produced by moving vehicles effectively. We conduct experiments on challenging sequences to demonstrate that our algorithm outperforms state-of-the-art methods in terms of accuracy and intersection over union.<\/jats:p>","DOI":"10.3390\/s18082571","type":"journal-article","created":{"date-parts":[[2018,8,7]],"date-time":"2018-08-07T03:44:18Z","timestamp":1533613458000},"page":"2571","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":31,"title":["Towards a Meaningful 3D Map Using a 3D Lidar and a Camera"],"prefix":"10.3390","volume":"18","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-0676-8347","authenticated-orcid":false,"given":"Jongmin","family":"Jeong","sequence":"first","affiliation":[{"name":"School of Electrical and Electronic Engineering, Yonsei University, Seoul 03722, Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tae Sung","family":"Yoon","sequence":"additional","affiliation":[{"name":"Department of Electrical Engineering, Changwon National University, Changwon-Si 51140, Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jin Bae","family":"Park","sequence":"additional","affiliation":[{"name":"School of Electrical and Electronic Engineering, Yonsei University, Seoul 03722, Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2018,8,6]]},"reference":[{"key":"ref_1","first-page":"3010","article-title":"Airborne light detection and ranging (LiDAR) point density analysis","volume":"7","author":"Barreiro","year":"2012","journal-title":"Sci. Res. Essays"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"3372","DOI":"10.1080\/01431161.2014.903355","article-title":"Empirical study of variation in lidar point density over different land covers","volume":"35","author":"Barreiro","year":"2014","journal-title":"Int. J. Remote Sens."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1496","DOI":"10.1080\/01431161.2013.878063","article-title":"A new methodology to estimate the discrete-return point density on airborne LiDAR surveys","volume":"35","author":"Barreiro","year":"2014","journal-title":"Int. J. Remote Sens."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1104","DOI":"10.1109\/TRO.2012.2200990","article-title":"Zebedee: Design of a spring-mounted 3-d range sensor with application to mobile mapping","volume":"28","author":"Bosse","year":"2012","journal-title":"IEEE Trans. Robot."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Zhang, J., and Singh, S. (2014, January 12\u201316). LOAM: Lidar Odometry and Mapping in Real-time. Proceedings of the 2014 Robotics: Science and Systems Conference, Rome, Italy.","DOI":"10.15607\/RSS.2014.X.007"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"915","DOI":"10.1016\/j.robot.2008.08.001","article-title":"Towards semantic maps for mobile robots","volume":"56","author":"Hertzberg","year":"2008","journal-title":"Robot. Auton. Syst."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Blodow, N., Goron, L.C., Marton, Z.C., Pangercic, D., R\u00fchr, T., Tenorth, M., and Beetz, M. (2011, January 25\u201330). Autonomous semantic mapping for robots performing everyday manipulation tasks in kitchen environments. Proceedings of the 2011 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS 2011), San Francisco, CA, USA.","DOI":"10.1109\/IROS.2011.6048540"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"1052","DOI":"10.1109\/TPAMI.2007.1049","article-title":"MonoSLAM: Real-time single camera SLAM","volume":"29","author":"Davison","year":"2007","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"1697","DOI":"10.1177\/0278364916669237","article-title":"ElasticFusion: Real-time dense SLAM and light source estimation","volume":"35","author":"Whelan","year":"2016","journal-title":"Int. J. Robot. Res."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"1147","DOI":"10.1109\/TRO.2015.2463671","article-title":"ORB-SLAM: A versatile and accurate monocular SLAM system","volume":"31","author":"Montiel","year":"2015","journal-title":"IEEE Trans. Robot."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"16","DOI":"10.1109\/MAES.2008.4694832","article-title":"SLAM for robot navigation","volume":"23","author":"Temeltas","year":"2008","journal-title":"IEEE Aerosp. Electron. Syst. Mag."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Leung, C., Huang, S., and Dissanayake, G. (2006, January 9\u201315). Active SLAM using model predictive control and attractor based exploration. Proceedings of the 2006 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS 2006), Beijing, China.","DOI":"10.1109\/IROS.2006.282530"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Vineet, V., Miksik, O., Lidegaard, M., Nie\u00dfner, M., Golodetz, S., Prisacariu, V.A., K\u00e4hler, O., Murray, D.W., Izadi, S., and P\u00e9rez, P. (2015, January 26\u201330). Incremental dense semantic stereo fusion for large-scale semantic scene reconstruction. Proceedings of the 2015 IEEE International Conference on Robotics and Automation (ICRA 2015), Seattle, WA, USA.","DOI":"10.1109\/ICRA.2015.7138983"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Li, X., and Belaroussi, R. (2016). Semi-Dense 3D Semantic Mapping from Monocular SLAM. arXiv.","DOI":"10.1109\/ITSC.2017.8317942"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Yang, S., Huang, Y., and Scherer, S. (2017). Semantic 3D occupancy mapping through efficient high order CRFs. arXiv.","DOI":"10.1109\/IROS.2017.8202212"},{"key":"ref_16","unstructured":"Qi, C.R., Su, H., Mo, K., and Guibas, L.J. (2017, January 21\u201326). Pointnet: Deep learning on point sets for 3d classification and segmentation. Proceedings of the 2017 IEEE International Conference on Computer Vision and Pattern Recognition (CVPR 2017), Honolulu, HI, USA."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Tchapmi, L., Choy, C., Armeni, I., Gwak, J.Y., and Savarese, S. (2017, January 10\u201312). Segcloud: Semantic segmentation of 3D point clouds. Proceedings of the 2017 International Conference on 3D Vision (3DV 2017), Qingdao, China.","DOI":"10.1109\/3DV.2017.00067"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Floros, G., and Leibe, B. (2012, January 16\u201321). Joint 2d-3d temporally consistent semantic segmentation of street scenes. Proceedings of the 2012 IEEE International Conference on Computer Vision and Pattern Recognition (CVPR 2012), Providence, RI, USA.","DOI":"10.1109\/CVPR.2012.6248007"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Larlus, D., and Jurie, F. (2008, January 23\u201328). Combining appearance models and markov random fields for category level object segmentation. Proceedings of the 2008 IEEE International Conference on Computer Vision and Pattern Recognition (CVPR 2008), Anchorage, AK, USA.","DOI":"10.1109\/CVPR.2008.4587453"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"640","DOI":"10.1109\/TPAMI.2016.2572683","article-title":"Fully convolutional networks for semantic segmentation","volume":"39","author":"Shelhamer","year":"2017","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_21","unstructured":"Paszke, A., Chaurasia, A., Kim, S., and Culurciello, E. (2016). Enet: A deep neural network architecture for real-time semantic segmentation. arXiv."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"2481","DOI":"10.1109\/TPAMI.2016.2644615","article-title":"Segnet: A deep convolutional encoder-decoder architecture for scene segmentation","volume":"39","author":"Badrinarayanan","year":"2017","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_23","unstructured":"Yu, F., and Koltun, V. (2016, January 2\u20134). Multi-scale context aggregation by dilated convolutions. Proceedings of the International Conference on Learning Representations (ICLR 2016), San Juan, Puerto Rico."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Lin, G., Milan, A., Shen, C., and Reid, I. (2016). Refinenet: Multi-path refinement networks with identity mappings for high-resolution semantic segmentation. arXiv.","DOI":"10.1109\/CVPR.2017.549"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Cheng, J., Sun, Y., and Meng, M.Q.H. (2017, January 10\u201312). A dense semantic mapping system based on CRF-RNN network. Proceedings of the 2017 18th International Conference on Advanced Robotics (ICAR 2017), Hong Kong, China.","DOI":"10.1109\/ICAR.2017.8023671"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Hermans, A., Floros, G., and Leibe, B. (June, January 31). Dense 3d semantic mapping of indoor scenes from rgb-d images. Proceedings of the 2014 IEEE International Conference on Robotics and Automation (ICRA 2014), Hong Kong, China.","DOI":"10.1109\/ICRA.2014.6907236"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Sengupta, S., and Sturgess, P. (2015, January 26\u201330). Semantic octree: Unifying recognition, reconstruction and representation via an octree constrained higher order MRF. Proceedings of the 2015 IEEE International Conference on Robotics and Automation (ICRA 2015), Seattle, WA, USA.","DOI":"10.1109\/ICRA.2015.7139442"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"2127","DOI":"10.1016\/j.measurement.2013.03.006","article-title":"Review of mobile mapping and surveying technologies","volume":"46","author":"Puente","year":"2013","journal-title":"Measurement"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Geiger, A., Moosmann, F., Car, \u00d6., and SchusterLin, B. (2012, January 14\u201318). Automatic camera and range sensor calibration using a single shot. Proceedings of the 2012 IEEE International Conference on Robotics and Automation (ICRA 2012), Saint Paul, MN, USA.","DOI":"10.1109\/ICRA.2012.6224570"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"696","DOI":"10.1002\/rob.21542","article-title":"Automatic extrinsic calibration of vision and lidar by maximizing mutual information","volume":"32","author":"Pandey","year":"2015","journal-title":"J. Field Robot."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Hackel, T., Savinov, N., Ladicky, L., Wegner, J.D., Schindler, K., and Pollefeys, M. (2017). Semantic3D.net: A new Large-scale Point Cloud Classification Benchmark. arXiv.","DOI":"10.5194\/isprs-annals-IV-1-W1-91-2017"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"181","DOI":"10.5194\/isprsannals-II-3-181-2014","article-title":"Semantic 3D scene interpretation: A framework combining optimal neighborhood size selection with relevant features","volume":"2","author":"Weinmann","year":"2014","journal-title":"ISPRS Ann. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_33","first-page":"226","article-title":"A Density-based Algorithm for Discovering Clusters in Large Spatial Databases with Noise","volume":"96","author":"Ester","year":"1996","journal-title":"KDD"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Sengupta, S., Greveson, E., Shahrokni, A., and Torr, P.H. (2013, January 6\u201310). Urban 3D Semantic Modelling Using Stereo Vision. Proceedings of the 2013 IEEE International Conference on Robotics and Automation (ICRA 2013), Karlsruhe, Germany.","DOI":"10.1109\/ICRA.2013.6630632"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"1231","DOI":"10.1177\/0278364913491297","article-title":"Vision Meets Robotics: The KITTI Dataset","volume":"32","author":"Geiger","year":"2013","journal-title":"Int. J. Robot. Res."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/18\/8\/2571\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T15:16:50Z","timestamp":1760195810000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/18\/8\/2571"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,8,6]]},"references-count":35,"journal-issue":{"issue":"8","published-online":{"date-parts":[[2018,8]]}},"alternative-id":["s18082571"],"URL":"https:\/\/doi.org\/10.3390\/s18082571","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2018,8,6]]}}}