{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T01:15:01Z","timestamp":1760145301996,"version":"build-2065373602"},"reference-count":34,"publisher":"MDPI AG","issue":"14","license":[{"start":{"date-parts":[[2024,7,11]],"date-time":"2024-07-11T00:00:00Z","timestamp":1720656000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100003052","name":"Ministry of Trade, Industry and Energy (MOTIE)","doi-asserted-by":"publisher","award":["P0008751"],"award-info":[{"award-number":["P0008751"]}],"id":[{"id":"10.13039\/501100003052","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>In the context of LiDAR sensor-based autonomous vehicles, segmentation networks play a crucial role in accurately identifying and classifying objects. However, discrepancies between the types of LiDAR sensors used for training the network and those deployed in real-world driving environments can lead to performance degradation due to differences in the input tensor attributes, such as x, y, and z coordinates, and intensity. To address this issue, we propose novel intensity rendering and data interpolation techniques. Our study evaluates the effectiveness of these methods by applying them to object tracking in real-world scenarios. The proposed solutions aim to harmonize the differences between sensor data, thereby enhancing the performance and reliability of deep learning networks for autonomous vehicle perception systems. Additionally, our algorithms prevent performance degradation, even when different types of sensors are used for the training data and real-world applications. This approach allows for the use of publicly available open datasets without the need to spend extensive time on dataset construction and annotation using the actual sensors deployed, thus significantly saving time and resources. When applying the proposed methods, we observed an approximate 20% improvement in mIoU performance compared to scenarios without these enhancements.<\/jats:p>","DOI":"10.3390\/s24144475","type":"journal-article","created":{"date-parts":[[2024,7,11]],"date-time":"2024-07-11T11:33:22Z","timestamp":1720697602000},"page":"4475","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["Enhancing Deep Learning-Based Segmentation Accuracy through Intensity Rendering and 3D Point Interpolation Techniques to Mitigate Sensor Variability"],"prefix":"10.3390","volume":"24","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-5348-8068","authenticated-orcid":false,"given":"Myeong-Jun","family":"Kim","sequence":"first","affiliation":[{"name":"Graduate School of Automotive Engineering, Kookmin University, Seoul 02707, Republic of Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Suyeon","family":"Kim","sequence":"additional","affiliation":[{"name":"Moovita Pte Ltd., Block 44, 535 Clementi Rd., Singapore 599489, Singapore"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Banghyon","family":"Lee","sequence":"additional","affiliation":[{"name":"Moovita Pte Ltd., Block 44, 535 Clementi Rd., Singapore 599489, Singapore"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jungha","family":"Kim","sequence":"additional","affiliation":[{"name":"Department of Automotive and IT Convergence, Kookmin University, Seoul 02707, Republic of Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2024,7,11]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"384","DOI":"10.1016\/j.trc.2018.02.012","article-title":"Autonomous vehicle perception: The technology of today and tomorrow","volume":"89","author":"Gruyer","year":"2018","journal-title":"Transp. Res. Part C Emerg. Technol."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"2284","DOI":"10.1007\/s12555-018-0134-6","article-title":"Convolutional neural network for monocular vision-based multi-target tracking","volume":"17","author":"Kim","year":"2019","journal-title":"Int. J. Control. Autom. Syst."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"922","DOI":"10.1007\/s12555-009-0608-7","article-title":"Modeling of target detection in local search for phased array radar tracking","volume":"7","author":"Choi","year":"2009","journal-title":"Int. J. Control. Autom. Syst."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1272","DOI":"10.1007\/s12555-013-0528-4","article-title":"Improved algorithm for the extrinsic calibration of a camera and laser range finder using 3D\u20133D correspondences","volume":"13","author":"Ha","year":"2015","journal-title":"Int. J. Control. Autom. Syst."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Du, X., Ang, M.H., and Rus, D. (2017, January 24\u201329). Car detection for autonomous vehicle: LIDAR and vision fusion approach through deep learning framework. Proceedings of the 2017 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Vancouver, BC, Canada.","DOI":"10.1109\/IROS.2017.8202234"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"94","DOI":"10.1109\/MITS.2019.2907630","article-title":"A Review of Sensor Technologies for Perception in Automated Driving","volume":"11","author":"Marti","year":"2019","journal-title":"IEEE Intell. Transp. Syst. Mag."},{"key":"ref_7","unstructured":"Alnaggar, Y., Afifi, M., and Amer, K. (2021, January 5\u20139). Multi Projection Fusion for Real-Time Semantic Segmentation of 3D Point Clouds. Proceedings of the IEEE\/CVF Winter Conference on Applications of Computer Vision, Virtual."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"477","DOI":"10.1016\/j.neucom.2019.10.116","article-title":"Multi-view semantic learning network for point cloud based 3D object detection","volume":"397","author":"Yang","year":"2020","journal-title":"Neurocomputing"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"2988","DOI":"10.1016\/j.rse.2008.02.004","article-title":"Object-based land cover classification using airborne LiDAR","volume":"112","author":"Antonarakis","year":"2008","journal-title":"Remote Sens. Environ."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"152","DOI":"10.1016\/j.isprsjprs.2013.11.001","article-title":"Contextual classification of LiDAR data and building object detection in urban areas","volume":"87","author":"Niemeyer","year":"2014","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"864","DOI":"10.1080\/2150704X.2015.1088668","article-title":"Deep learning-based tree classification using mobile LiDAR data","volume":"6","author":"Guan","year":"2015","journal-title":"Remote Sens. Lett."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Qi, R., Charles, H., Su, H., Mo, K., and Guibas, L.J. (2017, January 21\u201326). PointNet: Deep learning on point sets for 3D classification and segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.16"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Zhou, Y., and Tuzel, O. (2018, January 18\u201323). VoxelNet: End-to-end learning for point cloud based 3D object detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00472"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Wu, B., Wan, A., Yue, X., and Keutzer, K. (2018, January 21\u201325). SqueezeSeg: Convolutional neural nets with recurrent CRF for real-time road-object segmentation from 3D LiDAR point cloud. Proceedings of the 2018 IEEE International Conference on Robotics and Automation (ICRA), Brisbane, Australia.","DOI":"10.1109\/ICRA.2018.8462926"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Wu, B., Zhou, X., Zhao, S., Yue, X., and Keutzer, K. (2019, January 20\u201324). SqueezeSegv2: Improved model structure and unsupervised domain adaptation for road-object segmentation from a LiDAR point cloud. Proceedings of the 2019 International Conference on Robotics and Automation (ICRA), Montreal, QC, Canada.","DOI":"10.1109\/ICRA.2019.8793495"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Milioto, A., Vizzo, I., Behley, J., and Stachniss, C. (2019, January 3\u20138). RangeNet++: Fast and accurate LiDAR semantic segmentation. Proceedings of the IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Macau, China.","DOI":"10.1109\/IROS40897.2019.8967762"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Xu, C., Wu, B., Wang, Z., Zhan, W., Vajda, P., Keutzer, K., and Tomizuka, M. (2020, January 23\u201328). SqueezeSegv3: Spatially-adaptive convolution for efficient point-cloud segmentation. Proceedings of the Computer Vision\u2013ECCV 2020: 16th European Conference, Glasgow, UK. Part XXVIII 16.","DOI":"10.1007\/978-3-030-58604-1_1"},{"key":"ref_18","first-page":"1","article-title":"PointNet++: Deep hierarchical feature learning on point sets in a metric space","volume":"30","author":"Qi","year":"2017","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Tatarchenko, M., Park, J., Koltun, V., and Zhou, Q.Y. (2018, January 18\u201323). Tangent convolutions for dense prediction in 3D. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00409"},{"key":"ref_20","unstructured":"Hu, Q., Yang, B., Xie, L., Rosa, S., Guo, Y., Wang, Z., and Markham, A. (2022, January 18\u201324). Randla-net: Efficient semantic segmentation of large-scale point clouds. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, New Orleans, LA, USA."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Yan, X., Gao, J., Li, J., Zhang, R., Li, Z., Huang, R., and Cui, S. (2021, January 2\u20139). Sparse single sweep LiDAR point cloud segmentation via learning contextual shape priors from scene completion. Proceedings of the AAAI Conference on Artificial Intelligence, Virtual.","DOI":"10.1609\/aaai.v35i4.16419"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Li, B., Zhang, T., and Xia, T. (2016). Vehicle detection from 3D LiDAR using fully convolutional network. arXiv.","DOI":"10.15607\/RSS.2016.XII.042"},{"key":"ref_23","unstructured":"Fang, J., Zhou, D., Zhao, J., Tang, C., Xu, C., and Zhang, L. (2023). LiDAR-CS dataset: LiDAR point cloud dataset with cross-sensors for 3D object detection. arXiv."},{"key":"ref_24","unstructured":"Kim, M. (2024). A Study on Auto Valet Parking System Based on Dynamic Map Updates Utilizing V2I in Autonomous Vehicles. [Ph.D. Thesis, Graduate School of Automotive Engineering, Kookmin University]."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Mok, S., and Kim, G. (2021, January 17\u201320). Simulated Intensity Rendering of 3D LiDAR using Generative Adversarial Network. Proceedings of the 2021 IEEE International Conference on Big Data and Smart Computing (BigComp), Jeju Island, Republic of Korea.","DOI":"10.1109\/BigComp51126.2021.00062"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Zhao, S., Wang, Y., Li, B., Wu, B., Gao, Y., Xu, P., and Keutzer, K. (2020). ePointDA: An end-to-end simulation-to-real domain adaptation framework for LiDAR point cloud segmentation. arXiv.","DOI":"10.1609\/aaai.v35i4.16464"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Hurl, B., Czarnecki, K., and Waslander, S. (2019, January 9\u201312). Precise synthetic image and LiDAR (Presil) dataset for autonomous vehicle perception. Proceedings of the IEEE Intelligent Vehicles Symposium (IV), Paris, France.","DOI":"10.1109\/IVS.2019.8813809"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"2671","DOI":"10.1109\/TIM.2019.2906416","article-title":"Automatic generation of synthetic LiDAR point clouds for 3-D data analysis","volume":"68","author":"Wang","year":"2019","journal-title":"IEEE Trans. Instrum. Meas."},{"key":"ref_29","unstructured":"Iandola, F.N., Han, S., Moskewicz, M.W., Ashraf, K., Dally, W.J., and Keutzer, K. (2016). SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and <0.5 MB model size. arXiv."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"214","DOI":"10.1111\/j.1467-8659.2007.01016.x","article-title":"Efficient RANSAC for point-cloud shape detection","volume":"26","author":"Schnabel","year":"2007","journal-title":"Comput. Graph. Forum"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Sualeh, M., and Kim, G.W. (2019). Dynamic multi-LiDAR based multiple object detection and tracking. Sensors, 19.","DOI":"10.3390\/s19061474"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"103","DOI":"10.1109\/7.640267","article-title":"Interacting multiple model methods in target tracking: A survey","volume":"34","author":"Mazor","year":"1998","journal-title":"IEEE Trans. Aerosp. Electron. Syst."},{"key":"ref_33","first-page":"1494","article-title":"Multiple sensors and JPDA-IMM-UKF algorithm for tracking multiple maneuvering targets","volume":"1","author":"Saidani","year":"2017","journal-title":"Int. J. Electr. Comput. Eng."},{"key":"ref_34","unstructured":"Rachman, A. (2017). 3D-LIDAR Multi Object Tracking for Autonomous Driving. [Doctoral Dissertation, Delft University of Technology]."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/24\/14\/4475\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T15:13:09Z","timestamp":1760109189000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/24\/14\/4475"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,7,11]]},"references-count":34,"journal-issue":{"issue":"14","published-online":{"date-parts":[[2024,7]]}},"alternative-id":["s24144475"],"URL":"https:\/\/doi.org\/10.3390\/s24144475","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2024,7,11]]}}}