{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,4]],"date-time":"2026-08-04T09:51:47Z","timestamp":1785837107097,"version":"3.56.0"},"reference-count":48,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2023,1,3]],"date-time":"2023-01-03T00:00:00Z","timestamp":1672704000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>The key to autonomous navigation in unmanned systems is the ability to recognize static and moving objects in the environment and to support the task of predicting the future state of the environment, avoiding collisions, and planning. However, because the existing 3D LiDAR point-cloud moving object segmentation (MOS) convolutional neural network (CNN) models are very complex and have large computation burden, it is difficult to perform real-time processing on embedded platforms. In this paper, we propose a lightweight MOS network structure based on LiDAR point-cloud sequence range images with only 2.3 M parameters, which is 66% less than the state-of-the-art network. When running on RTX 3090 GPU, the processing time is 35.82 ms per frame and it achieves an intersection-over-union(IoU) score of 51.3% on the SemanticKITTI dataset. In addition, the proposed CNN successfully runs the FPGA platform using an NVDLA-like hardware architecture, and the system achieves efficient and accurate moving-object segmentation of LiDAR point clouds at a speed of 32 fps, meeting the real-time requirements of autonomous vehicles.<\/jats:p>","DOI":"10.3390\/s23010547","type":"journal-article","created":{"date-parts":[[2023,1,4]],"date-time":"2023-01-04T03:27:44Z","timestamp":1672802864000},"page":"547","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":22,"title":["Real-Time LiDAR Point-Cloud Moving Object Segmentation for Autonomous Driving"],"prefix":"10.3390","volume":"23","author":[{"given":"Xing","family":"Xie","sequence":"first","affiliation":[{"name":"School of Information Science and Technology, Nantong University, Nantong 226019, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1856-5627","authenticated-orcid":false,"given":"Haowen","family":"Wei","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Columbia University, New York, NY 10027, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5604-5505","authenticated-orcid":false,"given":"Yongjie","family":"Yang","sequence":"additional","affiliation":[{"name":"School of Information Science and Technology, Nantong University, Nantong 226019, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2023,1,3]]},"reference":[{"key":"ref_1","unstructured":"Yin, Z., and Tuzel, O. (2018, January 18\u201323). VoxelNet: End-to-End Learning for Point Cloud Based 3D Object Detection. Proceedings of the 2018 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Salt Lake City, UT, USA."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Zhang, C., Luo, W., and Urtasun, R. (2018, January 5\u20138). Efficient Convolutions for Real-Time Semantic Segmentation of 3D Point Clouds. Proceedings of the 2018 International Conference on 3D Vision (3DV), Verona, Italy.","DOI":"10.1109\/3DV.2018.00053"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1380","DOI":"10.1109\/TITS.2019.2905046","article-title":"3D LiDAR-Based Global Localization Using Siamese Neural Network","volume":"21","author":"Yin","year":"2019","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"6529","DOI":"10.1109\/LRA.2021.3093567","article-title":"Moving Object Segmentation in 3D LiDAR Data: A Learning-based Approach Exploiting Sequential Data","volume":"6","author":"Chen","year":"2021","journal-title":"IEEE Robot. Autom. Lett."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Lyu, Y., Bai, L., and Huang, X. (2018, January 27\u201330). Real-Time Road Segmentation Using LiDAR Data Processing on an FPGA. Proceedings of the 2018 IEEE International Symposium on Circuits and Systems (ISCAS), Florence, Italy.","DOI":"10.1109\/ISCAS.2018.8351244"},{"key":"ref_6","unstructured":"Qi, C.R., Su, H., Mo, K., and Guibas, L.J. (2017, January 21\u201326). PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA."},{"key":"ref_7","unstructured":"Nvidia (2022, July 02). Nvidia Deep Learning Accelerator. Available online: https:\/\/developer.nvidia.com\/deep-learning-accelerator."},{"key":"ref_8","unstructured":"Xilinx (2022, August 03). Dpuczdx8g for Zynq Ultrascale+ Mpsocs Product Guide. Available online: https:\/\/docs.xilinx.com\/r\/en-US\/pg338-dpu?tocId=Bd4R4bhnWgMYE6wUISXDLw."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Barnes, D., Maddern, W., Pascoe, G., and Posner, I. (2018, January 21\u201325). Driven to distraction: Self-supervised distractor learning for robust monocular visual odometry in urban environments. Proceedings of the 2018 IEEE International Conference on Robotics and Automation (ICRA), Brisbane, Australia.","DOI":"10.1109\/ICRA.2018.8460564"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Patil, P.W., Biradar, K.M., Dudhane, A., and Murala, S. (2020, January 13\u201319). An end-to-end edge aggregation network for moving object segmentation. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.00817"},{"key":"ref_11","first-page":"1","article-title":"YOLOv4-5D: An Effective and Efficient Object Detector for Autonomous Driving","volume":"70","author":"Cai","year":"2021","journal-title":"IEEE Trans. Instrum. Meas."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"5421","DOI":"10.1109\/TITS.2021.3053863","article-title":"A Novel System for Nighttime Vehicle Detection Based on Foveal Classifiers with Real-Time Performance","volume":"23","author":"Bell","year":"2021","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"21405","DOI":"10.1109\/TITS.2022.3177615","article-title":"SFNet-N: An Improved SFNet Algorithm for Semantic Segmentation of Low-light Autonomous Driving Road Scenes","volume":"23","author":"Wang","year":"2022","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_14","unstructured":"Yan, J., Chen, D., Myeong, H., Shiratori, T., and Ma, Y. (2014, January 8\u201311). Automatic Extraction of Moving Objects from Image and LIDAR Sequences. Proceedings of the 2014 2nd International Conference on 3D Vision, Tokyo, Japan."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Postica, G., Romanoni, A., Matteucci, M., Shiratori, T., and Ma, Y. (2016, January 9\u201314). Robust moving objects detection in lidar data exploiting visual cues. Proceedings of the 2016 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Daejeon, Republic of Korea.","DOI":"10.1109\/IROS.2016.7759185"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Xie, X., Bai, L., and Huang, X. (2022). Real-Time LiDAR Point Cloud Semantic Segmentation for Autonomous Driving. Electronics, 11.","DOI":"10.3390\/electronics11010011"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Milioto, A., Vizzo, I., Behley, J., and Stachniss, C. (2019, January 3\u20138). RangeNet ++: Fast and Accurate LiDAR Semantic Segmentation. Proceedings of the 2019 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Macau, China.","DOI":"10.1109\/IROS40897.2019.8967762"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Cortinhal, T., Tzelepis, G., and Aksoy, E.E. (2020). SalsaNext: Fast, Uncertainty-aware Semantic Segmentation of LiDAR Point Clouds for Autonomous Driving. arXiv.","DOI":"10.1007\/978-3-030-64559-5_16"},{"key":"ref_19","unstructured":"Li, S., Chen, X., Liu, Y., Dai, D., Stachniss, C., and Gall, J. (2020). Multiscale interaction for real-time lidar data segmentation on an embedded platform. arXiv."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Wu, B., Zhou, X., Zhao, S., Yue, X., and Keutzer, K. (2019, January 20\u201324). SqueezeSegV2: Improved Model Structure and Unsupervised Domain Adaptation for Road-Object Segmentation from a LiDAR Point Cloud. Proceedings of the 2019 International Conference on Robotics and Automation (ICRA), Montreal, QC, Canada.","DOI":"10.1109\/ICRA.2019.8793495"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Zhang, Y., Zhou, Z., David, P., Yue, X., and Foroosh, H. (2020, January 13\u201319). PolarNet: An Improved Grid Representation for Online LiDAR Point Clouds Semantic Segmentation. Proceedings of the 2020 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.00962"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Xu, C., Wu, B., Wang, Z., Zhan, W., Vajda, P., Keutzer, K., and Tomizuka, M. (2020). SqueezeSegV3: Spatially-Adaptive Convolution for Efficient Point-Cloud Segmentation, Springer.","DOI":"10.1007\/978-3-030-58604-1_1"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Sun, X., Wang, M., Du, J., Sun, Y., Cheng, S.S., and Xie, W. (2022). A Task-Driven Scene-Aware LiDAR Point Cloud Coding Framework for Autonomous Vehicles. IEEE Trans. Ind. Inform.","DOI":"10.1109\/TII.2022.3221222"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Sun, X., Wang, S., Wang, M., Cheng, S.S., and Liu, M. (2020, January 12\u201316). An Advanced LiDAR Point Cloud Sequence Coding Scheme for Autonomous Driving. Proceedings of the 28th ACM International Conference on Multimedia (MM \u201920), Seattle, WA, USA.","DOI":"10.1145\/3394171.3413537"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Liu, X., Qi, C.R., and Guibas, L.J. (2019, January 15\u201320). Flownet3d: Learning scene flow in 3d point clouds. Proceedings of the 2019 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00062"},{"key":"ref_26","unstructured":"Qi, C.R., Yi, L., Su, H., and Guibas, L.J. (2017). PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Space. arXiv."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Shi, H., Lin, G., Wang, H., Hung, T.Y., and Wang, Z. (2020, January 13\u201319). Spsequencenet: Semantic segmentation network on 4d point clouds. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.00463"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Thomas, H., Qi, C., Deschaud, J., Marcotegui, B., Goulette, F., and Guibas, L. (2019, January 27\u201328). KPConv: Flexible and Deformable Convolution for Point Clouds. Proceedings of the 2019 IEEE\/CVF International Conference on Computer Vision (ICCV), Seoul, Republic of Korea.","DOI":"10.1109\/ICCV.2019.00651"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Tang, H., Liu, Z., Zhao, S., Lin, Y., Lin, J., Wang, H., and Han, S. (2020, January 23\u201328). Searching Efficient 3D Architectures with Sparse Point-Voxel Convolution. Proceedings of the 16th European Conference on Computer Vision (ECCV), Edinburgh, UK.","DOI":"10.1007\/978-3-030-58604-1_41"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Mohapatra, S., Hodaei, M., Yogamani, S., Milz, S., Gotzig, H., Simon, M., Rashed, H., and Maeder, P. (2021). LiMoSeg: Real-time Bird\u2019s Eye View based LiDAR Motion Segmentation. arXiv.","DOI":"10.5220\/0010866000003124"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Sun, J., Dai, Y., Zhang, X., Xu, J., Rui, A., Gu, W., and Chen, X. (2022). Efficient Spatial-Temporal Information Fusion for LiDAR-Based 3D Moving Object Segmentation. arXiv.","DOI":"10.1109\/IROS47612.2022.9981210"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"8044","DOI":"10.1109\/LRA.2022.3186080","article-title":"RVMOS: Range-View Moving Object Segmentation Leveraged by Semantic and Motion Features","volume":"7","author":"Kim","year":"2022","journal-title":"IEEE Robot. Autom. Lett."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"41","DOI":"10.1109\/TCAD.2022.3172031","article-title":"EmPointMovSeg: Sparse Tensor Based Moving Object Segmentation in 3D LiDAR Point Clouds for Autonomous Driving Embedded System","volume":"42","author":"He","year":"2022","journal-title":"IEEE Trans. Comput. Aided Des. Integr. Circuits Syst."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"704","DOI":"10.1109\/TCSI.2020.3038139","article-title":"RoadNet-RT: High Throughput CNN Architecture and SoC Design for Real-Time Road Segmentation","volume":"68","author":"Bai","year":"2020","journal-title":"IEEE Trans. Circ. Syst. Regul. Pap."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"7825","DOI":"10.1109\/ACCESS.2020.3045681","article-title":"DepthNet: Real-Time LiDAR Point Cloud Depth Completion for Autonomous Vehicles","volume":"8","author":"Bai","year":"2020","journal-title":"IEEE Access"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Shen, J., You, H., Qiao, Y., Mei, W., and Zhang, C. (2018, January 27\u201330). Towards a Multi-array Architecture for Accelerating Large-scale Matrix Multiplication on FPGAs. Proceedings of the 2018 IEEE International Symposium on Circuits and Systems (ISCAS), Florence, Italy.","DOI":"10.1109\/ISCAS.2018.8351474"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Wu, G., Yong, D., and Miao, W. (2010, January 8\u201310). High performance and memory efficient implementation of matrix multiplication on FPGAs. Proceedings of the International Conference on Field-Programmable Technology, FPT 2010, Beijing, China.","DOI":"10.1109\/FPT.2010.5681769"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Chang, J.W., and Kang, S.J. (2018, January 22\u201325). Optimizing FPGA-based convolutional neural networks accelerator for image super-resolution. Proceedings of the 2018 23rd Asia and South Pacific Design Automation Conference (ASP-DAC), Jeju, Republic of Korea.","DOI":"10.1109\/ASPDAC.2018.8297347"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"1769","DOI":"10.1109\/TCSI.2018.2881162","article-title":"ChipNet: Real-Time LiDAR Processing for Drivable Region Segmentation on an FPGA","volume":"66","author":"Lyu","year":"2019","journal-title":"IEEE Trans. Circ. Syst. Regul. Pap."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27\u201330). Deep Residual Learning for Image Recognition. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_41","unstructured":"Chen, L.-C., Papandreou, G., Schroff, F., and Adam, H. (2017). Rethinking atrous convolution for semantic image segmentation. arXiv."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Yu, C., Wang, J., Peng, C., Gao, C., Yu, G., and Sang, N. (2018, January 8\u201314). BiSeNet: Bilateral Segmentation Network for Real-time Semantic Segmentation. Proceedings of the 15th European Conference on Computer Vision (ECCV), Munich, Germany.","DOI":"10.1007\/978-3-030-01261-8_20"},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Ronneberger, O., Fischer, P., and Brox, T. (2015, January 5\u20139). U-net: Convolutional networks for biomedical image segmentation. Proceedings of the International Conference on Medical Image Computing and Computer-Assisted Intervention (MICCAI), Munich, Germany.","DOI":"10.1007\/978-3-319-24574-4_28"},{"key":"ref_44","first-page":"640","article-title":"Fully convolutional networks for semantic segmentation","volume":"39","author":"Long","year":"2015","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Behley, J., Garbade, M., Milioto, A., Quenzel, J., Behnke, S., Stachniss, C., and Gall, J. (2019, January 27\u201328). SemanticKITTI: A Dataset for Semantic Scene Understanding of LiDAR Sequences. Proceedings of the 2019 IEEE\/CVF International Conference on Computer Vision (ICCV), Seoul, Republic of Korea.","DOI":"10.1109\/ICCV.2019.00939"},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"303","DOI":"10.1007\/s11263-009-0275-4","article-title":"The Pascal Visual Object Classes (VOC) Challenge","volume":"88","author":"Everingham","year":"2010","journal-title":"Int. J. Comput. Vis."},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Geiger, A., Lenz, P., and Urtasun, R. (2012, January 16\u201321). Are we ready for autonomous driving? The KITTI vision benchmark suite. Proceedings of the 2012 IEEE Conference on Computer Vision and Pattern Recognition, Providence, RI, USA.","DOI":"10.1109\/CVPR.2012.6248074"},{"key":"ref_48","unstructured":"Bradski, G. (2022, August 20). The OpenCV Library. Available online: https:\/\/github.com\/opencv\/opencv\/wiki\/CiteOpenCV."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/1\/547\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T17:57:37Z","timestamp":1760119057000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/1\/547"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,1,3]]},"references-count":48,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2023,1]]}},"alternative-id":["s23010547"],"URL":"https:\/\/doi.org\/10.3390\/s23010547","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,1,3]]}}}