{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,21]],"date-time":"2026-05-21T16:56:48Z","timestamp":1779382608475,"version":"3.53.1"},"reference-count":51,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2025,2,26]],"date-time":"2025-02-26T00:00:00Z","timestamp":1740528000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Hunan Provincial Natural Science Foundation of China","award":["2024JJ7428"],"award-info":[{"award-number":["2024JJ7428"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Information"],"abstract":"<jats:p>In recent years, pseudo point clouds generated from depth completion of RGB images and LiDAR data have provided a robust foundation for multimodal 3D object detection. However, the generation process often introduces noise, reducing data quality and detection accuracy. Moreover, existing methods fail to effectively capture channel correlations and global contextual information during the 2D feature extraction stage after the 3D backbone network, limiting detection performance. To address these challenges, this paper proposes NRAP-RCNN, a pseudo point cloud-based 3D object detection method with two key innovations: (1) A noise-reduction sparse convolution network (NRConvNet), comprising NRConv (noise-resistant submanifold sparse convolution), SRB (sparse convolution residual block), and MHSA (multi-head self-attention). NRConv suppresses pseudo point cloud noise by jointly encoding 2D and 3D features, SRB enhances feature extraction depth and robustness, and MHSA optimizes global feature representation. (2) An attention fusion module (ECA_GCA) is introduced to enhance the feature representation of the 2D backbone network by combining channel and global contextual information. The experimental results demonstrate that NRAP-RCNN achieves 88.4% car AP (R40) on the KITTI validation set and 85.1% on the test set, significantly outperforming advanced 3D detection methods, showcasing its effectiveness in improving detection performance.<\/jats:p>","DOI":"10.3390\/info16030176","type":"journal-article","created":{"date-parts":[[2025,2,26]],"date-time":"2025-02-26T06:15:33Z","timestamp":1740550533000},"page":"176","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["NRAP-RCNN: A Pseudo Point Cloud 3D Object Detection Method Based on Noise-Reduction Sparse Convolution and Attention Mechanism"],"prefix":"10.3390","volume":"16","author":[{"given":"Ziyue","family":"Zhou","sequence":"first","affiliation":[{"name":"School of Computer Science, University of South China, Hengyang 421001, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yongqing","family":"Jia","sequence":"additional","affiliation":[{"name":"Technology Department, Hunan Electric Research Institute Testing Group Co., Ltd., Xiangxiang 411402, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5879-5980","authenticated-orcid":false,"given":"Tao","family":"Zhu","sequence":"additional","affiliation":[{"name":"School of Computer Science, University of South China, Hengyang 421001, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yaping","family":"Wan","sequence":"additional","affiliation":[{"name":"School of Computer Science, University of South China, Hengyang 421001, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2025,2,26]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Lang, A.H., Vora, S., Caesar, H., Zhou, L., and Beijbom, O. (2019, January 15\u201320). PointPillars: Fast Encoders for Object Detection From Point Clouds. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.01298"},{"key":"ref_2","unstructured":"Yang, Z., Sun, Y., Liu, S., Shen, X., and Jia, J. (November, January 27). STD: Sparse-to-Dense 3D Object Detector for Point Cloud. Proceedings of the ICCV, Seoul, Republic of Korea."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Ye, M., Xu, S., and Cao, T. (2020, January 13\u201319). HVNet: Hybrid Voxel Network for LiDAR Based 3D Object Detection. Proceedings of the 2020 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.00170"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"156285","DOI":"10.1109\/ACCESS.2020.3019187","article-title":"Visual-LiDAR based 3D Object Detection and Tracking for Embedded Systems","volume":"8","author":"Sualeh","year":"2020","journal-title":"IEEE Access"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Mao, J., Niu, M., Bai, H., Liang, X., Xu, H., and Xu, C. (2021, January 11\u201317). Pyramid R-CNN: Towards Better Performance and Adaptability for 3D Object Detection. Proceedings of the ICCV, Montreal, QC, Canada.","DOI":"10.1109\/ICCV48922.2021.00272"},{"key":"ref_6","first-page":"813","article-title":"Robust 3D Object Detection from LiDAR Point Cloud Data with Spatial Information Aggregation","volume":"Volume 1268","author":"Aranjuelo","year":"2020","journal-title":"Proceedings of the SOCO"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Zheng, W., Tang, W., Jiang, L., and Fu, C. (2021, January 20\u201325). SE-SSD: Self-Ensembling Single-Stage Object Detector From Point Cloud. Proceedings of the CVPR, Nashville, TN, USA.","DOI":"10.1109\/CVPR46437.2021.01426"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Wu, H., Wen, C., Li, W., Li, X., Yang, R., and Wang, C. (2023, January 7\u201314). Transformation-Equivariant 3D Object Detection for Autonomous Driving. Proceedings of the AAAI, Washington, DC, USA.","DOI":"10.1609\/aaai.v37i3.25380"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Qi, C.R., Liu, W., Wu, C., Su, H., and Guibas, L.J. (2018, January 18\u201323). Frustum PointNets for 3D Object Detection From RGB-D Data. Proceedings of the CVPR, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00102"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Liang, M., Yang, B., Chen, Y., Hu, R., and Urtasun, R. (2019, January 15\u201320). Multi-Task Multi-Sensor Fusion for 3D Object Detection. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00752"},{"key":"ref_11","first-page":"720","article-title":"3D-CVF: Generating Joint Camera and LiDAR Features Using Cross-view Spatial Feature Fusion for 3D Object Detection","volume":"Volume 12372","author":"Yoo","year":"2020","journal-title":"Proceedings of the ECCV (27)"},{"key":"ref_12","unstructured":"Yin, T., Zhou, X., and Krhenb\u00fchl, P. (2021, January 6\u201314). Multimodal Virtual Point 3D Detection. Proceedings of the Neural Information Processing Systems, Online."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Wu, X., Peng, L., Yang, H., Xie, L., Huang, C., Deng, C., Liu, H., and Cai, D. (2022, January 18\u201324). Sparse Fuse Dense: Towards High Quality 3D Detection with Depth Completion. Proceedings of the CVPR, New Orleans, LA, USA.","DOI":"10.1109\/CVPR52688.2022.00534"},{"key":"ref_14","first-page":"35","article-title":"EPNet: Enhancing Point Features with Image Semantics for 3D Object Detection","volume":"Volume 12360","author":"Huang","year":"2020","journal-title":"Proceedings of the ECCV (15)"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Wu, H., Wen, C., Shi, S., Li, X., and Wang, C. (2023, January 17\u201324). Virtual Sparse Convolution for Multimodal 3D Object Detection. Proceedings of the CVPR, Vancouver, BC, Canada.","DOI":"10.1109\/CVPR52729.2023.02074"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Zhou, Y., and Tuzel, O. (2018, January 18\u201323). VoxelNet: End-to-End Learning for Point Cloud Based 3D Object Detection. Proceedings of the CVPR, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00472"},{"key":"ref_17","unstructured":"Qi, C.R., Su, H., Mo, K., and Guibas, L.J. (2017, January 21\u201326). PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Shi, S., Guo, C., Jiang, L., Wang, Z., Shi, J., Wang, X., and Li, H. (2020, January 13\u201319). PV-RCNN: Point-Voxel Feature Set Abstraction for 3D Object Detection. Proceedings of the CVPR, Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.01054"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Deng, J., Shi, S., Li, P., Zhou, W., Zhang, Y., and Li, H. (2021, January 2\u20139). Voxel R-CNN: Towards High Performance Voxel-based 3D Object Detection. Proceedings of the AAAI, Online.","DOI":"10.1609\/aaai.v35i2.16207"},{"key":"ref_20","unstructured":"Hu, M., Wang, S., Li, B., Ning, S., Fan, L., and Gong, X. (June, January 30). PENet: Towards Precise and Efficient Image Guided Depth Completion. Proceedings of the ICRA, Xi\u2019an, China."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Chen, X., Ma, H., Wan, J., Li, B., and Xia, T. (2017, January 21\u201326). Multi-View 3D Object Detection Network for Autonomous Driving. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.691"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Beltran, J., Guindel, C., Moreno, F.M., Cruzado, D., Garcia, F., and Arturo, D.L.E. (2018, January 4\u20137). BirdNet: A 3D Object Detection Framework from LiDAR Information. Proceedings of the 2018 21st International Conference on Intelligent Transportation Systems (ITSC), Maui, HI, USA.","DOI":"10.1109\/ITSC.2018.8569311"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1109\/TIM.2022.3216413","article-title":"Voxel-RCNN-Complex: An Effective 3-D Point Cloud Object Detector for Complex Traffic Conditions","volume":"71","author":"Wang","year":"2022","journal-title":"IEEE Trans. Instrum. Meas."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"531","DOI":"10.1007\/s11263-022-01710-9","article-title":"PV-RCNN++: Point-Voxel Feature Set Abstraction With Local Vector Representation for 3D Object Detection","volume":"131","author":"Shi","year":"2023","journal-title":"Int. J. Comput. Vis."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Shi, S., Wang, X., and Li, H. (2019, January 15\u201320). PointRCNN: 3D Object Proposal Generation and Detection From Point Cloud. Proceedings of the 2019 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00086"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Yang, Z., Sun, Y., Liu, S., and Jia, J. (2020;, January 13\u201319). 3DSSD: Point-Based 3D Single Stage Object Detector. Proceedings of the CVPR, Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.01105"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Sindagi, V.A., Zhou, Y., and Tuzel, O. (2019, January 20\u201324). MVX-Net: Multimodal VoxelNet for 3D Object Detection. Proceedings of the 2019 International Conference on Robotics and Automation (ICRA), Montreal, QC, Canada.","DOI":"10.1109\/ICRA.2019.8794195"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Vora, S., Lang, A.H., Helou, B., and Beijbom, O. (2020, January 13\u201319). PointPainting: Sequential Fusion for 3D Object Detection. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.00466"},{"key":"ref_29","unstructured":"Cai, H., Zhang, Z., Zhou, Z., Li, Z., Ding, W., and Zhao, J. (2023). BEVFusion4D: Learning LiDAR-Camera Fusion Under Bird\u2019s-Eye-View via Cross-Modality Guidance and Temporal Aggregation. arXiv."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"950","DOI":"10.1145\/882262.882368","article-title":"Bilateral Mesh Denoising","volume":"22","author":"Fleishman","year":"2003","journal-title":"ACM Trans. Graph."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"103","DOI":"10.1016\/j.image.2017.05.009","article-title":"A review of algorithms for filtering the 3D point cloud","volume":"57","author":"Han","year":"2017","journal-title":"Signal Process. Image Commun."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"17397","DOI":"10.1007\/s11042-017-5310-9","article-title":"Guided 3D point cloud filtering","volume":"77","author":"Han","year":"2018","journal-title":"Multimed. Tools Appl."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Luo, S., and Hu, W. (2021, January 10\u201317). Score-Based Point Cloud Denoising. Proceedings of the IEEE\/CVF International Conference on Computer Vision (ICCV), Montreal, QC, Canada.","DOI":"10.1109\/ICCV48922.2021.00454"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"2514","DOI":"10.1109\/LRA.2020.2972865","article-title":"CNN-based Lidar Point Cloud De-Noising in Adverse Weather","volume":"5","author":"Heinzler","year":"2020","journal-title":"IEEE Robot. Autom. Lett."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"100","DOI":"10.1109\/TPAMI.2020.3007074","article-title":"BDCN: Bi-Directional Cascade Network for Perceptual Edge Detection","volume":"44","author":"He","year":"2020","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"10299","DOI":"10.1109\/TCSVT.2024.3405789","article-title":"Blind Image Quality Assessment via Adaptive Graph Attention","volume":"34","author":"Wang","year":"2024","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Li, Y., Yang, X., Fu, J., Yue, G., and Zhou, W. (2024, January 15\u201319). Deep Bi-directional Attention Network for Image Super-Resolution Quality Assessment. Proceedings of the 2024 IEEE International Conference on Multimedia and Expo (ICME), Niagara Falls, ON, Canada.","DOI":"10.1109\/ICME57554.2024.10687430"},{"key":"ref_38","unstructured":"Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, L., and Polosukhin, I. (2017, January 7). Attention is All you Need. Proceedings of the NIPS, Long Beach, CA, USA."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"220","DOI":"10.1016\/j.inffus.2019.09.003","article-title":"Image Denoising Review: From Classical to State-of-the-Art Approaches","volume":"55","author":"Goyal","year":"2020","journal-title":"Inf. Fusion"},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"George, S.N., and Sagheer, S.M. (2020). A review on medical image denoising algorithms. Biomed. Signal Process. Control., 61.","DOI":"10.1016\/j.bspc.2020.102036"},{"key":"ref_41","first-page":"3969","article-title":"Fast bilateral filtering for denoising large 3D images","volume":"25","author":"Papari","year":"2016","journal-title":"IEEE Trans. Image Process."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Barsanti, S.G., Marini, M., Malatesta, S., and Rossi, A. (2024). Evaluation of Denoising and Voxelization Algorithms on 3D Point Clouds. Remote Sens., 16.","DOI":"10.3390\/rs16142632"},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27\u201330). Deep Residual Learning for Image Recognition. Proceedings of the CVPR, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Wang, Q., Wu, B., Zhu, P., Li, P., and Hu, Q. (2020, January 13\u201319). ECA-Net: Efficient Channel Attention for Deep Convolutional Neural Networks. Proceedings of the 2020 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.01155"},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Cao, Y., Xu, J., Lin, S., Wei, F., and Hu, H. (2020, January 20\u201328). GCNet: Non-Local Networks Meet Squeeze-Excitation Networks and Beyond. Proceedings of the 2019 IEEE\/CVF International Conference on Computer Vision Workshop (ICCVW), Seoul, Republic of Korea.","DOI":"10.1109\/ICCVW.2019.00246"},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"2379","DOI":"10.1364\/JOSAA.4.002379","article-title":"Relations between the statistics of natural images and the response properties of cortical cells","volume":"4","author":"Field","year":"1987","journal-title":"J. Opt. Soc. Am. -Opt. Image Sci. Vis."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"1231","DOI":"10.1177\/0278364913491297","article-title":"Vision meets robotics: The KITTI dataset","volume":"32","author":"Geiger","year":"2013","journal-title":"Int. J. Robotics Res."},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Zhao, X., Su, L., Zhang, X., Yang, D., Sun, M., Wang, S., Zhai, P., and Zhang, L. (2023, January 4\u201310). D-CONFORMER: Deformable Sparse Transformer Augmented Convolution for Voxel-Based 3D Object Detection. Proceedings of the ICASSP, Rhodes Island, Greece.","DOI":"10.1109\/ICASSP49357.2023.10097060"},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1109\/TGRS.2022.3228927","article-title":"CasA: A Cascade Attention Network for 3-D Object Detection from LiDAR Point Clouds","volume":"60","author":"Wu","year":"2022","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_50","first-page":"662","article-title":"Graph R-CNN: Towards Accurate 3D Object Detection with Semantic-Decorated Local Graph","volume":"Volume 13668","author":"Yang","year":"2022","journal-title":"Proceedings of the ECCV (8)"},{"key":"ref_51","doi-asserted-by":"crossref","unstructured":"Mo, Y., Wu, Y., Zhao, J., Hou, J., Huang, W., Hu, Y., Wang, J., and Yan, J. (2024, January 15\u201318). Sparse Query Dense: Enhancing 3D Object Detection with Pseudo points. Proceedings of the ACM Multimedia, Bari, Italy.","DOI":"10.1145\/3664647.3681420"}],"container-title":["Information"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2078-2489\/16\/3\/176\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,9]],"date-time":"2025-10-09T16:42:56Z","timestamp":1760028176000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2078-2489\/16\/3\/176"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,2,26]]},"references-count":51,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2025,3]]}},"alternative-id":["info16030176"],"URL":"https:\/\/doi.org\/10.3390\/info16030176","relation":{},"ISSN":["2078-2489"],"issn-type":[{"value":"2078-2489","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,2,26]]}}}