{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,19]],"date-time":"2026-03-19T07:03:22Z","timestamp":1773903802847,"version":"3.50.1"},"reference-count":37,"publisher":"MDPI AG","issue":"12","license":[{"start":{"date-parts":[[2021,6,9]],"date-time":"2021-06-09T00:00:00Z","timestamp":1623196800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>There have been significant advances regarding target detection in the autonomous vehicle context. To develop more robust systems that can overcome weather hazards as well as sensor problems, the sensor fusion approach is taking the lead in this context. Laser Imaging Detection and Ranging (LiDAR) and camera sensors are two of the most used sensors for this task since they can accurately provide important features such as target\u00b4s depth and shape. However, most of the current state-of-the-art target detection algorithms for autonomous cars do not take into consideration the hardware limitations of the vehicle such as the reduced computing power in comparison with Cloud servers as well as the reduced latency. In this work, we propose Edge Computing Tensor Processing Unit (TPU) devices as hardware support due to their computing capabilities for machine learning algorithms as well as their reduced power consumption. We developed an accurate and small target detection model for these devices. Our proposed Multi-Level Sensor Fusion model has been optimized for the network edge, specifically for the Google Coral TPU. As a result, high accuracy results are obtained while reducing the memory consumption as well as the latency of the system using the challenging KITTI dataset.<\/jats:p>","DOI":"10.3390\/s21123992","type":"journal-article","created":{"date-parts":[[2021,6,9]],"date-time":"2021-06-09T14:16:04Z","timestamp":1623248164000},"page":"3992","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":25,"title":["Camera-LiDAR Multi-Level Sensor Fusion for Target Detection at the Network Edge"],"prefix":"10.3390","volume":"21","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-5981-4135","authenticated-orcid":false,"given":"Javier","family":"Mendez","sequence":"first","affiliation":[{"name":"Infineon Technologies AG, Am Campeon 1-15, 85579 Neubiberg, Germany"},{"name":"Department of Electronic and Computer Technology, University of Granada, Avenida de Fuente Nueva s\/n, 18071 Granada, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1778-1910","authenticated-orcid":false,"given":"Miguel","family":"Molina","sequence":"additional","affiliation":[{"name":"Infineon Technologies AG, Am Campeon 1-15, 85579 Neubiberg, Germany"},{"name":"Department of Electronic and Computer Technology, University of Granada, Avenida de Fuente Nueva s\/n, 18071 Granada, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6032-6921","authenticated-orcid":false,"given":"Noel","family":"Rodriguez","sequence":"additional","affiliation":[{"name":"Department of Electronic and Computer Technology, University of Granada, Avenida de Fuente Nueva s\/n, 18071 Granada, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Manuel P.","family":"Cuellar","sequence":"additional","affiliation":[{"name":"Department of Computer Science and AI, University of Granada, C\/Periodista Daniel Saucedo Aranda s\/n, 18071 Granada, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3294-8934","authenticated-orcid":false,"given":"Diego P.","family":"Morales","sequence":"additional","affiliation":[{"name":"Department of Electronic and Computer Technology, University of Granada, Avenida de Fuente Nueva s\/n, 18071 Granada, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2021,6,9]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"113816","DOI":"10.1016\/j.eswa.2020.113816","article-title":"Self-driving cars: A survey","volume":"165","author":"Badue","year":"2020","journal-title":"Expert Syst. Appl."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1231","DOI":"10.1177\/0278364913491297","article-title":"Vision meets robotics: The kitti dataset","volume":"32","author":"Geiger","year":"2013","journal-title":"Int. J. Robot. Res."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Caesar, H., Bankiti, V., Lang, A.H., Vora, S., Liong, V.E., Xu, Q., Krishnan, A., Pan, Y., Baldan, G., and Beijbom, O. (2020, January 14\u201319). nuscenes: A multimodal dataset for autonomous driving. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.01164"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Redmon, J., Divvala, S., Girshick, R., and Farhadi, A. (2016, January 27\u201330). You only look once: Unified, real-time object detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.91"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Girshick, R., Donahue, J., Darrell, T., and Malik, J. (2014, January 24\u201327). Rich feature hierarchies for accurate object detection and semantic segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA.","DOI":"10.1109\/CVPR.2014.81"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Girshick, R. (2015, January 7\u201313). Fast r-cnn. Proceedings of the IEEE International Conference on Computer Vision, Santiago, Chile.","DOI":"10.1109\/ICCV.2015.169"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S., Fu, C.Y., and Berg, A.C. (2016, January 11\u201314). SSD: Single Shot MultiBox Detector. Proceedings of the 14th European Conference, Amsterdam, The Netherlands.","DOI":"10.1007\/978-3-319-46448-0_2"},{"key":"ref_8","unstructured":"Morgulis, N., Kreines, A., Mendelowitz, S., and Weisglass, Y. (2019). Fooling a real car with adversarial traffic signs. arXiv."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"6337","DOI":"10.1109\/JIOT.2020.3016145","article-title":"Adaptive Square Attack: Fooling Autonomous Cars with Adversarial Traffic Signs","volume":"8","author":"Li","year":"2020","journal-title":"IEEE Internet Things J."},{"key":"ref_10","unstructured":"Sitawarin, C., Bhagoji, A.N., Mosenia, A., Chiang, M., and Mittal, P. (2018). Darts: Deceiving autonomous cars with toxic signs. arXiv."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Nobis, F., Geisslinger, M., Weber, M., Betz, J., and Lienkamp, J. (2019, January 15\u201317). A Deep Learning-based Radar and Camera Sensor Fusion Architecture for Object Detection. Proceedings of the 2019 Sensor Data Fusion: Trends Solutions, Applications (SDF), Bonn, Germany.","DOI":"10.1109\/SDF.2019.8916629"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Pfeuffer, A., and Dietmayer, K. (2018, January 10\u201313). Optimal sensor data fusion architecture for object detection in adverse weather conditions. Proceedings of the 2018 21st International Conference on Information Fusion (FUSION), Cambridge, UK.","DOI":"10.23919\/ICIF.2018.8455757"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Pfeuffer, A., and Dietmayer, K. (2019, January 2\u20135). Robust semantic segmentation in adverse weather conditions by means of sensor data fusion. Proceedings of the 2019 22th International Conference on Information Fusion (FUSION), Ottawa, ON, Canada.","DOI":"10.23919\/FUSION43075.2019.9011192"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Cao, Y., Xiao, C., Cyr, B., Zhou, Y., Park, W., Rampazzi, S., Chen, Q.A., Fu, K., and Mao, Z.M. (2019, January 11\u201315). Adversarial sensor attack on lidar-based perception in autonomous driving. Proceedings of the 2019 ACM SIGSAC Conference on Computer and Communications Security, London, UK.","DOI":"10.1145\/3319535.3339815"},{"key":"ref_15","unstructured":"Sun, J., Cao, Y., Chen, Q.A., and Mao, Z.M. (2020, January 12\u201314). Towards robust lidar-based perception in autonomous driving: General black-box adversarial sensor attack and countermeasures. Proceedings of the 29th USENIX Security Symposium, Boston, MA, USA."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"159","DOI":"10.1016\/j.ins.2020.03.066","article-title":"Adversarial attacks on deep-learning-based radar range profile target recognition","volume":"531","author":"Huang","year":"2020","journal-title":"Inf. Sci."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Li, J., Rakin, A.S., He, Z., Fan, D., and Chakrabarti, C. (2021). RADAR: Run-time Adversarial Weight Attack Detection and Accuracy Recovery. arXiv.","DOI":"10.23919\/DATE51398.2021.9474113"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Snoek, C.G., Worring, M., and Smeulders, A.W. (2005, January 6\u201311). Early versus late fusion in semantic video analysis. Proceedings of the 13th Annual ACM International Conference on Multimedia, Singapore.","DOI":"10.1145\/1101149.1101236"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Kim, J., Choi, J., Kim, Y., Koh, J., Chung, C.C., and Choi, J.W. (2018, January 26\u201330). Robust Camera Lidar Sensor Fusion Via Deep Gated Information Fusion Network. Proceedings of the 2018 IEEE Intelligent Vehicles Symposium (IV), Changshu, China.","DOI":"10.1109\/IVS.2018.8500711"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"4287","DOI":"10.1109\/JSTARS.2018.2869801","article-title":"Voxel-Based Extraction and Classification of 3-D Pole-Like Objects From Mobile LiDAR Point Cloud Data","volume":"11","author":"Kang","year":"2018","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote. Sens."},{"key":"ref_21","unstructured":"Xu, D., Li, T., Li, Y., Su, X., Tarkoma, S., and Hui, P. (2020). A survey on edge intelligence. arXiv."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"1738","DOI":"10.1109\/JPROC.2019.2918951","article-title":"Edge intelligence: Paving the last mile of artificial intelligence with edge computing","volume":"107","author":"Zhou","year":"2019","journal-title":"Proc. IEEE"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Chabot, F., Chaouch, M., Rabarisoa, J., Teuliere, C., and Chateau, T. (2017, January 21\u201326). Deep manta: A coarse-to-fine many-task network for joint 2d and 3d vehicle analysis from monocular image. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.198"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Christiansen, M.P., Laursen, M.S., J\u00f8rgensen, R.N., Skovsen, S., and Gislum, R. (2017). Designing and testing a UAV mapping system for agricultural field surveying. Sensors, 17.","DOI":"10.3390\/s17122703"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Patil, A.K., and Chai, Y.H. (2019). On-site 4-in-1 alignment: Visualization and interactive cad model retrofitting using uav, lidar\u2019s point cloud data, and video. Sensors, 19.","DOI":"10.3390\/s19183908"},{"key":"ref_26","unstructured":"Zarzar, J., Giancola, S., and Ghanem, B. (2019). PointRGCN: Graph convolution networks for 3D vehicles detection refinement. arXiv."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Pang, S., Morris, D., and Radha, H. (2020). CLOCs: Camera-LiDAR Object Candidates Fusion for 3D Object Detection. arXiv.","DOI":"10.1109\/IROS45743.2020.9341791"},{"key":"ref_28","unstructured":"Simonyan, K., and Zisserman, A. (2014). Very deep convolutional networks for large-scale image recognition. arXiv."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"062013","DOI":"10.1088\/1742-6596\/1168\/6\/062013","article-title":"Classification method of LiDAR point cloud based on threedimensional convolutional neural network","volume":"1168","author":"Zhao","year":"2019","journal-title":"J. Physics Conf. Ser."},{"key":"ref_30","unstructured":"Velodyne (2021, May 31). Velodyne HDL-64E Sensor. Available online: https:\/\/velodynelidar.com\/products\/hdl-64e\/."},{"key":"ref_31","unstructured":"Google (2021, May 31). Google Coral TPU Dev Board. Available online: https:\/\/coral.ai\/products\/dev-board\/."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Chen, X., Ma, H., Wan, J., Li, B., and Xia, T. (2017, January 21\u201326). Multi-view 3d object detection network for autonomous driving. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.691"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Du, X., Ang, M.H., Karaman, S., and Rus, D. (2018, January 21\u201325). A general pipeline for 3d detection of vehicles. Proceedings of the 2018 IEEE International Conference on Robotics and Automation (ICRA), Brisbane, QSL, Australia.","DOI":"10.1109\/ICRA.2018.8461232"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"He, C., Zeng, H., Huang, J., Hua, X.S., and Zhang, L. (2020, January 14\u201319). Structure aware single-stage 3d object detection from point cloud. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.01189"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Chen, Y., Tai, L., Sun, K., and Li, M. (2020, January 14\u201319). Monopair: Monocular 3D object detection using pairwise spatial relationships. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.01211"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Simons, T., and Lee, D.J. (2019). A review of binarized neural networks. Electronics, 8.","DOI":"10.3390\/electronics8060661"},{"key":"ref_37","unstructured":"Lin, J., Rao, Y., Lu, J., and Zhou, J. (2017, January 4\u20139). Runtime neural pruning. Proceedings of the 31st Conference on Neural Information Processing Systems (NIPS 2017), Long Beach, CA, USA."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/12\/3992\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T06:12:38Z","timestamp":1760163158000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/12\/3992"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,6,9]]},"references-count":37,"journal-issue":{"issue":"12","published-online":{"date-parts":[[2021,6]]}},"alternative-id":["s21123992"],"URL":"https:\/\/doi.org\/10.3390\/s21123992","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,6,9]]}}}