{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,10]],"date-time":"2026-02-10T19:03:56Z","timestamp":1770750236982,"version":"3.50.0"},"reference-count":36,"publisher":"MDPI AG","issue":"24","license":[{"start":{"date-parts":[[2022,12,18]],"date-time":"2022-12-18T00:00:00Z","timestamp":1671321600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Operational Competitiveness and Internationalization Programme (COMPETE 2020)","award":["POCI-01-0247-FEDER-037902"],"award-info":[{"award-number":["POCI-01-0247-FEDER-037902"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Applied Sciences"],"abstract":"<jats:p>The world is facing a great technological transformation towards fully autonomous vehicles, where optimists predict that by 2030 autonomous vehicles will be sufficiently reliable, affordable, and common to displace most human driving. To cope with these trends, reliable perception systems must enable vehicles to hear and see all their surroundings, with light detection and ranging (LiDAR) sensors being a key instrument for recreating a 3D visualization of the world in real time. However, perception systems must rely on accurate measurements of the environment. Thus, these intelligent sensors must be calibrated and benchmarked before being placed on the market or assembled in a car. This article presents an Evaluation and Testing Platform for Automotive LiDAR sensors, with the main goal of testing both commercially available sensors and new sensor prototypes currently under development in Bosch Car Multimedia Portugal. The testing system can benchmark any LiDAR sensor under different conditions, recreating the expected driving environment in which such devices normally operate. To characterize and validate the sensor under test, the platform evaluates several parameters, such as the field of view (FoV), angular resolution, sensor\u2019s range, etc., based only on the point cloud output. This project is the result of a partnership between the University of Minho and Bosch Car Multimedia Portugal.<\/jats:p>","DOI":"10.3390\/app122413003","type":"journal-article","created":{"date-parts":[[2022,12,19]],"date-time":"2022-12-19T04:54:13Z","timestamp":1671425653000},"page":"13003","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":20,"title":["Evaluation and Testing System for Automotive LiDAR Sensors"],"prefix":"10.3390","volume":"12","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-4071-9015","authenticated-orcid":false,"given":"Tiago","family":"Gomes","sequence":"first","affiliation":[{"name":"Centro ALGORITMI\/LASI, Escola de Engenharia, Universidade do Minho, 4800-058 Guimar\u00e3es, Portugal"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8543-550X","authenticated-orcid":false,"given":"Ricardo","family":"Roriz","sequence":"additional","affiliation":[{"name":"Centro ALGORITMI\/LASI, Escola de Engenharia, Universidade do Minho, 4800-058 Guimar\u00e3es, Portugal"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7940-5347","authenticated-orcid":false,"given":"Lu\u00eds","family":"Cunha","sequence":"additional","affiliation":[{"name":"Centro ALGORITMI\/LASI, Escola de Engenharia, Universidade do Minho, 4800-058 Guimar\u00e3es, Portugal"}]},{"given":"Andreas","family":"Ganal","sequence":"additional","affiliation":[{"name":"Bosch Car Multimedia Portugal S.A., 4705-820 Braga, Portugal"}]},{"given":"Narciso","family":"Soares","sequence":"additional","affiliation":[{"name":"Bosch Car Multimedia Portugal S.A., 4705-820 Braga, Portugal"}]},{"given":"Teresa","family":"Ara\u00fajo","sequence":"additional","affiliation":[{"name":"Bosch Car Multimedia Portugal S.A., 4705-820 Braga, Portugal"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3287-3995","authenticated-orcid":false,"given":"Jo\u00e3o","family":"Monteiro","sequence":"additional","affiliation":[{"name":"Centro ALGORITMI\/LASI, Escola de Engenharia, Universidade do Minho, 4800-058 Guimar\u00e3es, Portugal"}]}],"member":"1968","published-online":{"date-parts":[[2022,12,18]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"18","DOI":"10.1109\/MC.2017.4451204","article-title":"Self-Driving Cars","volume":"50","author":"Daily","year":"2017","journal-title":"Computer"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"113816","DOI":"10.1016\/j.eswa.2020.113816","article-title":"Self-driving cars: A survey","volume":"165","author":"Badue","year":"2021","journal-title":"Expert Syst. Appl."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"7572","DOI":"10.1109\/JIOT.2021.3130054","article-title":"Autonomous Driving Security: State of the Art and Challenges","volume":"9","author":"Gao","year":"2022","journal-title":"IEEE Internet Things J."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"58443","DOI":"10.1109\/ACCESS.2020.2983149","article-title":"A Survey of Autonomous Driving: Common Practices and Emerging Technologies","volume":"8","author":"Yurtsever","year":"2020","journal-title":"IEEE Access"},{"key":"ref_5","unstructured":"Litman, T. (2021). Autonomous Vehicle Implementation Predictions, Victoria Transport Policy Institute Victoria."},{"key":"ref_6","unstructured":"Society of Automotive Engineers (SAE) (2021). Taxonomy and Definitions for Terms Related to Driving Automation Systems for On-Road Motor Vehicles (Surface Vehicle Recommended Practice: Superseding J3016 Jun 2018), SAE International."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Guerrero-Ib\u00e1\u00f1ez, J., Zeadally, S., and Contreras-Castillo, J. (2018). Sensor Technologies for Intelligent Transportation Systems. Sensors, 18.","DOI":"10.3390\/s18041212"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"94","DOI":"10.1109\/MITS.2019.2907630","article-title":"A Review of Sensor Technologies for Perception in Automated Driving","volume":"11","author":"Marti","year":"2019","journal-title":"IEEE Intell. Transp. Syst. Mag."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Shahian Jahromi, B., Tulabandhula, T., and Cetin, S. (2019). Real-Time Hybrid Multi-Sensor Fusion Framework for Perception in Autonomous Vehicles. Sensors, 19.","DOI":"10.3390\/s19204357"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Mohammed, A.S., Amamou, A., Ayevide, F.K., Kelouwani, S., Agbossou, K., and Zioui, N. (2020). The Perception System of Intelligent Ground Vehicles in All Weather Conditions: A Systematic Literature Review. Sensors, 20.","DOI":"10.3390\/s20226532"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Warren, M.E. (2019, January 9\u201314). Automotive LIDAR Technology. Proceedings of the 2019 Symposium on VLSI Circuits, Kyoto, Japan.","DOI":"10.23919\/VLSIC.2019.8777993"},{"key":"ref_12","first-page":"50","article-title":"Lidar for Autonomous Driving: The Principles, Challenges, and Trends for Automotive Lidar and Perception Systems","volume":"37","author":"Li","year":"2020","journal-title":"IEEE Signal Process. Mag."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"6282","DOI":"10.1109\/TITS.2021.3086804","article-title":"Automotive LiDAR Technology: A Survey","volume":"23","author":"Roriz","year":"2022","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_14","unstructured":"Cunha, L., Roriz, R., Pinto, S., and Gomes, T. (2022). Hardware-Accelerated Data Decoding and Reconstruction for Automotive LiDAR Sensors. IEEE Trans. Veh. Technol., 1\u201310."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"3782","DOI":"10.1109\/TITS.2019.2892405","article-title":"A Survey on 3D Object Detection Methods for Autonomous Driving Applications","volume":"20","author":"Arnold","year":"2019","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Shi, S., Wang, X., and Li, H. (2022, September 01). PointRCNN: 3D Object Proposal Generation and Detection From Point Cloud. Available online: https:\/\/openaccess.thecvf.com\/content_CVPR_2019\/html\/Shi_PointRCNN_3D_Object_Proposal_Generation_and_Detection_From_Point_Cloud_CVPR_2019_paper.html.","DOI":"10.1109\/CVPR.2019.00086"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Wu, J., Xu, H., Tian, Y., Pi, R., and Yue, R. (2020). Vehicle Detection under Adverse Weather from Roadside LiDAR Data. Sensors, 20.","DOI":"10.3390\/s20123433"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"71","DOI":"10.1016\/j.robot.2016.11.014","article-title":"Pedestrian recognition and tracking using 3D LiDAR for autonomous vehicle","volume":"88","author":"Wang","year":"2017","journal-title":"Robot. Auton. Syst."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Peng, X., and Shan, J. (2021). Detection and Tracking of Pedestrians Using Doppler LiDAR. Remote Sens., 13.","DOI":"10.3390\/rs13152952"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"7841","DOI":"10.1109\/TITS.2021.3073151","article-title":"A Fast Point Cloud Ground Segmentation Approach Based on Coarse-To-Fine Markov Random Field","volume":"23","author":"Huang","year":"2022","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Karlsson, R., Wong, D.R., Kawabata, K., Thompson, S., and Sakai, N. (2022, January 4\u20139). Probabilistic Rainfall Estimation from Automotive Lidar. Proceedings of the 2022 IEEE Intelligent Vehicles Symposium (IV), Aachen, Germany.","DOI":"10.1109\/IV51971.2022.9827119"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Raj, T., Hashim, F., Huddin, B., Ibrahim, M., and Hussain, A. (2020). A Survey on LiDAR Scanning Mechanisms. Electronics, 9.","DOI":"10.3390\/electronics9050741"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"135","DOI":"10.1109\/MCOM.2017.1700030","article-title":"Lidar System Architectures and Circuits","volume":"55","author":"Behroozpour","year":"2017","journal-title":"IEEE Commun. Mag."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"663","DOI":"10.1016\/S1631-0705(03)00097-5","article-title":"Laser diode reliability: Crystal defects and degradation modes","volume":"4","year":"2003","journal-title":"Comptes Rendus Phys."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Kwong, W.C., Lin, W.Y., Yang, G.C., and Glesk, I. (2020, January 19\u201323). 2-D Optical-CDMA Modulation in Automotive Time-of-Flight LIDAR Systems. Proceedings of the 2020 22nd International Conference on Transparent Optical Networks (ICTON), Bari, Italy.","DOI":"10.1109\/ICTON51198.2020.9203019"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"3507","DOI":"10.1109\/JSEN.2017.2688126","article-title":"A CDMA Modulation Technique for Automotive Time-of-Flight LiDAR Systems","volume":"17","author":"Fersch","year":"2017","journal-title":"IEEE Sensors J."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Lee, H., Kim, S., Park, S., Jeong, Y., Lee, H., and Yi, K. (2017, January 11\u201314). AVM \/ LiDAR sensor based lane marking detection method for automated driving on complex urban roads. Proceedings of the 2017 IEEE Intelligent Vehicles Symposium (IV), Los Angeles, CA, USA.","DOI":"10.1109\/IVS.2017.7995911"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Jokela, M., Kutila, M., and Pyyk\u00f6nen, P. (2019). Testing and Validation of Automotive Point-Cloud Sensors in Adverse Weather Conditions. Appl. Sci., 9.","DOI":"10.3390\/app9112341"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Vargas Rivero, J.R., Gerbich, T., Teiluf, V., Buschardt, B., and Chen, J. (2020). Weather Classification Using an Automotive LIDAR Sensor Based on Detections on Asphalt and Atmosphere. Sensors, 20.","DOI":"10.3390\/s20154306"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"1621","DOI":"10.1109\/JSEN.2021.3133873","article-title":"DIOR: A Hardware-Assisted Weather Denoising Solution for LiDAR Point Clouds","volume":"22","author":"Roriz","year":"2022","journal-title":"IEEE Sensors J."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1109\/LSENS.2020.2996428","article-title":"A Framework to Analyze Noise Factors of Automotive Perception Sensors","volume":"4","author":"Chan","year":"2020","journal-title":"IEEE Sensors Lett."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Carballo, A., Lambert, J., Monrroy, A., Wong, D., Narksri, P., Kitsukawa, Y., Takeuchi, E., Kato, S., and Takeda, K. (2020\u201313, January 19). LIBRE: The Multiple 3D LiDAR Dataset. Proceedings of the 2020 IEEE Intelligent Vehicles Symposium (IV), Las Vegas, NV, USA.","DOI":"10.1109\/IV47402.2020.9304681"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"131699","DOI":"10.1109\/ACCESS.2020.3009680","article-title":"Performance Analysis of 10 Models of 3D LiDARs for Automated Driving","volume":"8","author":"Lambert","year":"2020","journal-title":"IEEE Access"},{"key":"ref_34","first-page":"199","article-title":"Benchmarking time-of-flight based depth measurement techniques","volume":"Volume 9751","author":"He","year":"2016","journal-title":"Smart Photonic and Optoelectronic Integrated Circuits XVIII"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"12949","DOI":"10.1364\/OE.24.012949","article-title":"Technique to separate lidar signal and sunlight","volume":"24","author":"Sun","year":"2016","journal-title":"Opt. Express"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Rusu, R.B., and Cousins, S. (2011, January 18). 3D is here: Point Cloud Library (PCL). Proceedings of the 2011 IEEE International Conference on Robotics and Automation (ICRA), Shanghai, China.","DOI":"10.1109\/ICRA.2011.5980567"}],"container-title":["Applied Sciences"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2076-3417\/12\/24\/13003\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T01:43:41Z","timestamp":1760147021000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2076-3417\/12\/24\/13003"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,12,18]]},"references-count":36,"journal-issue":{"issue":"24","published-online":{"date-parts":[[2022,12]]}},"alternative-id":["app122413003"],"URL":"https:\/\/doi.org\/10.3390\/app122413003","relation":{},"ISSN":["2076-3417"],"issn-type":[{"value":"2076-3417","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,12,18]]}}}