{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,19]],"date-time":"2026-02-19T23:41:12Z","timestamp":1771544472176,"version":"3.50.1"},"reference-count":42,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2024,1,4]],"date-time":"2024-01-04T00:00:00Z","timestamp":1704326400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Ministry of Science and Technology (MOST) in Taiwan","award":["111-2221-E-305-003"],"award-info":[{"award-number":["111-2221-E-305-003"]}]},{"name":"MSC Software","award":["111-2221-E-305-003"],"award-info":[{"award-number":["111-2221-E-305-003"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Given that sensor-based perception systems are utilized in autonomous vehicle applications, it is essential to validate such systems to ensure their robustness before they are deployed. In this study, we propose a comprehensive simulation-based process to verify and enhance the robustness of sensor-based perception systems in relation to corruption. Firstly, we introduce a methodology and scenario-based corruption generation tool for creating a variety of simulated test scenarios. These scenarios can effectively mimic real-world traffic environments, with a focus on corruption types that are related to safety concerns. An effective corruption similarity filtering algorithm is then proposed to eliminate corruption types with high similarity and identify representative corruption types that encompass all considered corruption types. As a result, we can create efficient test scenarios for corruption-related robustness with reduced testing time and comprehensive scenario coverage. Subsequently, we conduct vulnerability analysis on object detection models to identify weaknesses and create an effective training dataset for enhancing model vulnerability. This improves the object detection models\u2019 tolerance to weather and noise-related corruptions, ultimately enhancing the robustness of the perception system. We use case studies to demonstrate the feasibility and effectiveness of the proposed procedures for verifying and enhancing robustness. Furthermore, we investigate the impact of various \u201csimilarity overlap threshold\u201d parameter settings on scenario coverage, effectiveness, scenario complexity (size of training and testing datasets), and time costs.<\/jats:p>","DOI":"10.3390\/s24010301","type":"journal-article","created":{"date-parts":[[2024,1,4]],"date-time":"2024-01-04T04:05:38Z","timestamp":1704341138000},"page":"301","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["Development of an Effective Corruption-Related Scenario-Based Testing Approach for Robustness Verification and Enhancement of Perception Systems in Autonomous Driving"],"prefix":"10.3390","volume":"24","author":[{"given":"Huang","family":"Hsiang","sequence":"first","affiliation":[{"name":"Department of Electrical Engineering, National Taipei University, New Taipei City 23741, Taiwan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6156-5473","authenticated-orcid":false,"given":"Yung-Yuan","family":"Chen","sequence":"additional","affiliation":[{"name":"Department of Electrical Engineering, National Taipei University, New Taipei City 23741, Taiwan"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2024,1,4]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Min, K., Han, S., Lee, D., Choi, D., Sung, K., and Choi, J. (2019, January 16\u201318). SAE Level 3 Autonomous Driving Technology of the ETRI. Proceedings of the 2019 International Conference on Information and Communication Technology Convergence (ICTC), Jeju Island, Republic of Korea.","DOI":"10.1109\/ICTC46691.2019.8939765"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Kl\u00fcck, F., Zimmermann, M., Wotawa, F., and Nica, M. (2019, January 22\u201326). Genetic Algorithm-Based Test Parameter Optimization for ADAS System Testing. Proceedings of the 2019 IEEE 19th International Conference on Software Quality, Reliability and Security (QRS), Sofia, Bulgaria.","DOI":"10.1109\/QRS.2019.00058"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"90","DOI":"10.1109\/MITS.2016.2583491","article-title":"Autonomous Vehicle Safety: An Interdisciplinary Challenge","volume":"9","author":"Koopman","year":"2017","journal-title":"IEEE Intell. Transp. Syst. Mag."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Pezzementi, Z., Tabor, T., Yim, S., Chang, J.K., Drozd, B., Guttendorf, D., Wagner, M., and Koopman, P. (2018, January 6\u20138). Putting Image Manipulations in Context: Robustness Testing for Safe Perception. Proceedings of the 2018 IEEE International Symposium on Safety, Security, and Rescue Robotics (SSRR), Philadelphia, PA, USA.","DOI":"10.1109\/SSRR.2018.8468619"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Bolte, J., Bar, A., Lipinski, D., and Fingscheidt, T. (2019, January 9\u201312). Towards Corner Case Detection for Autonomous Driving. Proceedings of the 2019 IEEE Intelligent Vehicles Symposium (IV), Paris, France.","DOI":"10.1109\/IVS.2019.8813817"},{"key":"ref_6","unstructured":"VIRES Simulationstechnologie GmbH (2023, November 01). VTD\u2014VIRES Virtual Test Drive. Available online: https:\/\/www.embeddedindia.com\/download\/hexagon-vtd.PDF."},{"key":"ref_7","unstructured":"(2022, October 11). CarMaker|IPG Automotive. Available online: https:\/\/ipg-automotive.com\/en\/products-solutions\/software\/carmaker\/."},{"key":"ref_8","unstructured":"Dosovitskiy, A., Ros, G., Codevilla, F., Lopez, A., and Koltun, V. (2017, January 13\u201315). CARLA: An Open Urban Driving Simulator. Proceedings of the 1st Annual Conference on Robot Learning, Mountain View, CA, USA."},{"key":"ref_9","unstructured":"International Organization for Standardization (2018). Road Vehicles\u2013Functional Safety (Standard No. ISO 26262). Available online: https:\/\/www.iso.org\/obp\/ui\/#iso:std:iso:26262:-1:en."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"von Bernuth, A., Volk, G., and Bringmann, O. (2019, January 27\u201330). Simulating Photo-Realistic Snow and Fog on Existing Images for Enhanced CNN Training and Evaluation. Proceedings of the 2019 IEEE Intelligent Transportation Systems Conference (ITSC), Auckland, New Zealand.","DOI":"10.1109\/ITSC.2019.8917367"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Caesar, H., Bankiti, V., Lang, A.H., Vora, S., Liong, V.E., Xu, Q., Krishnan, A., Pan, Y., Baldan, G., and Beijbom, O. (2020, January 13\u201319). nuScenes: A Multimodal Dataset for Autonomous Driving. Proceedings of the 2020 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.01164"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Yu, F., Chen, H., Wang, X., Xian, W., Chen, Y., Liu, F., Madhavan, V., and Darrell, T. (2020, January 13\u201319). BDD100K: A Diverse Driving Dataset for Heterogeneous Multitask Learning. Proceedings of the 2020 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.00271"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Cordts, M., Omran, M., Ramos, S., Rehfeld, T., Enzweiler, M., Benenson, R., Franke, U., Roth, S., and Schiele, B. (2016). The Cityscapes Dataset for Semantic Urban Scene Understanding. arXiv.","DOI":"10.1109\/CVPR.2016.350"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Geiger, A., Lenz, P., and Urtasun, R. (2012, January 16\u201321). Are We Ready for Autonomous Driving? The KITTI Vision Benchmark Suite. Proceedings of the 2012 IEEE Conference on Computer Vision and Pattern Recognition, Providence, RI, USA.","DOI":"10.1109\/CVPR.2012.6248074"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"828","DOI":"10.1109\/TEVC.2019.2890858","article-title":"One Pixel Attack for Fooling Deep Neural Networks","volume":"23","author":"Su","year":"2019","journal-title":"IEEE Trans. Evol. Comput."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Zofka, M.R., Klemm, S., Kuhnt, F., Schamm, T., and Z\u00f6llner, J.M. (2016, January 19\u201322). Testing and Validating High Level Components for Automated Driving: Simulation Framework for Traffic Scenarios. Proceedings of the 2016 IEEE Intelligent Vehicles Symposium (IV), Gotenburg, Sweden.","DOI":"10.1109\/IVS.2016.7535378"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Yu, H., and Li, X. (2018, January 22\u201325). Intelligent Corner Synthesis via Cycle-Consistent Generative Adversarial Networks for Efficient Validation of Autonomous Driving Systems. Proceedings of the 2018 23rd Asia and South Pacific Design Automation Conference (ASP-DAC), Jeju Island, Republic of Korea.","DOI":"10.1109\/ASPDAC.2018.8297275"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Muckenhuber, S., Holzer, H., R\u00fcbsam, J., and Stettinger, G. (2019, January 4\u20138). Object-Based Sensor Model for Virtual Testing of ADAS\/AD Functions. Proceedings of the 2019 IEEE International Conference on Connected Vehicles and Expo (ICCVE), Graz, Austria.","DOI":"10.1109\/ICCVE45908.2019.8965071"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Menzel, T., Bagschik, G., Isensee, L., Schomburg, A., and Maurer, M. (2019, January 9\u201312). From Functional to Logical Scenarios: Detailing a Keyword-Based Scenario Description for Execution in a Simulation Environment. Proceedings of the 2019 IEEE Intelligent Vehicles Symposium (IV), Paris, France.","DOI":"10.1109\/IVS.2019.8814099"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"6680","DOI":"10.1109\/TIP.2020.2992895","article-title":"Structured Dictionary Learning for Image Denoising Under Mixed Gaussian and Impulse Noise","volume":"29","author":"Zhu","year":"2020","journal-title":"IEEE Trans. Image Process."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Wu, D., Du, X., and Wang, K. (2018, January 27\u201329). An Effective Approach for Underwater Sonar Image Denoising Based on Sparse Representation. Proceedings of the 2018 IEEE 3rd International Conference on Image, Vision and Computing (ICIVC), Chongqing, China.","DOI":"10.1109\/ICIVC.2018.8492877"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"600","DOI":"10.1109\/TIP.2003.819861","article-title":"Image Quality Assessment: From Error Visibility to Structural Similarity","volume":"13","author":"Wang","year":"2004","journal-title":"IEEE Trans. Image Process."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Hor\u00e9, A., and Ziou, D. (2010, January 23\u201326). Image Quality Metrics: PSNR vs. SSIM. Proceedings of the 2010 20th International Conference on Pattern Recognition, Istanbul, Turkey.","DOI":"10.1109\/ICPR.2010.579"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"49","DOI":"10.1109\/MRA.2013.2287451","article-title":"Detecting Unfocused Raindrops: In-Vehicle Multipurpose Cameras","volume":"21","author":"Cord","year":"2014","journal-title":"IEEE Robot. Autom. Mag."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Qian, R., Tan, R.T., Yang, W., Su, J., and Liu, J. (2018). Attentive Generative Adversarial Network for Raindrop Removal from a Single Image. arXiv.","DOI":"10.1109\/CVPR.2018.00263"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"von Bernuth, A., Volk, G., and Bringmann, O. (2018, January 26\u201330). Rendering Physically Correct Raindrops on Windshields for Robustness Verification of Camera-Based Object Recognition. Proceedings of the 2018 IEEE Intelligent Vehicles Symposium (IV), Suzhou, China.","DOI":"10.1109\/IVS.2018.8500494"},{"key":"ref_27","unstructured":"Porav, H., Musat, V.-N., Bruls, T., and Newman, P. (2020). Rainy Screens: Collecting Rainy Datasets, Indoors. arXiv."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"111","DOI":"10.1109\/MSP.2020.2984428","article-title":"Simulating the Autonomous Future: A Look at Virtual Vehicle Environments and How to Validate Simulation Using Public Data Sets","volume":"38","author":"Deter","year":"2021","journal-title":"IEEE Signal Process. Mag."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Johnson-Roberson, M., Barto, C., Mehta, R., Sridhar, S.N., Rosaen, K., and Vasudevan, R. (June, January 29). Driving in the Matrix: Can Virtual Worlds Replace Human-Generated Annotations for Real World Tasks?. Proceedings of the 2017 IEEE International Conference on Robotics and Automation (ICRA), Singapore.","DOI":"10.1109\/ICRA.2017.7989092"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Gaidon, A., Wang, Q., Cabon, Y., and Vig, E. (2016, January 27\u201330). VirtualWorlds as Proxy for Multi-Object Tracking Analysis. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.470"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Jin, J., Fatemi, A., Pinto Lira, W.M., Yu, F., Leng, B., Ma, R., Mahdavi-Amiri, A., and Zhang, H. (2021, January 11\u201317). RaidaR: A Rich Annotated Image Dataset of Rainy Street Scenes. Proceedings of the 2021 IEEE\/CVF International Conference on Computer Vision Workshops (ICCVW), Montreal, BC, Canada.","DOI":"10.1109\/ICCVW54120.2021.00330"},{"key":"ref_32","unstructured":"Hendrycks, D., and Dietterich, T. (2019). Benchmarking Neural Network Robustness to Common Corruptions and Perturbations. arXiv."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"4316","DOI":"10.1109\/TITS.2020.3032227","article-title":"Deep Learning for Safe Autonomous Driving: Current Challenges and Future Directions","volume":"22","author":"Muhammad","year":"2021","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_34","unstructured":"Nowruzi, F.E., Kapoor, P., Kolhatkar, D., Hassanat, F.A., Laganiere, R., and Rebut, J. (2019). How Much Real Data Do We Actually Need: Analyzing Object Detection Performance Using Synthetic and Real Data. arXiv."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"3075","DOI":"10.1109\/TGRS.2010.2043955","article-title":"Raindrop Size Distribution Parameters of Distrometer Data With Different Bin Sizes","volume":"48","author":"Marzuki","year":"2010","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"210","DOI":"10.1016\/j.jhydrol.2019.06.040","article-title":"Raindrop Size Distribution and Terminal Velocity for Rainfall Erosivity Studies. A Review","volume":"576","author":"Serio","year":"2019","journal-title":"J. Hydrol."},{"key":"ref_37","unstructured":"Koch, R., and Huang, F. (2019, January 8\u20139). Realistic Modeling of Water Droplets for Monocular Adherent Raindrop Recognition Using B\u00e9zier Curves. Proceedings of the Computer Vision\u2014ACCV 2010 Workshops, Queenstown, New Zealand."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Huang, W., Lv, Y., Chen, L., and Zhu, F. (2017, January 16\u201319). Accelerate the Autonomous Vehicles Reliability Testing in Parallel Paradigm. Proceedings of the 2017 IEEE 20th International Conference on Intelligent Transportation Systems (ITSC), Yokohama, Japan.","DOI":"10.1109\/ITSC.2017.8317959"},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Laugros, A., Caplier, A., and Ospici, M. (2021, January 19\u201322). Using the Overlapping Score to Improve Corruption Benchmarks. Proceedings of the 2021 IEEE International Conference on Image Processing (ICIP), Anchorage, AK, USA.","DOI":"10.1109\/ICIP42928.2021.9506339"},{"key":"ref_40","unstructured":"Kenk, M.A., and Hassaballah, M. (2020). DAWN: Vehicle Detection in Adverse Weather Nature Dataset. arXiv."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"973","DOI":"10.1007\/s11263-018-1072-8","article-title":"Semantic Foggy Scene Understanding with Synthetic Data","volume":"126","author":"Sakaridis","year":"2018","journal-title":"Int. J. Comput. Vis."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Poucin, F., Kraus, A., and Simon, M. (2021, January 11\u201317). Boosting Instance Segmentation with Synthetic Data: A Study to Overcome the Limits of Real World Data Sets. Proceedings of the IEEE\/CVF International Conference on Computer Vision, Montreal, BC, Canada.","DOI":"10.1109\/ICCVW54120.2021.00110"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/24\/1\/301\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T13:39:47Z","timestamp":1760103587000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/24\/1\/301"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,1,4]]},"references-count":42,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2024,1]]}},"alternative-id":["s24010301"],"URL":"https:\/\/doi.org\/10.3390\/s24010301","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,1,4]]}}}