{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,18]],"date-time":"2026-05-18T03:19:38Z","timestamp":1779074378670,"version":"3.51.4"},"reference-count":86,"publisher":"Association for Computing Machinery (ACM)","issue":"FSE","license":[{"start":{"date-parts":[[2024,7,12]],"date-time":"2024-07-12T00:00:00Z","timestamp":1720742400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by-sa\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Proc. ACM Softw. Eng."],"published-print":{"date-parts":[[2024,7,12]]},"abstract":"<jats:p>\n                    The optimization of a system\u2019s configuration options is crucial for determining its performance and functionality, particularly in the case of autonomous driving software (ADS) systems because they possess a multitude of such options. Research efforts in the domain of ADS have prioritized the development of automated testing methods to enhance the safety and security of self-driving cars. Presently, search-based approaches are utilized to test ADS systems in a virtual environment, thereby simulating real-world scenarios. However, such approaches rely on optimizing the waypoints of ego cars and obstacles to generate diverse scenarios that trigger violations, and no prior techniques focus on optimizing the ADS from the perspective of configuration. To address this challenge, we present a framework called C\n                    <jats:sc>onf<\/jats:sc>\n                    VE, which is the first automated configuration testing framework for ADSes. C\n                    <jats:sc>onf<\/jats:sc>\n                    VE\u2019s design focuses on the emergence of violations through rerunning scenarios generated by different ADS testing approaches under different configurations, leveraging 9 test oracles to enable previous ADS testing approaches to find more types of violations without modifying their designs or implementations and employing a novel technique to identify bug-revealing violations and eliminate duplicate violations. Our evaluation results demonstrate that C\n                    <jats:sc>onf<\/jats:sc>\n                    VE can discover\n                    <jats:inline-formula>\n                      <mml:math xmlns:mml=\"http:\/\/www.w3.org\/1998\/Math\/MathML\" display=\"inline\">\n                        <mml:mrow>\n                          <mml:mn>1<\/mml:mn>\n                          <mml:mo>,<\/mml:mo>\n                          <mml:mn>818<\/mml:mn>\n                        <\/mml:mrow>\n                      <\/mml:math>\n                    <\/jats:inline-formula>\n                    unique violations and reduce\n                    <jats:inline-formula>\n                      <mml:math xmlns:mml=\"http:\/\/www.w3.org\/1998\/Math\/MathML\" display=\"inline\">\n                        <mml:mn>74.19<\/mml:mn>\n                        <mml:mo>%<\/mml:mo>\n                      <\/mml:math>\n                    <\/jats:inline-formula>\n                    of duplicate violations.\n                  <\/jats:p>","DOI":"10.1145\/3660792","type":"journal-article","created":{"date-parts":[[2024,7,12]],"date-time":"2024-07-12T10:22:09Z","timestamp":1720779729000},"page":"1913-1936","source":"Crossref","is-referenced-by-count":9,"title":["Misconfiguration Software Testing for Failure Emergence in Autonomous Driving Systems"],"prefix":"10.1145","volume":"1","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-3497-4167","authenticated-orcid":false,"given":"Yuntianyi","family":"Chen","sequence":"first","affiliation":[{"name":"University of California, Irvine, Irvine, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4792-8215","authenticated-orcid":false,"given":"Yuqi","family":"Huai","sequence":"additional","affiliation":[{"name":"University of California, Irvine, Irvine, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0006-8875-983X","authenticated-orcid":false,"given":"Shilong","family":"Li","sequence":"additional","affiliation":[{"name":"University of California, Irvine, Irvine, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0000-3704-3379","authenticated-orcid":false,"given":"Changnam","family":"Hong","sequence":"additional","affiliation":[{"name":"University of California, Irvine, Irvine, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1696-8783","authenticated-orcid":false,"given":"Joshua","family":"Garcia","sequence":"additional","affiliation":[{"name":"University of California, Irvine, Irvine, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2024,7,12]]},"reference":[{"key":"e_1_3_1_2_2","doi-asserted-by":"publisher","unstructured":"April 2024. Source Code and Data of ConfVE. https:\/\/doi.org\/10.5281\/zenodo.11406940 10.5281\/zenodo.11406940","DOI":"10.5281\/zenodo.11406940"},{"key":"e_1_3_1_3_2","doi-asserted-by":"publisher","unstructured":"April 2024. Video Recordings of ConfVE. https:\/\/doi.org\/10.5281\/zenodo.11051748 10.5281\/zenodo.11051748","DOI":"10.5281\/zenodo.11051748"},{"key":"e_1_3_1_4_2","unstructured":"August 2021. Dreamland\u2019s Grading System. https:\/\/bit.ly\/3nfe48e"},{"key":"e_1_3_1_5_2","unstructured":"August 2021. Google\u2019s Self-Driving Car Caused Its First Accident. https:\/\/bit.ly\/3acQwgO"},{"key":"e_1_3_1_6_2","unstructured":"August 2021. Look no hands! Test driving a Google car. https:\/\/bit.ly\/3kWXPAm"},{"key":"e_1_3_1_7_2","unstructured":"August 2021. Open Vehicles Compatible with Apollo. https:\/\/apollo.auto\/vehicle\/certificate_en.html"},{"key":"e_1_3_1_8_2","unstructured":"August 2021. Self-Driving Tesla Was Involved in Fatal Crash U.S. Says. https:\/\/nyti.ms\/3abv3Vq"},{"key":"e_1_3_1_9_2","unstructured":"August 2021. Tesla: Autopilot was on during deadly Mountain View crash. https:\/\/bayareane.ws\/3U1p4av"},{"key":"e_1_3_1_10_2","unstructured":"August 2021. Tesla driver dies in first fatal crash while using autopilot mode. https:\/\/bit.ly\/3nlNavo"},{"key":"e_1_3_1_11_2","unstructured":"August 2021. There are some scary similarities between Tesla\u2019s deadly crashes linked to Autopilot. https:\/\/bit.ly\/3Zppqsz"},{"key":"e_1_3_1_12_2","unstructured":"August 2023. 5 Traffic Laws You Might Not Realize You Broke. https:\/\/bit.ly\/45V7vy7"},{"key":"e_1_3_1_13_2","unstructured":"August 2023. Autoware Foundation Members. https:\/\/autoware.org\/about\/members\/"},{"key":"e_1_3_1_14_2","unstructured":"August 2023. Autoware: Open-source software for urban autonomous driving. https:\/\/bit.ly\/3xPVmuH"},{"key":"e_1_3_1_15_2","unstructured":"August 2023. Contributing Factors To Aggressive Driving. https:\/\/bit.ly\/48giaF7"},{"key":"e_1_3_1_16_2","unstructured":"August 2023. What You Need to Know About Unsafe Lane Changes. https:\/\/bit.ly\/3PoMViF"},{"key":"e_1_3_1_17_2","unstructured":"December 2022. Baidu Apollo: An open autonomous driving platform. http:\/\/apollo.auto\/"},{"key":"e_1_3_1_18_2","unstructured":"February 2018. Two Years On A Father Is Still Fighting Tesla Over Autopilot And His Son\u2019s Fatal Crash. https:\/\/bit.ly\/42OFMxS"},{"key":"e_1_3_1_19_2","unstructured":"February 2022. Waymo to begin charging for robotaxi rides in San Francisco. https:\/\/tcrn.ch\/3lUBoNd"},{"key":"e_1_3_1_20_2","unstructured":"February 2024. Autoware release\/v1.0. https:\/\/github.com\/autowarefoundation\/autoware\/tree\/release\/v1.0"},{"key":"e_1_3_1_21_2","unstructured":"Feburary 2023. Dangers of Speeding: Facts and Problems | Wilson Kehoe Winingham. bit.ly\/3JW0Fzv"},{"key":"e_1_3_1_22_2","unstructured":"July 2022. U.S. agency to review if Pony.ai complied with crash reporting order. https:\/\/tinyurl.com\/42twsa2b"},{"key":"e_1_3_1_23_2","unstructured":"June 2018. Tesla Autopilot System Found Probably at Fault in 2018 Crash. https:\/\/nyti.ms\/3qXuioY"},{"key":"e_1_3_1_24_2","unstructured":"June 2021. Baidu is building Level 4 autonomous robotaxis called Apollo Moon in China. https:\/\/bit.ly\/3HQ46qH"},{"key":"e_1_3_1_25_2","unstructured":"June 2022. GM\u2019s Cruise starts charging fares for driverless rides in San Francisco. https:\/\/reut.rs\/40rtGJu"},{"key":"e_1_3_1_26_2","unstructured":"June 2022. Toyota Follows Tesla In Developing A Vision-Based Self-Driving System. https:\/\/bit.ly\/3TQQNuw"},{"key":"e_1_3_1_27_2","unstructured":"March 2018. Self-Driving Uber Car Kills Pedestrian in Arizona Where Robots Roam. https:\/\/nyti.ms\/40IHWxd"},{"key":"e_1_3_1_28_2","unstructured":"March 2022. Self-Driving Fundamentals: Featuring Apollo | Udacity. https:\/\/bit.ly\/3RnMVC0"},{"key":"e_1_3_1_29_2","unstructured":"March 2023. Apollo: An open autonomous driving platform. https:\/\/bit.ly\/3XSQUa5."},{"key":"e_1_3_1_30_2","unstructured":"March 2023. Tesla Autopilot. https:\/\/www.tesla.com\/autopilot"},{"key":"e_1_3_1_31_2","unstructured":"March 2023. Uber Advanced Technolgoy Group. https:\/\/ubr.to\/40tYsBA"},{"key":"e_1_3_1_32_2","unstructured":"March 2023. Waymo. https:\/\/waymo.com\/"},{"key":"e_1_3_1_33_2","unstructured":"November 2018. Baidu hits the gas on autonomous vehicles with Volvo and Ford deals. https:\/\/tcrn.ch\/3EL8Prj"},{"key":"e_1_3_1_34_2","doi-asserted-by":"crossref","unstructured":"October 2020. Ford unveils new self-driving test vehicle for 2022 launch. https:\/\/cnb.cx\/3zi2AIQ","DOI":"10.1016\/S1464-2859(20)30376-X"},{"key":"e_1_3_1_35_2","unstructured":"October 2021. Tesla Sold 2 Million Electric Cars: First Automaker To Reach Milestone. https:\/\/bit.ly\/3G1zDVm"},{"key":"e_1_3_1_36_2","unstructured":"September 2023. Inquiry about time cost of simulation \u00b7 autowarefoundation \u00b7 Discussion #3853 \u00b7 GitHub. https:\/\/bit.ly\/432LLiU"},{"key":"e_1_3_1_37_2","unstructured":"September 2023. Motion sickness: MedlinePlus Genetics. https:\/\/bit.ly\/3sYuoCe."},{"key":"e_1_3_1_38_2","unstructured":"September 2023. TIER IV Autoware Evaluator. https:\/\/bit.ly\/49SKfSX"},{"key":"e_1_3_1_39_2","doi-asserted-by":"publisher","DOI":"10.1145\/2970276.2970311"},{"key":"e_1_3_1_40_2","doi-asserted-by":"publisher","DOI":"10.1145\/3180155.3180160"},{"key":"e_1_3_1_41_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.trf.2018.02.036"},{"key":"e_1_3_1_42_2","article-title":"Ten ways autonomous driving could redefine the automotive world","volume":"6","author":"Bertoncello Michele","year":"2015","unstructured":"Michele Bertoncello and Dominik Wee. 2015. Ten ways autonomous driving could redefine the automotive world. McKinsey & Company 6 (2015).","journal-title":"McKinsey & Company"},{"key":"e_1_3_1_43_2","doi-asserted-by":"publisher","DOI":"10.1109\/ASE51524.2021.9678525"},{"key":"e_1_3_1_44_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICST46399.2020.00045"},{"key":"e_1_3_1_45_2","doi-asserted-by":"publisher","DOI":"10.1109\/SBST52555.2021.00016"},{"key":"e_1_3_1_46_2","doi-asserted-by":"publisher","DOI":"10.1145\/3597926.3598072"},{"key":"e_1_3_1_47_2","article-title":"Operational design domain for automated driving systems","author":"Czarnecki Krzysztof","year":"2018","unstructured":"Krzysztof Czarnecki. 2018. Operational design domain for automated driving systems. Taxonomy of Basic Terms \u201c, Waterloo Intelligent Systems Engineering (WISE) Lab, University of Waterloo, Canada (2018).","journal-title":"Taxonomy of Basic Terms \u201c, Waterloo Intelligent Systems Engineering (WISE) Lab, University of Waterloo, Canada"},{"key":"e_1_3_1_48_2","doi-asserted-by":"publisher","DOI":"10.1007\/3-540-45356-3_83"},{"key":"e_1_3_1_49_2","doi-asserted-by":"publisher","DOI":"10.1016\/S0005-7967(02)00046-3"},{"key":"e_1_3_1_50_2","doi-asserted-by":"crossref","unstructured":"Yao Deng Xi Zheng Mengshi Zhang Guannan Lou and Tianyi Zhang. 2022. Scenario-Based Test Reduction and Prioritization for Multi-Module Autonomous Driving Systems. http:\/\/arxiv.org\/abs\/2209.01546 arXiv:2209.01546 [cs].","DOI":"10.1145\/3540250.3549152"},{"key":"e_1_3_1_51_2","first-page":"226","volume-title":"Proceedings of the Second International Conference on Knowledge Discovery and Data Mining (KDD-96), Portland, Oregon, USA","author":"Ester Martin","year":"1996","unstructured":"Martin Ester, Hans-Peter Kriegel, J\u00f6rg Sander, and Xiaowei Xu. 1996. A Density-Based Algorithm for Discovering Clusters in Large Spatial Databases with Noise. In Proceedings of the Second International Conference on Knowledge Discovery and Data Mining (KDD-96), Portland, Oregon, USA, Evangelos Simoudis, Jiawei Han, and Usama M. Fayyad (Eds.). AAAI Press, 226\u2013231. http:\/\/www.aaai.org\/Library\/KDD\/1996\/kdd96-037.php"},{"key":"e_1_3_1_52_2","unstructured":"Federal Highway Administration US Department of Transportation. June 2009. Analysis of Lane-Change Crashes and Near-Crashes. https:\/\/bit.ly\/3WUnLtO"},{"key":"e_1_3_1_53_2","doi-asserted-by":"publisher","DOI":"10.1145\/2463372.2463454"},{"key":"e_1_3_1_54_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE-Companion.2019.00030"},{"key":"e_1_3_1_55_2","doi-asserted-by":"publisher","DOI":"10.1145\/3377811.3380397"},{"key":"e_1_3_1_56_2","doi-asserted-by":"publisher","DOI":"10.1016\/B978-0-444-63437-5.00027-3"},{"key":"e_1_3_1_57_2","doi-asserted-by":"publisher","DOI":"10.1145\/2961111.2962602"},{"key":"e_1_3_1_58_2","doi-asserted-by":"publisher","DOI":"10.1145\/3510003.3510188"},{"key":"e_1_3_1_59_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2023.3309610"},{"key":"e_1_3_1_60_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE48619.2023.00216"},{"key":"e_1_3_1_61_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE-Companion.2019.00031"},{"key":"e_1_3_1_62_2","doi-asserted-by":"publisher","DOI":"10.1145\/3468264.3468601"},{"key":"e_1_3_1_63_2","doi-asserted-by":"publisher","DOI":"10.1109\/DSN.2008.4630084"},{"key":"e_1_3_1_64_2","doi-asserted-by":"publisher","DOI":"10.1145\/3548606.3560558"},{"key":"e_1_3_1_65_2","doi-asserted-by":"publisher","DOI":"10.1109\/SBST52555.2021.00017"},{"key":"e_1_3_1_66_2","doi-asserted-by":"publisher","DOI":"10.1109\/ISSRE5003.2020.00012"},{"key":"e_1_3_1_67_2","doi-asserted-by":"publisher","DOI":"10.1109\/TR.2018.2865962"},{"key":"e_1_3_1_68_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2022.3150788"},{"key":"e_1_3_1_69_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-88106-1_4"},{"key":"e_1_3_1_70_2","unstructured":"Anna C Mastroianni Ruth R Faden and Daniel D Federman. 1994. Women and health research. (1994)."},{"key":"e_1_3_1_71_2","doi-asserted-by":"publisher","DOI":"10.1145\/2884781.2884793"},{"key":"e_1_3_1_72_2","doi-asserted-by":"publisher","DOI":"10.1109\/SBST52555.2021.00018"},{"key":"e_1_3_1_73_2","volume-title":"Invisible women: Data bias in a world designed for men","author":"Perez Caroline Criado","year":"2019","unstructured":"Caroline Criado Perez. 2019. Invisible women: Data bias in a world designed for men. Abrams."},{"key":"e_1_3_1_74_2","doi-asserted-by":"publisher","DOI":"10.1145\/2667317.2667330"},{"key":"e_1_3_1_75_2","doi-asserted-by":"publisher","DOI":"10.1109\/ITSC45102.2020.9294422"},{"key":"e_1_3_1_76_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.iatssr.2019.12.002"},{"key":"e_1_3_1_77_2","first-page":"735","volume-title":"14th USENIX Symposium on Operating Systems Design and Implementation, OSDI 2020, Virtual Event, November 4-6, 2020","author":"Sun Xudong","year":"2020","unstructured":"Xudong Sun, Runxiang Cheng, Jianyan Chen, Elaine Ang, Owolabi Legunsen, and Tianyin Xu. 2020. Testing Configuration Changes in Context to Prevent Production Failures. In 14th USENIX Symposium on Operating Systems Design and Implementation, OSDI 2020, Virtual Event, November 4-6, 2020. USENIX Association, 735\u2013751. https:\/\/www.usenix.org\/conference\/osdi20\/presentation\/sun"},{"key":"e_1_3_1_78_2","doi-asserted-by":"publisher","DOI":"10.1109\/32.979992"},{"key":"e_1_3_1_79_2","doi-asserted-by":"crossref","unstructured":"Haoxiang Tian Yan Jiang Guoquan Wu Jiren Yan Jun Wei Wei Chen Shuo Li and Dan Ye. 2022. MOSAT: Finding Safety Violations of Autonomous Driving Systems using Multi-objective Genetic Algorithm. (2022) 13.","DOI":"10.1145\/3540250.3549100"},{"key":"e_1_3_1_80_2","doi-asserted-by":"crossref","unstructured":"Haoxiang Tian Guoquan Wu Jiren Yan Yan Jiang Jun Wei Wei Chen Shuo Li and Dan Ye. 2022. Generating Critical Test Scenarios for Autonomous Driving Systems via Influential Behavior Patterns. (2022) 13.","DOI":"10.1145\/3551349.3560430"},{"key":"e_1_3_1_81_2","doi-asserted-by":"publisher","DOI":"10.1080\/001401399184730"},{"key":"e_1_3_1_82_2","doi-asserted-by":"publisher","DOI":"10.1109\/MET59151.2023.00010"},{"key":"e_1_3_1_83_2","doi-asserted-by":"publisher","DOI":"10.1145\/2517349.2522727"},{"key":"e_1_3_1_84_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE.2013.6606577"},{"key":"e_1_3_1_85_2","doi-asserted-by":"publisher","DOI":"10.1145\/2568225.2568251"},{"key":"e_1_3_1_86_2","doi-asserted-by":"publisher","DOI":"10.1145\/2771783.2771817"},{"key":"e_1_3_1_87_2","unstructured":"Ziyuan Zhong Gail E. Kaiser and Baishakhi Ray. 2021. Neural Network Guided Evolutionary Fuzzing for Finding Traffic Violations of Autonomous Vehicles. CoRR abs\/2109.06126 (2021). arXiv:2109.06126 https:\/\/arxiv.org\/abs\/2109.06126"}],"container-title":["Proceedings of the ACM on Software Engineering"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3660792","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3660792","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,2,4]],"date-time":"2026-02-04T07:54:20Z","timestamp":1770191660000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3660792"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,7,12]]},"references-count":86,"journal-issue":{"issue":"FSE","published-print":{"date-parts":[[2024,7,12]]}},"alternative-id":["10.1145\/3660792"],"URL":"https:\/\/doi.org\/10.1145\/3660792","relation":{},"ISSN":["2994-970X"],"issn-type":[{"value":"2994-970X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,7,12]]}}}