{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,25]],"date-time":"2026-07-25T08:01:37Z","timestamp":1784966497827,"version":"3.55.0"},"reference-count":70,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2026,7,25]],"date-time":"2026-07-25T00:00:00Z","timestamp":1784937600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2026,7,25]],"date-time":"2026-07-25T00:00:00Z","timestamp":1784937600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100000646","name":"Japan Society for the Promotion of Science London","doi-asserted-by":"publisher","award":["JP23K03913"],"award-info":[{"award-number":["JP23K03913"]}],"id":[{"id":"10.13039\/501100000646","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001695","name":"Japan Science and Technology Corporation","doi-asserted-by":"publisher","award":["JPMJAP2301"],"award-info":[{"award-number":["JPMJAP2301"]}],"id":[{"id":"10.13039\/501100001695","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001695","name":"Japan Science and Technology Corporation","doi-asserted-by":"publisher","award":["JP26K07561"],"award-info":[{"award-number":["JP26K07561"]}],"id":[{"id":"10.13039\/501100001695","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Empir Software Eng"],"published-print":{"date-parts":[[2027,2]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Context<\/jats:title>\n                    <jats:p>The use of automated driving systems (ADSs) in the real world requires rigorous testing to ensure safety. To increase trust, ADSs should be tested on a large set of diverse road scenarios. Literature suggests that if a vehicle is driven along a set of geometrically diverse roads\u2014measured using various diversity measures (DMs)\u2014it will react in a wide range of behaviours, thereby increasing the chances of observing failures, or strengthening the confidence in its safety, if no failures are observed. However, this assumption has never been tested before, nor have road DMs been assessed for their properties.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Objective<\/jats:title>\n                    <jats:p>\n                      Our goal was to perform an exploratory study on 53 currently used and new, potentially promising road DMs. Specifically, our research questions looked into the road DMs themselves, to analyse their properties (e.g.\n                      <jats:italic>monotonicity<\/jats:italic>\n                      ,\n                      <jats:italic>computation efficiency<\/jats:italic>\n                      ), and to test correlation between DMs. Furthermore, we investigated the use of road DMs to determine whether the assumption that diverse test suites of roads expose diverse driving behaviour holds.\n                    <\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Method<\/jats:title>\n                    <jats:p>Our empirical analysis relies on a state-of-the-art, open-source ADS testing infrastructure and uses a data set containing over 97,000 individual road geometries and matching simulation data that were collected using two driving agents. By considering test suites of various sizes and measuring their roads\u2019 geometric diversity, we studied road DM properties, the correlation between road DMs, and the correlation between road DMs and the observed behaviour.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>Our findings reveal a strong correlation between road diversity and behavioural diversity, confirming that geometrically diverse test suites systematically exercise diverse driving behaviours. We identified \u00a0and \u00a0aggregations as most effective, with \u00a0achieving the strongest correlation of 0.95 while requiring minimal computation time. The analysed measures maintain robust correlation with behavioural diversity across test suites containing roads of varying lengths, eliminating the need for length normalisation.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusions<\/jats:title>\n                    <jats:p>These results empirically validate the fundamental assumption underlying diversity-driven ADS testing: road geometry diversity serves as a reliable proxy for behavioural diversity. For practitioners, we recommend \u00a0or \u00a0as optimal choices, whilst -based measures should be avoided entirely. The near-identical correlation patterns observed across architecturally different driving agents indicate that our findings generalise beyond specific ADS implementations, providing a solid foundation for diversity-driven test generation and selection.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1007\/s10664-026-10920-5","type":"journal-article","created":{"date-parts":[[2026,7,25]],"date-time":"2026-07-25T07:55:33Z","timestamp":1784966133000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Does road diversity really matter in testing automated driving systems?"],"prefix":"10.1007","volume":"32","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-4212-7029","authenticated-orcid":false,"given":"Stefan","family":"Klikovits","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6229-8231","authenticated-orcid":false,"given":"Vincenzo","family":"Riccio","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9604-9997","authenticated-orcid":false,"given":"Ezequiel","family":"Castellano","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1731-8600","authenticated-orcid":false,"given":"Ahmet","family":"Cetinkaya","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0132-6497","authenticated-orcid":false,"given":"Alessio","family":"Gambi","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6253-4062","authenticated-orcid":false,"given":"Paolo","family":"Arcaini","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2026,7,25]]},"reference":[{"issue":"2","key":"10920_CR1","doi-asserted-by":"publisher","first-page":"429","DOI":"10.1137\/130920526","volume":"43","author":"PK Agarwal","year":"2014","unstructured":"Agarwal PK, Avraham RB, Kaplan H, Sharir M (2014) Computing the discrete Fr\u00e9chet distance in subquadratic time. SIAM J Comput 43(2):429\u2013449","journal-title":"SIAM J Comput"},{"key":"10920_CR2","doi-asserted-by":"publisher","unstructured":"Alt H, Godau M (1995) Computing the Fr\u00e9chet distance between two polygonal curves. Int J Comput Geometry Appl 5:75\u201391. https:\/\/doi.org\/10.1142\/S0218195995000064","DOI":"10.1142\/S0218195995000064"},{"key":"10920_CR3","doi-asserted-by":"publisher","first-page":"103490","DOI":"10.1016\/j.scico.2026.103490","volume":"253","author":"P Arcaini","year":"2026","unstructured":"Arcaini P, Cetinkaya A (2026) DETOUR: a tool for regression testing of autonomous driving systems. Sci Comput Program 253:103490. https:\/\/doi.org\/10.1016\/j.scico.2026.103490","journal-title":"Sci Comput Program"},{"key":"10920_CR4","doi-asserted-by":"crossref","unstructured":"Aronov B, Har-Peled S, Knauer C, Wang Y, Wenk C (2006) Fr\u00e9chet distance for curves, revisited. European symposium on algorithms, pp 52\u201363","DOI":"10.1007\/11841036_8"},{"key":"10920_CR5","doi-asserted-by":"publisher","unstructured":"Bachman E (2025) Tesla deaths. Regularly updated at tesladeaths.com; version hosted on Zenodo will be updated periodically. https:\/\/doi.org\/10.5281\/zenodo.17810101","DOI":"10.5281\/zenodo.17810101"},{"key":"10920_CR6","doi-asserted-by":"publisher","unstructured":"Ben\u00a0Abdessalem R, Nejati S, Briand LC, Stifter T (2018) Testing vision-based control systems using learnable evolutionary algorithms. In: Proceedings of the 40th international conference on software engineering, Association for Computing Machinery, New York, NY, USA, ICSE \u201918, pp 1016\u20131026. https:\/\/doi.org\/10.1145\/3180155.3180160,","DOI":"10.1145\/3180155.3180160"},{"key":"10920_CR7","first-page":"359","volume":"10","author":"DJ Berndt","year":"1994","unstructured":"Berndt DJ, Clifford J (1994) Using dynamic time warping to find patterns in time series. KDD Workshop Seattle WA USA 10:359\u2013370","journal-title":"KDD Workshop Seattle WA USA"},{"key":"10920_CR8","doi-asserted-by":"publisher","unstructured":"Birchler C, Khatiri S, Derakhshanfar P, Panichella S, Panichella A (2023a) Single and multi-objective test cases prioritization for self-driving cars in virtual environments. ACM Trans Softw Eng Methodol 32(2). https:\/\/doi.org\/10.1145\/3533818","DOI":"10.1145\/3533818"},{"key":"10920_CR9","doi-asserted-by":"publisher","unstructured":"Birchler C, Ganz N, Khatiri S, Gambi A, Panichella S (2023b) Cost-effective simulation-based test selection in self-driving cars software. Sci Comput Program 226(C). https:\/\/doi.org\/10.1016\/j.scico.2023.102926,","DOI":"10.1016\/j.scico.2023.102926"},{"key":"10920_CR10","doi-asserted-by":"publisher","unstructured":"Birchler C, Khatiri S, Bosshard B, Gambi A, Panichella S (2023c) Machine learning-based test selection for simulation-based testing of self-driving cars software. Empirical Softw Engg 28(3). https:\/\/doi.org\/10.1007\/s10664-023-10286-y,","DOI":"10.1007\/s10664-023-10286-y"},{"key":"10920_CR11","unstructured":"Bojarski M, Del\u00a0Testa D, Dworakowski D, Firner B, Flepp B, Goyal P, Jackel LD, Monfort M, Muller U, Zhang J, Zhang X, Zhao J, Zieba K (2016) End to end learning for self-driving cars. arxiv:1604.07316"},{"key":"10920_CR12","doi-asserted-by":"publisher","unstructured":"Bueno PM, Jino M, Wong WE (2014) Diversity oriented test data generation using metaheuristic search techniques. Inf Sci 259:490\u2013509. https:\/\/doi.org\/10.1016\/j.ins.2011.01.025","DOI":"10.1016\/j.ins.2011.01.025"},{"key":"10920_CR13","doi-asserted-by":"publisher","unstructured":"Cal\u00f2 A, Arcaini P, Ali S, Hauer F, Ishikawa F (2020a) Generating avoidable collision scenarios for testing autonomous driving systems. In: IEEE 13th int conf on software testing, validation and verification (ICST), pp 375\u2013386. https:\/\/doi.org\/10.1109\/ICST46399.2020.00045","DOI":"10.1109\/ICST46399.2020.00045"},{"key":"10920_CR14","doi-asserted-by":"publisher","unstructured":"Cal\u00f2 A, Arcaini P, Ali S, Hauer F, Ishikawa F (2020b) Simultaneously searching and solving multiple avoidable collisions for testing autonomous driving systems. In: Proceedings of the 2020 genetic and evolutionary computation conference, Association for Computing Machinery, New York, NY, USA, GECCO \u201920, pp 1055\u20131063. https:\/\/doi.org\/10.1145\/3377930.3389827,","DOI":"10.1145\/3377930.3389827"},{"key":"10920_CR15","doi-asserted-by":"publisher","unstructured":"Castellano E, Cetinkaya A, Arcaini P (2021) Analysis of road representations in search-based testing of autonomous driving systems. In: 2021 IEEE 21st int conf on software quality, reliability and security (QRS), pp 167\u2013178. https:\/\/doi.org\/10.1109\/QRS54544.2021.00028","DOI":"10.1109\/QRS54544.2021.00028"},{"key":"10920_CR16","doi-asserted-by":"publisher","unstructured":"Castellano E, Klikovits S, Cetinkaya A, Arcaini P (2022) FreneticV at the SBST 2022 tool competition. In: 2022 IEEE\/ACM 15th international workshop on search-based software testing (SBST), pp 47\u201348. https:\/\/doi.org\/10.1145\/3526072.3527532","DOI":"10.1145\/3526072.3527532"},{"key":"10920_CR17","doi-asserted-by":"publisher","unstructured":"Chen TY, Leung H, Mak I (2004) Adaptive random testing. In: Advances in computer science - ASIAN 2004, higher-level decision making, 9th Asian Computing Science Conference, Dedicated to Jean-Louis Lassez on the Occasion of His 5th Cycle Birthday, Chiang Mai, Thailand, December 8-10, 2004, Proceedings, Springer, Lecture Notes in Computer Science, pp 320\u2013329. https:\/\/doi.org\/10.1007\/978-3-540-30502-6_23","DOI":"10.1007\/978-3-540-30502-6_23"},{"key":"10920_CR18","doi-asserted-by":"publisher","unstructured":"Cheng M, Zhou Y, Xie X (2023) BehAVExplor: behavior diversity guided testing for autonomous driving systems. In: Proceedings of the 32nd ACM SIGSOFT international symposium on software testing and analysis, Association for Computing Machinery, New York, NY, USA, ISSTA 2023, pp 488\u2013500. https:\/\/doi.org\/10.1145\/3597926.3598072,","DOI":"10.1145\/3597926.3598072"},{"issue":"7","key":"10920_CR19","doi-asserted-by":"publisher","first-page":"e100014","DOI":"10.1371\/journal.pone.0100014","volume":"9","author":"CH Chiu","year":"2014","unstructured":"Chiu CH, Chao A (2014) Distance-based functional diversity measures and their decomposition: a framework based on hill numbers. PLoS ONE 9(7):e100014","journal-title":"PLoS ONE"},{"issue":"954","key":"10920_CR20","doi-asserted-by":"publisher","first-page":"295","DOI":"10.1086\/282831","volume":"107","author":"PA DeBenedictis","year":"1973","unstructured":"DeBenedictis PA (1973) On the correlations between certain diversity indices. Am Nat 107(954):295\u2013302","journal-title":"Am Nat"},{"key":"10920_CR21","unstructured":"DMV California (2022) Autonomous vehicle collision reports. https:\/\/www.dmv.ca.gov\/portal\/vehicle-industry-services\/autonomous-vehicles\/autonomous-vehicle-collision-reports, last accessed: 18 Apr 2026"},{"key":"10920_CR22","doi-asserted-by":"crossref","unstructured":"Dryden IL, Mardia KV (2016) Statistical shape analysis: with applications in R. John Wiley & Sons","DOI":"10.1002\/9781119072492"},{"issue":"3","key":"10920_CR23","doi-asserted-by":"publisher","first-page":"203","DOI":"10.1007\/s10851-006-0647-0","volume":"27","author":"A Efrat","year":"2007","unstructured":"Efrat A, Fan Q, Venkatasubramanian S (2007) Curve matching, time warping, and light fields: new algorithms for computing similarity between curves. J Math Imaging Vis 27(3):203\u2013216","journal-title":"J Math Imaging Vis"},{"issue":"2","key":"10920_CR24","doi-asserted-by":"publisher","first-page":"e1914","DOI":"10.1002\/stvr.1914","volume":"35","author":"IT Elgendy","year":"2025","unstructured":"Elgendy IT, Hierons RM, McMinn P (2025) A systematic mapping study of the metrics, uses and subjects of diversity-based testing techniques. Softw Test Verif Reliab 35(2):e1914. https:\/\/doi.org\/10.1002\/stvr.1914","journal-title":"Softw Test Verif Reliab"},{"key":"10920_CR25","doi-asserted-by":"publisher","unstructured":"Fan C, Luo J, Zhu B (2010) Fr\u00e9chet-distance on road networks. In: Akiyama J, Jiang B, Kano M, Tan X (eds) Computational geometry, graphs and applications - 9th international conference, CGGA 2010, Dalian, China, November 3-6, 2010, Revised Selected Papers, Springer, Lecture Notes in Computer Science, pp 61\u201372. https:\/\/doi.org\/10.1007\/978-3-642-24983-9_7,","DOI":"10.1007\/978-3-642-24983-9_7"},{"key":"10920_CR26","unstructured":"Feldt R, Poulding S (2017) Searching for test data with feature diversity. arxiv:1709.06017"},{"key":"10920_CR27","doi-asserted-by":"publisher","unstructured":"Feldt R, Poulding S, Clark D, Yoo S (2016) Test set diameter: quantifying the diversity of sets of test cases. In: 2016 IEEE international conference on software testing, verification and validation (ICST), pp 223\u2013233. https:\/\/doi.org\/10.1109\/ICST.2016.33","DOI":"10.1109\/ICST.2016.33"},{"key":"10920_CR28","doi-asserted-by":"publisher","unstructured":"Fraser G, Arcuri A (2011) EvoSuite: automatic test suite generation for object-oriented software. In: Proceedings of the 19th ACM SIGSOFT symposium and the 13th European conference on foundations of software engineering, Association for Computing Machinery, New York, NY, USA, ESEC\/FSE \u201911, pp 416\u2013419. https:\/\/doi.org\/10.1145\/2025113.2025179","DOI":"10.1145\/2025113.2025179"},{"key":"10920_CR29","doi-asserted-by":"publisher","unstructured":"Fraser G, Rojas JM (2019) Software testing, Springer International Publishing, Cham, pp 123\u2013192. https:\/\/doi.org\/10.1007\/978-3-030-00262-6_4,","DOI":"10.1007\/978-3-030-00262-6_4"},{"key":"10920_CR30","unstructured":"Gailly J, Adler M (2026) Zlib: a massively spiffy yet delicately unobtrusive compression library. https:\/\/zlib.net, last accessed: 18 Apr 2026"},{"key":"10920_CR31","doi-asserted-by":"publisher","unstructured":"Gambi A, Mueller M, Fraser G (2019) Automatically testing self-driving cars with search-based procedural content generation. In: Proceedings of the 28th ACM SIGSOFT international symposium on software testing and analysis, Association for Computing Machinery, New York, NY, USA, ISSTA 2019, pp 318\u2013328. https:\/\/doi.org\/10.1145\/3293882.3330566,","DOI":"10.1145\/3293882.3330566"},{"key":"10920_CR32","doi-asserted-by":"crossref","unstructured":"Gambi A, Jahangirova G, Riccio V, Zampetti F (2022) SBST tool competition 2022. In: 15th IEEE\/ACM international workshop on search-based software testing, SBST 2022, Pittsburgh, PA, USA, May 9, 2022","DOI":"10.1145\/3526072.3527538"},{"key":"10920_CR33","doi-asserted-by":"publisher","unstructured":"Huai Y, Chen Y, Almanee S, Ngo T, Liao X, Wan Z, Chen QA, Garcia J (2023) Doppelg\u00e4nger test generation for revealing bugs in autonomous driving software. In: 2023 IEEE\/ACM 45th international conference on software engineering (ICSE), pp 2591\u20132603. https:\/\/doi.org\/10.1109\/ICSE48619.2023.00216","DOI":"10.1109\/ICSE48619.2023.00216"},{"key":"10920_CR34","doi-asserted-by":"publisher","unstructured":"Humeniuk D, Khomh F (2025) Representation improvement in latent space for search-based testing of autonomous robotic systems. https:\/\/doi.org\/10.48550\/ARXIV.2503.20642","DOI":"10.48550\/ARXIV.2503.20642"},{"key":"10920_CR35","doi-asserted-by":"publisher","unstructured":"Jahangirova G, Stocco A, Tonella P (2021) Quality metrics and oracles for autonomous vehicles testing. In: 2021 14th IEEE conference on software testing, verification and validation (ICST), pp 194\u2013204. https:\/\/doi.org\/10.1109\/ICST49551.2021.00030","DOI":"10.1109\/ICST49551.2021.00030"},{"key":"10920_CR36","doi-asserted-by":"publisher","unstructured":"Jekel CF, Venter G, Venter MP, Stander N, Haftka RT (2019) Similarity measures for identifying material parameters from hysteresis loops using inverse analysis. International Journal of Material Forming. https:\/\/doi.org\/10.1007\/s12289-018-1421-8","DOI":"10.1007\/s12289-018-1421-8"},{"key":"10920_CR37","doi-asserted-by":"publisher","first-page":"102996","DOI":"10.1016\/j.scico.2023.102996","volume":"230","author":"S Klikovits","year":"2023","unstructured":"Klikovits S, Castellano E, Cetinkaya A, Arcaini P (2023) Frenetic-lib: an extensible framework for search-based generation of road structures for ADS testing. Sci Comput Program 230:102996. https:\/\/doi.org\/10.1016\/j.scico.2023.102996","journal-title":"Sci Comput Program"},{"key":"10920_CR38","doi-asserted-by":"publisher","unstructured":"Kong Z, Guo J, Li A, Liu C (2020) PhysGAN: generating physical-world-resilient adversarial examples for autonomous driving. In: 2020 IEEE\/CVF conference on computer vision and pattern recognition (CVPR), pp 14242\u201314251. https:\/\/doi.org\/10.1109\/CVPR42600.2020.01426","DOI":"10.1109\/CVPR42600.2020.01426"},{"key":"10920_CR39","doi-asserted-by":"publisher","unstructured":"Laurent T, Klikovits S, Arcaini P, Ishikawa F, Ventresque A (2023) Parameter coverage for testing of autonomous driving systems under uncertainty. ACM Trans Softw Eng Methodol 32(3). https:\/\/doi.org\/10.1145\/3550270,","DOI":"10.1145\/3550270"},{"issue":"2","key":"10920_CR40","doi-asserted-by":"publisher","first-page":"189","DOI":"10.1162\/EVCO_a_00025","volume":"19","author":"J Lehman","year":"2011","unstructured":"Lehman J, Stanley KO (2011) Abandoning objectives: evolution through the search for novelty alone. Evol Comput 19(2):189\u2013223","journal-title":"Evol Comput"},{"key":"10920_CR41","doi-asserted-by":"publisher","unstructured":"Leinster T, Cobbold CA (2012) Measuring diversity: the importance of species similarity. Ecology 93(3):477\u2013489. https:\/\/doi.org\/10.1890\/10-2402.1","DOI":"10.1890\/10-2402.1"},{"key":"10920_CR42","first-page":"707","volume":"10","author":"VI Levenshtein","year":"1966","unstructured":"Levenshtein VI et al (1966) Binary codes capable of correcting deletions, insertions, and reversals. Soviet Physics Doklady Soviet Union 10:707\u2013710","journal-title":"Soviet Physics Doklady Soviet Union"},{"key":"10920_CR43","doi-asserted-by":"publisher","unstructured":"Luo Y, Zhang XY, Arcaini P, Jin Z, Zhao H, Ishikawa F, Wu R, Xie T (2021) Targeting requirements violations of autonomous driving systems by dynamic evolutionary search. In: 2021 36th IEEE\/ACM international conference on automated software engineering (ASE), pp 279\u2013291. https:\/\/doi.org\/10.1109\/ASE51524.2021.9678883","DOI":"10.1109\/ASE51524.2021.9678883"},{"key":"10920_CR44","doi-asserted-by":"publisher","first-page":"172","DOI":"10.1007\/978-3-030-71500-7_9","volume-title":"Fundamental approaches to software engineering","author":"R Majumdar","year":"2021","unstructured":"Majumdar R, Mathur A, Pirron M, Stegner L, Zufferey D (2021) Paracosm: a test framework for autonomous driving simulations. In: Guerra E, Stoelinga M (eds) Fundamental approaches to software engineering. Springer International Publishing, Cham, pp 172\u2013195"},{"key":"10920_CR45","doi-asserted-by":"crossref","unstructured":"McNaughton M, Urmson C, Dolan JM, Lee JW (2011) Motion planning for autonomous driving with a conformal spatiotemporal lattice. In: 2011 IEEE int conf on robotics and automation, IEEE, pp 4889\u20134895","DOI":"10.1109\/ICRA.2011.5980223"},{"issue":"2","key":"10920_CR46","doi-asserted-by":"publisher","first-page":"113","DOI":"10.1016\/j.comgeo.2004.05.004","volume":"30","author":"A Mosig","year":"2005","unstructured":"Mosig A, Clausen M (2005) Approximately matching polygonal curves with respect to the Fr\u00e9chet distance. Comput Geom 30(2):113\u2013127","journal-title":"Comput Geom"},{"issue":"4","key":"10920_CR47","doi-asserted-by":"publisher","first-page":"867","DOI":"10.1111\/j.1365-2435.2010.01695.x","volume":"24","author":"MA Mouchet","year":"2010","unstructured":"Mouchet MA, Vill\u00e9ger S, Mason NW, Mouillot D (2010) Functional diversity measures: an overview of their redundancy and their ability to discriminate community assembly rules. Funct Ecol 24(4):867\u2013876","journal-title":"Funct Ecol"},{"key":"10920_CR48","doi-asserted-by":"publisher","unstructured":"Munich ME, Perona P (1999) Continuous dynamic time warping for translation-invariant curve alignment with applications to signature verification. In: Proceedings of the seventh IEEE international conference on computer vision, vol\u00a01, pp 108\u2013115. https:\/\/doi.org\/10.1109\/ICCV.1999.791205","DOI":"10.1109\/ICCV.1999.791205"},{"key":"10920_CR49","doi-asserted-by":"publisher","unstructured":"Nguyen V, Huber S, Gambi A (2021) SALVO: automated generation of diversified tests for self-driving cars from existing maps. In: 2021 IEEE international conference on artificial intelligence testing (AITest), pp 128\u2013135. https:\/\/doi.org\/10.1109\/AITEST52744.2021.00033","DOI":"10.1109\/AITEST52744.2021.00033"},{"key":"10920_CR50","doi-asserted-by":"publisher","unstructured":"Riccio V, Tonella P (2020) Model-based exploration of the frontier of behaviours for deep learning system testing. In: Proceedings of the 28th ACM joint meeting on european software engineering conference and symposium on the foundations of software engineering, Association for Computing Machinery, New York, NY, USA, ESEC\/FSE 2020, pp 876\u2013888. https:\/\/doi.org\/10.1145\/3368089.3409730,","DOI":"10.1145\/3368089.3409730"},{"key":"10920_CR51","doi-asserted-by":"publisher","unstructured":"Sadat A, Segal S, Casas S, Tu J, Yang B, Urtasun R, Yumer E (2021) Diverse complexity measures for dataset curation in self-driving. In: 2021 IEEE\/RSJ international conference on intelligent robots and systems (IROS), IEEE Press, pp 8609\u20138616. https:\/\/doi.org\/10.1109\/IROS51168.2021.9636869","DOI":"10.1109\/IROS51168.2021.9636869"},{"key":"10920_CR52","doi-asserted-by":"publisher","unstructured":"Shi Q, Chen Z, Fang C, Feng Y, Xu B (2016) Measuring the diversity of a test set with distance entropy. IEEE Trans Reliab 65(1):19\u201327. https:\/\/doi.org\/10.1109\/TR.2015.2434953","DOI":"10.1109\/TR.2015.2434953"},{"key":"10920_CR53","doi-asserted-by":"publisher","unstructured":"Tang Y, Zhou Y, Wu F, Liu Y, Sun J, Huang W, Wang G (2021) Route coverage testing for autonomous vehicles via map modeling. In: 2021 IEEE international conference on robotics and automation (ICRA), IEEE Press, pp 11450\u201311456. https:\/\/doi.org\/10.1109\/ICRA48506.2021.9560890","DOI":"10.1109\/ICRA48506.2021.9560890"},{"key":"10920_CR54","doi-asserted-by":"publisher","unstructured":"Tang S, Zhang Z, Zhang Y, Zhou J, Guo Y, Liu S, Guo S, Li YF, Ma L, Xue Y, Liu Y (2023) A survey on automated driving system testing: landscapes and trends. ACM Trans Softw Eng Methodol 32(5). https:\/\/doi.org\/10.1145\/3579642,","DOI":"10.1145\/3579642"},{"key":"10920_CR55","doi-asserted-by":"publisher","unstructured":"Tuncali CE, Fainekos G, Ito H, Kapinski J (2018) Sim-ATAV: simulation-based adversarial testing framework for autonomous vehicles. In: Proceedings of the 21st international conference on hybrid systems: computation and control (Part of CPS Week), Association for Computing Machinery, New York, NY, USA, HSCC \u201918, pp 283\u2013284. https:\/\/doi.org\/10.1145\/3178126.3187004,","DOI":"10.1145\/3178126.3187004"},{"key":"10920_CR56","unstructured":"US Department of Transportation, National Highway Traffic Safety Association (2022) Summary report: Standing general order on crash reporting for automated driving systems (DOT HS 813 324). Tech. rep"},{"key":"10920_CR57","doi-asserted-by":"publisher","unstructured":"Vlachos M, Gunopulos D, Das G (2004) Rotation invariant distance measures for trajectories. In: Proceedings of the Tenth ACM SIGKDD international conference on knowledge discovery and data mining, Association for Computing Machinery, New York, NY, USA, KDD \u201904, pp 707\u2013712. https:\/\/doi.org\/10.1145\/1014052.1014144,","DOI":"10.1145\/1014052.1014144"},{"key":"10920_CR58","doi-asserted-by":"publisher","unstructured":"Weise J, Mostaghim S (2021) Many-objective pathfinding based on Fr\u00e9chet similarity metric. In: Evolutionary multi-criterion optimization: 11th international conference, EMO 2021, Shenzhen, China, March 28\u201331, 2021, Proceedings, Springer-Verlag, Berlin, Heidelberg, pp 375\u2013386. https:\/\/doi.org\/10.1007\/978-3-030-72062-9_30","DOI":"10.1007\/978-3-030-72062-9_30"},{"issue":"2","key":"10920_CR59","doi-asserted-by":"publisher","first-page":"363","DOI":"10.2307\/2118476","volume":"107","author":"ML Weitzman","year":"1992","unstructured":"Weitzman ML (1992) On diversity. Q J Econ 107(2):363\u2013405","journal-title":"Q J Econ"},{"key":"10920_CR60","doi-asserted-by":"publisher","unstructured":"Werling M, Ziegler J, Kammel S, Thrun S (2010) Optimal trajectory generation for dynamic street scenarios in a Fren\u00e9t frame. In: 2010 IEEE international conference on robotics and automation, pp 987\u2013993. https:\/\/doi.org\/10.1109\/ROBOT.2010.5509799","DOI":"10.1109\/ROBOT.2010.5509799"},{"issue":"12","key":"10920_CR61","doi-asserted-by":"publisher","first-page":"1128","DOI":"10.1109\/TSE.1986.6313008","volume":"12","author":"EJ Weyuker","year":"1986","unstructured":"Weyuker EJ (1986) Axiomatizing software test data adequacy. IEEE Trans Softw Eng 12(12):1128\u20131138","journal-title":"IEEE Trans Softw Eng"},{"key":"10920_CR62","doi-asserted-by":"crossref","unstructured":"Witowski K, Stander N (2012) Parameter identification of hysteretic models using partial curve mapping. In: 12th AIAA aviation technology, integration, and operations (ATIO) conference and 14th AIAA\/ISSMO multidisciplinary analysis and optimization conference, p 5580","DOI":"10.2514\/6.2012-5580"},{"key":"10920_CR63","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-29044-2","volume-title":"Experimentation in software engineering","author":"C Wohlin","year":"2012","unstructured":"Wohlin C, Runeson P, Hst M, Ohlsson MC, Regnell B, Wessln A (2012) Experimentation in software engineering. Springer Publishing Company, Incorporated"},{"key":"10920_CR64","doi-asserted-by":"publisher","unstructured":"Xie Q, Memon AM (2006) Studying the characteristics of a \u201cgood\u201d GUI test suite. In: Proceedings of the 17th international symposium on software reliability engineering, IEEE Computer Society, USA, ISSRE \u201906, pp 159\u2013168. https:\/\/doi.org\/10.1109\/ISSRE.2006.45,","DOI":"10.1109\/ISSRE.2006.45"},{"key":"10920_CR65","unstructured":"Zhong Z, Tang Y, Zhou Y, Neves VdO, Liu Y, Ray B (2021) A survey on scenario-based testing for automated driving systems in high-fidelity simulation. arxiv:2112.00964"},{"key":"10920_CR66","doi-asserted-by":"publisher","unstructured":"Zhong Z, Kaiser G, Ray B (2023) Neural network guided evolutionary fuzzing for finding traffic violations of autonomous vehicles. IEEE Trans Softw Eng 49(4):1860\u20131875. https:\/\/doi.org\/10.1109\/TSE.2022.3195640","DOI":"10.1109\/TSE.2022.3195640"},{"key":"10920_CR67","doi-asserted-by":"publisher","unstructured":"Zhou H, Li W, Kong Z, Guo J, Zhang Y, Yu B, Zhang L, Liu C (2020) DeepBillboard: systematic physical-world testing of autonomous driving systems. In: Proceedings of the ACM\/IEEE 42nd international conference on software engineering, Association for Computing Machinery, New York, NY, USA, ICSE \u201920, pp 347\u2013358. https:\/\/doi.org\/10.1145\/3377811.3380422,","DOI":"10.1145\/3377811.3380422"},{"issue":"3","key":"10920_CR68","doi-asserted-by":"publisher","first-page":"1055","DOI":"10.1007\/s10846-020-01215-y","volume":"100","author":"S Zhu","year":"2020","unstructured":"Zhu S, Aksun-Guvenc B (2020) Trajectory planning of autonomous vehicles based on parameterized control optimization in dynamic on-road environments. J Intel Robot Syst 100(3):1055\u20131067","journal-title":"J Intel Robot Syst"},{"key":"10920_CR69","doi-asserted-by":"publisher","unstructured":"Zhu B, Zhang P, Zhao J, Deng W (2022) Hazardous scenario enhanced generation for automated vehicle testing based on optimization searching method. Trans Intell Transport Sys 23(7):7321\u20137331. https:\/\/doi.org\/10.1109\/TITS.2021.3068784","DOI":"10.1109\/TITS.2021.3068784"},{"key":"10920_CR70","doi-asserted-by":"publisher","unstructured":"Zohdinasab T, Riccio V, Gambi A, Tonella P (2021) DeepHyperion: exploring the feature space of deep learning-based systems through illumination search. In: Proceedings of the 30th ACM SIGSOFT international symposium on software testing and analysis, Association for Computing Machinery, New York, NY, USA, ISSTA 2021, pp 79\u201390. https:\/\/doi.org\/10.1145\/3460319.3464811","DOI":"10.1145\/3460319.3464811"}],"container-title":["Empirical Software Engineering"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10664-026-10920-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10664-026-10920-5","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10664-026-10920-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,7,25]],"date-time":"2026-07-25T07:55:36Z","timestamp":1784966136000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10664-026-10920-5"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,7,25]]},"references-count":70,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2027,2]]}},"alternative-id":["10920"],"URL":"https:\/\/doi.org\/10.1007\/s10664-026-10920-5","relation":{},"ISSN":["1382-3256","1573-7616"],"issn-type":[{"value":"1382-3256","type":"print"},{"value":"1573-7616","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,7,25]]},"assertion":[{"value":"13 January 2026","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"29 June 2026","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"25 July 2026","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"Not applicable.","order":1,"name":"Ethics","label":"Ethical approval","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"Not applicable.","order":2,"name":"Ethics","label":"Informed consent","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"Not applicable.","order":3,"name":"Ethics","label":"Clinical Trial Number","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"All authors certify that they have no affiliations with or involvement in any organization or entity with any financial interest or non-financial interest in the subject matter or materials discussed in this manuscript.","order":4,"name":"Ethics","label":"Conflict of interest","group":{"name":"EthicsHeading","label":"Declarations"}}],"article-number":"10"}}