{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,2,21]],"date-time":"2025-02-21T22:09:29Z","timestamp":1740175769660,"version":"3.37.3"},"reference-count":66,"publisher":"Springer Science and Business Media LLC","issue":"3","license":[{"start":{"date-parts":[[2024,1,24]],"date-time":"2024-01-24T00:00:00Z","timestamp":1706054400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,1,24]],"date-time":"2024-01-24T00:00:00Z","timestamp":1706054400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["62276103","62006053"],"award-info":[{"award-number":["62276103","62006053"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100003453","name":"Natural Science Foundation of Guangdong Province","doi-asserted-by":"publisher","award":["2022A1515011491","2020A1515010696","2022A1515011551","2022A1515110058"],"award-info":[{"award-number":["2022A1515011491","2020A1515010696","2022A1515011551","2022A1515110058"]}],"id":[{"id":"10.13039\/501100003453","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100012226","name":"Fundamental Research Funds for the Central Universities","doi-asserted-by":"publisher","award":["2020ZYGXZR014","z2kjD2220200"],"award-info":[{"award-number":["2020ZYGXZR014","z2kjD2220200"]}],"id":[{"id":"10.13039\/501100012226","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Open Foundation of Guangdong Provincial Key Laboratory of Public Finance and Taxation with Big Data Application","award":["2019B121203012"],"award-info":[{"award-number":["2019B121203012"]}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Complex Intell. Syst."],"published-print":{"date-parts":[[2024,6]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Generating test cases is essential for discovering software bugs. However, finding bugs in multi-path loops is challenging, especially when bugs can only be exposed after a specific interleaving execution order. Furthermore, the number of paths increases exponentially when the iteration count increases. It results in running out of resources (e.g., allocated search budget) in existing algorithms for test case generation before finding program bugs. To overcome these challenges and improve the effectiveness of existing algorithms in finding bugs among multi-path loops, we propose a path-oriented test case generation framework to explore loop paths of bounded depth. To fulfill this task, we first present a method that groups loop paths based on their latent similarities. Then, we formulate the problem of generating test cases to cover loop paths as a many-objective optimization one. The many-objective optimization problem is designed to optimize one group of loop paths at a time. Finally, a many-objective test case generation framework is used to generate test cases for covering loop paths. In this framework, a knowledge transfer scheme is incorporated to reuse suitable archived test cases at the start of the search process for a similar group of paths. We have implemented the proposed knowledge transfer scheme with generalized differential evolution 3 (KT-GDE3) and evaluated it with benchmarks from the competition on software verification (SV-COMP16 and SV-COMP21). The experimental results show that KT-GDE3 outperforms\u00a0alternative search-based test case generation algorithms in bug finding capability for multi-path loops. To evaluate the effectiveness of the proposed knowledge transfer scheme, our approach is compared with the variant without this scheme (called KT-GDE3-unarchived) in the benchmarks. The corresponding experimental results verify our assumption that the knowledge transfer scheme can significantly enhance the optimization process of multi-objective algorithms such as generalized differential evolution when finding bugs in multi-path loops.<\/jats:p>","DOI":"10.1007\/s40747-023-01323-w","type":"journal-article","created":{"date-parts":[[2024,1,24]],"date-time":"2024-01-24T07:02:07Z","timestamp":1706079727000},"page":"3235-3258","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["Knowledge transfer based many-objective approach for finding bugs in multi-path loops"],"prefix":"10.1007","volume":"10","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-1843-577X","authenticated-orcid":false,"given":"Stuart D.","family":"Semujju","sequence":"first","affiliation":[]},{"given":"Fangqing","family":"Liu","sequence":"additional","affiliation":[]},{"given":"Han","family":"Huang","sequence":"additional","affiliation":[]},{"given":"Yi","family":"Xiang","sequence":"additional","affiliation":[]},{"given":"Xueming","family":"Yan","sequence":"additional","affiliation":[]},{"given":"Zhifeng","family":"Hao","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2024,1,24]]},"reference":[{"issue":"2","key":"1323_CR1","doi-asserted-by":"publisher","first-page":"226","DOI":"10.1109\/TSE.2009.71","volume":"36","author":"M Harman","year":"2010","unstructured":"Harman M, McMinn P (2010) A theoretical and empirical study of search-based testing: local, global, and hybrid search. IEEE Trans Softw Eng 36(2):226\u2013247","journal-title":"IEEE Trans Softw Eng"},{"key":"1323_CR2","doi-asserted-by":"publisher","first-page":"4535","DOI":"10.1109\/TSE.2021.3120680","volume":"48","author":"A Afzal","year":"2021","unstructured":"Afzal A, Le Goues C, Timperley CS (2021) Mithra: anomaly detection as an oracle for cyberphysical systems. IEEE Trans Softw Eng 48:4535\u20134552","journal-title":"IEEE Trans Softw Eng"},{"issue":"3","key":"1323_CR3","doi-asserted-by":"publisher","first-page":"286","DOI":"10.1007\/s10664-008-9077-5","volume":"14","author":"K Pan","year":"2009","unstructured":"Pan K, Kim S, Whitehead EJ (2009) Toward an understanding of bug fix patterns. Empir Softw Eng 14(3):286\u2013315","journal-title":"Empir Softw Eng"},{"issue":"3","key":"1323_CR4","doi-asserted-by":"publisher","first-page":"421","DOI":"10.1007\/s11219-013-9208-0","volume":"21","author":"C Le Goues","year":"2013","unstructured":"Le Goues C, Forrest S, Weimer W (2013) Current challenges in automatic software repair. Softw Qual J 21(3):421\u2013443","journal-title":"Softw Qual J"},{"key":"1323_CR5","doi-asserted-by":"crossref","unstructured":"Li Z, Tan L, Wang X, Lu S, Zhou Y, Zhai C (2006) Have things changed now? An empirical study of bug characteristics in modern open source software. In: Proceedings of the 1st workshop on architectural and system support for improving software dependability, pp 25\u201333","DOI":"10.1145\/1181309.1181314"},{"key":"1323_CR6","doi-asserted-by":"crossref","unstructured":"Beyer D (2021) Software verification: 10th comparative evaluation (SV-COMP 2021). In: International conference on tools and algorithms for the construction and analysis of systems. Springer, London, pp 401\u2013422","DOI":"10.1007\/978-3-030-72013-1_24"},{"issue":"2","key":"1323_CR7","doi-asserted-by":"publisher","first-page":"691","DOI":"10.1109\/TSE.2020.2999884","volume":"48","author":"S Liu","year":"2022","unstructured":"Liu S, Nakajima S (2022) Automatic test case and test oracle generation based on functional scenarios in formal specifications for conformance testing. IEEE Trans Softw Eng 48(2):691\u2013712","journal-title":"IEEE Trans Softw Eng"},{"key":"1323_CR8","doi-asserted-by":"crossref","unstructured":"Xiao X, Li S, Xie T, Tillmann N (2013) Characteristic studies of loop problems for structural test generation via symbolic execution. In: 2013 28th IEEE\/ACM international conference on automated software engineering (ASE). IEEE, London, pp 246\u2013256","DOI":"10.1109\/ASE.2013.6693084"},{"issue":"6","key":"1323_CR9","doi-asserted-by":"publisher","first-page":"537","DOI":"10.1109\/TSE.2017.2788018","volume":"45","author":"X Xie","year":"2019","unstructured":"Xie X, Chen B, Zou L, Liu Y, Le W, Li X (2019) Automatic loop summarization via path dependency analysis. IEEE Trans Softw Eng 45(6):537\u2013557","journal-title":"IEEE Trans Softw Eng"},{"key":"1323_CR10","doi-asserted-by":"crossref","unstructured":"Blicha M, Kofro\u0148 J, Tatarko W (2022) Summarization of branching loops. In: Proceedings of the 37th ACM\/SIGAPP symposium on applied computing, pp 1808\u20131816","DOI":"10.1145\/3477314.3507042"},{"issue":"10","key":"1323_CR11","doi-asserted-by":"publisher","first-page":"1019","DOI":"10.1109\/TSE.2015.2431688","volume":"41","author":"JP Galeotti","year":"2015","unstructured":"Galeotti JP, Furia CA, May E, Fraser G, Zeller A (2015) Inferring loop invariants by mutation, dynamic analysis, and static checking. IEEE Trans Softw Eng 41(10):1019\u20131037","journal-title":"IEEE Trans Softw Eng"},{"key":"1323_CR12","doi-asserted-by":"crossref","unstructured":"Godefroid P, Luchaup D (2011) Automatic partial loop summarization in dynamic test generation. In: Proceedings of the 2011 international symposium on software testing and analysis. ACM, London, pp 23\u201333","DOI":"10.1145\/2001420.2001424"},{"key":"1323_CR13","doi-asserted-by":"crossref","unstructured":"Henkel J, Silva D, Teixeira L, d\u2019Amorim M, Reps T (2021) Shipwright: a human-in-the-loop system for Dockerfile repair. In: 2021 IEEE\/ACM 43rd international conference on software engineering (ICSE). IEEE, London, pp 1148\u20131160","DOI":"10.1109\/ICSE43902.2021.00106"},{"key":"1323_CR14","doi-asserted-by":"crossref","unstructured":"Hork\u1ef3 M, S\u00ed\u010d J, Turo\u0148ov\u00e1 L (2023) Automata with bounded repetition in RE2. In: Computer aided systems theory\u2014EUROCAST 2022: 18th international conference, Las Palmas de Gran Canaria, Spain, February 20\u201325, 2022, Revised Selected Papers. Springer, London, pp 232\u2013239","DOI":"10.1007\/978-3-031-25312-6_27"},{"key":"1323_CR15","doi-asserted-by":"crossref","unstructured":"Adhikari B, Huttunen H (2021) Iterative bounding box annotation for object detection. In: 2020 25th international conference on pattern recognition (ICPR). IEEE, London, pp 4040\u20134046","DOI":"10.1109\/ICPR48806.2021.9412956"},{"key":"1323_CR16","doi-asserted-by":"crossref","unstructured":"Badihi S, Akinotcho F, Li Y, Rubin J (2020) Ardiff: scaling program equivalence checking via iterative abstraction and refinement of common code. In: Proceedings of the 28th ACM joint meeting on European software engineering conference and symposium on the foundations of software engineering, pp 13\u201324","DOI":"10.1145\/3368089.3409757"},{"key":"1323_CR17","doi-asserted-by":"crossref","unstructured":"Dilley N, Lange J (2021) Automated verification of go programs via bounded model checking. In: 2021 36th IEEE\/ACM international conference on automated software engineering (ASE). IEEE, London, pp 1016\u20131027","DOI":"10.1109\/ASE51524.2021.9678571"},{"issue":"05","key":"1323_CR18","doi-asserted-by":"publisher","first-page":"669","DOI":"10.1142\/S0218194020500242","volume":"30","author":"M Vujo\u0161evi\u0107 Jani\u010di\u0107","year":"2020","unstructured":"Vujo\u0161evi\u0107 Jani\u010di\u0107 M (2020) Concurrent bug finding based on bounded model checking. Int J Softw Eng Knowl Eng 30(05):669\u2013694","journal-title":"Int J Softw Eng Knowl Eng"},{"key":"1323_CR19","doi-asserted-by":"crossref","unstructured":"Huster S, Burg S, Eichelberger H, Laufenberg J, Ruf J, Kropf T, Rosenstiel W (2015) Efficient testing of different loop paths. In: Software engineering and formal methods. Springer, Cham, pp 117\u2013131","DOI":"10.1007\/978-3-319-22969-0_9"},{"issue":"12","key":"1323_CR20","doi-asserted-by":"publisher","first-page":"2222","DOI":"10.1016\/j.jss.2011.06.028","volume":"84","author":"D Gong","year":"2011","unstructured":"Gong D, Zhang W, Yao X (2011) Evolutionary generation of test data for many paths coverage based on grouping. J Syst Softw 84(12):2222\u20132233","journal-title":"J Syst Softw"},{"issue":"2","key":"1323_CR21","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3423132","volume":"30","author":"D Gong","year":"2021","unstructured":"Gong D, Sun B, Yao X, Tian T (2021) Test data generation for path coverage of MPI programs using SAEO. ACM Trans Softw Eng Methodol (TOSEM) 30(2):1\u201337","journal-title":"ACM Trans Softw Eng Methodol (TOSEM)"},{"key":"1323_CR22","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2019.110495","volume":"161","author":"AM Bidgoli","year":"2020","unstructured":"Bidgoli AM, Haghighi H (2020) Augmenting ant colony optimization with adaptive random testing to cover prime paths. J Syst Softw 161:110495","journal-title":"J Syst Softw"},{"issue":"1","key":"1323_CR23","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/s40747-019-0102-7","volume":"6","author":"A Hussain","year":"2020","unstructured":"Hussain A, Muhammad YS (2020) Trade-off between exploration and exploitation with genetic algorithm using a novel selection operator. Complex Intell Syst 6(1):1\u201314","journal-title":"Complex Intell Syst"},{"issue":"4","key":"1323_CR24","doi-asserted-by":"publisher","first-page":"283","DOI":"10.1007\/s40747-018-0080-1","volume":"4","author":"R Cheng","year":"2018","unstructured":"Cheng R, He C, Jin Y, Yao X (2018) Model-based evolutionary algorithms: a short survey. Complex Intell Syst 4(4):283\u2013292","journal-title":"Complex Intell Syst"},{"issue":"2","key":"1323_CR25","doi-asserted-by":"publisher","first-page":"46","DOI":"10.1109\/MCI.2017.2670462","volume":"12","author":"H Huang","year":"2017","unstructured":"Huang H, Liu F, Zhuo X, Hao Z (2017) Differential evolution based on self-adaptive fitness function for automated test case generation. IEEE Comput Intell Mag 12(2):46\u201355","journal-title":"IEEE Comput Intell Mag"},{"issue":"11","key":"1323_CR26","doi-asserted-by":"publisher","first-page":"5005","DOI":"10.1109\/TII.2018.2856881","volume":"14","author":"H Huang","year":"2018","unstructured":"Huang H, Liu F, Yang Z, Hao Z (2018) Automated test case generation based on differential evolution with relationship matrix for iFogSim toolkit. IEEE Trans Ind Inf 14(11):5005\u20135016","journal-title":"IEEE Trans Ind Inf"},{"issue":"3","key":"1323_CR27","doi-asserted-by":"publisher","first-page":"491","DOI":"10.1109\/TETCI.2019.2914280","volume":"5","author":"F Liu","year":"2019","unstructured":"Liu F, Huang H, Yang Z, Hao Z, Wang J (2019) Search-based algorithm with scatter search strategy for automated test case generation of NLP toolkit. IEEE Trans Emerg Top Comput Intell 5(3):491\u2013503","journal-title":"IEEE Trans Emerg Top Comput Intell"},{"issue":"1\u20134","key":"1323_CR28","doi-asserted-by":"publisher","first-page":"47","DOI":"10.1016\/S0020-0255(00)00093-1","volume":"131","author":"J-C Lin","year":"2001","unstructured":"Lin J-C, Yeh P-L (2001) Automatic test data generation for path testing using gas. Inf Sci 131(1\u20134):47\u201364","journal-title":"Inf Sci"},{"issue":"10","key":"1323_CR29","doi-asserted-by":"publisher","first-page":"3107","DOI":"10.1016\/j.cor.2007.01.012","volume":"35","author":"MA Ahmed","year":"2008","unstructured":"Ahmed MA, Hermadi I (2008) Ga-based multiple paths test data generator. Comput Oper Res 35(10):3107\u20133124","journal-title":"Comput Oper Res"},{"issue":"2","key":"1323_CR30","doi-asserted-by":"publisher","first-page":"276","DOI":"10.1109\/TSE.2012.14","volume":"39","author":"G Fraser","year":"2013","unstructured":"Fraser G, Arcuri A (2013) Whole test suite generation. IEEE Trans Softw Eng 39(2):276\u2013291","journal-title":"IEEE Trans Softw Eng"},{"key":"1323_CR31","doi-asserted-by":"publisher","first-page":"122","DOI":"10.1109\/TSE.2017.2663435","volume":"44","author":"A Panichella","year":"2018","unstructured":"Panichella A, Kifetew FM, Tonella P (2018) Automated test case generation as a many-objective optimisation problem with dynamic selection of the targets. IEEE Trans Softw Eng 44:122\u2013158","journal-title":"IEEE Trans Softw Eng"},{"key":"1323_CR32","doi-asserted-by":"publisher","first-page":"236","DOI":"10.1016\/j.infsof.2018.08.009","volume":"104","author":"A Panichella","year":"2018","unstructured":"Panichella A, Kifetew FM, Tonella P (2018) A large scale empirical comparison of state-of-the-art search-based test case generators. Inf Softw Technol 104:236\u2013256","journal-title":"Inf Softw Technol"},{"key":"1323_CR33","doi-asserted-by":"publisher","first-page":"207","DOI":"10.1016\/j.infsof.2018.08.010","volume":"104","author":"J Campos","year":"2018","unstructured":"Campos J, Ge Y, Albunian N, Fraser G, Eler M, Arcuri A (2018) An empirical evaluation of evolutionary algorithms for unit test suite generation. Inf Softw Technol 104:207\u2013235","journal-title":"Inf Softw Technol"},{"key":"1323_CR34","doi-asserted-by":"crossref","unstructured":"Beyer D (2016) Reliable and reproducible competition results with benchexec and witnesses (report on SV-COMP 2016). In: International conference on tools and algorithms for the construction and analysis of systems. Springer, London, pp 887\u2013904","DOI":"10.1007\/978-3-662-49674-9_55"},{"key":"1323_CR35","doi-asserted-by":"publisher","first-page":"1075","DOI":"10.1109\/TETC.2021.3070968","volume":"10","author":"F Liu","year":"2021","unstructured":"Liu F, Huang H, Su J, Semujju SD, Yang Z, Hao Z (2021) Manifold-inspired search-based algorithm for automated test case generation. IEEE Trans Emerg Top Comput 10:1075\u20131090","journal-title":"IEEE Trans Emerg Top Comput"},{"key":"1323_CR36","doi-asserted-by":"crossref","unstructured":"Kukkonen S, Lampinen J (2005) GDE3: the third evolution step of generalized differential evolution. In: 2005 IEEE congress on evolutionary computation, vol 1, pp 443\u20134501","DOI":"10.1109\/CEC.2005.1554717"},{"key":"1323_CR37","doi-asserted-by":"crossref","unstructured":"Chalupa M, Strej\u010dek J (2021) Backward symbolic execution with loop folding. In: International static analysis symposium. Springer, London, pp 49\u201376","DOI":"10.1007\/978-3-030-88806-0_3"},{"key":"1323_CR38","first-page":"134","volume-title":"Pex-white box test generation for .NET","author":"N Tillmann","year":"2008","unstructured":"Tillmann N, Halleux J (2008) Pex-white box test generation for .NET. Springer, Berlin, pp 134\u2013153"},{"issue":"1","key":"1323_CR39","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3472796","volume":"48","author":"J H\u00fcckelheim","year":"2022","unstructured":"H\u00fcckelheim J, Hasco\u00ebt L (2022) Source-to-source automatic differentiation of OpenMP parallel loops. ACM Trans Math Softw (TOMS) 48(1):1\u201332","journal-title":"ACM Trans Math Softw (TOMS)"},{"key":"1323_CR40","first-page":"340","volume-title":"Loop untangling","author":"K Francis","year":"2014","unstructured":"Francis K, Stuckey PJ (2014) Loop untangling. Springer, Cham, pp 340\u2013355"},{"key":"1323_CR41","unstructured":"Godefroid P, Levin MY, Molnar DA et al (2008) Automated Whitebox fuzz testing. In: NDSS, vol 8, pp 151\u2013166"},{"key":"1323_CR42","doi-asserted-by":"crossref","unstructured":"Gu Z, Barr ET, Hamilton DJ, Su Z (2010) Has the bug really been fixed? In: 2010 ACM\/IEEE 32nd international conference on software engineering, vol 1. IEEE, New York, pp 55\u201364","DOI":"10.1145\/1806799.1806812"},{"key":"1323_CR43","doi-asserted-by":"publisher","first-page":"281","DOI":"10.1007\/11408901_21","volume-title":"Dependable computing\u2014EDCC 5","author":"N Williams","year":"2005","unstructured":"Williams N, Marre B, Mouy P, Roger M (2005) Pathcrawler: automatic generation of path tests by combining static and dynamic analysis. In: Dal Cin M, Ka\u00e2niche M, Pataricza A (eds) Dependable computing\u2014EDCC 5. Springer, Berlin, pp 281\u2013292"},{"key":"1323_CR44","doi-asserted-by":"publisher","first-page":"215","DOI":"10.1109\/TSE.1976.233817","volume":"3","author":"LA Clarke","year":"1976","unstructured":"Clarke LA (1976) A system to generate test data and symbolically execute programs. IEEE Trans Softw Eng 3:215\u2013222","journal-title":"IEEE Trans Softw Eng"},{"key":"1323_CR45","doi-asserted-by":"crossref","unstructured":"Bouchachia A (2007) An immune genetic algorithm for software test data generation. In: 7th international conference on hybrid intelligent systems (HIS 2007). IEEE, London, pp 84\u201389","DOI":"10.1109\/HIS.2007.37"},{"issue":"5","key":"1323_CR46","doi-asserted-by":"publisher","first-page":"334","DOI":"10.1049\/iet-sen.2009.0079","volume":"4","author":"DJ Mala","year":"2010","unstructured":"Mala DJ, Mohan V, Kamalapriya M (2010) Automated software test optimisation framework\u2014an artificial bee colony optimisation-based approach. IET Softw 4(5):334\u2013348","journal-title":"IET Softw"},{"key":"1323_CR47","doi-asserted-by":"crossref","unstructured":"Scalabrino S, Grano G, Di\u00a0Nucci D, Oliveto R, De\u00a0Lucia A (2016) Search-based testing of procedural programs: iterative single-target or multi-target approach? In: International symposium on search based software engineering. Springer, London, pp 64\u201379","DOI":"10.1007\/978-3-319-47106-8_5"},{"key":"1323_CR48","unstructured":"Cadar C, Dunbar D, Engler D (2008) KLEE: unassisted and automatic generation of high-coverage tests for complex systems programs. In: Proceedings of the 8th USENIX conference on operating systems design and implementation, pp 209\u2013224"},{"key":"1323_CR49","doi-asserted-by":"crossref","unstructured":"Sen K, Marinov D, Agha G (2005) Cute: a concolic unit testing engine for C. In: ACM SIGSOFT software engineering notes, vol 30. ACM, London, pp 263\u2013272","DOI":"10.1145\/1095430.1081750"},{"key":"1323_CR50","doi-asserted-by":"crossref","unstructured":"Godefroid P, Klarlund N, Sen K (2005) Dart: directed automated random testing. In: ACM Sigplan notices, vol 40. ACM, London, pp 213\u2013223","DOI":"10.1145\/1064978.1065036"},{"key":"1323_CR51","doi-asserted-by":"crossref","unstructured":"Park S, Lu S, Zhou Y (2009) CTrigger: exposing atomicity violation bugs from their hiding places. In: Proceedings of the 14th international conference on architectural support for programming languages and operating systems, pp 25\u201336","DOI":"10.1145\/1508244.1508249"},{"key":"1323_CR52","doi-asserted-by":"crossref","unstructured":"Abreu R, Zoeteweij P, Van\u00a0Gemund AJ (2007) On the accuracy of spectrum-based fault localization. In: Testing: academic and industrial conference practice and research techniques-Mutation (TAICPART-mutation 2007). IEEE, London, pp 89\u201398","DOI":"10.1109\/TAIC.PART.2007.13"},{"issue":"5","key":"1323_CR53","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/2659118.2659125","volume":"39","author":"P Agarwal","year":"2014","unstructured":"Agarwal P, Agrawal AP (2014) Fault-localization techniques for software systems: a literature review. ACM SIGSOFT Softw Eng Notes 39(5):1\u20138","journal-title":"ACM SIGSOFT Softw Eng Notes"},{"key":"1323_CR54","first-page":"1","volume":"2022","author":"Z Wang","year":"2022","unstructured":"Wang Z, Tong W, Li P, Ye G, Chen H, Gong X, Tang Z (2022) BugPre: an intelligent software version-to-version bug prediction system using graph convolutional neural networks. Complex Intell Syst 2022:1\u201321","journal-title":"Complex Intell Syst"},{"issue":"2","key":"1323_CR55","doi-asserted-by":"publisher","first-page":"105","DOI":"10.1002\/stvr.294","volume":"14","author":"P McMinn","year":"2004","unstructured":"McMinn P (2004) Search-based software test data generation: a survey. Softw Test Verif Reliab 14(2):105\u2013156","journal-title":"Softw Test Verif Reliab"},{"key":"1323_CR56","doi-asserted-by":"crossref","unstructured":"Arcuri A (2010) It does matter how you normalise the branch distance in search based software testing. In: 2010 3rd international conference on software testing, verification and validation. IEEE, London, pp 205\u2013214","DOI":"10.1109\/ICST.2010.17"},{"key":"1323_CR57","doi-asserted-by":"publisher","first-page":"195","DOI":"10.1016\/j.infsof.2018.05.003","volume":"104","author":"A Arcuri","year":"2018","unstructured":"Arcuri A (2018) Test suite generation with the many independent objective (MIO) algorithm. Inf Softw Technol 104:195\u2013206","journal-title":"Inf Softw Technol"},{"key":"1323_CR58","first-page":"1","volume":"2023","author":"C He","year":"2023","unstructured":"He C, Li L, Cheng R, Jin Y (2023) Evolutionary multiobjective optimization via efficient sampling-based offspring generation. Complex Intell Syst 2023:1\u201317","journal-title":"Complex Intell Syst"},{"issue":"4","key":"1323_CR59","doi-asserted-by":"publisher","first-page":"341","DOI":"10.1023\/A:1008202821328","volume":"11","author":"R Storn","year":"1997","unstructured":"Storn R, Price K (1997) Differential evolution-a simple and efficient heuristic for global optimization over continuous spaces. J Global Optim 11(4):341\u2013359","journal-title":"J Global Optim"},{"issue":"15","key":"1323_CR60","doi-asserted-by":"publisher","first-page":"4417","DOI":"10.1007\/s00500-016-2250-7","volume":"21","author":"ZQ Cai","year":"2017","unstructured":"Cai ZQ, Lv L, Huang H, Hu H, Liang YH (2017) Improving sampling-based image matting with cooperative coevolution differential evolution algorithm. Soft Comput 21(15):4417\u20134430","journal-title":"Soft Comput"},{"issue":"1","key":"1323_CR61","doi-asserted-by":"publisher","first-page":"92","DOI":"10.1109\/TCYB.2013.2247594","volume":"44","author":"H Wang","year":"2014","unstructured":"Wang H, Yao X (2014) Corner sort for pareto-based many-objective optimization. IEEE Trans Cybern 44(1):92\u2013102","journal-title":"IEEE Trans Cybern"},{"key":"1323_CR62","first-page":"727","volume-title":"Substitute distance assignments in NSGA-II for handling many-objective optimization problems","author":"M K\u00f6ppen","year":"2007","unstructured":"K\u00f6ppen M, Yoshida K (2007) Substitute distance assignments in NSGA-II for handling many-objective optimization problems. Springer, Berlin, pp 727\u2013741"},{"key":"1323_CR63","doi-asserted-by":"crossref","unstructured":"Deb K, Pratap A, Agarwal S, Meyarivan T (2002) A fast and elitist multiobjective genetic algorithm: NSGA-II. IEEE Trans Evol Comput 6(2):182\u2013197","DOI":"10.1109\/4235.996017"},{"key":"1323_CR64","doi-asserted-by":"crossref","unstructured":"Fraser G, Arcuri A (2011) EvoSuite: automatic test suite generation for object-oriented software. In: Proceedings of the 19th ACM SIGSOFT symposium and the 13th European conference on foundations of software engineering. ACM, New York, pp 416\u2013419","DOI":"10.1145\/2025113.2025179"},{"key":"1323_CR65","volume-title":"Practical nonparametric statistics","author":"WJ Conover","year":"1980","unstructured":"Conover WJ, Conover WJ (1980) Practical nonparametric statistics. Wiley, London"},{"issue":"2","key":"1323_CR66","first-page":"101","volume":"25","author":"A Vargha","year":"2000","unstructured":"Vargha A, Delaney HD (2000) A critique and improvement of the CL common language effect size statistics of Mcgraw and Wong. J Educ Behav Stat 25(2):101\u2013132","journal-title":"J Educ Behav Stat"}],"container-title":["Complex &amp; Intelligent Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s40747-023-01323-w.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s40747-023-01323-w\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s40747-023-01323-w.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,5,16]],"date-time":"2024-05-16T18:10:30Z","timestamp":1715883030000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s40747-023-01323-w"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,1,24]]},"references-count":66,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2024,6]]}},"alternative-id":["1323"],"URL":"https:\/\/doi.org\/10.1007\/s40747-023-01323-w","relation":{},"ISSN":["2199-4536","2198-6053"],"issn-type":[{"type":"print","value":"2199-4536"},{"type":"electronic","value":"2198-6053"}],"subject":[],"published":{"date-parts":[[2024,1,24]]},"assertion":[{"value":"31 March 2023","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"2 December 2023","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"24 January 2024","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}}]}}