{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,27]],"date-time":"2026-06-27T00:47:20Z","timestamp":1782521240615,"version":"3.54.5"},"reference-count":73,"publisher":"Springer Science and Business Media LLC","issue":"4","license":[{"start":{"date-parts":[[2024,5,17]],"date-time":"2024-05-17T00:00:00Z","timestamp":1715904000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,5,17]],"date-time":"2024-05-17T00:00:00Z","timestamp":1715904000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100007065","name":"Universit\u00e0 degli Studi di Salerno","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100007065","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Empir Software Eng"],"published-print":{"date-parts":[[2024,7]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Unit testing verifies the presence of faults in individual software components. Previous research has been targeting the automatic generation of unit tests through the adoption of random or search-based algorithms. Despite their effectiveness, these approaches aim at creating tests by solely optimizing metrics like code coverage, without ensuring that the resulting tests have granularities that would allow them to verify both the behavior of individual production methods and the interaction between methods of the class under test. To address this limitation, we propose a two-step systematic approach to the generation of unit tests: we first force search-based algorithms to create tests that cover individual methods of the production code, hence implementing the so-called <jats:italic>intra-method tests<\/jats:italic>; then, we relax the constraints to enable the creation of <jats:italic>intra-class tests<\/jats:italic> that target the interactions among production code methods. The assessment of our approach is conducted through a mixed-method research design that combines statistical analyses with a user study. The key results report that our approach is able to keep the same level of code and mutation coverage while providing test suites that are more structured, more understandable and aligned to the design principles of unit testing.<\/jats:p>","DOI":"10.1007\/s10664-024-10451-x","type":"journal-article","created":{"date-parts":[[2024,5,17]],"date-time":"2024-05-17T08:01:40Z","timestamp":1715932900000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":6,"title":["Toward granular search-based automatic unit test case generation"],"prefix":"10.1007","volume":"29","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-2446-4291","authenticated-orcid":false,"given":"Fabiano","family":"Pecorelli","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Giovanni","family":"Grano","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Fabio","family":"Palomba","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Harald C.","family":"Gall","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Andrea","family":"De Lucia","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2024,5,17]]},"reference":[{"key":"10451_CR1","doi-asserted-by":"publisher","unstructured":"Afshan S, McMinn P, Stevenson M (2013) Evolving readable string test inputs using a natural language model to reduce human oracle cost. In: Proceedings of the 2013 IEEE Sixth International Conference on Software Testing, Verification and Validation, IEEE Computer Society, Washington, DC, USA, ICST \u201913, pp 352\u2013361. https:\/\/doi.org\/10.1109\/ICST.2013.11. http:\/\/dx.doi.org\/10.1109\/ICST.2013.11","DOI":"10.1109\/ICST.2013.11"},{"issue":"6","key":"10451_CR2","doi-asserted-by":"publisher","first-page":"742","DOI":"10.1109\/TSE.2009.52","volume":"36","author":"S Ali","year":"2009","unstructured":"Ali S, Briand LC, Hemmati H, Panesar-Walawege RK (2009) A systematic review of the application and empirical investigation of search-based test case generation. IEEE rans Softw Eng 36(6):742\u2013762","journal-title":"IEEE rans Softw Eng"},{"key":"10451_CR3","doi-asserted-by":"publisher","DOI":"10.1017\/9781316771273","volume-title":"Introduction to software testing","author":"P Ammann","year":"2016","unstructured":"Ammann P, Offutt J (2016) Introduction to software testing. Cambridge University Press"},{"issue":"8","key":"10451_CR4","doi-asserted-by":"publisher","first-page":"1978","DOI":"10.1016\/j.jss.2013.02.061","volume":"86","author":"S Anand","year":"2013","unstructured":"Anand S, Burke EK, Chen TY, Clark J, Cohen MB, Grieskamp W, Harman M, Harrold MJ, Mcminn P, Bertolino A et al (2013) An orchestrated survey of methodologies for automated software test case generation. J Syst Softw 86(8):1978\u20132001","journal-title":"J Syst Softw"},{"key":"10451_CR5","unstructured":"Anonymous (2021) Toward granular automatic unit test case generation - online appendix. https:\/\/figshare.com\/s\/34d39dae76ed68d57d18"},{"issue":"1","key":"10451_CR6","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3293455","volume":"28","author":"A Arcuri","year":"2019","unstructured":"Arcuri A (2019) Restful api automated test case generation with evomaster. ACM Trans Softw Eng Methodol 28(1):1\u201337","journal-title":"ACM Trans Softw Eng Methodol"},{"issue":"3","key":"10451_CR7","doi-asserted-by":"publisher","first-page":"594","DOI":"10.1007\/s10664-013-9249-9","volume":"18","author":"A Arcuri","year":"2013","unstructured":"Arcuri A, Fraser G (2013) Parameter tuning or default values? an empirical investigation in search-based software engineering. Empir Softw Eng 18(3):594\u2013623","journal-title":"Empir Softw Eng"},{"key":"10451_CR8","doi-asserted-by":"crossref","unstructured":"Baltes S, Diehl S (2016) Worse than spam: Issues in sampling software developers. In: Proceedings of the 10th ACM\/IEEE international symposium on empirical software engineering and measurement, p 1\u20136","DOI":"10.1145\/2961111.2962628"},{"issue":"5","key":"10451_CR9","doi-asserted-by":"publisher","first-page":"507","DOI":"10.1109\/TSE.2014.2372785","volume":"41","author":"ET Barr","year":"2015","unstructured":"Barr ET, Harman M, McMinn P, Shahbaz M, Yoo S (2015) The oracle problem in software testing: A survey. IEEE Trans Softw Eng 41(5):507\u2013525. https:\/\/doi.org\/10.1109\/TSE.2014.2372785","journal-title":"IEEE Trans Softw Eng"},{"issue":"3","key":"10451_CR10","doi-asserted-by":"publisher","first-page":"261","DOI":"10.1109\/TSE.2017.2776152","volume":"45","author":"M Beller","year":"2017","unstructured":"Beller M, Gousios G, Panichella A, Proksch S, Amann S, Zaidman A (2017) Developer testing in the ide: Patterns, beliefs, and behavior. IEEE Trans Softw Eng 45(3):261\u2013284","journal-title":"IEEE Trans Softw Eng"},{"key":"10451_CR11","doi-asserted-by":"publisher","unstructured":"Campos J, Ge Y, Fraser G, Eler M, Arcuri A (2017) An empirical evaluation of evolutionary algorithms for test suite generation. In: Proceedings of the 9th International Symposium on Search Based Software Engineering SSBSE 2017, p 33\u201348. https:\/\/doi.org\/10.1007\/978-3-319-66299-2_3","DOI":"10.1007\/978-3-319-66299-2_3"},{"issue":"1","key":"10451_CR12","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/2768829","volume":"25","author":"M Ceccato","year":"2015","unstructured":"Ceccato M, Marchetto A, Mariani L, Nguyen CD, Tonella P (2015) Do automatically generated test cases make debugging easier? an experimental assessment of debugging effectiveness and efficiency. ACM Trans Softw Eng Methodol 25(1):1\u201338","journal-title":"ACM Trans Softw Eng Methodol"},{"key":"10451_CR13","unstructured":"Conover W (1999) Practical nonparametric statistics, 3rd edn. Wiley series in probability and statistics, Wiley, New York, NY [u.a.]"},{"key":"10451_CR14","doi-asserted-by":"crossref","unstructured":"Daka E, Campos J, Fraser G, Dorn J, Weimer W (2015) Modeling readability to improve unit tests. In: Proceedings of the 2015 10th Joint Meeting on Foundations of Software Engineering, ACM, p 107\u2013118","DOI":"10.1145\/2786805.2786838"},{"key":"10451_CR15","doi-asserted-by":"crossref","unstructured":"Dietrich J, Schole H, Sui L, Tempero E (2017) Xcorpus\u2013an executable corpus of java programs","DOI":"10.5381\/jot.2017.16.4.a1"},{"key":"10451_CR16","doi-asserted-by":"crossref","unstructured":"Elish MO, Rine D (2006) Design structural stability metrics and post-release defect density: An empirical study. In: 2006 30th Annual International Computer Software and Applications Conference (COMPSAC\u201906 Supplement), IEEE, p 1\u20138","DOI":"10.1109\/COMPSAC.2006.261038"},{"issue":"3","key":"10451_CR17","doi-asserted-by":"publisher","first-page":"226","DOI":"10.1109\/TSE.2005.37","volume":"31","author":"H Erdogmus","year":"2005","unstructured":"Erdogmus H, Morisio M, Torchiano M (2005) On the effectiveness of the test-first approach to programming. IEEE Trans Softw Eng 31(3):226\u2013237","journal-title":"IEEE Trans Softw Eng"},{"key":"10451_CR18","doi-asserted-by":"publisher","unstructured":"Ferrer J, Chicano F, Alba E (2012) Evolutionary algorithms for the multi-objective test data generation problem. Softw Pract Exper 42(11):1331\u20131362. https:\/\/doi.org\/10.1002\/spe.1135. https:\/\/dx.doi.org\/10.1002\/spe.1135","DOI":"10.1002\/spe.1135"},{"key":"10451_CR19","volume-title":"Refactoring: improving the design of existing code","author":"M Fowler","year":"1999","unstructured":"Fowler M, Beck K (1999) Refactoring: improving the design of existing code. Addison-Wesley Professional"},{"key":"10451_CR20","doi-asserted-by":"publisher","unstructured":"Fraser G, Arcuri A (2011) Evosuite: Automatic test suite generation for object-oriented software. In: Proceedings of the 19th ACM SIGSOFT Symposium and the 13th European Conference on Foundations of Software Engineering, ACM, New York, NY, USA, ESEC\/FSE \u201911, p 416\u2013419. https:\/\/doi.org\/10.1145\/2025113.2025179. http:\/\/doi.acm.org\/10.1145\/2025113.2025179","DOI":"10.1145\/2025113.2025179"},{"key":"10451_CR21","doi-asserted-by":"publisher","unstructured":"Fraser G, Arcuri A (2013) Whole test suite generation. IEEE Trans Softw Eng 39(2):276\u2013291. https:\/\/doi.org\/10.1109\/TSE.2012.14. https:\/\/dx.doi.org\/10.1109\/TSE.2012.14","DOI":"10.1109\/TSE.2012.14"},{"issue":"2","key":"10451_CR22","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/2685612","volume":"24","author":"G Fraser","year":"2014","unstructured":"Fraser G, Arcuri A (2014) A large-scale evaluation of automated unit test generation using evosuite. ACM Trans Softw Eng Methodol 24(2):1\u201342","journal-title":"ACM Trans Softw Eng Methodol"},{"issue":"3","key":"10451_CR23","doi-asserted-by":"publisher","first-page":"611","DOI":"10.1007\/s10664-013-9288-2","volume":"20","author":"G Fraser","year":"2015","unstructured":"Fraser G, Arcuri A (2015) 1600 faults in 100 projects: automatically finding faults while achieving high coverage with evosuite. Empir Softw Eng 20(3):611\u2013639","journal-title":"Empir Softw Eng"},{"issue":"3","key":"10451_CR24","doi-asserted-by":"publisher","first-page":"783","DOI":"10.1007\/s10664-013-9299-z","volume":"20","author":"G Fraser","year":"2015","unstructured":"Fraser G, Arcuri A (2015) Achieving scalable mutation-based generation of whole test suites. Empir Softw Eng 20(3):783\u2013812","journal-title":"Empir Softw Eng"},{"key":"10451_CR25","doi-asserted-by":"crossref","unstructured":"Fraser G, Arcuri A (2016) Evosuite at the sbst 2016 tool competition. In: Proceedings of the 9th International Workshop on Search-Based Software Testing, p 33\u201336","DOI":"10.1145\/2897010.2897020"},{"issue":"4","key":"10451_CR26","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/2699688","volume":"24","author":"G Fraser","year":"2015","unstructured":"Fraser G, Staats M, McMinn P, Arcuri A, Padberg F (2015) Does automated unit test generation really help software testers? a controlled empirical study. ACM Trans Softw Eng Methodol To Appear 24(4):1\u201349","journal-title":"ACM Trans Softw Eng Methodol To Appear"},{"key":"10451_CR27","doi-asserted-by":"publisher","first-page":"52","DOI":"10.1016\/j.jss.2017.12.013","volume":"138","author":"V Garousi","year":"2018","unstructured":"Garousi V, K\u00fc\u00e7\u00fck B (2018) Smells in software test code: a survey of knowledge in industry and academia. J Syst Softw 138:52\u201381","journal-title":"J Syst Softw"},{"key":"10451_CR28","volume-title":"Genetic Algorithms in Search, Optimization and Machine Learning","author":"DE Goldberg","year":"1989","unstructured":"Goldberg DE (1989) Genetic Algorithms in Search, Optimization and Machine Learning, 1st edn. Addison-Wesley Longman Publishing Co., Inc, Boston","edition":"1"},{"key":"10451_CR29","doi-asserted-by":"crossref","unstructured":"Grano G, Scalabrino S, Oliveto R, Gall H (2018) An empirical investigation on the readability of manual and generated test cases. In: Proceedings of the 26th International Conference on Program Comprehension, ICPC","DOI":"10.1145\/3196321.3196363"},{"key":"10451_CR30","unstructured":"Grano G, Laaber C, Panichella A, Panichella S (2019a) Testing with fewer resources: An adaptive approach to performance-aware test case generation. IEEE Trans Softw Eng"},{"key":"10451_CR31","doi-asserted-by":"publisher","first-page":"312","DOI":"10.1016\/j.jss.2019.07.016","volume":"156","author":"G Grano","year":"2019","unstructured":"Grano G, Palomba F, Di Nucci D, De Lucia A, Gall HC (2019) Scented since the beginning: On the diffuseness of test smells in automatically generated test code. J Syst Softw 156:312\u2013327","journal-title":"J Syst Softw"},{"key":"10451_CR32","doi-asserted-by":"crossref","unstructured":"Grano G, De\u00a0Iaco C, Palomba F, Gall HC (2020) Pizza versus pinsa: On the perception and measurability of unit test code quality. In: 2020 IEEE International Conference on Software Maintenance and Evolution (ICSME), IEEE, p 336\u2013347","DOI":"10.1109\/ICSME46990.2020.00040"},{"key":"10451_CR33","doi-asserted-by":"crossref","unstructured":"Gren L, Antinyan V (2017) On the relation between unit testing and code quality. In: 2017 43rd Euromicro Conference on Software Engineering and Advanced Applications (SEAA), IEEE, p 52\u201356","DOI":"10.1109\/SEAA.2017.36"},{"key":"10451_CR34","doi-asserted-by":"crossref","unstructured":"Habchi S, Haben G, Papadakis M, Cordy M, Traon YL (2021) A qualitative study on the sources, impacts, and mitigation strategies of flaky tests. arXiv preprint arXiv:2112.04919","DOI":"10.1109\/ICST53961.2022.00034"},{"key":"10451_CR35","doi-asserted-by":"crossref","unstructured":"Harrold MJ, McGregor JD, Fitzpatrick KJ (1992) Incremental testing of object-oriented class structures. In: Proceedings of the 14th international conference on Software engineering, p 68\u201380","DOI":"10.1145\/143062.143093"},{"key":"10451_CR36","doi-asserted-by":"crossref","unstructured":"Heckman JJ (1990) Selection bias and self-selection. In: Econometrics, Springer, p 201\u2013224","DOI":"10.1007\/978-1-349-20570-7_29"},{"key":"10451_CR37","doi-asserted-by":"publisher","first-page":"510","DOI":"10.1109\/TSE.1981.231113","volume":"5","author":"S Henry","year":"1981","unstructured":"Henry S, Kafura D (1981) Software structure metrics based on information flow. IEEE Trans Softw Eng 5:510\u2013518","journal-title":"IEEE Trans Softw Eng"},{"issue":"1","key":"10451_CR38","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/1471-2288-13-3","volume":"13","author":"KJ Hunt","year":"2013","unstructured":"Hunt KJ, Shlomo N, Addington-Hall J (2013) Participant recruitment in sensitive surveys: a comparative trial of \u2018opt in\u2019versus \u2018opt out\u2019approaches. BMC Med Res Methodol 13(1):1\u20138","journal-title":"BMC Med Res Methodol"},{"key":"10451_CR39","doi-asserted-by":"crossref","unstructured":"Just R, Jalali D, Ernst MD (2014) Defects4j: A database of existing faults to enable controlled testing studies for java programs. In: Proceedings of the 2014 international symposium on software testing and analysis, p 437\u2013440","DOI":"10.1145\/2610384.2628055"},{"issue":"2","key":"10451_CR40","doi-asserted-by":"publisher","first-page":"149","DOI":"10.1162\/106365600568167","volume":"8","author":"JD Knowles","year":"2000","unstructured":"Knowles JD, Corne DW (2000) Approximating the nondominated front using the pareto archived evolution strategy. Evol Comput 8(2):149\u2013172","journal-title":"Evol Comput"},{"key":"10451_CR41","doi-asserted-by":"crossref","unstructured":"Kudrjavets G, Nagappan N, Ball T (2006) Assessing the relationship between software assertions and faults: An empirical investigation. In: 2006 17th International Symposium on Software Reliability Engineering, IEEE, p 204\u2013212","DOI":"10.1109\/ISSRE.2006.14"},{"key":"10451_CR42","doi-asserted-by":"crossref","unstructured":"Lakhotia K, Harman M, McMinn P (2007) A multi-objective approach to search-based test data generation. In: Proceedings of the 9th annual conference on Genetic and evolutionary computation, p 1098\u20131105","DOI":"10.1145\/1276958.1277175"},{"issue":"3","key":"10451_CR43","first-page":"707","volume":"58","author":"C von L\u00fccken","year":"2014","unstructured":"von L\u00fccken C, Bar\u00e1n B, Brizuela C (2014) A survey on multi-objective evolutionary algorithms for many-objective problems. Comput Optim Appl 58(3):707\u2013756","journal-title":"Comput Optim Appl"},{"key":"10451_CR44","doi-asserted-by":"publisher","first-page":"308","DOI":"10.1109\/TSE.1976.233837","volume":"4","author":"TJ McCabe","year":"1976","unstructured":"McCabe TJ (1976) A complexity measure. IEEE Trans Softw Eng 4:308\u2013320","journal-title":"IEEE Trans Softw Eng"},{"key":"10451_CR45","doi-asserted-by":"publisher","unstructured":"McMinn P (2004) Search-based software test data generation: A survey. Softw Test Verif Reliab 14(2):105\u2013156. https:\/\/doi.org\/10.1002\/stvr.v14:2. https:\/\/dx.doi.org\/10.1002\/stvr.v14:2","DOI":"10.1002\/stvr.v14:2"},{"issue":"2","key":"10451_CR46","doi-asserted-by":"publisher","first-page":"105","DOI":"10.1002\/stvr.294","volume":"14","author":"P McMinn","year":"2004","unstructured":"McMinn P (2004) Search-based software test data generation: a survey. Softw Test Verification Reliab 14(2):105\u2013156","journal-title":"Softw Test Verification Reliab"},{"key":"10451_CR47","volume-title":"The art of software testing","author":"GJ Myers","year":"2011","unstructured":"Myers GJ, Sandler C, Badgett T (2011) The art of software testing. John Wiley & Sons"},{"key":"10451_CR48","unstructured":"Orso A, Silva S (1998) Open issues and research directions in object-oriented testing. In: Proceedings of the 4th International Conference on\u201d Achieving Quality in Software: Software Quality in the Communication Society\u201d (AQUIS\u201998)"},{"key":"10451_CR49","doi-asserted-by":"crossref","unstructured":"Oster N, Saglietti F (2006) Automatic test data generation by multi-objective optimisation. In: International Conference on Computer Safety, Reliability, and Security, Springer, p 426\u2013438","DOI":"10.1007\/11875567_32"},{"key":"10451_CR50","doi-asserted-by":"publisher","unstructured":"Palomba F, Panichella A, Zaidman A, Oliveto R, De\u00a0Lucia A (2016) Automatic test case generation: What if test code quality matters? In: Proceedings of the 25th International Symposium on Software Testing and Analysis, ACM, New York, NY, USA, ISSTA 2016, p 130\u2013141. https:\/\/doi.org\/10.1145\/2931037.2931057. http:\/\/doi.acm.org\/10.1145\/2931037.2931057","DOI":"10.1145\/2931037.2931057"},{"key":"10451_CR51","doi-asserted-by":"crossref","unstructured":"Panichella A, Kifetew FM, Tonella P (2015a) Reformulating branch coverage as a many-objective optimization problem. In: ICST, IEEE Computer Society, p 1\u201310","DOI":"10.1109\/ICST.2015.7102604"},{"key":"10451_CR52","doi-asserted-by":"crossref","unstructured":"Panichella A, Kifetew FM, Tonella P (2015b) Reformulating branch coverage as a many-objective optimization problem. In: ICST, IEEE Computer Society, p 1\u201310","DOI":"10.1109\/ICST.2015.7102604"},{"issue":"2","key":"10451_CR53","doi-asserted-by":"publisher","first-page":"122","DOI":"10.1109\/TSE.2017.2663435","volume":"44","author":"A Panichella","year":"2018","unstructured":"Panichella A, Kifetew FM, Tonella P (2018) Automated test case generation as a many-objective optimisation problem with dynamic selection of the targets. IEEE Trans Softw Eng 44(2):122\u2013158","journal-title":"IEEE Trans Softw Eng"},{"key":"10451_CR54","doi-asserted-by":"crossref","unstructured":"Panichella A, Kifetew FM, Tonella P (2018b) Incremental control dependency frontier exploration for many-criteria test case generation. In: International Symposium on Search Based Software Engineering, Springer, p 309\u2013324","DOI":"10.1007\/978-3-319-99241-9_17"},{"key":"10451_CR55","doi-asserted-by":"crossref","unstructured":"Papadakis M, Shin D, Yoo S, Bae DH (2018) Are mutation scores correlated with real fault detection? a large scale empirical study on the relationship between mutants and real faults. In: 2018 IEEE\/ACM 40th International Conference on Software Engineering (ICSE), IEEE, p 537\u2013548","DOI":"10.1145\/3180155.3180183"},{"issue":"2","key":"10451_CR56","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/s10664-020-09891-y","volume":"26","author":"F Pecorelli","year":"2021","unstructured":"Pecorelli F, Palomba F, De Lucia A (2021) The relation of test-related factors to software quality: a case study on apache systems. Empir Softw Eng 26(2):1\u201342","journal-title":"Empir Softw Eng"},{"key":"10451_CR57","doi-asserted-by":"crossref","unstructured":"Peruma A, Almalki K, Newman CD, Mkaouer MW, Ouni A, Palomba F (2020) Tsdetect: An open source test smells detection tool. In: Proceedings of the 28th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering, p 1650\u20131654","DOI":"10.1145\/3368089.3417921"},{"key":"10451_CR58","volume-title":"Software testing and analysis: process, principles, and techniques","author":"M Pezz\u00e8","year":"2008","unstructured":"Pezz\u00e8 M, Young M (2008) Software testing and analysis: process, principles, and techniques. John Wiley & Sons"},{"key":"10451_CR59","doi-asserted-by":"crossref","unstructured":"Pinto GH, Vergilio SR (2010) A multi-objective genetic algorithm to test data generation. In: 2010 22nd IEEE International Conference on Tools with Artificial Intelligence, IEEE, vol\u00a01, p 129\u2013134","DOI":"10.1109\/ICTAI.2010.26"},{"key":"10451_CR60","doi-asserted-by":"crossref","unstructured":"Ramler R, Wolfmaier K, Kopetzky T (2013) A replicated study on random test case generation and manual unit testing: How many bugs do professional developers find? In: 2013 IEEE 37th Annual Computer Software and Applications Conference, IEEE, p 484\u2013491","DOI":"10.1109\/COMPSAC.2013.82"},{"key":"10451_CR61","unstructured":"Reid B, Wagner M, d\u2019Amorim M, Treude C (2022) Software engineering user study recruitment on prolific: An experience report. arXiv preprint arXiv:2201.05348"},{"key":"10451_CR62","doi-asserted-by":"publisher","first-page":"93","DOI":"10.1007\/978-3-319-22183-0_7","volume-title":"Search-Based Software Engineering","author":"JM Rojas","year":"2015","unstructured":"Rojas JM, Campos J, Vivanti M, Fraser G, Arcuri A (2015) Combining multiple coverage criteria in search-based unit test generation. In: Barros M, Labiche Y (eds) Search-Based Software Engineering. Springer International Publishing, Cham, pp 93\u2013108"},{"key":"10451_CR63","doi-asserted-by":"crossref","unstructured":"Rojas JM, Fraser G, Arcuri A (2015b) Automated unit test generation during software development: A controlled experiment and think-aloud observations. In: Proceedings of the 2015 international symposium on software testing and analysis, p 338\u2013349","DOI":"10.1145\/2771783.2771801"},{"key":"10451_CR64","first-page":"64","volume-title":"Search Based Software Engineering","author":"S Scalabrino","year":"2016","unstructured":"Scalabrino S, Grano G, Di Nucci D, Oliveto R, De Lucia A (2016) Search-based testing of procedural programs: Iterative single-target or multi-target approach? In: Sarro F, Deb K (eds) Search Based Software Engineering. Springer International Publishing, Cham, pp 64\u201379"},{"key":"10451_CR65","doi-asserted-by":"crossref","unstructured":"Spadini D, Palomba F, Zaidman A, Bruntink M, Bacchelli A (2018) On the relation of test smells to software code quality. In: 2018 IEEE International Conference on Software Maintenance and Evolution (ICSME), IEEE, p 1\u201312","DOI":"10.1109\/ICSME.2018.00010"},{"issue":"4","key":"10451_CR66","doi-asserted-by":"publisher","first-page":"9","DOI":"10.1109\/MS.2005.111","volume":"22","author":"D Spinellis","year":"2005","unstructured":"Spinellis D (2005) Tool writing: a forgotten art?(software tools). IEEE Softw 22(4):9\u201311","journal-title":"IEEE Softw"},{"issue":"4","key":"10451_CR67","doi-asserted-by":"publisher","first-page":"297","DOI":"10.1109\/TSE.2003.1191795","volume":"29","author":"R Subramanyam","year":"2003","unstructured":"Subramanyam R, Krishnan MS (2003) Empirical analysis of ck metrics for object-oriented design complexity: Implications for software defects. IEEE Trans Softw Eng 29(4):297\u2013310","journal-title":"IEEE Trans Softw Eng"},{"key":"10451_CR68","unstructured":"Van\u00a0Deursen A, Moonen L, van\u00a0den Bergh A, Kok G (2001) Refactoring test code. In: Proceedings of the 2nd international conference on extreme programming and flexible processes in software engineering (XP2001), p 92\u201395"},{"key":"10451_CR69","doi-asserted-by":"crossref","unstructured":"Wang S, Offutt J (2009) Comparison of unit-level automated test generation tools. In: 2009 International Conference on Software Testing, Verification, and Validation Workshops, IEEE, p 210\u2013219","DOI":"10.1109\/ICSTW.2009.36"},{"key":"10451_CR70","doi-asserted-by":"publisher","unstructured":"Wappler S, Lammermann F (2005) Using evolutionary algorithms for the unit testing of object-oriented software. In: Proceedings of the 7th Annual Conference on Genetic and Evolutionary Computation, Association for Computing Machinery, New York, NY, USA, GECCO \u201905, p 1053\u20131060. https:\/\/doi.org\/10.1145\/1068009.1068187","DOI":"10.1145\/1068009.1068187"},{"key":"10451_CR71","doi-asserted-by":"crossref","unstructured":"Williams L, Kudrjavets G, Nagappan N (2009) On the effectiveness of unit test automation at microsoft. In: 2009 20th International Symposium on Software Reliability Engineering, IEEE, p 81\u201389","DOI":"10.1109\/ISSRE.2009.32"},{"key":"10451_CR72","doi-asserted-by":"crossref","unstructured":"Zamani S, Hemmati H (2020) A cost-effective approach for hyper-parameter tuning in search-based test case generation. In: 2020 IEEE International Conference on Software Maintenance and Evolution (ICSME), IEEE, p 418\u2013429","DOI":"10.1109\/ICSME46990.2020.00047"},{"key":"10451_CR73","volume-title":"Why programs fail: a guide to systematic debugging","author":"A Zeller","year":"2009","unstructured":"Zeller A (2009) Why programs fail: a guide to systematic debugging. Elsevier"}],"container-title":["Empirical Software Engineering"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10664-024-10451-x.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10664-024-10451-x\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10664-024-10451-x.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,7,5]],"date-time":"2024-07-05T15:09:43Z","timestamp":1720192183000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10664-024-10451-x"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,5,17]]},"references-count":73,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2024,7]]}},"alternative-id":["10451"],"URL":"https:\/\/doi.org\/10.1007\/s10664-024-10451-x","relation":{},"ISSN":["1382-3256","1573-7616"],"issn-type":[{"value":"1382-3256","type":"print"},{"value":"1573-7616","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,5,17]]},"assertion":[{"value":"23 January 2024","order":1,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"17 May 2024","order":2,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare that they have no conflict of interest.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}}],"article-number":"71"}}