{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,7]],"date-time":"2026-05-07T15:22:00Z","timestamp":1778167320533,"version":"3.51.4"},"reference-count":63,"publisher":"Springer Science and Business Media LLC","issue":"6","license":[{"start":{"date-parts":[[2022,7,8]],"date-time":"2022-07-08T00:00:00Z","timestamp":1657238400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2022,7,8]],"date-time":"2022-07-08T00:00:00Z","timestamp":1657238400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100002661","name":"fonds de la recherche scientifique - fnrs","doi-asserted-by":"publisher","award":["EOS Project 30446992 SECO-ASSIST"],"award-info":[{"award-number":["EOS Project 30446992 SECO-ASSIST"]}],"id":[{"id":"10.13039\/501100002661","id-type":"DOI","asserted-by":"publisher"}]},{"name":"flanders make vzw, the strategic research centre for the manufacturing industry"},{"DOI":"10.13039\/501100003130","name":"fonds wetenschappelijk onderzoek","doi-asserted-by":"publisher","award":["EOS Project 30446992 SECO-ASSIST"],"award-info":[{"award-number":["EOS Project 30446992 SECO-ASSIST"]}],"id":[{"id":"10.13039\/501100003130","id-type":"DOI","asserted-by":"publisher"}]},{"name":"lam research and fondecyt regular","award":["1200067"],"award-info":[{"award-number":["1200067"]}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Empir Software Eng"],"published-print":{"date-parts":[[2022,11]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Some test amplification tools extend a manually created test suite with additional test cases to increase the code coverage. The technique is effective, in the sense that it suggests strong and understandable test cases, generally adopted by software engineers. Unfortunately, the current state-of-the-art for test amplification heavily relies on program analysis techniques which benefit a lot from explicit type declarations present in statically typed languages. In dynamically typed languages, such type declarations are not available and as a consequence test amplification has yet to find its way to programming languages like Smalltalk, Python, Ruby and Javascript. We propose to exploit profiling information \u2014readily obtainable by executing the associated test suite\u2014 to infer the necessary type information creating special test inputs with corresponding assertions. We evaluated this approach on 52 selected test classes from 13 mature projects in the Pharo ecosystem containing approximately 400 test methods. We show the improvement in killing new mutants and mutation coverage at least in 28 out of 52 test classes (\u2248\u200953%). Moreover, these generated tests are understandable by humans: 8 out of 11 pull-requests submitted were merged into the main code base (\u2248\u200972%). These results are comparable to the state-of-the-art, hence we conclude that test amplification is feasible for dynamically typed languages.<\/jats:p>","DOI":"10.1007\/s10664-022-10169-8","type":"journal-article","created":{"date-parts":[[2022,7,8]],"date-time":"2022-07-08T08:13:19Z","timestamp":1657267999000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":10,"title":["Small-Amp: Test amplification in a dynamically typed language"],"prefix":"10.1007","volume":"27","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-6984-3098","authenticated-orcid":false,"given":"Mehrdad","family":"Abdi","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Henrique","family":"Rocha","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Serge","family":"Demeyer","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Alexandre","family":"Bergel","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2022,7,8]]},"reference":[{"key":"10169_CR1","unstructured":"Abdi M, Rocha H, Demeyer S (2019a) Adopting program synthesis for test amplification. In: Proceedings of the 18th Belgium-Netherlands software evolution workshop. published at http:\/\/ceur-ws.org, http:\/\/ceur-ws.org\/Vol-2605\/11.pdf, Brussels, Belgium"},{"key":"10169_CR2","unstructured":"Abdi M, Rocha H, Demeyer S (2019b) Test amplification in the pharo smalltalk ecosystem. In: Proceedings of the 14th edition of the international workshop on smalltalk technologies, IWST, vol 19, pp 1\u20137"},{"key":"10169_CR3","unstructured":"Agibalov A (2015) What is a normal \u201cfunctional lines of code\u201d to \u201ctest lines of code\u201d ratio? Teslarati. [on line] https:\/\/softwareengineering.stackexchange.com\/questions\/156883\/ \u2014 last Accessed In April 2021"},{"issue":"11","key":"10169_CR4","doi-asserted-by":"publisher","first-page":"1100","DOI":"10.1109\/TSE.2014.2342227","volume":"40","author":"D Athanasiou","year":"2014","unstructured":"Athanasiou D, Nugroho A, Visser J, Zaidman A (2014) Test code quality and its relation to issue handling performance. IEEE Trans Softw Eng 40 (11):1100\u20131125. https:\/\/doi.org\/10.1109\/TSE.2014.2342227","journal-title":"IEEE Trans Softw Eng"},{"key":"10169_CR5","unstructured":"Baudry B, Allier S, Rodriguez-Cancio M, Monperrus M (2015) Dspot: Test amplification for automatic assessment of computational diversity. CoRR: a computing research repository. arXiv:1503.05807"},{"issue":"2","key":"10169_CR6","doi-asserted-by":"publisher","first-page":"73","DOI":"10.1002\/stvr.313","volume":"15","author":"B Baudry","year":"2005","unstructured":"Baudry B, Fleurey F, J\u00e9z\u00e9quel J-M, Le Traon Y (2005) From genetic to bacteriological algorithms for mutation-based testing. Software Testing, Verification and Reliability 15(2):73\u201396","journal-title":"Software Testing, Verification and Reliability"},{"key":"10169_CR7","doi-asserted-by":"crossref","unstructured":"Beller M, Wong C-P, Bader J, Scott A, Machalica M, Chandra S, Meijer E (2021) What it would take to use mutation testing in industry\u2013a study at facebook. In: 2021 IEEE\/ACM 43rd international conference on software engineering: software engineering in practice (ICSE-SEIP), pp 268\u2013277","DOI":"10.1109\/ICSE-SEIP52600.2021.00036"},{"key":"10169_CR8","unstructured":"Bergel A, Cassou D, Ducasse S, Laval J (2013) Deep into pharo. Square Bracket Associates. http:\/\/books.pharo.org\/deep-into-pharo\/"},{"key":"10169_CR9","unstructured":"Black AP, Nierstrasz O, Ducasse S, Pollet D (2010) Pharo by example. Lulu. com"},{"key":"10169_CR10","doi-asserted-by":"crossref","unstructured":"Brandt C, Zaidman A (2021) Developer-centric test amplification the interplay between automatic generation and human exploration. arXiv:2108.12249","DOI":"10.1007\/s10664-021-10094-2"},{"key":"10169_CR11","doi-asserted-by":"crossref","unstructured":"Chauvel F, Morin B, Garcia-Ceja E (2019) Amplifying integration tests with camp. In: 2019 IEEE 30th international symposium on software reliability engineering (ISSRE), pp 283\u2013291","DOI":"10.1109\/ISSRE.2019.00036"},{"key":"10169_CR12","doi-asserted-by":"crossref","unstructured":"Costiou S, Aranega V, Denker M (2020) Sub-method, partial behavioral reflection with reflectivity: Looking back on 10 years of use. The Art, Science, and Engineering of Programming, 4(3)","DOI":"10.22152\/programming-journal.org\/2020\/4\/5"},{"key":"10169_CR13","doi-asserted-by":"publisher","first-page":"110398","DOI":"10.1016\/j.jss.2019.110398","volume":"157","author":"B Danglot","year":"2019","unstructured":"Danglot B, Vera-Perez O, Yu Z, Zaidman A, Monperrus M, Baudry B (2019a) A snowballing literature study on test amplification. J Syst Softw 157:110398. https:\/\/doi.org\/10.1016\/j.jss.2019.110398. http:\/\/www.sciencedirect.com\/science\/article\/pii\/S0164121219301736","journal-title":"J Syst Softw"},{"key":"10169_CR14","volume-title":"Automatic test improvement with dspot: a study with ten mature open-source projects. Empirical Software Engineering","author":"B Danglot","year":"2019","unstructured":"Danglot B, Vera-P\u00e9rez O L, Baudry B, Monperrus M (2019b) Automatic test improvement with dspot: a study with ten mature open-source projects. Empirical Software Engineering. Springer, Berlin"},{"key":"10169_CR15","doi-asserted-by":"crossref","unstructured":"Daniel B, Jagannath V, Dig D, Marinov D (2009) Reassert: Suggesting repairs for broken unit tests. In: Proceedings ASE 2009 (international conference on automated software engineering). IEEE CS, pp 433\u2013444","DOI":"10.1109\/ASE.2009.17"},{"key":"10169_CR16","doi-asserted-by":"crossref","unstructured":"Delplanque J, Ducasse S, Polito G, Black A P, Etien A (2019) Rotten green tests. In: 41th international conference on software engineering, ICSE \u201919. https:\/\/hal.inria.fr\/hal-02002346. IEEE, pp 500\u2013511","DOI":"10.1109\/ICSE.2019.00062"},{"key":"10169_CR17","doi-asserted-by":"publisher","first-page":"275","DOI":"10.5381\/jot.2007.6.9.a14","volume":"6","author":"M Denker","year":"2007","unstructured":"Denker M, Ducasse S, Lienhard A, Marschall P (2007) Sub-method reflection. Journal of Object Technology 6:275\u2013295. https:\/\/doi.org\/10.5381\/jot.2007.6.9.a14. http:\/\/www.jot.fm\/contents\/issue_2007_10\/paper14.html","journal-title":"Journal of Object Technology"},{"key":"10169_CR18","first-page":"39","volume":"12","author":"S Ducasse","year":"1999","unstructured":"Ducasse S (1999) Evaluating message passing control techniques in smalltalk. Journal of Object Oriented Programming 12:39\u201350","journal-title":"Journal of Object Oriented Programming"},{"key":"10169_CR19","unstructured":"Ducasse S (2019) Pharo with style. Square Bracket Associates"},{"key":"10169_CR20","doi-asserted-by":"crossref","unstructured":"Fischer S, Haslinger EN, Zimmermann M, Thaller H (2020) An empirical evaluation for object initialization of member variables in unit testing. In: Proceedings VST 2020 (IEEE workshop on validation, analysis and evolution of software tests), pp 8\u201311","DOI":"10.1109\/VST50071.2020.9051634"},{"key":"10169_CR21","doi-asserted-by":"crossref","unstructured":"Fraser G, Arcuri A (2012) The seed is strong: Seeding strategies in search-based software testing. In: 2012 IEEE fifth international conference on software testing, verification and validation, pp 121\u2013130","DOI":"10.1109\/ICST.2012.92"},{"issue":"2","key":"10169_CR22","doi-asserted-by":"publisher","first-page":"276","DOI":"10.1109\/TSE.2012.14","volume":"39","author":"G Fraser","year":"2013","unstructured":"Fraser G, Arcuri A (2013) Whole test suite generation. IEEE Trans Softw Eng 39(2):276\u2013291. https:\/\/doi.org\/10.1109\/TSE.2012.14https:\/\/doi.org\/10.1109\/TSE.2012.14","journal-title":"IEEE Trans Softw Eng"},{"issue":"2","key":"10169_CR23","doi-asserted-by":"publisher","first-page":"278","DOI":"10.1109\/TSE.2011.93","volume":"38","author":"G Fraser","year":"2012","unstructured":"Fraser G, Zeller A (2012) Mutation-driven generation of unit tests and oracles. IEEE Trans Softw Eng 38(2):278\u2013292. https:\/\/doi.org\/10.1109\/TSE.2011.93","journal-title":"IEEE Trans Softw Eng"},{"key":"10169_CR24","doi-asserted-by":"crossref","unstructured":"Fraser G, Zeller A (2011) Generating parameterized unit tests. In: Proceedings of the 2011 international symposium on software testing and analysis, pp 364\u2013374","DOI":"10.1145\/2001420.2001464"},{"key":"10169_CR25","volume-title":"Smalltalk-80: The language and its implementation","author":"A Goldberg","year":"1983","unstructured":"Goldberg A, Robson D (1983) Smalltalk-80: The language and its implementation. Addison-Wesley Longman Publishing Co Inc, USA"},{"key":"10169_CR26","doi-asserted-by":"crossref","unstructured":"Grano G, De Iaco C, Palomba F, Gall H C (2020) Pizza versus pinsa: On the perception and measurability of unit test code quality. In: 2020 IEEE international conference on software maintenance and evolution (ICSME), pp 336\u2013347","DOI":"10.1109\/ICSME46990.2020.00040"},{"issue":"4","key":"10169_CR27","doi-asserted-by":"publisher","first-page":"372","DOI":"10.1109\/TSE.2016.2597136","volume":"43","author":"N Li","year":"2016","unstructured":"Li N, Offutt J (2016) Test oracle strategies for model-based testing. IEEE Trans Softw Eng 43(4):372\u2013395. https:\/\/doi.org\/10.1109\/TSE.2016.2597136","journal-title":"IEEE Trans Softw Eng"},{"key":"10169_CR28","doi-asserted-by":"crossref","unstructured":"Lu Z X, Vercammen S, Demeyer S (2020) Semi-automatic test case expansion for mutation testing. In: 2020 IEEE workshop on validation, analysis and evolution of software tests (VST). IEEE, pp 1\u20137","DOI":"10.1109\/VST50071.2020.9051637"},{"key":"10169_CR29","doi-asserted-by":"crossref","unstructured":"Lukasczyk S, Kroi\u00df F, Fraser G (2020) Automated unit test generation for python. In: Aleti A, Panichella A (eds) Search-based software engineering. Springer International Publishing, Cham, pp 9\u201324","DOI":"10.1007\/978-3-030-59762-7_2"},{"key":"10169_CR30","doi-asserted-by":"publisher","unstructured":"Mairhofer S, Feldt R, Torkar R (2011) Search-based software testing and test data generation for a dynamic programming language. In: Proceedings of the 13th annual conference on genetic and evolutionary computation, GECCO \u201911. https:\/\/doi.org\/10.1145\/2001576.2001826. Association for Computing Machinery, New York, pp 1859\u20131866","DOI":"10.1145\/2001576.2001826"},{"key":"10169_CR31","doi-asserted-by":"crossref","unstructured":"Milani Fard A, Mirzaaghaei M, Mesbah A (2014) Leveraging existing tests in automated test generation for web applications. In: Proceedings of the 29th ACM\/IEEE international conference on Automated software engineering, pp 67\u201378","DOI":"10.1145\/2642937.2642991"},{"key":"10169_CR32","doi-asserted-by":"crossref","unstructured":"Mirshokraie S, Mesbah A, Pattabiraman K (2015) Jseft: Automated javascript unit test generation. In: 2015 IEEE 8th international conference on software testing, verification and validation (ICST), pp 1\u201310","DOI":"10.1109\/ICST.2015.7102595"},{"key":"10169_CR33","doi-asserted-by":"crossref","unstructured":"Nijkamp N, Brandt C, Zaidman A (2021) Naming amplified tests based on improved coverage. In: 2021 IEEE 21st international working conference on source code analysis and manipulation (SCAM). IEEE, pp 237\u2013241","DOI":"10.1109\/SCAM52516.2021.00036"},{"key":"10169_CR34","doi-asserted-by":"crossref","unstructured":"Oosterbroek W, Brandt C, Zaidman A (2021) Removing redundant statements in amplified test cases. In: 2021 IEEE 21st international working conference on source code analysis and manipulation (SCAM), IEEE, pp 242\u2013246","DOI":"10.1109\/SCAM52516.2021.00037"},{"key":"10169_CR35","doi-asserted-by":"crossref","unstructured":"Pacheco C, Lahiri S K, Ernst M D, Ball T (2007) Feedback-directed random test generation. In: 29th international conference on software engineering (ICSE\u201907), pp 75\u201384","DOI":"10.1109\/ICSE.2007.37"},{"issue":"2","key":"10169_CR36","doi-asserted-by":"publisher","first-page":"122","DOI":"10.1109\/TSE.2017.2663435","volume":"44","author":"A Panichella","year":"2018","unstructured":"Panichella A, Kifetew F M, Tonella P (2018) Automated test case generation as a many-objective optimisation problem with dynamic selection of the targets. IEEE Trans Softw Eng 44(2):122\u2013158. https:\/\/doi.org\/10.1109\/TSE.2017.2663435","journal-title":"IEEE Trans Softw Eng"},{"key":"10169_CR37","doi-asserted-by":"publisher","first-page":"275","DOI":"10.1016\/bs.adcom.2018.03.015","volume":"112","author":"M Papadakis","year":"2019","unstructured":"Papadakis M, Kintis M, Zhang J, Jia Y, Traon Y L, Harman M (2019) Mutation testing advances: An analysis and survey. Adv Comput 112:275\u2013378. https:\/\/doi.org\/10.1016\/bs.adcom.2018.03.015. http:\/\/www.sciencedirect.com\/science\/article\/pii\/S0065245818300305","journal-title":"Adv Comput"},{"key":"10169_CR38","doi-asserted-by":"publisher","first-page":"36","DOI":"10.1016\/j.infsof.2016.04.009","volume":"81","author":"M Patrick","year":"2017","unstructured":"Patrick M, Jia Y (2017) Kd-art: Should we intensify or diversify tests to kill mutants?. Inf Softw Technol 81:36\u201351","journal-title":"Inf Softw Technol"},{"key":"10169_CR39","doi-asserted-by":"publisher","first-page":"339","DOI":"10.1016\/j.scico.2014.05.015","volume":"98","author":"MM Peck","year":"2015","unstructured":"Peck M M, Bouraqadi N, Fabresse L, Denker M, Teruel C (2015) Ghost: A uniform and general-purpose proxy implementation. Sci Comput Program 98:339\u2013359","journal-title":"Sci Comput Program"},{"issue":"3","key":"10169_CR40","doi-asserted-by":"publisher","first-page":"415","DOI":"10.1109\/TEVC.2017.2693219","volume":"22","author":"J Petke","year":"2018","unstructured":"Petke J, Haraldsson S O, Harman M, Langdon W B, White D R, Woodward J R (2018) Genetic improvement of software: A comprehensive survey. IEEE Trans Evol Comput 22(3):415\u2013432. https:\/\/doi.org\/10.1109\/TEVC.2017.2693219https:\/\/doi.org\/10.1109\/TEVC.2017.2693219","journal-title":"IEEE Trans Evol Comput"},{"key":"10169_CR41","doi-asserted-by":"publisher","unstructured":"Petrovi\u0107 G, Ivankovi\u0107 M (2018) State of mutation testing at google. In: Proceedings of the 40th international conference on software engineering: software engineering in practice, ICSE-SEIP \u201918. https:\/\/doi.org\/10.1145\/3183519.3183521. Association for Computing Machinery, New York, pp 163\u2013171","DOI":"10.1145\/3183519.3183521"},{"key":"10169_CR42","doi-asserted-by":"publisher","unstructured":"Petrovic G, Ivankovic M, Fraser G, Just R (2021) Practical mutation testing at scale: A view from google. IEEE Trans Softw Eng, 1\u20131. https:\/\/doi.org\/10.1109\/TSE.2021.3107634","DOI":"10.1109\/TSE.2021.3107634"},{"key":"10169_CR43","doi-asserted-by":"crossref","unstructured":"Pezze M, Rubinov K, Wuttke J (2013) Generating effective integration test cases from unit ones. In: 2013 IEEE Sixth international conference on software testing, verification and validation, IEEE, pp 11\u201320","DOI":"10.1109\/ICST.2013.37"},{"key":"10169_CR44","doi-asserted-by":"publisher","unstructured":"Pluquet F, Marot A, Wuyts R (2009) Fast type reconstruction for dynamically typed programming languages. In: Noble J (ed) Proceedings of the 5th symposium on dynamic languages, DLS 2009, october 26, 2010. https:\/\/doi.org\/10.1145\/1640134.1640145. ACM, Orlando, pp 69\u201378","DOI":"10.1145\/1640134.1640145"},{"key":"10169_CR45","doi-asserted-by":"crossref","unstructured":"R\u00f6\u03b2ler J, Fraser G, Zeller A, Orso A (2012)  Isolating failure causes through test case generation. In: Proceedings of the 2012 international symposium on software testing and analysis, pp 309\u2013319","DOI":"10.1145\/2338965.2336790"},{"issue":"5","key":"10169_CR46","doi-asserted-by":"publisher","first-page":"366","DOI":"10.1002\/stvr.1601","volume":"26","author":"JM Rojas","year":"2016","unstructured":"Rojas J M, Fraser G, Arcuri A (2016) Seeding strategies in search-based unit test generation. Software Testing, Verification and Reliability 26(5):366\u2013401","journal-title":"Software Testing, Verification and Reliability"},{"key":"10169_CR47","doi-asserted-by":"crossref","unstructured":"S\u0103lcianu A, Rinard M (2005) Purity and side effect analysis for java programs. In: International workshop on verification, model checking, and abstract interpretation. Springer, pp 199\u2013215","DOI":"10.1007\/978-3-540-30579-8_14"},{"key":"10169_CR48","doi-asserted-by":"crossref","unstructured":"Thummalapenta S, Marri M R, Xie T, Tillmann N, De Halleux J (2011) Retrofitting unit tests for parameterized unit testing. In: International conference on fundamental approaches to software engineering. Springer, pp 294\u2013309","DOI":"10.1007\/978-3-642-19811-3_21"},{"key":"10169_CR49","doi-asserted-by":"publisher","unstructured":"Tillmann N, Schulte W (2006) Unit tests reloaded: Parameterized unit testing with symbolic execution. IEEE Softw, 23(4). https:\/\/doi.org\/10.1109\/MS.2006.117","DOI":"10.1109\/MS.2006.117"},{"key":"10169_CR50","doi-asserted-by":"publisher","unstructured":"Tonella P (2004) Evolutionary testing of classes. In: Proceedings of the 2004 ACM SIGSOFT international symposium on Software testing and analysis - ISSTA \u201904. https:\/\/doi.org\/10.1145\/1007512.1007528","DOI":"10.1145\/1007512.1007528"},{"key":"10169_CR51","unstructured":"Vera-P\u00e9rez O L, Danglot B, Monperrus M, Baudry B (2019) Suggestions on test suite improvements with automatic infection and propagation analysis. arXiv:1909.04770"},{"key":"10169_CR52","doi-asserted-by":"crossref","unstructured":"Vera-P\u00e9rez O L, Monperrus M, Baudry B (2018) Descartes: A pitest engine to detect pseudo-tested methods: Tool demonstration. In: 2018 33rd IEEE\/ACM international conference on automated software engineering (ASE), pp 908\u2013911","DOI":"10.1145\/3238147.3240474"},{"key":"10169_CR53","doi-asserted-by":"crossref","unstructured":"Wibowo J T P, Hendradjaya B, Widyani Y (2015) Unit test code generator for lua programming language. In: 2015 international conference on data and software engineering (ICoDSE), pp 241\u2013245","DOI":"10.1109\/ICODSE.2015.7437005"},{"key":"10169_CR54","doi-asserted-by":"publisher","unstructured":"Wilkinson H (2019) Vm support for live typing: Automatic type annotation for dynamically typed languages. In: Proceedings of the Conference Companion of the 3rd International Conference on Art, Science, and Engineering of Programming, Programming \u201919. https:\/\/doi.org\/10.1145\/3328433.3328443. Association for Computing Machinery, New York","DOI":"10.1145\/3328433.3328443"},{"key":"10169_CR55","unstructured":"Wilkinson H, Chillo N, Brunstein G (2009) Mutation testing. European Smalltalk User Group (ESUG 09). Brest, France. http:\/\/www.esug.org\/data\/ESUG2009\/Friday\/Mutation_Testing.pdf"},{"key":"10169_CR56","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4615-4625-2","volume-title":"Experimentation in software engineering","author":"C Wohlin","year":"2000","unstructured":"Wohlin C, Runeson P, H\u00f6st M, Ohlsson M C, Regnell B, Wessl\u00e9n A (2000) Experimentation in software engineering. Kluwer Academic Publishers, Boston"},{"key":"10169_CR57","doi-asserted-by":"publisher","unstructured":"Xie T (2006) Augmenting automatically generated unit-test suites with regression oracle checking. Lect Notes Comput Sci, 380\u2013403. https:\/\/doi.org\/10.1007\/11785477_23","DOI":"10.1007\/11785477_23"},{"key":"10169_CR58","doi-asserted-by":"crossref","unstructured":"Xu Z, Cohen M B, Rothermel G (2010) Factors affecting the use of genetic algorithms in test suite augmentation. In: Proceedings of the 12th annual conference on Genetic and evolutionary computation, pp 1365\u20131372","DOI":"10.1145\/1830483.1830734"},{"key":"10169_CR59","doi-asserted-by":"crossref","unstructured":"Xu Z, Rothermel G (2009) Directed test suite augmentation. In: 2009 16th asia-pacific software engineering conference. IEEE, pp 406\u2013413","DOI":"10.1109\/APSEC.2009.29"},{"key":"10169_CR60","doi-asserted-by":"crossref","unstructured":"Xuan J, Xie X, Monperrus M (2015) Crash reproduction via test case mutation: let existing test cases help. In: Proceedings of the 2015 10th joint meeting on foundations of software engineering, pp 910\u2013913","DOI":"10.1145\/2786805.2803206"},{"issue":"3","key":"10169_CR61","doi-asserted-by":"publisher","first-page":"171","DOI":"10.1002\/stvr.435","volume":"22","author":"S Yoo","year":"2012","unstructured":"Yoo S, Harman M (2012) Test data regeneration: generating new test data from existing test data. Software Testing, Verification and Reliability 22 (3):171\u2013201","journal-title":"Software Testing, Verification and Reliability"},{"key":"10169_CR62","doi-asserted-by":"crossref","unstructured":"Yoshida H, Tokumoto S, Prasad M R, Ghosh I, Uehara T (2016) Fsx: fine-grained incremental unit test generation for c\/c++ programs. In: Proceedings of the 25th international symposium on software testing and analysis, pp 106\u2013117","DOI":"10.1145\/2931037.2931055"},{"issue":"3","key":"10169_CR63","doi-asserted-by":"publisher","first-page":"325","DOI":"10.1007\/s10664-010-9143-7","volume":"16","author":"A Zaidman","year":"2011","unstructured":"Zaidman A, Rompaey B V, van Deursen A, Demeyer S (2011) Studying the co-evolution of production and test code in open source and industrial developer test processes through repository mining. International Journal on Empirical Software Engineering 16(3):325\u2013364. https:\/\/doi.org\/10.1007\/s10664-010-9143-7","journal-title":"International Journal on Empirical Software Engineering"}],"container-title":["Empirical Software Engineering"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10664-022-10169-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10664-022-10169-8\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10664-022-10169-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,9,26]],"date-time":"2022-09-26T08:18:58Z","timestamp":1664180338000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10664-022-10169-8"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,7,8]]},"references-count":63,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2022,11]]}},"alternative-id":["10169"],"URL":"https:\/\/doi.org\/10.1007\/s10664-022-10169-8","relation":{},"ISSN":["1382-3256","1573-7616"],"issn-type":[{"value":"1382-3256","type":"print"},{"value":"1573-7616","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,7,8]]},"assertion":[{"value":"13 April 2022","order":1,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"8 July 2022","order":2,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"We confirm that there are no conflicts of interest.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"<!--Emphasis Type='Bold' removed-->Conflict of Interests"}}],"article-number":"128"}}