{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,3,24]],"date-time":"2025-03-24T08:52:10Z","timestamp":1742806330374,"version":"3.37.3"},"reference-count":59,"publisher":"Springer Science and Business Media LLC","issue":"4","license":[{"start":{"date-parts":[[2022,5,5]],"date-time":"2022-05-05T00:00:00Z","timestamp":1651708800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2022,5,5]],"date-time":"2022-05-05T00:00:00Z","timestamp":1651708800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Empir Software Eng"],"published-print":{"date-parts":[[2022,7]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Automatic Program Repair (APR) techniques can promisingly help reduce the cost of debugging. Many relevant APR techniques follow the <jats:italic>generate-and-validate<\/jats:italic> approach, that is, the faulty program is iteratively modified with different change operators and then validated with a test suite until a plausible patch is generated. In particular, Kali is a generate-and-validate technique developed to investigate the possibility of generating plausible patches by only removing code. Former studies show that indeed Kali successfully addressed several faults. This paper addresses the single and particular case of code-removal patches in automated program repair. We investigate the reasons and the scenarios that make their creation possible, and the relationship with patches implemented by developers. Our study reveals that code-removal patches are often insufficient to fix bugs, and proposes a comprehensive taxonomy of code-removal patches that provides evidence of the problems that may affect test suites, opening new opportunities for researchers in the field of automatic program repair.<\/jats:p>","DOI":"10.1007\/s10664-021-10100-7","type":"journal-article","created":{"date-parts":[[2022,5,5]],"date-time":"2022-05-05T08:17:23Z","timestamp":1651738643000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":6,"title":["A comprehensive study of code-removal patches in automated program repair"],"prefix":"10.1007","volume":"27","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-1489-321X","authenticated-orcid":false,"given":"Davide","family":"Ginelli","sequence":"first","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2945-866X","authenticated-orcid":false,"given":"Matias","family":"Martinez","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9527-7042","authenticated-orcid":false,"given":"Leonardo","family":"Mariani","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3505-3383","authenticated-orcid":false,"given":"Martin","family":"Monperrus","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2022,5,5]]},"reference":[{"doi-asserted-by":"publisher","unstructured":"Alarcon G, Walter C, Gibson A, Gamble R, Capiola A, Jessup S, Ryan T (2020) Would you fix this code for me? effects of repair source and commenting on trust in code repair. In: Systems vol 8, p 8. https:\/\/doi.org\/10.3390\/systems8010008","key":"10100_CR1","DOI":"10.3390\/systems8010008"},{"unstructured":"Britton T, Jeng L, Carver G, Cheak P, Katzenellenbogen T (2013) Reversible debugging software: quantify the time and cost saved using reversible debuggers. Tech. rep., http:\/\/citeseerx.ist.psu.edu\/viewdoc\/download?doi=10.1.1.444.9094&rep=rep1&type=pdf","key":"10100_CR2"},{"doi-asserted-by":"publisher","unstructured":"Brown MD, Pande S (2019) Carve: Practical security-focused software debloating using simple feature set mappings. In: Proceedings of the 3rd ACM workshop on forming an ecosystem around software transformation, FEAST\u201919. London, United Kingdom: Association for Computing Machinery, pp 1\u20137. https:\/\/doi.org\/10.1145\/3338502.3359764","key":"10100_CR3","DOI":"10.1145\/3338502.3359764"},{"doi-asserted-by":"publisher","unstructured":"Cambronero JP, Shen J, Cito J, Glassman E, Rinard M (2019) Characterizing developer use of automatically generated patches. In: Smith J, Bogart C, Good J, Fleming SD (eds) 2019 IEEE symposium on visual languages and human-centric computing, VL\/HCC 2019, Memphis, Tennessee, USA, October 14-18 2019, IEEE Computer Society, pp 181\u2013185, https:\/\/doi.org\/10.1109\/VLHCC.2019.8818884,","key":"10100_CR4","DOI":"10.1109\/VLHCC.2019.8818884"},{"doi-asserted-by":"publisher","unstructured":"Campos J, Riboira A, Perez A, Abreu R (2012) Gzoltar: an eclipse plug-in for testing and debugging. In: 2012 Proceedings of the 27th IEEE\/ACM international conference on automated software engineering, pp 378\u2013381. https:\/\/doi.org\/10.1145\/2351676.2351752","key":"10100_CR5","DOI":"10.1145\/2351676.2351752"},{"doi-asserted-by":"publisher","unstructured":"Colanzi TE, McMinn P (2018) Search-based software engineering - 10th international symposium, SSBSE 2018, Montpellier, France, September 8\u20139, 2018, Proceedings, Lecture Notes in Computer Science, vol 11036. Springer. https:\/\/doi.org\/10.1007\/978-3-319-99241-9","key":"10100_CR6","DOI":"10.1007\/978-3-319-99241-9"},{"unstructured":"Coralogix (2015) This is what your developers are doing 75% of the time, and this is the cost you pay, Tech. rep. https:\/\/coralogix.com\/log-analytics-blog\/this-is-what-your-developers-are-doing-75-of-the-time-and-this-is-the-cost-you-pay\/","key":"10100_CR7"},{"doi-asserted-by":"crossref","unstructured":"Daniel B, Jagannath V, Dig D, Marinov D (2009) ReAssert: Suggesting repairs for broken unit tests. In: Proceedings of the 24th IEEE\/ACM international conference on automated software engineering","key":"10100_CR8","DOI":"10.1109\/ASE.2009.17"},{"doi-asserted-by":"crossref","unstructured":"Delplanque J, Ducasse S, Polito G, Black AP, Etien A (2019) Rotten green tests. In: 2019 IEEE\/ACM 41st International conference on software engineering (ICSE), pp 500\u2013511","key":"10100_CR9","DOI":"10.1109\/ICSE.2019.00062"},{"doi-asserted-by":"publisher","unstructured":"Durieux T, Madeiral F, Martinez M, Abreu R (2019) Empirical review of java program repair tools: A large-scale experiment on 2,141 bugs and 23,551 repair attempts. In: Proceedings of the 2019 27th ACM joint meeting on european software engineering conference and symposium on the foundations of software engineering, ESEC\/FSE 2019. Tallinn, Estonia: Association for Computing Machinery, pp 302\u2013313. https:\/\/doi.org\/10.1145\/3338906.3338911","key":"10100_CR10","DOI":"10.1145\/3338906.3338911"},{"doi-asserted-by":"crossref","unstructured":"Durieux T, Goues CL, Hilton M, Abreu R (2020) Empirical study of restarted and flaky builds on travis ci. arxiv:2003.11772 [cs.SE]","key":"10100_CR11","DOI":"10.1145\/3379597.3387460"},{"doi-asserted-by":"crossref","unstructured":"Dziurzanski P, Gerasimou S, Kolovos D, Matragkas N (2020) Empirical analysis of 1-edit degree patches in syntax-based automatic program repair. In: 2020 IEEE Congress on evolutionary computation (CEC), pp 1\u201310","key":"10100_CR12","DOI":"10.1109\/CEC48606.2020.9185913"},{"doi-asserted-by":"crossref","unstructured":"Fry ZP, Landau B, Weimer W (2012) A human study of patch maintainability. In: In international symposium on software testing and analysis, pp 177\u2013187","key":"10100_CR13","DOI":"10.1145\/2338965.2336775"},{"issue":"1","key":"10100_CR14","doi-asserted-by":"publisher","first-page":"34","DOI":"10.1109\/TSE.2017.2755013","volume":"45","author":"L Gazzola","year":"2019","unstructured":"Gazzola L, Micucci D, Mariani L (2019) Automatic software repair: A survey. IEEE Transactions on Software Engineering 45(1):34\u201367","journal-title":"IEEE Transactions on Software Engineering"},{"doi-asserted-by":"publisher","unstructured":"Jiang J, Xiong Y, Xia X (2019) A manual inspection of defects4j bugs and its implications for automatic program repair. In: Science china information sciences, vol 62. https:\/\/doi.org\/10.1007\/s11432-018-1465-6","key":"10100_CR15","DOI":"10.1007\/s11432-018-1465-6"},{"doi-asserted-by":"publisher","unstructured":"Just R, Jalali D, Ernst MD (2014) Defects4j: A database of existing faults to enable controlled testing studies for java programs. In: Proceedings of the 2014 international symposium on software testing and analysis, ISSTA 2014. San Jose, CA, USA: Association for Computing Machinery, pp 437\u2013440. https:\/\/doi.org\/10.1145\/2610384.2628055,","key":"10100_CR16","DOI":"10.1145\/2610384.2628055"},{"doi-asserted-by":"crossref","unstructured":"Kim D, Nam J, Song J, Kim S (2013) Automatic patch generation learned from human-written patches. In: Proceedings of the 2013 international conference on software engineering, ICSE \u201913. San Francisco, CA, USA: IEEE Press, pp 802\u201381","key":"10100_CR17","DOI":"10.1109\/ICSE.2013.6606626"},{"unstructured":"Krasner H (2018) The cost of poor quality software in the US: A 2018 report. Tech. rep., https:\/\/www.it-cisq.org\/the-cost-of-poor-quality-software-in-the-us-a-2018-report\/The-Cost-of-Poor-Quality-Software-in-the-US-2018-Report.pdf","key":"10100_CR18"},{"unstructured":"Langr J, Hunt A, Thomas D (2015) Pragmatic unit testing in java 8 with JUnit, 1st edn. Pragmatic Bookshelf","key":"10100_CR19"},{"issue":"1","key":"10100_CR20","doi-asserted-by":"publisher","first-page":"54","DOI":"10.1109\/TSE.2011.104","volume":"38","author":"C Le Goues","year":"2012","unstructured":"Le Goues C, Nguyen T, Forrest S, Weimer W (2012) Genprog: A generic method for automatic software repair. IEEE Transactions on Software Engineering 38(1):54\u201372","journal-title":"IEEE Transactions on Software Engineering"},{"issue":"12","key":"10100_CR21","doi-asserted-by":"publisher","first-page":"1236","DOI":"10.1109\/TSE.2015.2454513","volume":"41","author":"C Le Goues","year":"2015","unstructured":"Le Goues C, Holtschulte N, Smith EK, Brun Y, Devanbu P, Forrest S, Weimer W (2015) The manybugs and introclass benchmarks for automated repair of c programs. IEEE Transactions on Software Engineering 41(12):1236\u20131256","journal-title":"IEEE Transactions on Software Engineering"},{"doi-asserted-by":"publisher","unstructured":"Lin D, Koppel J, Chen A, Solar-Lezama A (2017) Quixbugs: A multi-lingual program repair benchmark set based on the quixey challenge. In: Proceedings companion of the 2017 ACM SIGPLAN international conference on systems, pogramming, languages, and applications: software for humanity. SPLASH Companion 2017, Vancouver, BC, Canada: Association for Computing Machinery, pp 55\u201356. https:\/\/doi.org\/10.1145\/3135932.3135941,","key":"10100_CR22","DOI":"10.1145\/3135932.3135941"},{"doi-asserted-by":"publisher","unstructured":"Liu K, Koyuncu A, Bissyand\u00e9 TF, Kim D, Klein J, Le Traon Y (2019) You cannot fix what you cannot find! an investigation of fault localization bias in benchmarking automated program repair systems. In: 2019 12th IEEE conference on software testing, validation and verification (ICST), pp 102\u2013113. https:\/\/doi.org\/10.1109\/ICST.2019.00020","key":"10100_CR23","DOI":"10.1109\/ICST.2019.00020"},{"doi-asserted-by":"publisher","unstructured":"Liu K, Koyuncu A, Kim D, Bissyand\u00e9 TF (2019) Tbar: Revisiting template-based automated program repair. In: Proceedings of the 28th ACM SIGSOFT international symposium on software testing and analysis. ISSTA 2019. Beijing, China: Association for Computing Machinery, pp 31\u201342. https:\/\/doi.org\/10.1145\/3293882.3330577","key":"10100_CR24","DOI":"10.1145\/3293882.3330577"},{"doi-asserted-by":"publisher","unstructured":"Liu K, Wang S, Koyuncu A, Kim K, Wu P, Klein J, Mao X, Le Traon Y, Bissyand\u00e9 T, Kim D (2020) On the efficiency of test suite based program repair: A systematic assessment of 16 automated repair systems for java programs. https:\/\/doi.org\/10.1145\/3377811.3380338","key":"10100_CR25","DOI":"10.1145\/3377811.3380338"},{"issue":"1","key":"10100_CR26","doi-asserted-by":"publisher","first-page":"165","DOI":"10.1109\/TSE.2018.2884955","volume":"47","author":"K Liu","year":"2021","unstructured":"Liu K, Kim D, Bissyand\u00e9 TF, Yoo S, Le Traon Y (2021) Mining fix patterns for findbugs violations. IEEE Transactions on Software Engineering 47(1):165\u2013188. https:\/\/doi.org\/10.1109\/TSE.2018.2884955","journal-title":"IEEE Transactions on Software Engineering"},{"issue":"1","key":"10100_CR27","doi-asserted-by":"publisher","first-page":"298","DOI":"10.1145\/2914770.2837617","volume":"51","author":"F Long","year":"2016","unstructured":"Long F, Rinard M (2016) Automatic patch generation by learning correct code. SIGPLAN Not 51(1):298\u2013312. https:\/\/doi.org\/10.1145\/2914770.2837617","journal-title":"SIGPLAN Not"},{"doi-asserted-by":"publisher","unstructured":"Luo Q, Hariri F, Eloussi L, Marinov D (2014) An empirical analysis of flaky tests. In: Proceedings of the 22nd ACM SIGSOFT international symposium on foundations of software engineering. FSE 2014. Hong Kong, China: Association for Computing Machinery, pp 643\u2013653, https:\/\/doi.org\/10.1145\/2635868.2635920","key":"10100_CR28","DOI":"10.1145\/2635868.2635920"},{"doi-asserted-by":"crossref","unstructured":"Madeiral F, Urli S, Maia M, Monperrus M (2019) Bears: An extensible java bug benchmark for automatic program repair studies. In: Proceedings of the 26th IEEE international conference on software analysis, evolution and reengineering (SANER \u201919), https:\/\/arxiv.org\/abs\/1901.06024","key":"10100_CR29","DOI":"10.1109\/SANER.2019.8667991"},{"issue":"1","key":"10100_CR30","doi-asserted-by":"publisher","first-page":"176","DOI":"10.1007\/s10664-013-9282-8","volume":"20","author":"M Martinez","year":"2015","unstructured":"Martinez M, Monperrus M (2015) Mining software repair models for reasoning on the search space of automated program fixing. Empirical Softw Engg 20(1):176\u2013205. https:\/\/doi.org\/10.1007\/s10664-013-9282-8","journal-title":"Empirical Softw Engg"},{"doi-asserted-by":"publisher","unstructured":"Martinez M, Monperrus M (2016) Astor: A program repair library for java. In: Proceedings of ISSTA, https:\/\/doi.org\/10.1145\/2931037.2948705","key":"10100_CR31","DOI":"10.1145\/2931037.2948705"},{"doi-asserted-by":"publisher","unstructured":"Martinez M, Durieux T, Sommerard R, Xuan J, Monperrus M (2016) Automatic Repair of Real Bugs in Java: A Large-Scale Experiment on the Defects4J Dataset. In: Springer empirical software engineering https:\/\/doi.org\/10.1007\/s10664-016-9470-4, https:\/\/hal.archives-ouvertes.fr\/hal-01387556\/document","key":"10100_CR32","DOI":"10.1007\/s10664-016-9470-4"},{"doi-asserted-by":"publisher","unstructured":"Martinez M, Etien A, Ducasse S, Fuhrman C (2020) Rtj: A java framework for detecting and refactoring rotten green test cases. In: Proceedings of the ACM\/IEEE 42nd international conference on software engineering: companion proceedings. ICSE \u201920. Seoul, South Korea: Association for Computing Machinery, pp 69\u201372. https:\/\/doi.org\/10.1145\/3377812.3382151","key":"10100_CR33","DOI":"10.1145\/3377812.3382151"},{"doi-asserted-by":"crossref","unstructured":"Meyvis T, Yoon H (2021) Adding is favoured over subtracting in problem solving","key":"10100_CR34","DOI":"10.1038\/d41586-021-00592-0"},{"doi-asserted-by":"publisher","unstructured":"Monperrus M (2018)Automatic software repair: a bibliography. In: ACM Comput. Surv. 51.1. https:\/\/doi.org\/10.1145\/3105906","key":"10100_CR35","DOI":"10.1145\/3105906"},{"doi-asserted-by":"publisher","unstructured":"Monperrus M, Urli S, Durieux T, Martinez M, Baudry B, Seinturier L (2019) Repairnator patches programs automatically. In: Ubiquity (July 2019). https:\/\/doi.org\/10.1145\/3349589","key":"10100_CR36","DOI":"10.1145\/3349589"},{"doi-asserted-by":"crossref","unstructured":"Motwani M, Sankaranarayanan S, Just R, Brun Y (2018) [Journal First] do automated program repair techniques repair hard and important bugs? In: 2018 IEEE\/ACM 40th International conference on software engineering (ICSE), pp 25\u201325","key":"10100_CR37","DOI":"10.1145\/3180155.3182533"},{"issue":"5\u20137","key":"10100_CR38","doi-asserted-by":"publisher","first-page":"605","DOI":"10.1002\/stvr.1509","volume":"25","author":"M Papadakis","year":"2015","unstructured":"Papadakis M, Le Traon Y (2015) Metallaxis-fl: mutation-based fault localization. Software Testing, Verification and Reliability 25(5\u20137):605\u2013628","journal-title":"Software Testing, Verification and Reliability"},{"doi-asserted-by":"publisher","unstructured":"Qi Z, Long F, Achour S, Rinard M (2015) An analysis of patch plausibility and correctness for generate-and-validate patch generation systems. In: Proceedings of the 2015 international symposium on software testing and analysis. ISSTA 2015. Baltimore, MD, USA: Association for Computing Machinery, pp 24\u201336. https:\/\/doi.org\/10.1145\/2771783.2771791","key":"10100_CR39","DOI":"10.1145\/2771783.2771791"},{"doi-asserted-by":"publisher","unstructured":"Ramanathan MK, Clapp L, Barik R, Sridharan M (2020) Piranha: Reducing feature flag debt at uber. In: Proceedings of the ACM\/IEEE 42nd international conference on software engineering: software engineering in practice. ICSE-SEIP \u201920. Seoul, South Korea: Association for Computing Machinery, pp 221\u2013230. https:\/\/doi.org\/10.1145\/3377813.3381350,","key":"10100_CR40","DOI":"10.1145\/3377813.3381350"},{"doi-asserted-by":"publisher","unstructured":"Ryan TJ, Alarcon GM, Walter C, Gamble RF, Jessup SA, Capiola AA, Pfahler MD (2019) Trust in automated software repair - the effects of repair source, transparency, and programmer experience on perceived trustworthiness and trust. In: Moallem A (ed) HCI for Cybersecurity, Privacy and Trust - First International Conference, HCI-CPT 2019, Held as Part of the 21st HCI International Conference, HCII 2019, Orlando, FL, USA, July 26-31, 2019, Proceedings, Springer, Lecture Notes in Computer Science, vol 11594, pp 452\u2013470. https:\/\/doi.org\/10.1007\/978-3-030-22351-9_31","key":"10100_CR41","DOI":"10.1007\/978-3-030-22351-9_31"},{"doi-asserted-by":"publisher","unstructured":"Saha RK, Lyu Y, Yoshida H, Prasad MR (2017) Elixir: Effective object-oriented program repair. In: 2017 32nd IEEE\/ACM international conference on automated software engineering (ASE), pp 648\u2013659. https:\/\/doi.org\/10.1109\/ASE.2017.8115675","key":"10100_CR42","DOI":"10.1109\/ASE.2017.8115675"},{"unstructured":"Undo Software (2014) Increasing software development productivity with reversible debugging. white paper, https:\/\/undo.io\/media\/uploads\/files\/Undo_ReversibleDebugging_Whitepaper.pdf","key":"10100_CR43"},{"doi-asserted-by":"publisher","unstructured":"Soto M, Goues CL (2018) Common statement kind changes to inform automatic program repair. In: Proceedings of the 15th international conference on mining software repositories, MSR \u201918. Gothenburg, Sweden: Association for Computing Machinery, pp 102\u2013105. https:\/\/doi.org\/10.1145\/3196398.3196472,","key":"10100_CR44","DOI":"10.1145\/3196398.3196472"},{"doi-asserted-by":"crossref","unstructured":"Soto-Valero C, Durieux T, Baudry B (2021a) A longitudinal analysis of bloated java dependencies. arxiv:2105.14226","key":"10100_CR45","DOI":"10.1145\/3468264.3468589"},{"issue":"3","key":"10100_CR46","doi-asserted-by":"publisher","first-page":"45","DOI":"10.1007\/s10664-020-09914-8","volume":"26","author":"C Soto-Valero","year":"2021","unstructured":"Soto-Valero C, Harrand N, Monperrus M, Baudry B (2021) A comprehensive study of bloated dependencies in the maven ecosystem. Empir Softw Eng 26(3):45. https:\/\/doi.org\/10.1007\/s10664-020-09914-8","journal-title":"Empir Softw Eng"},{"doi-asserted-by":"crossref","unstructured":"Tan SH, Roychoudhury A (2015) Relifix: Automated repair of software regressions. In: 37th International conference on software engineering, IEEE","key":"10100_CR47","DOI":"10.1109\/ICSE.2015.65"},{"doi-asserted-by":"publisher","unstructured":"Tan SH, Yoshida H, Prasad MR, Roychoudhury A (2016) Anti-patterns in search-based program repair. In: Proceedings of the 2016 24th ACM SIGSOFT international symposium on foundations of software engineering. FSE 2016. Seattle, WA, USA: Association for Computing Machinery, pp 727\u2013738. https:\/\/doi.org\/10.1145\/2950290.2950295,","key":"10100_CR48","DOI":"10.1145\/2950290.2950295"},{"doi-asserted-by":"crossref","unstructured":"Urli S, Yu Z, Seinturier L, Monperrus M (2018) How to design a program repair bot? insights from the repairnator project. In: Proceedings of the 40th international conference on software engineering","key":"10100_CR49","DOI":"10.1145\/3183519.3183540"},{"doi-asserted-by":"publisher","unstructured":"Wang S, Wen M, Chen L, Yi X, Mao X (2019) How different is it between machine-generated and developer-provided patches?: An empirical study on the correct patches generated by automated program repair techniques. In: 2019 ACM\/IEEE International symposium on empirical software engineering and measurement (ESEM). https:\/\/doi.org\/10.1109\/esem.2019.8870172","key":"10100_CR50","DOI":"10.1109\/esem.2019.8870172"},{"doi-asserted-by":"crossref","unstructured":"Weimer W, Fry ZP, Forrest S (2013) Leveraging program equivalence for adaptive program repair: Models and first results. In: Proceedings of the 28th IEEE\/ACM international conference on automated software engineering (ASE), IEEE Press","key":"10100_CR51","DOI":"10.1109\/ASE.2013.6693094"},{"issue":"1","key":"10100_CR52","doi-asserted-by":"publisher","first-page":"34","DOI":"10.1109\/TSE.2016.2560811","volume":"43","author":"J Xuan","year":"2017","unstructured":"Xuan J, Martinez M, DeMarco F, Clement M, Marcote SL, Durieux T, Le Berre D, Monperrus M (2017) Nopol: Automatic repair of conditional statement bugs in java programs. IEEE Trans Softw Eng 43(1):34\u201355. https:\/\/doi.org\/10.1109\/TSE.2016.2560811","journal-title":"IEEE Trans Softw Eng"},{"doi-asserted-by":"publisher","unstructured":"Yang J, Zhikhartsev A, Liu Y, Tan L (2017) Better test cases for better automated program repair. In: Proceedings of the 2017 11th joint meeting on foundations of software engineering. ESEC\/ FSE 2017. Paderborn, Germany: Association for Computing Machinery, pp 831\u2013841. https:\/\/doi.org\/10.1145\/3106237.3106274","key":"10100_CR53","DOI":"10.1145\/3106237.3106274"},{"key":"10100_CR54","doi-asserted-by":"publisher","first-page":"110825","DOI":"10.1016\/j.jss.2020.110825","volume":"171","author":"H Ye","year":"2021","unstructured":"Ye H, Martinez M, Durieux T, Monperrus M (2021) A comprehensive study of automatic program repair on the quixbugs benchmark. Journal of Systems and Software 171:110825. https:\/\/doi.org\/10.1016\/j.jss.2020.110825","journal-title":"Journal of Systems and Software"},{"issue":"2","key":"10100_CR55","doi-asserted-by":"publisher","first-page":"20","DOI":"10.1007\/s10664-020-09920-w","volume":"26","author":"H Ye","year":"2021","unstructured":"Ye H, Martinez M, Monperrus M (2021) Automated patch assessment for program repair at scale. Empir Softw Eng 26(2):20. https:\/\/doi.org\/10.1007\/s10664-020-09920-w","journal-title":"Empir Softw Eng"},{"doi-asserted-by":"publisher","unstructured":"Yi J, Tan SH, Mechtaev S, B\u00f6hme M, Roychoudhury A (2018) A correlation study between automated program repair and test-suite metrics. In: Proceedings of the 40th international conference on software engineering. ICSE \u201918. Gothenburg, Sweden: Association for Computing Machinery, p 24. https:\/\/doi.org\/10.1145\/3180155.3182517","key":"10100_CR56","DOI":"10.1145\/3180155.3182517"},{"unstructured":"Yu Z, Martinez M, Danglot B, Durieux T, Monperrus M (2017) Test case generation for program repair: A study of feasibility and effectiveness. arXiv:1703.00198","key":"10100_CR57"},{"issue":"10","key":"10100_CR58","doi-asserted-by":"publisher","first-page":"1040","DOI":"10.1109\/TSE.2018.2874648","volume":"46","author":"Y Yuan","year":"2020","unstructured":"Yuan Y, Banzhaf W (2020) Arja: Automated repair of java programs via multi-objective genetic programming. IEEE Transactions on Software Engineering 46(10):1040\u20131067. https:\/\/doi.org\/10.1109\/TSE.2018.2874648","journal-title":"IEEE Transactions on Software Engineering"},{"key":"10100_CR59","doi-asserted-by":"publisher","first-page":"16","DOI":"10.1016\/j.jss.2018.03.046","volume":"141","author":"H Zhong","year":"2018","unstructured":"Zhong H, Mei H (2018) Mining repair model for exception-related bug. Journal of Systems and Software 141:16\u201331","journal-title":"Journal of Systems and Software"}],"container-title":["Empirical Software Engineering"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10664-021-10100-7.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10664-021-10100-7\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10664-021-10100-7.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,8,25]],"date-time":"2022-08-25T08:14:50Z","timestamp":1661415290000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10664-021-10100-7"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,5,5]]},"references-count":59,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2022,7]]}},"alternative-id":["10100"],"URL":"https:\/\/doi.org\/10.1007\/s10664-021-10100-7","relation":{},"ISSN":["1382-3256","1573-7616"],"issn-type":[{"type":"print","value":"1382-3256"},{"type":"electronic","value":"1573-7616"}],"subject":[],"published":{"date-parts":[[2022,5,5]]},"assertion":[{"value":"22 November 2021","order":1,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"5 May 2022","order":2,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"24 August 2022","order":3,"name":"change_date","label":"Change Date","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"Update","order":4,"name":"change_type","label":"Change Type","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"Missing Open Access funding information has been added in the Funding Note.","order":5,"name":"change_details","label":"Change Details","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"The computations were enabled by resources provided by the Swedish National Infrastructure for Computing (SNIC).","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors have no conflicts of interests to declare.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflicts of interest"}}],"article-number":"97"}}