{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,13]],"date-time":"2026-06-13T18:15:31Z","timestamp":1781374531254,"version":"3.54.1"},"reference-count":64,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2024,7,17]],"date-time":"2024-07-17T00:00:00Z","timestamp":1721174400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["SIGSOFT Softw. Eng. Notes"],"published-print":{"date-parts":[[2024,7,17]]},"abstract":"<jats:p>The GI @ ICSE 2024 workshop, held 16 April, in addition to presentations, contained a keynote on how to use Genetic Improvement to control deep AI large language models in software engineering and a tutorial on a language independent tool for GI research. We summarise these, the papers, people, prizes, acknowledgements, discussions and hopes for the future.<\/jats:p>","DOI":"10.1145\/3672089.3672102","type":"journal-article","created":{"date-parts":[[2024,7,18]],"date-time":"2024-07-18T20:23:37Z","timestamp":1721334217000},"page":"42-50","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":2,"title":["The 13th International Workshop on Genetic Improvement(GI @ ICSE 2024)"],"prefix":"10.1145","volume":"49","author":[{"given":"William B.","family":"Langdon","sequence":"first","affiliation":[{"name":"UCL, London, United Kingdom"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Gabin","family":"An","sequence":"additional","affiliation":[{"name":"KAIST, Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Aymeric","family":"Blot","sequence":"additional","affiliation":[{"name":"Universite de Rennes, France"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Vesna","family":"Nowack","sequence":"additional","affiliation":[{"name":"Imperial College, London, United Kingdom"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Justyna","family":"Petke","sequence":"additional","affiliation":[{"name":"UCL, London, United Kingdom"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Shin","family":"Yoo","sequence":"additional","affiliation":[{"name":"KAIST, Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Oliver","family":"Krauss","sequence":"additional","affiliation":[{"name":"FH Upper Austria, Austria"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Erik M.","family":"Fredericks","sequence":"additional","affiliation":[{"name":"GVSU, MI, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Daniel","family":"Blackwell","sequence":"additional","affiliation":[{"name":"UCL, London, United Kingdom"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2024,7,18]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"crossref","unstructured":"John Ahlgren Maria Eugenia Berezin Kinga Bojarczuk Elena Dulskyte Inna Dvortsova Johann George Natalija Gucevska Mark Harman Ralf Laemmel Erik Meijer Silvia Sapora and Justin Spahr-Summers. WES: Agent-based user interaction simulation on real infrastructure. In Shin Yoo Justyna Petke Westley Weimer and Bobby R. Bruce editors GI @ ICSE 2020 pages 276{284 internet 3 July 2020. ACM. Invited Keynote.","DOI":"10.1145\/3387940.3392089"},{"key":"e_1_2_1_2_1","first-page":"1","volume-title":"ICSE workshops proceedings","author":"Alshahwan Nadia","year":"2019","unstructured":"Nadia Alshahwan. Industrial experience of genetic improvement in Facebook. In Justyna Petke, Shin Hwei Tan, William B. Langdon, and Westley Weimer, editors, GI-2019, ICSE workshops proceedings, page 1, Montreal, 28 May 2019. IEEE. Invited Keynote."},{"key":"e_1_2_1_3_1","volume-title":"Assured LLM-based software engineering","author":"Alshahwan Nadia","year":"2024","unstructured":"Nadia Alshahwan, Mark Harman, Inna Harper, Alexandru Marginean, Shubho Sengupta, and Eddy Wang. Assured LLM-based software engineering, 15 April 2024. InteNSE 2024 Keynote."},{"key":"e_1_2_1_4_1","first-page":"10","volume-title":"16th IEEE International Conference on Software Testing, Verication and Validation (ICST 2023","author":"Alshahwan Nadia","year":"2023","unstructured":"Nadia Alshahwan, Mark Harman, and Alexandru Marginean. Software testing research challenges: An industrial perspective. In Sreedevi Sampath, editor, 16th IEEE International Conference on Software Testing, Verication and Validation (ICST 2023), pages 1{10, Dublin, Ireland, 16--20 April 2023. Keynote."},{"key":"e_1_2_1_5_1","volume-title":"13th International Workshop on Genetic Improvement @ICSE 2024","author":"An Gabin","year":"2023","unstructured":"Gabin An, Aymeric Blot, Vesna Nowack, Oliver Krauss, and Justyna Petke, editors. 13th International Workshop on Genetic Improvement @ICSE 2024, Lisbon, 16 April 2023."},{"key":"e_1_2_1_6_1","first-page":"1104","volume-title":"Proceedings of the 27th Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering ESEC\/FSE 2019","author":"An Gabin","year":"2019","unstructured":"Gabin An, Aymeric Blot, Justyna Petke, and Shin Yoo. PyGGI 2.0: Language independent genetic improvement framework. In Sven Apel and Alessandra Russo, editors, Proceedings of the 27th Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering ESEC\/FSE 2019), pages 1100{1104, Tallinn, Estonia, August 26{30 2019. ACM."},{"key":"e_1_2_1_7_1","series-title":"Lecture Notes in Computer Science","doi-asserted-by":"crossref","first-page":"70","DOI":"10.1007\/978-3-540-69369-7","volume-title":"John Clark, and Xin Yao. Multi-objective improvement of software using co-evolution and smart seeding. In Xiaodong Li, Michael Kirley, Mengjie Zhang, David G","author":"Arcuri Andrea","year":"2008","unstructured":"Andrea Arcuri, David Robert White, John Clark, and Xin Yao. Multi-objective improvement of software using co-evolution and smart seeding. In Xiaodong Li, Michael Kirley, Mengjie Zhang, David G. Green, Victor Ciesielski, Hussein A. Abbass, Zbigniew Michalewicz, Tim Hendtlass, Kalyanmoy Deb, Kay Chen Tan, Jurgen Branke, and Yuhui Shi, editors, Proceedings of the 7th International Conference on Simulated Evolution And Learning (SEAL '08), volume 5361 of Lecture Notes in Computer Science, pages 61{70, Melbourne, Australia, December 7--10 2008. Springer."},{"key":"e_1_2_1_8_1","first-page":"269","volume-title":"International Symposium on Software Testing and Analysis, ISSTA 2015","author":"Barr Earl T.","year":"2015","unstructured":"Earl T. Barr, Mark Harman, Yue Jia, Alexandru Marginean, and Justyna Petke. Automated software transplantation. In Tao Xie and Michal Young, editors, International Symposium on Software Testing and Analysis, ISSTA 2015, pages 257{269, Baltimore, Maryland, USA, 14--17 July 2015. ACM. ACM SIGSOFT Distinguished Paper Award."},{"key":"e_1_2_1_9_1","first-page":"128","volume-title":"Proceedings of the 2018 26th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering, ESEC\/FSE 2018","author":"Basios Michail","year":"2018","unstructured":"Michail Basios, Lingbo Li, Fan Wu, Leslie Kanthan, and Earl T. Barr. Darwinian data structure selection. In Gary T. Leavens, Alessandro Garcia, and Corina S. Pasareanu, editors, Proceedings of the 2018 26th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering, ESEC\/FSE 2018, pages 118{128, Lake Buena Vista, FL, USA, 4--9 Nov 2018. ACM."},{"key":"e_1_2_1_10_1","volume-title":"13th International Workshop on Genetic Improvement @ICSE 2024","author":"Baxter Hunter","year":"2024","unstructured":"Hunter Baxter, Yu Huang, and Kevin Leach. Genetic improvement for DNN security. In Gabin An, Aymeric Blot, Vesna Nowack, Oliver Krauss, and Justyna Petke, editors, 13th International Workshop on Genetic Improvement @ICSE 2024, Lisbon, 16 April 2024. ACM. Best Presentation."},{"key":"e_1_2_1_11_1","volume-title":"USA","author":"Bentley Peter","year":"2002","unstructured":"Peter Bentley and David Corne, editors. Creative evolutionary systems. Morgan Kaufmann, USA, 2002."},{"key":"e_1_2_1_12_1","volume-title":"Prescientfuzz: A more e ective exploration approach for grey-box fuzzing. arXiv 2404.18887","author":"Blackwell Daniel","year":"2024","unstructured":"Daniel Blackwell and David Clark. Prescientfuzz: A more e ective exploration approach for grey-box fuzzing. arXiv 2404.18887, 29 April 2024."},{"key":"e_1_2_1_13_1","first-page":"16","volume-title":"13th International Workshop on Genetic Improvement @ICSE 2024","author":"Blot Aymeric","year":"2024","unstructured":"Aymeric Blot. Automated software performance improvement with Magpie. In Gabin An, Aymeric Blot, Vesna Nowack, Oliver Krauss, and Justyna Petke, editors, 13th International Workshop on Genetic Improvement @ICSE 2024, page v, Lisbon, 16 April 2024. ACM. Invited tutorial."},{"key":"e_1_2_1_14_1","volume-title":"MAGPIE: Machine automated general performance improvement via evolution of software. arXiv","author":"Blot Aymeric","year":"2022","unstructured":"Aymeric Blot and Justyna Petke. MAGPIE: Machine automated general performance improvement via evolution of software. arXiv, 4 August 2022."},{"key":"e_1_2_1_15_1","volume-title":"ICSE 2021: Personal re ection of a workshop participant. SIGSOFT Software Engineering Notes, 46(4):28{30","author":"Brownlee Alexander E. I.","year":"2021","unstructured":"Alexander E. I. Brownlee. Genetic Improvement @ ICSE 2021: Personal re ection of a workshop participant. SIGSOFT Software Engineering Notes, 46(4):28{30, October 2021."},{"key":"e_1_2_1_17_1","volume-title":"13th International Workshop on Genetic Improvement @ICSE 2024","author":"Callan James","year":"2024","unstructured":"James Callan, William B. Langdon, and Justyna Petke. On reducing network usage with genetic improvement. In Gabin An, Aymeric Blot, Vesna Nowack, Oliver Krauss, and Justyna Petke, editors, 13th International Workshop on Genetic Improvement @ICSE 2024, Lisbon, 16 April 2024. ACM."},{"key":"e_1_2_1_18_1","volume-title":"13th International Workshop on Genetic Improvement @ICSE 2024","author":"Craine Benjamin J.","year":"2024","unstructured":"Benjamin J. Craine, Penn Faulkner Rainford, and Barry Porter. Human guidance approaches for the genetic improvement of software. In Gabin An, Aymeric Blot, Vesna Nowack, Oliver Krauss, and Justyna Petke, editors, 13th International Workshop on Genetic Improvement @ICSE 2024, Lisbon, 16 April 2024. ACM."},{"key":"e_1_2_1_19_1","doi-asserted-by":"crossref","unstructured":"Aidan Dakhama Karine Even-Mendoza W. B. Langdon Hector Menendez Benito and Justyna Petke. SearchGEM5: Towards reliable gem5 with search based software testing and large language models. In Paolo Arcaini Tao Yue and Erik Fredericks editors SSBSE 2023: Challenge Track volume 14415 of LNCS pages 60{166 San Francisco USA 8 December 2023. Springer. Winner best Challenge Track paper.","DOI":"10.1007\/978-3-031-48796-5_14"},{"key":"e_1_2_1_20_1","first-page":"20","volume-title":"Proceedings of the 1st International Workshop on Soft Computing Applied to Software Engineering","author":"Feldt Robert","year":"1999","unstructured":"Robert Feldt. Genetic programming as an explorative tool in early software development phases. In Conor Ryan and Jim Buckley, editors, Proceedings of the 1st International Workshop on Soft Computing Applied to Software Engineering, pages 11{20, University of Limerick, Ireland, 12--14 April 1999. Limerick University Press."},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1109\/ASE56229.2023.00148"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/2338965.2336775"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.7551\/mitpress\/3119.003.0079"},{"key":"e_1_2_1_24_1","first-page":"1147","volume-title":"2021 IEEE\/ACM 43rd International Conference on Software Engineering (ICSE)","author":"Zheng Guolong","year":"2021","unstructured":"Sim--on Guti--errez Brida, Germ--an Regis, Guolong Zheng, Hamid Bagheri, ThanhVu Nguyen, Nazareno Aguirre, and Marcelo Frias. Bounded exhaustive search of Alloy specification repairs. In 2021 IEEE\/ACM 43rd International Conference on Software Engineering (ICSE), pages 1135{1147, 2021."},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/3524459.3527353"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/3660771"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE48619.2023.00194"},{"issue":"4","key":"e_1_2_1_28_1","first-page":"51","article-title":"On the introduction of automatic program repair","volume":"38","author":"Kirbas Serkan","year":"2021","unstructured":"Serkan Kirbas, Etienne Windels, Olayori McBello, Kevin Kells, Matthew Pagano, Rafal Szalanski, Vesna Nowack, Emily Winter, Steve Counsell, David Bowes, Tracy Hall, Saemundur Haraldsson, and John Woodward. On the introduction of automatic program repair in Bloomberg. IEEE Software, 38(4):43{51, July-August 2021.","journal-title":"Bloomberg. IEEE Software"},{"key":"e_1_2_1_29_1","volume-title":"Genetic Programming: On the Programming of Computers by Means of Natural Selection","author":"Koza John R.","year":"1992","unstructured":"John R. Koza. Genetic Programming: On the Programming of Computers by Means of Natural Selection. MIT Press, Cambridge, MA, USA, 1992."},{"key":"e_1_2_1_30_1","first-page":"158","volume-title":"44th ACM SIGPLAN Conference on Programming Language Design and Implementation, PLDI 2023","author":"Kuepper Joel","year":"2023","unstructured":"Joel Kuepper, Andres Erbsen, Jason Gross, Owen Conoly, Chuyue Sun, Samuel Tian, David Wu, Adam Chlipala, Chitchanok Chuengsatiansup, Daniel Genkin, Markus Wagner, and Yuval Yarom. CryptOpt: Verified compilation with randomized program search for cryptographic primitives. In Nate Foster, editor, 44th ACM SIGPLAN Conference on Programming Language Design and Implementation, PLDI 2023, page article no. 158, Orlando, Florida, 17--21 June 2023. Association for Computing Machinery. Gold winner 2023 HUMIES, PLDI Distinguished Paper."},{"key":"e_1_2_1_31_1","volume-title":"18th International Conference on Soft Computing, MENDEL 2012, Brno, Czech Republic, 27--29","author":"Langdon W. B.","year":"2012","unstructured":"W. B. Langdon. Genetic improvement of programs. In Radomil Matousek, editor, 18th International Conference on Soft Computing, MENDEL 2012, Brno, Czech Republic, 27--29 June 2012. Brno University of Technology. Invited keynote."},{"key":"e_1_2_1_32_1","volume-title":"Grand Challenges for Computing","author":"Langdon W. B.","year":"2002","unstructured":"W. B. Langdon and Riccardo Poli. Removal of the man-machine interface bottleneck \\Do what I ment not what I said\". In Grand Challenges for Computing, Edinburgh, 24--26 November 2002. Discussion paper."},{"key":"e_1_2_1_33_1","volume-title":"13th International Workshop on Genetic Improvement @ICSE 2024","author":"William","year":"2024","unstructured":"William B. Langdon and David Clark. Deep mutations have little impact. In Gabin An, Aymeric Blot, Vesna Nowack, Oliver Krauss, and Justyna Petke, editors, 13th International Workshop on Genetic Improvement @ICSE 2024, Lisbon, 16 April 2024. ACM. Best paper."},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1109\/TEVC.2013.2281544"},{"key":"e_1_2_1_35_1","unstructured":"William B. Langdon Vesna Nowack Justyna Petke Erik M. Fredericks Gabin An Aymeric Blot Markus"},{"key":"e_1_2_1_36_1","first-page":"3075","volume-title":"Key Challenges and Future Directions of Evolutionary Computation","author":"William","year":"2016","unstructured":"William B. Langdon and Gabriela Ochoa. Genetic improvement: A key challenge for evolutionary computation. In Yun Li, editor, Key Challenges and Future Directions of Evolutionary Computation, pages 3068{3075, Vancouver, 25--29 July 2016. IEEE."},{"key":"e_1_2_1_37_1","doi-asserted-by":"crossref","unstructured":"William B. Langdon Justyna Petke and Ronny Lorenz. Evolving better RNAfold structure prediction. In Mauro Castelli Lukas Sekanina and Mengjie Zhang editors EuroGP 2018: Proceedings of the 21st European Conference on Genetic Programming volume 10781 of LNCS pages 220{236 Parma Italy 4--6 April 2018. Springer Verlag.","DOI":"10.1007\/978-3-319-77553-1_14"},{"key":"e_1_2_1_38_1","volume-title":"ICSE 2020","author":"Langdon William B.","year":"2020","unstructured":"William B. Langdon, Westley Weimer, Justyna Petke, Erik Fredericks, Seongmin Lee, Emily Winter, Michail Basios, Myra B. Cohen, Aymeric Blot, Markus Wagner, Bobby R. Bruce, Shin Yoo, Simos Gerasimou, Oliver Krauss, Yu Huang, and Michael Gerten. Genetic Improvement @ ICSE 2020. SIGSOFT Software Engineering Notes, 45(4):24{30, October 2020."},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/3356773.3356801"},{"key":"e_1_2_1_40_1","first-page":"6","volume-title":"Search-Based Software Testing","author":"Langdon William B.","year":"2017","unstructured":"William B. Langdon, Shin Yoo, and Mark Harman. Inferring automatic test oracles. In Juan P. Galeotti and Justyna Petke, editors, Search-Based Software Testing, pages 5{6, Buenos Aires, Argentina, 22--23 May 2017."},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10270-021-00868-z"},{"key":"e_1_2_1_42_1","first-page":"278","volume-title":"41st International Conference on Software Engineering","author":"Marginean Alexandru","year":"2019","unstructured":"Alexandru Marginean, Johannes Bader, Satish Chandra, Mark Harman, Yue Jia, Ke Mao, Alexander Mols, and Andrew Scott. SapFix: Automated end-to-end repair at scale. In Joanne M. Atlee and Tevfik Bultan, editors, 41st International Conference on Software Engineering, pages 269{278, Montreal, 25--31 May 2019. ACM."},{"key":"e_1_2_1_43_1","doi-asserted-by":"crossref","unstructured":"Alexandru Marginean Earl T. Barr Mark Harman and Yue Jia. Automated transplantation of call graph and layout features into Kate. In Yvan Labiche and Marcio Barros editors SSBSE volume 9275 of LNCS pages 262{268 Bergamo Italy September 5--7 2015. Springer.","DOI":"10.1007\/978-3-319-22183-0_21"},{"key":"e_1_2_1_44_1","volume-title":"13th International Workshop on Genetic Improvement @ICSE 2024","author":"Nemeth Zsolt","year":"2024","unstructured":"Zsolt Nemeth, Penn Faulkner Rainford, and Barry Porter. Ecosystem curation in genetic improvement for emergent software systems. In Gabin An, Aymeric Blot, Vesna Nowack, Oliver Krauss, and Justyna Petke, editors, 13th International Workshop on Genetic Improvement @ICSE 2024, Lisbon, 16 April 2024. ACM. Best position paper."},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.5555\/862025"},{"key":"e_1_2_1_46_1","first-page":"1478","volume-title":"Software robustness: A survey, a theory, and some prospects","author":"Petke Justyna","year":"2021","unstructured":"Justyna Petke, David Clark, and William B. Langdon. Software robustness: A survey, a theory, and some prospects. In Paris Avgeriou and Dongmei Zhang, editors, ESEC\/FSE 2021, Ideas, Visions and Re ections, pages 1475{1478, Athens, Greece, 23--28 August 2021. ACM."},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2017.2702606"},{"key":"e_1_2_1_48_1","doi-asserted-by":"crossref","unstructured":"Giovanni Pinna Damiano Ravalico Luigi Rovito Luca Manzoni and Andrea De Lorenzo. Enhancing large language models-based code generation by leveraging genetic improvement. In Mario Giacobini Bing Xue and Luca Manzoni editors EuroGP 2024: Proceedings of the 27th European Conference on Genetic Programming volume 14631 of LNCS pages 108{124 Aberystwyth 3--5 April 2024. Springer.","DOI":"10.1007\/978-3-031-56957-9_7"},{"key":"e_1_2_1_49_1","volume-title":"A field guide to genetic programming. Published via http:\/\/lulu.com and freely","author":"Poli Riccardo","year":"2008","unstructured":"Riccardo Poli, William B. Langdon, and Nicholas Freitag McPhee. A field guide to genetic programming. Published via http:\/\/lulu.com and freely available at http:\/\/www.gp-field-guide.org.uk, 2008. (With contributions by J. R. Koza)."},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2013.12.044"},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-72877-1"},{"key":"e_1_2_1_52_1","volume-title":"Gabin An","author":"Sarmiento Ricardo","year":"2024","unstructured":"Ricardo Sarmiento, Marina de la Cruz, Alfonso Ortega, Roberto Baena-Galle, Terrence Girard, Dana Casetti-Dinescu, and Alejandro Cervantes. Grammar evolution and symbolic regression for astrometric centering of Hubble space telescope images. In Gabin An, Aymeric Blot, Vesna Nowack, Oliver Krauss, and Justyna Petke, editors, 13th International Workshop on Genetic Improvement @ICSE 2024, Lisbon, 16 April 2024. ACM."},{"issue":"3","key":"e_1_2_1_53_1","first-page":"424","article-title":"Behavioral and Bra","volume":"3","author":"Searle John R.","year":"1980","unstructured":"John R. Searle. Minds, brains, and programs. Behavioral and Brain Sciences, 3(3):417{{424, 1980.","journal-title":"Sciences"},{"key":"e_1_2_1_54_1","series-title":"LNCS","first-page":"152","volume-title":"Justyna Petke, and Federica Sarro. Evaluating explanations for software patches generated by large language models","author":"Sobania Dominik","year":"2023","unstructured":"Dominik Sobania, Alina Geiger, James Callan, Alexander E. I. Brownlee, Carol Hanna, Rebecca Moussa, Mar Zamorano Lopez, Justyna Petke, and Federica Sarro. Evaluating explanations for software patches generated by large language models. In Paolo Arcaini, Tao Yue, and Erik Fredericks, editors, SSBSE 2023: Challenge Track, volume 14415 of LNCS, pages 147{152, San Francisco, USA, 8 Dec 2023. Springer."},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1109\/5.949485"},{"key":"e_1_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.1145\/3583133.3596395"},{"key":"e_1_2_1_57_1","volume-title":"The Eleventh International Conference on Learning Representations, ICLR 2023","author":"Wang Xuezhi","year":"2023","unstructured":"Xuezhi Wang, Jason Wei, Dale Schuurmans, Quoc V. Le, Ed H. Chi, Sharan Narang, Aakanksha Chowdhery, and Denny Zhou. Self-consistency improves chain of thought reasoning in language models. In The Eleventh International Conference on Learning Representations, ICLR 2023, Kigali, Rwanda, May 1--5, 2023. OpenReview.net, 2023."},{"key":"e_1_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE.2009.5070536"},{"key":"e_1_2_1_59_1","volume-title":"ICSE 2019 Plenary Most In ential Paper","author":"Weimer Westley","year":"2019","unstructured":"Westley Weimer, ThanhVu Nguyen, Claire Le Goues, and Stephanie Forrest. It does what you say, not what you mean: Lessons from a decade of program repair. ICSE 2019 Plenary Most In ential Paper, 30 May 2019."},{"key":"e_1_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.1109\/TEVC.2010.2083669"},{"key":"e_1_2_1_61_1","doi-asserted-by":"publisher","DOI":"10.1145\/3639477.3639756"},{"key":"e_1_2_1_62_1","doi-asserted-by":"publisher","DOI":"10.1145\/3540250.3558953"},{"key":"e_1_2_1_63_1","first-page":"16","volume-title":"13th International Workshop on Genetic Improvement @ICSE 2024","author":"Yoo Shin","year":"2024","unstructured":"Shin Yoo. Executing one's way out of the chinese room. In Gabin An, Aymeric Blot, Vesna Nowack, Oliver Krauss, and Justyna Petke, editors, 13th International Workshop on Genetic Improvement @ICSE 2024, page iv, Lisbon, 16 April 2024. ACM. Invited Keynote."},{"key":"e_1_2_1_64_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.artint.2023.103962"},{"key":"e_1_2_1_65_1","doi-asserted-by":"publisher","DOI":"10.1145\/3533767.3534369"}],"container-title":["ACM SIGSOFT Software Engineering Notes"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3672089.3672102","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3672089.3672102","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T00:04:29Z","timestamp":1750291469000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3672089.3672102"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,7,17]]},"references-count":64,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2024,7,17]]}},"alternative-id":["10.1145\/3672089.3672102"],"URL":"https:\/\/doi.org\/10.1145\/3672089.3672102","relation":{},"ISSN":["0163-5948"],"issn-type":[{"value":"0163-5948","type":"print"}],"subject":[],"published":{"date-parts":[[2024,7,17]]},"assertion":[{"value":"2024-07-18","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}