{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T04:09:51Z","timestamp":1750219791005,"version":"3.41.0"},"reference-count":42,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2023,10,13]],"date-time":"2023-10-13T00:00:00Z","timestamp":1697155200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["SIGSOFT Softw. Eng. Notes"],"published-print":{"date-parts":[[2023,10,13]]},"abstract":"<jats:p>Following the formal presentations, which included keynotes by Prof. Myra B. Cohen of Iowa State University and Dr. Sebastian Baltes of SAP as well as six papers (which are recorded in the pro- ceedings) there was a wide ranging discussion at the twelfth inter- national Genetic Improvement workshop, GI-2023 @ ICSE held on Saturday 20th May 2023 in Melbourne and online via Zoom. Topics included GI to improve testing, and remove unpleasant surprises in cloud computing costs, incorporating novelty search, large language models (LLM ANN) and GI benchmarks.<\/jats:p>","DOI":"10.1145\/3617946.3617956","type":"journal-article","created":{"date-parts":[[2023,10,17]],"date-time":"2023-10-17T18:15:30Z","timestamp":1697566530000},"page":"51-59","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["Genetic Improvement @ ICSE 2023"],"prefix":"10.1145","volume":"48","author":[{"given":"William B.","family":"Langdon","sequence":"first","affiliation":[{"name":"UCLA, London, United Kingdom"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Vesna","family":"Nowack","sequence":"additional","affiliation":[{"name":"Imperial College, London, United Kingdom"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Justyna","family":"Petke","sequence":"additional","affiliation":[{"name":"UCL, London, United Kingdom"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Markus","family":"Wagner","sequence":"additional","affiliation":[{"name":"Monash University, Melbourne, Australia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hyeonseok","family":"Lee","sequence":"additional","affiliation":[{"name":"KAIST, South Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Erik M.","family":"Fredericks","sequence":"additional","affiliation":[{"name":"Grand Valley State University, MI, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Gabin","family":"An","sequence":"additional","affiliation":[{"name":"KAIST, South Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Aymeric","family":"Blot","sequence":"additional","affiliation":[{"name":"Universite du Littoral Cote d'Opale, Calais, France"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2023,10,17]]},"reference":[{"key":"e_1_2_1_1_1","volume-title":"12th International Workshop on Genetic Improvement @ICSE","author":"Cohen Myra B.","year":"2023","unstructured":"Myra B. Cohen. It's all in the semantics: When are genetically improved programs still correct? In Vesna Nowack, Markus Wagner, Gabin An, Aymeric Blot, and Justyna Petke, editors, 12th International Workshop on Genetic Improvement @ICSE 2023, page ix, Melbourne, Australia, 20 May 2023. IEEE. Invited Keynote. URL: http: \/\/gpbib.cs.ucl.ac.uk\/gp-html\/Cohen_2023_GI.html."},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0950--5849(01)00189--6"},{"key":"e_1_2_1_3_1","volume-title":"Genetic Programming: On the Programming of Computers by Means of Natural Selection","author":"Koza John R.","year":"1992","unstructured":"John R. Koza. Genetic Programming: On the Programming of Computers by Means of Natural Selection. MIT Press, Cambridge, MA, USA, 1992. URL: http:\/\/gpbib.cs.ucl.ac.uk\/gp-html\/koza_book.html."},{"key":"e_1_2_1_4_1","volume-title":"A eld guide to genetic programming. Published via http:\/\/lulu.com and freely","author":"Poli Riccardo","year":"2008","unstructured":"Riccardo Poli, William B. Langdon, and Nicholas Freitag McPhee. A eld guide to genetic programming. Published via http:\/\/lulu.com and freely available at http:\/\/www.gp-field-guide.org.uk, 2008. (With contributions by J. R. Koza). URL: http:\/\/gpbib.cs.ucl. ac.uk\/gp-html\/poli08_fieldguide.html."},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/3318162"},{"key":"e_1_2_1_6_1","doi-asserted-by":"crossref","unstructured":"Alexandru Marginean Earl T. Barr Mark Harman and Yue Jia. Automated transplantation of call graph and layout features into Kate. In Yvan Labiche and Marcio Barros editors SSBSE volume 9275 of LNCS pages 262{268 Bergamo Italy September 5--7 2015. Springer. URL: http:\/\/gpbib.cs.ucl.ac.uk\/gp-html\/Marginean_ 2015_SSBSE.html.","DOI":"10.1007\/978-3-319-22183-0_21"},{"key":"e_1_2_1_7_1","doi-asserted-by":"crossref","unstructured":"William B. Langdon Justyna Petke and Ronny Lorenz. Evolving better RNAfold structure prediction. In Mauro Castelli Lukas Sekanina and Mengjie Zhang editors EuroGP 2018: Proceedings of the 21st European Conference on Genetic Programming volume 10781 of LNCS pages 220{236 Parma Italy 4--6 April 2018. Springer Verlag. URL: http:\/\/gpbib.cs.ucl.ac.uk\/gp-html\/langdon_ 2018_EuroGP.html.","DOI":"10.1007\/978-3-319-77553-1_14"},{"key":"e_1_2_1_8_1","volume-title":"Langdon and Oliver Krauss. Genetic improvement of data for maths functions. ACM Transactions on Evolutionary Learning and Optimization, 1(2):Article No","author":"William","year":"2021","unstructured":"William B. Langdon and Oliver Krauss. Genetic improvement of data for maths functions. ACM Transactions on Evolutionary Learning and Optimization, 1(2):Article No.: 7, July 2021. URL: http: \/\/gpbib.cs.ucl.ac.uk\/gp-html\/Langdon_TELO.html."},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1109\/TEVC.2013.2281544"},{"key":"e_1_2_1_10_1","first-page":"1140","volume-title":"Genetic Improvement 2016 Workshop","author":"Bokhari Mahmoud","year":"2016","unstructured":"Mahmoud Bokhari and Markus Wagner. Optimising energy consumption heuristically on Android mobile phones. In Justyna Petke, David R. White, and Westley Weimer, editors, Genetic Improvement 2016 Workshop, pages 1139{1140, Denver, July 20--24 2016. ACM. URL: http: \/\/gpbib.cs.ucl.ac.uk\/gp-html\/Bokhari_2016_GI.html."},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/2739480.2754648"},{"key":"e_1_2_1_12_1","first-page":"269","volume-title":"International Symposium on Software Testing and Analysis, ISSTA 2015","author":"Barr Earl T.","year":"2015","unstructured":"Earl T. Barr, Mark Harman, Yue Jia, Alexandru Marginean, and Justyna Petke. Automated software transplantation. In Tao Xie and Michal Young, editors, International Symposium on Software Testing and Analysis, ISSTA 2015, pages 257{269, Baltimore, Maryland, USA, 14--17 July 2015. ACM. ACM SIGSOFT Distinguished Paper Award. URL: http: \/\/gpbib.cs.ucl.ac.uk\/gp-html\/Barr_2015_ISSTA.html."},{"key":"e_1_2_1_13_1","doi-asserted-by":"crossref","unstructured":"Justyna Petke Mark Harman William B. Langdon and Westley Weimer. Using genetic improvement and code transplants to specialise a C++ program to a problem class. In Miguel Nicolau Krzysztof Krawiec Malcolm I. Heywood Mauro Castelli Pablo Garcia-Sanchez Juan J. Merelo Victor M. Rivas Santos and Kevin Sim editors 17th European Conference on Genetic Programming volume 8599 of LNCS pages 137{149 Granada Spain 23--25 April 2014. Springer. URL: http:\/\/gpbib.cs.ucl. ac.uk\/gp-html\/Petke_2014_EuroGP.html.","DOI":"10.1007\/978-3-662-44303-3_12"},{"key":"e_1_2_1_14_1","first-page":"128","volume-title":"Proceedings of the 2018 26th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering, ESEC\/FSE 2018","author":"Basios Michail","year":"2018","unstructured":"Michail Basios, Lingbo Li, Fan Wu, Leslie Kanthan, and Earl T. Barr. Darwinian data structure selection. In Gary T. Leavens, Alessandro Garcia, and Corina S. Pasareanu, editors, Proceedings of the 2018 26th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering, ESEC\/FSE 2018, pages 118{128, Lake Buena Vista, FL, USA, 4--9 November 2018. ACM. URL: http: \/\/gpbib.cs.ucl.ac.uk\/gp-html\/Basios_2018_FSE.html."},{"key":"e_1_2_1_15_1","volume-title":"12th International Workshop on Genetic Improvement @ICSE 2023","author":"Nowack Vesna","year":"2023","unstructured":"Vesna Nowack, Markus Wagner, Gabin An, Aymeric Blot, and Justyna Petke, editors. 12th International Workshop on Genetic Improvement @ICSE 2023, Melbourne, Australia, 20 May 2023. IEEE. URL: http: \/\/gpbib.cs.ucl.ac.uk\/gp-html\/Nowack_2023_GI.html."},{"key":"e_1_2_1_16_1","unstructured":"Sebastian Baltes. All about the money: Cost modeling and"},{"key":"e_1_2_1_17_1","first-page":"8","volume-title":"12th International Workshop on Genetic Improvement @ICSE 2023","author":"Fredericks Erik M.","year":"2023","unstructured":"Erik M. Fredericks, Abigail C. Diller, and Jared M. Moore. Generative art via grammatical evolution. In Vesna Nowack, Markus Wagner, Gabin An, Aymeric Blot, and Justyna Petke, editors, 12th International Workshop on Genetic Improvement @ICSE 2023, pages 1{8, Melbourne, Australia, 20 May 2023. IEEE. Best paper. URL: http:\/\/ gpbib.cs.ucl.ac.uk\/gp-html\/Fredericks_2023_GI.html."},{"key":"e_1_2_1_18_1","first-page":"18","volume-title":"12th International Workshop on Genetic Improvement @ICSE 2023","author":"Grin David","year":"2023","unstructured":"David Grin, Susan Stepney, and Ian Vidamour. DebugNS: Novelty search for nding bugs in simulators. In Vesna Nowack, Markus Wagner, Gabin An, Aymeric Blot, and Justyna Petke, editors, 12th International Workshop on Genetic Improvement @ICSE 2023, pages 17{18, Melbourne, Australia, 20 May 2023. IEEE. URL: http: \/\/gpbib.cs.ucl.ac.uk\/gp-html\/Griffin_2023_GI.html."},{"key":"e_1_2_1_19_1","first-page":"20","volume-title":"12th International Workshop on Genetic Improvement @ICSE 2023","author":"Kang Sungmin","year":"2023","unstructured":"Sungmin Kang and Shin Yoo. Towards objective-tailored genetic improvement through large language models. In Vesna Nowack, Markus Wagner, Gabin An, Aymeric Blot, and Justyna Petke, editors, 12th International Workshop on Genetic Improvement @ICSE 2023, pages 19{20, Melbourne, Australia, 20 May 2023. IEEE. Best position paper. URL: http: \/\/gpbib.cs.ucl.ac.uk\/gp-html\/Kang_2023_GI.html."},{"key":"e_1_2_1_20_1","first-page":"22","volume-title":"12th International Workshop on Genetic Improvement @ICSE 2023","author":"Krauss Oliver","year":"2023","unstructured":"Oliver Krauss. Exploring the use of natural language processing techniques for enhancing genetic improvement. In Vesna Nowack, Markus Wagner, Gabin An, Aymeric Blot, and Justyna Petke, editors, 12th International Workshop on Genetic Improvement @ICSE 2023, pages 21{22, Melbourne, Australia, 20 May 2023. IEEE. URL: http: \/\/gpbib.cs.ucl.ac.uk\/gp-html\/Krauss_2023_GI.html."},{"key":"e_1_2_1_21_1","first-page":"16","volume-title":"12th International Workshop on Genetic Improvement @ICSE 2023","author":"William","year":"2023","unstructured":"William B. Langdon and Bradley J. Alexander. Genetic improvement of OLC and H3 with Magpie. In Vesna Nowack, Markus Wagner, Gabin An, Aymeric Blot, and Justyna Petke, editors, 12th International Workshop on Genetic Improvement @ICSE 2023, pages 9{16, Melbourne, Australia, 20 May 2023. IEEE. URL: http: \/\/gpbib.cs.ucl.ac.uk\/gp-html\/langdon_2023_GI.html."},{"key":"e_1_2_1_22_1","first-page":"28","volume-title":"12th International Workshop on Genetic Improvement @ICSE 2023","author":"Watkinson Myles","year":"2023","unstructured":"Myles Watkinson and Alexander Brownlee. Updating Gin's pro ler for current java. In Vesna Nowack, Markus Wagner, Gabin An, Aymeric Blot, and Justyna Petke, editors, 12th International Workshop on Genetic Improvement @ICSE 2023, pages 23{28, Melbourne, Australia, 20 May 2023. IEEE. URL: http:\/\/gpbib.cs.ucl.ac.uk\/gp-html\/ Watkinson_2023_GI.html."},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/2025113.2025179"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1109\/TEVC.2017.2693219"},{"key":"e_1_2_1_25_1","volume-title":"The Search-Based & Fuzz Testing (SBFT) Workshop","author":"Gambi Alessio","year":"2023","unstructured":"Alessio Gambi, Giovani Guizzo, and Panichella Sebastiano, editors. The Search-Based & Fuzz Testing (SBFT) Workshop, Melbourne, 10 May 2023. Co-located with ICSE 2023. URL: https:\/\/sbft23.github.io\/."},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.asoc.2022.109916"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1002\/stvr.430"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1109\/ASE.2011.6100082"},{"key":"e_1_2_1_29_1","first-page":"12","volume-title":"8th IEEE International Conference on Software Testing, Veri cation and Validation, ICST 2015","author":"Harman Mark","year":"2015","unstructured":"Mark Harman, Yue Jia, and Yuanyuan Zhang. Achievements, open problems and challenges for search based software testing. In Gordon Fraser and Darko Marinov, editors, 8th IEEE International Conference on Software Testing, Veri cation and Validation, ICST 2015, pages 1{12, Graz, Austria, April 14--16 2015. IEEE. Keynote. URL: http: \/\/gpbib.cs.ucl.ac.uk\/gp-html\/Harman_2015_ICST.html."},{"key":"e_1_2_1_30_1","first-page":"56","volume-title":"Genetic Programming Theory and Practice IX, Genetic and Evolutionary Computation","author":"Lehman Joel","unstructured":"Joel Lehman and Kenneth O. Stanley. Novelty search and the problem with objectives. In Rick Riolo, Ekaterina Vladislavleva, and Jason H. Moore, editors, Genetic Programming Theory and Practice IX, Genetic and Evolutionary Computation, chapter 3, pages 37{56. Springer, Ann Arbor, USA, 12--14 May 2011. URL: http: \/\/gpbib.cs.ucl.ac.uk\/gp-html\/Lehman_2011_GPTP.html."},{"key":"e_1_2_1_31_1","volume-title":"Genetic improvement @ icse","author":"Langdon William B.","year":"2020","unstructured":"William B. Langdon, Westley Weimer, Justyna Petke, Erik Fredericks, Seongmin Lee, Emily Winter, Michail Basios, Myra B. Cohen, Aymeric Blot, Markus Wagner, Bobby R. Bruce, Shin Yoo, Simos Gerasimou, Oliver Krauss, Yu Huang, and Michael Gerten. Genetic improvement @ icse 2020. SIGSOFT Software Engineering Notes, 45(4):24{30, October 2020. URL: http: \/\/gpbib.cs.ucl.ac.uk\/gp-html\/Langdon_2020_SEN.html."},{"key":"e_1_2_1_32_1","volume-title":"ArXiv","author":"Lehman Joel","year":"2022","unstructured":"Joel Lehman, Jonathan Gordon, Shawn Jain, Kamal Ndousse, Cathy Yeh, and Kenneth O. Stanley. Evolution through large models. ArXiv, 17 June 2022. URL: http: \/\/gpbib.cs.ucl.ac.uk\/gp-html\/Lehman_2022_ELM.html."},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/3212695"},{"key":"e_1_2_1_34_1","series-title":"Natural Computing Series","first-page":"347","volume-title":"Massively Parallel Evolutionary Computation on GPGPUs","author":"Langdon William B.","unstructured":"William B. Langdon. Large scale bioinformatics data mining with parallel genetic programming on graphics processing units. In Shigeyoshi Tsutsui and Pierre Collet, editors, Massively Parallel Evolutionary Computation on GPGPUs, Natural Computing Series, chapter 15, pages 311{347. Springer, 2013. URL: http:\/\/gpbib.cs.ucl.ac. uk\/gp-html\/langdon_2013_ecgpu.html."},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/3196398.3196466"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/3135932.3135941"},{"key":"e_1_2_1_37_1","first-page":"46","volume-title":"ICSE workshops proceedings","author":"Landsborough Jason","year":"2018","unstructured":"Jason Landsborough, Stephen Harding, and Bryan Beabout. Evolutionary fuzzing for genetic improvement: Toward adaptive software defense. In Justyna Petke, Kathryn Stolee, William B. Langdon, and Westley Weimer, editors, GI-2018, ICSE workshops proceedings, pages 45{46, Gothenburg, Sweden, 2 June 2018. ACM. URL: http:\/\/gpbib.cs.ucl.ac.uk\/gp-html\/Landsborough_ 2018_GI.html."},{"key":"e_1_2_1_38_1","first-page":"20","volume-title":"GI @ ICSE","author":"Kitt Linsey","year":"2021","unstructured":"Linsey Kitt and Myra B. Cohen. Partial speci cations for program repair. In Justyna Petke, Bobby R. Bruce, Yu Huang, Aymeric Blot, Westley Weimer, and W. B. Langdon, editors, GI @ ICSE 2021, pages 19{20, internet, 30 May 2021. IEEE. URL: http: \/\/gpbib.cs.ucl.ac.uk\/gp-html\/Kitt_2021_GI.html."},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/1143997.1144316"},{"key":"e_1_2_1_40_1","first-page":"1362","volume-title":"The 36th IEEE\/ACM International Conference on Automated Software Engineering, New Ideas and Emerging Results track, ASE NIER 2021","author":"Mesecan Ibrahim","year":"2021","unstructured":"Ibrahim Mesecan, Daniel Blackwell, David Clark, Myra B. Cohen, and Justyna Petke. HyperGI: Automated detection and repair of information ow leakage. In Hourieh Khalajzadeh and Jean-Guy Schneider, editors, The 36th IEEE\/ACM International Conference on Automated Software Engineering, New Ideas and Emerging Results track, ASE NIER 2021, pages 1358{1362, Melbourne, 15--19 November 2021. URL: http:\/\/gpbib.cs.ucl.ac.uk\/ gp-html\/Clark_2021_ASE-NIER.html, arXiv:2108.12075."},{"key":"e_1_2_1_41_1","volume-title":"June 25","author":"Woodward John R.","year":"2015","unstructured":"John R. Woodward, Justyna Petke, and William Langdon. How computers are learning to make human software work more efficiently. The Conversation, page 10.08am BST, June 25 2015. URL: http:\/\/gpbib.cs.ucl.ac.uk\/ gp-html\/Woodward_2015_hclhswe.html."},{"key":"e_1_2_1_42_1","volume-title":"MAGPIE: Machine automated general performance improvement via evolution of software. arXiv","author":"Blot Aymeric","year":"2022","unstructured":"Aymeric Blot and Justyna Petke. MAGPIE: Machine automated general performance improvement via evolution of software. arXiv, 4 August 2022. URL: http: \/\/gpbib.cs.ucl.ac.uk\/gp-html\/blot_2022_corr_1.html"}],"container-title":["ACM SIGSOFT Software Engineering Notes"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3617946.3617956","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3617946.3617956","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T16:37:58Z","timestamp":1750178278000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3617946.3617956"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,10,13]]},"references-count":42,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2023,10,13]]}},"alternative-id":["10.1145\/3617946.3617956"],"URL":"https:\/\/doi.org\/10.1145\/3617946.3617956","relation":{},"ISSN":["0163-5948"],"issn-type":[{"type":"print","value":"0163-5948"}],"subject":[],"published":{"date-parts":[[2023,10,13]]},"assertion":[{"value":"2023-10-17","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}