{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,22]],"date-time":"2026-07-22T03:41:47Z","timestamp":1784691707822,"version":"3.55.0"},"reference-count":247,"publisher":"Association for Computing Machinery (ACM)","issue":"5","license":[{"start":{"date-parts":[[2025,5,26]],"date-time":"2025-05-26T00:00:00Z","timestamp":1748217600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Swiss National Foundation","award":["SNF 200021_215487"],"award-info":[{"award-number":["SNF 200021_215487"]}]},{"name":"State Research Agency","award":["PID2022-140106NB-I00"],"award-info":[{"award-number":["PID2022-140106NB-I00"]}]},{"DOI":"10.13039\/501100003359","name":"Generalitat Valenciana","doi-asserted-by":"crossref","award":["CIAICO\/2021\/303 (AKILA)"],"award-info":[{"award-number":["CIAICO\/2021\/303 (AKILA)"]}],"id":[{"id":"10.13039\/501100003359","id-type":"DOI","asserted-by":"crossref"}]},{"name":"Denys Poshyvanyk\u2019s research","award":["NSF CCF-234635, CCF-2311469, CNS-2132281, and CCF-1955853"],"award-info":[{"award-number":["NSF CCF-234635, CCF-2311469, CNS-2132281, and CCF-1955853"]}]},{"name":"Singapore Ministry of Education (MoE) Tier3","award":["MOE-MOET32021-0001"],"award-info":[{"award-number":["MOE-MOET32021-0001"]}]},{"name":"State Key Laboratory of Complex & Critical Software Environment","award":["CCSE-2024ZX-01"],"award-info":[{"award-number":["CCSE-2024ZX-01"]}]},{"DOI":"10.13039\/501100012226","name":"Fundamental Research Funds for the Central Universities","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100012226","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Softw. Eng. Methodol."],"published-print":{"date-parts":[[2025,6,30]]},"abstract":"<jats:p>\n            The landscape of software engineering has dramatically changed in recent years. The impressive advances of artificial intelligence are just the latest and most disruptive innovation that has remarkably changed the software engineering research and practice. This special issue shares a roadmap to guide the software engineering community in this confused era. This roadmap is the outcome of a 2-day intensive discussion at the\n            <jats:italic>2030 Software Engineering<\/jats:italic>\n            workshop. The roadmap spotlights and discusses seven main landmarks in the new software engineering landscape: artificial intelligence for software engineering, human aspects of software engineering, software security, verification and validation, sustainable software engineering, automatic programming, and quantum software engineering. This editorial summarizes the core aspects discussed in the 37 papers that comprise the seven sections of the special issue and guides the interested readers throughout the issue. This roadmap is a living body that we will refine with follow-up workshops that will update the roadmap for a series of forthcoming ACM TOSEM special issues.\n          <\/jats:p>","DOI":"10.1145\/3731559","type":"journal-article","created":{"date-parts":[[2025,4,25]],"date-time":"2025-04-25T17:23:23Z","timestamp":1745601803000},"page":"1-55","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":10,"title":["A 2030 Roadmap for Software Engineering"],"prefix":"10.1145","volume":"34","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5193-7379","authenticated-orcid":false,"given":"Mauro","family":"Pezz\u00e8","sequence":"first","affiliation":[{"name":"Universit\u00e0 della Svizzera italiana, Lugano, Switzerland, Universit\u00e0 degli Studi di Milano-Bicocca, Milan, Italy, and Constructor University, Schaffhausen, Switzerland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3580-2014","authenticated-orcid":false,"given":"Silvia","family":"Abrah\u00e3o","sequence":"additional","affiliation":[{"name":"Universitat Politecnica de Valencia, Valencia, Spain"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5771-0455","authenticated-orcid":false,"given":"Birgit","family":"Penzenstadler","sequence":"additional","affiliation":[{"name":"Chalmers University of Technology, Gothenburg, Sweden"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5626-7586","authenticated-orcid":false,"given":"Denys","family":"Poshyvanyk","sequence":"additional","affiliation":[{"name":"William &amp; Mary, Williamsburg, VA, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7127-1137","authenticated-orcid":false,"given":"Abhik","family":"Roychoudhury","sequence":"additional","affiliation":[{"name":"National University of Singapore, Singapore, Singapore"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3262-5577","authenticated-orcid":false,"given":"Tao","family":"Yue","sequence":"additional","affiliation":[{"name":"Beihang University, Beijing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2025,5,26]]},"reference":[{"key":"e_1_3_2_2_2","article-title":"Software engineering by and for humans in an AI era","author":"Abrah\u00e3o Silvia","year":"2025","unstructured":"Silvia Abrah\u00e3o, John Grundy, Mauro Pezz\u00e8, Margaret-Anne Storey, and Damian Andrew Tamburri. 2025. Software engineering by and for humans in an AI era. ACM Transaction on Software Engineering and Methodology, 2030 Roadmap Special Issue, 1049-33X.","journal-title":"ACM Transaction on Software Engineering and Methodology"},{"key":"e_1_3_2_3_2","doi-asserted-by":"publisher","DOI":"10.1109\/MC.2020.2996587"},{"issue":"2","key":"e_1_3_2_4_2","doi-asserted-by":"crossref","first-page":"1536","DOI":"10.1007\/s10664-019-09759-w","article-title":"Code localization in programming screencasts","volume":"25","author":"Alahmadi Mohammad","year":"2020","unstructured":"Mohammad Alahmadi, Abdulkarim Khormi, Biswas Parajuli, Jonathan Hassel, Sonia Haiduc, and Piyush Kumar. 2020. Code localization in programming screencasts. Empirical Software Engineering 25, 2 (2020), 1536\u20131572.","journal-title":"Empirical Software Engineering"},{"issue":"1","key":"e_1_3_2_5_2","doi-asserted-by":"crossref","first-page":"9","DOI":"10.1016\/j.ecolecon.2005.03.020","article-title":"Jevons\u2019 paradox","volume":"54","author":"Alcott Blake","year":"2005","unstructured":"Blake Alcott. 2005. Jevons\u2019 paradox. Ecological Economics 54, 1 (2005), 9\u201321.","journal-title":"Ecological Economics"},{"key":"e_1_3_2_6_2","doi-asserted-by":"publisher","DOI":"10.1145\/3512340"},{"key":"e_1_3_2_7_2","first-page":"185","volume-title":"Companion Proceedings of the 32nd ACM International Conference on the Foundations of Software Engineering (FSE \u201924)","author":"Alshahwan Nadia","year":"2024","unstructured":"Nadia Alshahwan, Jubin Chheda, Anastasia Finogenova, Beliz Gokkaya, Mark Harman, Inna Harper, Alexandru Marginean, Shubho Sengupta, and Eddy Wang. 2024. Automated unit test improvement using large language models at meta. In Companion Proceedings of the 32nd ACM International Conference on the Foundations of Software Engineering (FSE \u201924). ACM, New York, NY, 185\u2013196. DOI: 10.1145\/3663529.3663839"},{"key":"e_1_3_2_8_2","first-page":"3","volume-title":"Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI \u201919)","author":"Amershi Saleema","year":"2019","unstructured":"Saleema Amershi, Daniel S. Weld, Mihaela Vorvoreanu, Adam Fourney, Besmira Nushi, Penny Collisson, Jina Suh, Shamsi T. Iqbal, Paul N. Bennett, Kori Inkpen, et al. 2019. Guidelines for human-AI interaction. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI \u201919). Stephen A. Brewster, Geraldine Fitzpatrick, Anna L. Cox, and Vassilis Kostakos (Eds.), ACM, 3. DOI: 10.1145\/3290605.3300233"},{"key":"e_1_3_2_9_2","article-title":"Contemporary software modernization: Strategies, driving forces, and research opportunities","author":"Assun\u00e7\u00e3o Wesley","year":"2025","unstructured":"Wesley Assun\u00e7\u00e3o, Luciano Marchezan, Lawrence Arkoh, Alexander Egyed, and Rudolf Ramler. 2025. Contemporary software modernization: Strategies, driving forces, and research opportunities. ACM Transaction on Software Engineering and Methodology 2030 Roadmap Special Issue, 1049-331X.","journal-title":"ACM Transaction on Software Engineering and Methodology"},{"key":"e_1_3_2_10_2","article-title":"Engineering digital systems for humanity: A research roadmap","author":"Autili Marco","year":"2025","unstructured":"Marco Autili, Martina De Sanctis, Paola Inverardi, and Patrizio Pelliccione. 2025. Engineering digital systems for humanity: A research roadmap. ACM Transaction on Software Engineering and Methodology 2030 Roadmap Special Issue, 1049-331X.","journal-title":"ACM Transaction on Software Engineering and Methodology"},{"issue":"3","key":"e_1_3_2_11_2","doi-asserted-by":"crossref","first-page":"329","DOI":"10.1016\/j.cognition.2009.07.005","article-title":"Action understanding as inverse planning","volume":"113","author":"Baker C. L.","year":"2009","unstructured":"C. L. Baker, R. Saxe, and J. Tenenbaum. 2009. Action understanding as inverse planning. Cognition 113, 3 (2009), 329\u2013349.","journal-title":"Cognition"},{"issue":"5","key":"e_1_3_2_12_2","doi-asserted-by":"crossref","first-page":"507","DOI":"10.1109\/TSE.2014.2372785","article-title":"The oracle problem in software testing: A survey","volume":"41","author":"Barr Earl T.","year":"2014","unstructured":"Earl T. Barr, Mark Harman, Phil McMinn, Muzammil Shahbaz, and Shin Yoo. 2014. The oracle problem in software testing: A survey. IEEE Transactions on Software Engineering 41, 5 (2014), 507\u2013525.","journal-title":"IEEE Transactions on Software Engineering"},{"key":"e_1_3_2_13_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.inffus.2019.12.012"},{"key":"e_1_3_2_14_2","doi-asserted-by":"crossref","DOI":"10.7551\/mitpress\/14668.001.0001","volume-title":"Insolvent: How to Reorient Computing for Just Sustainability","author":"Becker Christoph","year":"2023","unstructured":"Christoph Becker. 2023. Insolvent: How to Reorient Computing for Just Sustainability. MIT Press."},{"issue":"1","key":"e_1_3_2_15_2","doi-asserted-by":"crossref","first-page":"56","DOI":"10.1109\/MS.2015.158","article-title":"Requirements: The key to sustainability","volume":"33","author":"Becker Christoph","year":"2015","unstructured":"Christoph Becker, Stefanie Betz, Ruzanna Chitchyan, Leticia Duboc, Steve M. Easterbrook, Birgit Penzenstadler, Norbet Seyff, and Colin C. Venters. 2015. Requirements: The key to sustainability. IEEE Software 33, 1 (2015), 56\u201365.","journal-title":"IEEE Software"},{"key":"e_1_3_2_16_2","doi-asserted-by":"crossref","first-page":"467","DOI":"10.1109\/ICSE.2015.179","volume-title":"Proceedings of the 2015 IEEE\/ACM 37th IEEE International Conference on Software Engineering","volume":"2","author":"Becker Christoph","year":"2015","unstructured":"Christoph Becker, Ruzanna Chitchyan, Leticia Duboc, Steve Easterbrook, Birgit Penzenstadler, Norbert Seyff, and Colin C. Venters. 2015. Sustainability design and software: The Karlskrona manifesto. In Proceedings of the 2015 IEEE\/ACM 37th IEEE International Conference on Software Engineering. IEEE, Vol. 2, 467\u2013476."},{"key":"e_1_3_2_17_2","doi-asserted-by":"publisher","DOI":"10.1145\/3447240"},{"key":"e_1_3_2_18_2","article-title":"With great power comes great responsibility: The role of software engineers","author":"Betz Stefanie","year":"2025","unstructured":"Stefanie Betz and Birgit Penzenstadler. 2025. With great power comes great responsibility: The role of software engineers. ACM Transaction on Software Engineering and Methodology 2030 Roadmap Special Issue, 1049-331X.","journal-title":"ACM Transaction on Software Engineering and Methodology"},{"issue":"5","key":"e_1_3_2_19_2","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3649597","article-title":"Lessons learned from developing a sustainability awareness framework for software engineering using design science","volume":"33","author":"Betz Stefanie","year":"2024","unstructured":"Stefanie Betz, Birgit Penzenstadler, Leticia Duboc, Ruzanna Chitchyan, Sedef Akinli Kocak, Ian Brooks, Shola Oyedeji, Jari Porras, Norbert Seyff, and Colin C. Venters. 2024. Lessons learned from developing a sustainability awareness framework for software engineering using design science. ACM Transactions on Software Engineering and Methodology 33, 5 (2024), 1\u201339.","journal-title":"ACM Transactions on Software Engineering and Methodology"},{"key":"e_1_3_2_20_2","doi-asserted-by":"crossref","first-page":"54","DOI":"10.1145\/3643795.3648396","volume-title":"Proceedings of the 1st International Workshop on Large Language Models for Code (LLM4Code\u201924)","author":"Bhatia Shreya","year":"2024","unstructured":"Shreya Bhatia, Tarushi Gandhi, Dhruv Kumar, and Pankaj Jalote. 2024. Unit test generation using generative AI: A comparative performance analysis of autogeneration tools. In Proceedings of the 1st International Workshop on Large Language Models for Code (LLM4Code\u201924). ACM, New York, NY, 54\u201361. DOI: 10.1145\/3643795.3648396"},{"issue":"7671","key":"e_1_3_2_21_2","doi-asserted-by":"crossref","first-page":"195","DOI":"10.1038\/nature23474","article-title":"Quantum machine learning","volume":"549","author":"Biamonte Jacob","year":"2017","unstructured":"Jacob Biamonte, Peter Wittek, Nicola Pancotti, Patrick Rebentrost, Nathan Wiebe, and Seth Lloyd. 2017. Quantum machine learning. Nature 549, 7671 (2017), 195\u2013202.","journal-title":"Nature"},{"key":"e_1_3_2_22_2","doi-asserted-by":"crossref","DOI":"10.1145\/3711906","article-title":"A roadmap for simulation-based testing of autonomous cyber-physical systems: Challenges and future direction","author":"Birchler Christian","year":"2025","unstructured":"Christian Birchler, Sajad Khatiri, Pooja Rani, Timo Kehrer, and Sebastiano Panichella. 2025. A roadmap for simulation-based testing of autonomous cyber-physical systems: Challenges and future direction. ACM Transaction on Software Engineering and Methodology 2030 Roadmap Special Issue.","journal-title":"ACM Transaction on Software Engineering and Methodology"},{"key":"e_1_3_2_23_2","first-page":"19:1","volume-title":"Proceedings of the 37th IEEE\/ACM International Conference on Automated Software Engineering (ASE \u201922)","author":"Blasi Arianna","year":"2022","unstructured":"Arianna Blasi, Alessandra Gorla, Michael D. Ernst, and Mauro Pezz\u00e8. 2022. Call me maybe: Using NLP to automatically generate unit test cases respecting temporal constraints. In Proceedings of the 37th IEEE\/ACM International Conference on Automated Software Engineering (ASE \u201922). ACM, 19:1\u201319:11. DOI: 10.1145\/3551349.3556961"},{"issue":"7962","key":"e_1_3_2_24_2","first-page":"S1","article-title":"The race to find quantum computing\u2019s sweet spot","volume":"617","author":"Brooks Michael","year":"2023","unstructured":"Michael Brooks. 2023. The race to find quantum computing\u2019s sweet spot. Nature 617, 7962 (May 2023), S1\u2013S3. DOI:10.1038\/d41586-023-01692-9","journal-title":"Nature"},{"key":"e_1_3_2_25_2","volume-title":"Our Common Future World Commission on Environment and Developement","author":"Brundtland Gro Harlem","year":"1987","unstructured":"Gro Harlem Brundtland. 1987. Our Common Future World Commission on Environment and Developement. UN World Commission on Environment and Development."},{"key":"e_1_3_2_26_2","article-title":"Automation in model-driven engineering: A look back and ahead","author":"Burgue\u00f1o Lola","year":"2025","unstructured":"Lola Burgue\u00f1o, Davide Di Ruscio, Houari Sahraoui, and Manuel WImmer. 2025. Automation in model-driven engineering: A look back and ahead. ACM Transaction on Software Engineering and Methodology 2030 Roadmap Special Issue, 1049-331X.","journal-title":"ACM Transaction on Software Engineering and Methodology"},{"key":"e_1_3_2_27_2","article-title":"Software security analysis in 2030 and beyond: A research roadmap","author":"B\u00f6hme Marcel","year":"2025","unstructured":"Marcel B\u00f6hme, Eric Bodden, Tevfik Bultan, Cristian Cadar, Yang Liu, and Giuseppe Scanniello. 2025. Software security analysis in 2030 and beyond: A research roadmap. ACM Transaction on Software Engineering and Methodology 2030 Roadmap Special Issue, 1049-331X.","journal-title":"ACM Transaction on Software Engineering and Methodology"},{"key":"e_1_3_2_28_2","doi-asserted-by":"crossref","DOI":"10.1007\/978-3-319-08581-4","volume":"3","author":"Calero Coral","year":"2015","unstructured":"Coral Calero and Mario Piattini. 2015. Green in Software Engineering, Vol. 3, Springer.","journal-title":"Green in Software Engineering"},{"issue":"3","key":"e_1_3_2_29_2","doi-asserted-by":"crossref","first-page":"781","DOI":"10.1007\/s10270-023-01105-5","article-title":"On the assessment of generative AI in modeling tasks: An experience report with ChatGPT and UML","volume":"22","author":"C\u00e1mara Javier","year":"2023","unstructured":"Javier C\u00e1mara, Javier Troya, Lola Burgue\u00f1o, and Antonio Vallecillo. 2023. On the assessment of generative AI in modeling tasks: An experience report with ChatGPT and UML. Software and Systems Modeling 22, 3 (2023), 781\u2013793.","journal-title":"Software and Systems Modeling"},{"key":"e_1_3_2_30_2","article-title":"Software engineering for collective cyber-physical ecosystems","author":"Casadei Roberto","year":"2025","unstructured":"Roberto Casadei, Gianluca Aguzzi, Giorgio Audrito, Ferruccio Damiani, Danilo Pianini, Giordano Scarso, Gianluca Torta, and Mirko Viroli. 2025. Software engineering for collective cyber-physical ecosystems. ACM Transaction on Software Engineering and Methodology 2030 Roadmap Special Issue, 1049-331X.","journal-title":"ACM Transaction on Software Engineering and Methodology"},{"key":"e_1_3_2_31_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10664-018-9669-7"},{"key":"e_1_3_2_32_2","unstructured":"Federico Cassano John Gouwar Daniel Nguyen Sydney Nguyen Luna Phipps-Costin Donald Pinckney Ming-Ho Yee Yangtian Zi Carolyn Jane Anderson Molly Q. Feldman et al. 2022. MultiPL-E: A scalable and extensible approach to benchmarking neural code generation. arXiv:2208.08227. Retrieved from http:\/\/arxiv.org\/abs\/2208.08227"},{"key":"e_1_3_2_33_2","article-title":"A road-map to readily available early validation & verification of system behaviour in model-based systems engineering using software engineering best practices","author":"Cederbladh Johan","unstructured":"Johan Cederbladh, Antonio Cicchetti, and Robbert Jongeling. n.d. A road-map to readily available early validation & verification of system behaviour in model-based systems engineering using software engineering best practices. ACM Transaction on Software Engineering and Methodology 2030 Roadmap Special Issue, 1049-331X.","journal-title":"ACM Transaction on Software Engineering and Methodology"},{"key":"e_1_3_2_34_2","first-page":"9","article-title":"Artificial intelligence for software engineering: The journey so far and the road ahead","volume":"34","author":"Chatzigeorgiou Alexander","year":"2024","unstructured":"Alexander Chatzigeorgiou, Iftekar Ahmed, Haipeng Cai, Mauro Pezz\u00e8, and Denys Poshyvanyk. 2024. Artificial intelligence for software engineering: The journey so far and the road ahead. ACM Transactions on Software Engineering and Methodology 34 (2024), 9.","journal-title":"ACM Transactions on Software Engineering and Methodology"},{"key":"e_1_3_2_35_2","doi-asserted-by":"crossref","first-page":"665","DOI":"10.1145\/3180155.3180240","volume-title":"Proceedings of the 40th International Conference on Software Engineering","author":"Chen Chunyang","year":"2018","unstructured":"Chunyang Chen, Ting Su, Guozhu Meng, Zhenchang Xing, and Yang Liu. 2018. From UI design image to GUI skeleton: A neural machine translator to bootstrap mobile GUI implementation. In Proceedings of the 40th International Conference on Software Engineering, 665\u2013676."},{"key":"e_1_3_2_36_2","article-title":"LLM for mobile: An initial roadmap","author":"Chen Daihang","year":"2025","unstructured":"Daihang Chen, Yonghui Liu, Mingyi Zhou, Yanjie Zhao, Haoyu Wang, Shuai Wang, Xiao Chen, Tegawende Bissyande, Jacques Klein, and Li Li. 2025. LLM for mobile: An initial roadmap. ACM Transaction on Software Engineering and Methodology 2030 Roadmap Special Issue, 1049-331X.","journal-title":"ACM Transaction on Software Engineering and Methodology"},{"key":"e_1_3_2_37_2","first-page":"364","volume-title":"Proceedings of the 2019 34th IEEE\/ACM International Conference on Automated Software Engineering (ASE)","author":"Chen Junjie","year":"2019","unstructured":"Junjie Chen, Xiaoting He, Qingwei Lin, Hongyu Zhang, Dan Hao, Feng Gao, Zhangwei Xu, Yingnong Dang, and Dongmei Zhang. 2019. Continuous incident triage for large-scale online service systems. In Proceedings of the 2019 34th IEEE\/ACM International Conference on Automated Software Engineering (ASE). IEEE, 364\u2013375."},{"key":"e_1_3_2_38_2","unstructured":"Mark Chen Jerry Tworek Heewoo Jun Qiming Yuan Henrique Ponde de Oliveira Pinto Jared Kaplan Harri Edwards Yuri Burda Nicholas Joseph Greg Brockman et al. 2021. Evaluating large language models trained on code. arXiv:2107.03374. Retrieved from http:\/\/arxiv.org\/abs\/2107.03374"},{"key":"e_1_3_2_39_2","unstructured":"Tsong Y. Chen Shing C. Cheung and Shiu Ming Yiu. 2020. Metamorphic testing: A new approach for generating next test cases. arXiv:2002.12543. Retrieved from https:\/\/arxiv.org\/abs\/2002.12543"},{"key":"e_1_3_2_40_2","volume-title":"Proceedings of the International Conference on Learning Representations","author":"Chen Xinyun","year":"2018","unstructured":"Xinyun Chen, Chang Liu, and Dawn Song.2018. Execution-guided neural program synthesis. In Proceedings of the International Conference on Learning Representations."},{"key":"e_1_3_2_41_2","unstructured":"Yuxing Cheng Yi Chang and Yuan Wu. 2025. A survey on data contamination for large language models. arXiv:2502.14425. Retrieved from https:\/\/arxiv.org\/abs\/2502.14425"},{"key":"e_1_3_2_42_2","doi-asserted-by":"crossref","unstructured":"Matteo Ciniselli Nathan Cooper Luca Pascarella Antonio Mastropaolo Emad Aghajani Denys Poshyvanyk Massimiliano Di Penta and Gabriele Bavota. 2021. An empirical study on the usage of transformer models for code completion. arXiv:2108.01585. Retrieved from https:\/\/arxiv.org\/abs\/2108.01585","DOI":"10.1109\/TSE.2021.3128234"},{"key":"e_1_3_2_43_2","first-page":"255","volume-title":"Proceedings of the 48th Annual IEEE\/IFIP International Conference on Dependable Systems and Networks Workshops","author":"Cioroaica Emilia","year":"2018","unstructured":"Emilia Cioroaica, Thomas Kuhn, and Thomas Bauer. 2018. Prototyping automotive smart ecosystems. In Proceedings of the 48th Annual IEEE\/IFIP International Conference on Dependable Systems and Networks Workshops. IEEE Computer Society, 255\u2013262. DOI: 10.1109\/DSN-W.2018.00072"},{"key":"e_1_3_2_44_2","unstructured":"J\u00fcrgen Cito Isil Dillig Vijayaraghavan Murali and Satish Chandra. 2021. Counterfactual explanations for models of code. arXiv:2111.05711. Retrieved from https:\/\/arxiv.org\/abs\/2111.05711"},{"key":"e_1_3_2_45_2","first-page":"120","volume-title":"Proceedings of the International Symposium on Software Engineering for Adaptive and Self-Managing Systems (SEAMS \u201922)","author":"Cleland-Huang Jane","year":"2022","unstructured":"Jane Cleland-Huang, Ankit Agrawal, Michael Vierhauser, Michael Murphy, and Mike Prieto. 2022. Extending MAPE-K to support human-machine teaming. In Proceedings of the International Symposium on Software Engineering for Adaptive and Self-Managing Systems (SEAMS \u201922). Bradley R. Schmerl, Martina Maggio, and Javier C\u00e1mara (Eds.), ACM\/IEEE, 120\u2013131. DOI: 10.1145\/3524844.3528054"},{"key":"e_1_3_2_46_2","article-title":"Innovating for tomorrow: The convergence of SE and green AI","author":"Cruz Luis","year":"2025","unstructured":"Luis Cruz, Xavier Franch, and Silverio Mart\u00ednez-Fern\u00e1ndez. 2025. Innovating for tomorrow: The convergence of SE and green AI. ACM Transaction on Software Engineering and Methodology 2030 Roadmap Special Issue, 1049-331X.","journal-title":"ACM Transaction on Software Engineering and Methodology"},{"key":"e_1_3_2_47_2","doi-asserted-by":"crossref","first-page":"111734","DOI":"10.1016\/j.jss.2023.111734","article-title":"Github copilot ai pair programmer: Asset or liability?","volume":"203","author":"Moradi Dakhel Arghavan","year":"2023","unstructured":"Arghavan Moradi Dakhel, Vahid Majdinasab, Amin Nikanjam, Foutse Khomh, Michel C. Desmarais, and Zhen Ming Jack Jiang. 2023. Github copilot ai pair programmer: Asset or liability? Journal of Systems and Software 203 (2023), 111734.","journal-title":"Journal of Systems and Software"},{"key":"e_1_3_2_48_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.infsof.2024.107468"},{"key":"e_1_3_2_49_2","first-page":"53","volume-title":"Proceedings of the 40th International Conference on Software Engineering: New Ideas and Emerging Results (ICSE-NIER \u201918)","author":"Khanh Dam Hoa","year":"2018","unstructured":"Hoa Khanh Dam, Truyen Tran, and Aditya Ghose. 2018. Explainable software analytics. In Proceedings of the 40th International Conference on Software Engineering: New Ideas and Emerging Results (ICSE-NIER \u201918). ACM, New York, NY, 53\u201356. DOI: 10.1145\/3183399.3183424"},{"key":"e_1_3_2_50_2","volume-title":"Proceedings of the ACM ISSTA International Symposium on Software Testing and Analysis","author":"Zackrone Eliot","year":"2025","unstructured":"Eliot Zackrone, Beiza Eken, Michal Ernst, Mauro Pezz\u00e8, Davide Molinelli, and Alberto Martin-Lopez. 2025. Tratto: A neuro-symbolic approach to deriving axiomatic test oracles. In Proceedings of the ACM ISSTA International Symposium on Software Testing and Analysis."},{"key":"e_1_3_2_51_2","first-page":"1","volume-title":"Proceedings of the International Seminar on Software Engineering for Self-Adaptive Systems IILecture Notes in Computer Science, Vol. 7475","author":"de Lemos Rog\u00e9rio","year":"2010","unstructured":"Rog\u00e9rio de Lemos, Holger Giese, Hausi A. M\u00fcller, Mary Shaw, Jesper Andersson, Marin Litoiu, Bradley R. Schmerl, Gabriel Tamura, Norha M. Villegas, Thomas Vogel, et al. 2010. Software engineering for self-adaptive systems: A second research roadmap. In Proceedings of the International Seminar on Software Engineering for Self-Adaptive Systems II. Rog\u00e9rio de Lemos, Holger Giese, Hausi A. M\u00fcller, and Mary Shaw (Eds.), Lecture Notes in Computer Science, Vol. 7475, Springer, 1\u201332. DOI: 10.1007\/978-3-642-35813-5_1"},{"key":"e_1_3_2_52_2","article-title":"Software fairness debt: Building a research agenda for addressing bias in AI systems","author":"de Souza Ronnie Santos","year":"2025","unstructured":"Santos de Souza Ronnie, Felipe Fronchetti, S\u00e1vio Freire, and Rodrigo Spinola. 2025. Software fairness debt: Building a research agenda for addressing bias in AI systems. ACM Transaction on Software Engineering and Methodology 2030 Roadmap Special Issue, 1049-331X.","journal-title":"ACM Transaction on Software Engineering and Methodology"},{"key":"e_1_3_2_53_2","unstructured":"Prem Devanbu Matthew Dwyer Sebastian Elbaum Michael Lowry Kevin Moran Denys Poshyvanyk Baishakhi Ray Rishabh Singh and Xiangyu Zhang. 2020. Deep learning & software engineering: State of research and future directions. arXiv:2009.08525. Retrieved from https:\/\/arxiv.org\/abs\/2009.08525"},{"key":"e_1_3_2_54_2","volume-title":"Proceedings of the International Conference on Software Engineering (ICSE \u201922)","author":"Dinella Elizabeth","year":"2022","unstructured":"Elizabeth Dinella, Gabriel Ryan, Todd Mytkowicz, and Shuvendu Lahiri. 2022. TOGA: A neural method for test oracle generation. In Proceedings of the International Conference on Software Engineering (ICSE \u201922). ACM. Retrieved from https:\/\/www.microsoft.com\/en-us\/research\/publication\/toga-a-neural-method-for-test-oracle-generation\/"},{"issue":"4","key":"e_1_3_2_55_2","doi-asserted-by":"crossref","first-page":"469","DOI":"10.1007\/s00766-020-00336-y","article-title":"Requirements engineering for sustainability: An awareness framework for designing software systems for a better tomorrow","volume":"25","author":"Duboc Leticia","year":"2020","unstructured":"Leticia Duboc, Birgit Penzenstadler, Jari Porras, Sedef Akinli Kocak, Stefanie Betz, Ruzanna Chitchyan, Ola Leifler, Norbert Seyff, and Colin C. Venters. 2020. Requirements engineering for sustainability: An awareness framework for designing software systems for a better tomorrow. Requirements Engineering 25, 4 (2020), 469\u2013492.","journal-title":"Requirements Engineering"},{"key":"e_1_3_2_56_2","doi-asserted-by":"crossref","first-page":"530","DOI":"10.1145\/3377811.3380364","volume-title":"Proceedings of the ACM\/IEEE 42nd International Conference on Software Engineering (ICSE \u201920)","author":"Durieux Thomas","year":"2020","unstructured":"Thomas Durieux, Jo\u00e3o F. Ferreira, Rui Abreu, and Pedro Cruz. 2020. Empirical review of automated analysis tools on 47,587 ethereum smart contracts. In Proceedings of the ACM\/IEEE 42nd International Conference on Software Engineering (ICSE \u201920). ACM, New York, NY, 530\u2013541. DOI: 10.1145\/3377811.3380364"},{"key":"e_1_3_2_57_2","unstructured":"Nelson Elhage Tristan Hume Catherine Olsson Nicholas Schiefer Tom Henighan Shauna Kravec Zac Hatfield-Dodds Robert Lasenby Dawn Drain Carol Chen et al. 2022. Toy models of superposition. arXiv:2209.10652. Retrieved from https:\/\/arxiv.org\/abs\/2209.10652"},{"key":"e_1_3_2_58_2","volume-title":"Proceedings of the IEEE\/ACM 45th International Conference on Software Engineering (ICSE)","author":"Fan Zhiyu","year":"2023","unstructured":"Zhiyu Fan, Xiang Gao, Martin Mirchev, Abhik Roychoudhury, and Shin Hwei Tan. 2023. Automated repair of programs from large language models. In Proceedings of the IEEE\/ACM 45th International Conference on Software Engineering (ICSE)."},{"issue":"2","key":"e_1_3_2_59_2","doi-asserted-by":"crossref","first-page":"136","DOI":"10.1002\/sdr.4260030205","article-title":"Lessons from system dynamics modeling","volume":"3","author":"Forrester Jay W.","year":"1987","unstructured":"Jay W. Forrester. 1987. Lessons from system dynamics modeling. System Dynamics Review 3, 2 (1987), 136\u2013149.","journal-title":"System Dynamics Review"},{"key":"e_1_3_2_60_2","first-page":"416","volume-title":"Proceedings of the 19th ACM SIGSOFT Symposium and the 13th European Conference on Foundations of Software Engineering (ESEC\/FSE \u201911)","author":"Fraser Gordon","year":"2011","unstructured":"Gordon Fraser and Andrea Arcuri. 2011. EvoSuite: Automatic test suite generation for object-oriented software. In Proceedings of the 19th ACM SIGSOFT Symposium and the 13th European Conference on Foundations of Software Engineering (ESEC\/FSE \u201911). ACM, New York, NY, 416\u2013419. DOI: 10.1145\/2025113.2025179"},{"key":"e_1_3_2_61_2","doi-asserted-by":"crossref","unstructured":"Gordon Fraser and Andrea Arcuri. 2013. Whole test suite generation. 39 2 (2013) 276\u2013291.","DOI":"10.1109\/TSE.2012.14"},{"key":"e_1_3_2_62_2","doi-asserted-by":"crossref","first-page":"1811","DOI":"10.1145\/3650212.3685299","volume-title":"Proceedings of the 33rd ACM SIGSOFT International Symposium on Software Testing and Analysis (ISSTA \u201924)","author":"Gambi Alessio","year":"2024","unstructured":"Alessio Gambi, Shreya Mathews, Benedikt Steininger, Mykhailo Poienko, and David Bobek. 2024. The flexcrash platform for testing autonomous vehicles in mixed-traffic scenarios. In Proceedings of the 33rd ACM SIGSOFT International Symposium on Software Testing and Analysis (ISSTA \u201924). Maria Christakis and Michael Pradel (Eds.), ACM, 1811\u20131815. DOI: 10.1145\/3650212.3685299"},{"key":"e_1_3_2_63_2","article-title":"The current challenges of software engineering in the era of large language models","author":"Gao Cuiyun","year":"2025","unstructured":"Cuiyun Gao, Xing Hu, Shan Gao, Xin Xia, and Zhi Jin. 2025. The current challenges of software engineering in the era of large language models. ACM Transaction on Software Engineering and Methodology 2030 Roadmap Special Issue.","journal-title":"ACM Transaction on Software Engineering and Methodology"},{"key":"e_1_3_2_64_2","first-page":"761","volume-title":"Proceedings of the 2023 38th IEEE\/ACM International Conference on Automated Software Engineering (ASE)","author":"Gao S.","year":"2023","unstructured":"S. Gao, X. Wen, C. Gao, W. Wang, H. Zhang, and M. R. Lyu. 2023. What makes good in-context demonstrations for code intelligence tasks with LLMs? In Proceedings of the 2023 38th IEEE\/ACM International Conference on Automated Software Engineering (ASE). IEEE Computer Society, Los Alamitos, CA, USA, 761\u2013773. DOI: 10.1109\/ASE56229.2023.00109"},{"issue":"12","key":"e_1_3_2_65_2","doi-asserted-by":"crossref","first-page":"1236","DOI":"10.1109\/TSE.2015.2454513","article-title":"The ManyBugs and IntroClass benchmarks for automated repair of C programs","volume":"41","author":"Le Goues Claire","year":"2015","unstructured":"Claire Le Goues, Neal Holtschulte, Edward K. Smith, Yuriy Brun, Premkumar Devanbu, Stephanie Forrest, and Westley Weimer. 2015. The ManyBugs and IntroClass benchmarks for automated repair of C programs. IEEE Transactions on Software Engineering 41, 12 (2015), 1236\u20131256.","journal-title":"IEEE Transactions on Software Engineering"},{"issue":"12","key":"e_1_3_2_66_2","doi-asserted-by":"crossref","first-page":"56","DOI":"10.1145\/3318162","article-title":"Automated program repair","volume":"62","author":"Le Goues Claire","year":"2019","unstructured":"Claire Le Goues, Michael Pradel, and Abhik Roychoudhury. 2019. Automated program repair. Communications of the ACM 62, 12 (2019), 56\u201365.","journal-title":"Communications of the ACM"},{"key":"e_1_3_2_67_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-38756-7_4"},{"key":"e_1_3_2_68_2","doi-asserted-by":"crossref","first-page":"746","DOI":"10.1145\/3324884.3416546","volume-title":"Proceedings of the 35th IEEE\/ACM International Conference on Automated Software Engineering","author":"Gros David","year":"2020","unstructured":"David Gros, Hariharan Sezhiyan, Prem Devanbu, and Zhou Yu. 2020. Code to comment \u201ctranslation\u201d data, metrics, baselining & evaluation. In Proceedings of the 35th IEEE\/ACM International Conference on Automated Software Engineering, 746\u2013757."},{"key":"e_1_3_2_69_2","first-page":"1296","volume-title":"Proceedings of the 28th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC\/FSE)","author":"Gu Jiazhen","year":"2020","unstructured":"Jiazhen Gu, Jiaqi Wen, Zijian Wang, Pu Zhao, Chuan Luo, Yu Kang, Yangfan Zhou, Li Yang, Jeffrey Sun, Zhangwei Xu, et al. 2020. Efficient customer incident triage via linking with system incidents. In Proceedings of the 28th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC\/FSE), 1296\u20131307."},{"key":"e_1_3_2_70_2","doi-asserted-by":"crossref","first-page":"402","DOI":"10.1016\/j.future.2024.01.033","article-title":"Development and evaluation of a reference measurement model for assessing the resource and energy efficiency of software products and components\u2014Green software measurement model (GSMM)","volume":"155","author":"Guldner Achim","year":"2024","unstructured":"Achim Guldner, Rabea Bender, Coral Calero, Giovanni S. Fernando, Markus Funke, Jens Gr\u00f6ger, Lorenz M. Hilty, Julian H\u00f6rnschemeyer, Geerd-Dietger Hoffmann, Dennis Junger, et al. 2024. Development and evaluation of a reference measurement model for assessing the resource and energy efficiency of software products and components\u2014Green software measurement model (GSMM). Future Generation Computer Systems 155 (2024), 402\u2013418.","journal-title":"Future Generation Computer Systems"},{"key":"e_1_3_2_71_2","unstructured":"Guoxiang Guo Aldeida Aleti Neelofar Neelofar and Chakkrit Tantithamthavorn. 2024. MORTAR: Metamorphic multi-turn testing for LLM-based dialogue systems. arXiv:2412.15557. Retrieved from https:\/\/arxiv.org\/abs\/2412.15557"},{"key":"e_1_3_2_72_2","first-page":"288","volume-title":"Proceedings of the 2024 IEEE\/ACM 46th International Conference on Software Engineering: Companion Proceedings (ICSE-Companion)","author":"Haldar Susmita","year":"2024","unstructured":"Susmita Haldar and Luiz Fernando Capretz. 2024. Interpretable software maintenance and support effort prediction using machine learning. In Proceedings of the 2024 IEEE\/ACM 46th International Conference on Software Engineering: Companion Proceedings (ICSE-Companion). IEEE Computer Society, Los Alamitos, CA, USA, 288\u2013289. DOI: 10.1145\/3639478.3643069"},{"key":"e_1_3_2_73_2","doi-asserted-by":"crossref","first-page":"94","DOI":"10.1016\/j.eap.2021.02.001","article-title":"Where do we stand on the 17 sustainable development goals? An overview on progress","volume":"70","author":"Halkos George","year":"2021","unstructured":"George Halkos and Eleni-Christina Gkampoura. 2021. Where do we stand on the 17 sustainable development goals? An overview on progress. Economic Analysis and Policy 70 (2021), 94\u2013122.","journal-title":"Economic Analysis and Policy"},{"key":"e_1_3_2_74_2","article-title":"LLM-based multi-agent systems for software engineering: Literature review, vision and the road ahead","author":"He Junda","year":"2025","unstructured":"Junda He, Christoph Treude, and David Lo. 2025. LLM-based multi-agent systems for software engineering: Literature review, vision and the road ahead. ACM Transaction on Software Engineering and Methodology 2030 Roadmap Special Issue, 1049-331X.","journal-title":"ACM Transaction on Software Engineering and Methodology"},{"key":"e_1_3_2_75_2","first-page":"1465","volume-title":"Proceedings of the 30th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering","author":"He Shilin","year":"2022","unstructured":"Shilin He, Xu Zhang, Pinjia He, Yong Xu, Liqun Li, Yu Kang, Minghua Ma, Yining Wei, Yingnong Dang, Saravanakumar Rajmohan, et al. 2022. An empirical study of log analysis at Microsoft. In Proceedings of the 30th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering, 1465\u20131476."},{"key":"e_1_3_2_76_2","first-page":"11","volume-title":"Proceedings of the 41st International Conference on Machine Learning (ICML\u201924)","author":"Hooda Ashish","year":"2024","unstructured":"Ashish Hooda, Mihai Christodorescu, Miltiadis Allamanis, Aaron Wilson, Kassem Fawaz, and Somesh Jha. 2024. Do large code models understand programming concepts? Counterfactual analysis for code predicates. In Proceedings of the 41st International Conference on Machine Learning (ICML\u201924). Article 753, 11 pages."},{"key":"e_1_3_2_77_2","unstructured":"Soneya Binta Hossain and Matthew Dwyer. 2024. TOGLL: Correct and strong test oracle generation with LLMs. arXiv:2405.03786. Retrieved from https:\/\/arxiv.org\/abs\/2405.03786"},{"key":"e_1_3_2_78_2","unstructured":"Hui Huang Yingqi Qu Hongli Zhou Jing Liu Muyun Yang Bing Xu and Tiejun Zhao. 2024. On the limitations of fine-tuned judge models for LLM evaluation. arXiv:2403.02839. Retrieved from https:\/\/arxiv.org\/abs\/2403.02839"},{"key":"e_1_3_2_79_2","article-title":"Bridging gaps, building futures: Advancing software developer diversity and inclusion through future-oriented research","author":"Hyrynsalmi Sonja","year":"2025","unstructured":"Sonja Hyrynsalmi, Sebastian Baltes, Chris Brown, Rafael Prikladnicki, Perez Gema Rodriguez, Alexander Serebrenik, Jocelyn Simmonds, Bianca Trinkenreich, and Yi Wang. 2025. Bridging gaps, building futures: Advancing software developer diversity and inclusion through future-oriented research. ACM Transaction on Software Engineering and Methodology 2030 Roadmap Special Issue, 1049-331X.","journal-title":"ACM Transaction on Software Engineering and Methodology"},{"key":"e_1_3_2_80_2","article-title":"The impact of generative AI on creativity in software development: A research agenda","author":"Jackson Victoria","year":"2025","unstructured":"Victoria Jackson, Bogdan Vasilescu, Daniel Russo, Paul Ralph, Rafael Prikladnicki, Maliheh Izadi, Sarah D\u2019Angelo, Sarah Inman, Anielle Lisboa, and Andr\u00e9 van der Hoek. 2025. The impact of generative AI on creativity in software development: A research agenda. ACM Transaction on Software Engineering and Methodology 2030 Roadmap Special Issue, 1049-331X.","journal-title":"ACM Transaction on Software Engineering and Methodology"},{"key":"e_1_3_2_81_2","first-page":"61","volume-title":"Proceedings of the 2023 IEEE\/ACM International Workshop on Search-Based and Fuzz Testing (SBFT)","author":"Jahangirova Gunel","year":"2023","unstructured":"Gunel Jahangirova and Valerio Terragni. 2023. SBFT tool competition 2023 \u2013 Java test case generation track. In Proceedings of the 2023 IEEE\/ACM International Workshop on Search-Based and Fuzz Testing (SBFT), 61\u201364. DOI: 10.1109\/SBFT59156.2023.00025"},{"issue":"1","key":"e_1_3_2_82_2","doi-asserted-by":"crossref","first-page":"579","DOI":"10.1038\/s41467-020-20729-5","article-title":"A co-design framework of neural networks and quantum circuits towards quantum advantage","volume":"12","author":"Jiang Weiwen","year":"2021","unstructured":"Weiwen Jiang, Jinjun Xiong, and Yiyu Shi. 2021. A co-design framework of neural networks and quantum circuits towards quantum advantage. Nature Communications 12, 1 (2021), 579.","journal-title":"Nature Communications"},{"key":"e_1_3_2_83_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2020.2982385"},{"key":"e_1_3_2_84_2","unstructured":"Carlos E. Jimenez John Yang Alexander Wettig Shunyu Yao Kexin Pei Ofir Press and Karthik Narasimhan. 2023. Swe-bench: Can language models resolve real-world github issues? arXiv:2310.06770. Retrieved from https:\/\/arxiv.org\/abs\/2310.06770"},{"key":"e_1_3_2_85_2","doi-asserted-by":"crossref","first-page":"437","DOI":"10.1145\/2610384.2628055","volume-title":"Proceedings of the 2014 International Symposium on Software Testing and Analysis (ISSTA \u201914)","author":"Just Ren\u00e9","year":"2014","unstructured":"Ren\u00e9 Just, Darioush Jalali, and Michael D. Ernst. 2014. Defects4J: A database of existing faults to enable controlled testing studies for java programs. In Proceedings of the 2014 International Symposium on Software Testing and Analysis (ISSTA \u201914), 437\u2013440."},{"key":"e_1_3_2_86_2","first-page":"5110","volume-title":"Proceedings of the International Conference on Machine Learning","author":"Kanade Aditya","year":"2020","unstructured":"Aditya Kanade, Petros Maniatis, Gogul Balakrishnan, and Kensen Shi. 2020. Learning and evaluating contextual embedding of source code. In Proceedings of the International Conference on Machine Learning. PMLR, 5110\u20135121."},{"key":"e_1_3_2_87_2","doi-asserted-by":"crossref","first-page":"62","DOI":"10.1109\/MetroCAD51599.2021.00018","volume-title":"Proceedings of the 2021 4th International Conference on Connected and Autonomous Driving (MetroCAD)","author":"Kaur Prabhjot","year":"2021","unstructured":"Prabhjot Kaur, Samira Taghavi, Zhaofeng Tian, and Weisong Shi. 2021. A survey on simulators for testing self-driving cars. In Proceedings of the 2021 4th International Conference on Connected and Autonomous Driving (MetroCAD), 62\u201370. DOI: 10.1109\/MetroCAD51599.2021.00018"},{"key":"e_1_3_2_88_2","doi-asserted-by":"publisher","DOI":"10.1109\/MC.2003.1160055"},{"key":"e_1_3_2_89_2","article-title":"Morescient GAI for software engineering","author":"Kessel Marcus","year":"2025","unstructured":"Marcus Kessel and Colin Atkinson. 2025. Morescient GAI for software engineering. ACM Transaction on Software Engineering and Methodology 2030 Roadmap Special Issue.","journal-title":"ACM Transaction on Software Engineering and Methodology 2030 Roadmap Special Issue"},{"key":"e_1_3_2_90_2","doi-asserted-by":"publisher","DOI":"10.3390\/technologies6040100"},{"issue":"6","key":"e_1_3_2_91_2","doi-asserted-by":"crossref","first-page":"139","DOI":"10.1007\/s10664-024-10533-w","article-title":"Impact of log parsing on deep learning-based anomaly detection","volume":"29","author":"Khan Zanis Ali","year":"2024","unstructured":"Zanis Ali Khan, Donghwan Shin, Domenico Bianculli, and Lionel C. Briand. 2024. Impact of log parsing on deep learning-based anomaly detection. Empirical Software Engineering 29, 6 (2024), 139.","journal-title":"Empirical Software Engineering"},{"key":"e_1_3_2_92_2","unstructured":"Dipin Khati Yijin Liu David N. Palacio Yixuan Zhang and Denys Poshyvanyk. 2025. Mapping the trust terrain: LLMs in software engineering \u2013 Insights and perspectives. arXiv:2503.13793. Retrieved from https:\/\/arxiv.org\/abs\/2503.13793"},{"key":"e_1_3_2_93_2","unstructured":"Fatemeh Khayashi Behnaz Jamasb Reza Akbari and Pirooz Shamsinejadbabaki. 2022. Deep learning methods for software requirement classification: A performance study on the PURE dataset. arXiv:2211.05286. Retrieved from https:\/\/arxiv.org\/abs\/2211.05286"},{"issue":"3","key":"e_1_3_2_94_2","doi-asserted-by":"crossref","first-page":"80","DOI":"10.1145\/3371906","article-title":"Toward model-driven sustainability evaluation","volume":"63","author":"Kienzle J\u00f6rg","year":"2020","unstructured":"J\u00f6rg Kienzle, Gunter Mussbacher, Benoit Combemale, Lucy Bastin, Nelly Bencomo, Jean-Michel Bruel, Christoph Becker, Stefanie Betz, Ruzanna Chitchyan, Betty H. C. Cheng, et al. 2020. Toward model-driven sustainability evaluation. Communications of the ACM 63, 3 (2020), 80\u201391.","journal-title":"Communications of the ACM"},{"key":"e_1_3_2_95_2","unstructured":"Michael Konstantinou Renzo Degiovanni and Mike Papadakis. 2024. Do LLMs generate test oracles that capture the actual or the expected program behaviour? arXiv:2410.21136. Retrieved from https:\/\/arxiv.org\/abs\/2410.21136"},{"issue":"1","key":"e_1_3_2_96_2","doi-asserted-by":"crossref","first-page":"64","DOI":"10.14512\/gaia.32.S1.10","article-title":"More sustainable artificial intelligence systems through stakeholder involvement?","volume":"32","author":"Kunkel Stefanie","year":"2023","unstructured":"Stefanie Kunkel, Frieder Schmelzle, Silke Niehoff, and Grischa Beier. 2023. More sustainable artificial intelligence systems through stakeholder involvement? GAIA-Ecological Perspectives for Science and Society 32, 1 (2023), 64\u201370.","journal-title":"GAIA-Ecological Perspectives for Science and Society"},{"key":"e_1_3_2_97_2","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2021.3086230"},{"key":"e_1_3_2_98_2","article-title":"Sustainable software engineering: Concepts, challenges, and vision","author":"K\u00f6nig Christoph","year":"2025","unstructured":"Christoph K\u00f6nig, Daniel Lang, and Ina Schaefer. 2025. Sustainable software engineering: Concepts, challenges, and vision. ACM Transaction on Software Engineering and Methodology 2030 Roadmap Special Issue.","journal-title":"ACM Transaction on Software Engineering and Methodology"},{"key":"e_1_3_2_99_2","unstructured":"Patricia Lago Nelly Condori Fernandez Iffat Fatima Markus Funke and Ivano Malavolta. 2024. The sustainability assessment framework toolkit: A decade of modeling experience. arXiv:2405.01391. Retrieved from https:\/\/arxiv.org\/abs\/2405.01391"},{"issue":"10","key":"e_1_3_2_100_2","doi-asserted-by":"crossref","first-page":"70","DOI":"10.1145\/2714560","article-title":"Framing sustainability as a property of software quality","volume":"58","author":"Lago Patricia","year":"2015","unstructured":"Patricia Lago, Sedef Akinli Ko\u00e7ak, Ivica Crnkovic, and Birgit Penzenstadler. 2015. Framing sustainability as a property of software quality. Communications of the ACM 58, 10 (2015), 70\u201378.","journal-title":"Communications of the ACM"},{"issue":"1","key":"e_1_3_2_101_2","doi-asserted-by":"crossref","first-page":"25","DOI":"10.1007\/s11625-011-0149-x","article-title":"Transdisciplinary research in sustainability science: Practice, principles, and challenges","volume":"7","author":"Lang Daniel J.","year":"2012","unstructured":"Daniel J. Lang, Arnim Wiek, Matthias Bergmann, Michael Stauffacher, Pim Martens, Peter Moll, Mark Swilling, and Christopher J. Thomas. 2012. Transdisciplinary research in sustainability science: Practice, principles, and challenges. Sustainability Science 7, S1 (2012), 25\u201343.","journal-title":"Sustainability Science"},{"key":"e_1_3_2_102_2","doi-asserted-by":"crossref","first-page":"184","DOI":"10.1145\/3387904.3389268","volume-title":"Proceedings of the 28th International Conference on Program Comprehension","author":"LeClair Alexander","year":"2020","unstructured":"Alexander LeClair, Sakib Haque, Lingfei Wu, and Collin McMillan. 2020. Improved code summarization via a graph neural network. In Proceedings of the 28th International Conference on Program Comprehension, 184\u2013195."},{"key":"e_1_3_2_103_2","doi-asserted-by":"crossref","first-page":"919","DOI":"10.1109\/ICSE48619.2023.00085","volume-title":"Proceedings of the 2023 IEEE\/ACM 45th International Conference on Software Engineering (ICSE)","author":"Lemieux Caroline","year":"2023","unstructured":"Caroline Lemieux, Jeevana Priya Inala, Shuvendu K. Lahiri, and Siddhartha Sen. 2023. CodaMosa: Escaping coverage plateaus in test generation with pre-trained large language models. In Proceedings of the 2023 IEEE\/ACM 45th International Conference on Software Engineering (ICSE), 919\u2013931. DOI: 10.1109\/ICSE48619.2023.00085"},{"key":"e_1_3_2_104_2","unstructured":"Vanessa Levesque. 2019. Sustainability Methods & Perspectives. Retrieved from https:\/\/pressbooks.pub\/sustainabilitymethods\/"},{"key":"e_1_3_2_105_2","unstructured":"Jian Li Yue Wang Michael R. Lyu and Irwin King. 2017. Code completion with neural attention and pointer networks. arXiv:1711.09573. Retrieved from https:\/\/arxiv.org\/abs\/1711.09573"},{"key":"e_1_3_2_106_2","first-page":"208","volume-title":"Proceedings of the 2020 IEEE International Conference on Software Maintenance and Evolution (ICSME)","author":"Li Mingyang","year":"2020","unstructured":"Mingyang Li, Ye Yang, Lin Shi, Qing Wang, Jun Hu, Xinhua Peng, Weimin Liao, and Guizhen Pi. 2020. Automated extraction of requirement entities by leveraging LSTM-CRF and transfer learning. In Proceedings of the 2020 IEEE International Conference on Software Maintenance and Evolution (ICSME). IEEE, 208\u2013219."},{"key":"e_1_3_2_107_2","article-title":"Metamorphic relation generation: State of the art and research directions","author":"Li Rui","year":"2025","unstructured":"Rui Li, Huai Liu, Pak-Lok Poon, Dave Towey, Chang Ai Sun, Zheng Zheng, Zhi Quan Zhou, and Tsong Chen. 2025. Metamorphic relation generation: State of the art and research directions. ACM Transaction on Software Engineering and Methodology 2030 Roadmap Special Issue (April 2025).","journal-title":"ACM Transaction on Software Engineering and Methodology"},{"key":"e_1_3_2_108_2","doi-asserted-by":"crossref","first-page":"115","DOI":"10.1109\/ICSME46990.2020.00021","volume-title":"Proceedings of the 2020 IEEE International Conference on Software Maintenance and Evolution (ICSME)","author":"Li Wei","year":"2020","unstructured":"Wei Li, Haozhe Qin, Shuhan Yan, Beijun Shen, and Yuting Chen. 2020. Learning code-query interaction for enhancing code searches. In Proceedings of the 2020 IEEE International Conference on Software Maintenance and Evolution (ICSME). IEEE, 115\u2013126."},{"key":"e_1_3_2_109_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.csi.2024.103942"},{"key":"e_1_3_2_110_2","doi-asserted-by":"publisher","DOI":"10.1109\/THFE2.1960.4503259"},{"key":"e_1_3_2_111_2","unstructured":"Chao Liu Xuanlin Bao Hongyu Zhang Neng Zhang Haibo Hu Xiaohong Zhang and Meng Yan. 2023. Improving ChatGPT prompt for code generation. arXiv:2305.08360. Retrieved from https:\/\/arxiv.org\/abs\/2305.08360"},{"key":"e_1_3_2_112_2","unstructured":"Jiawei Liu Chunqiu Steven Xia Yuyao Wang and Lingming Zhang. 2023. Is your code generated by ChatGPT really correct? Rigorous evaluation of large language models for code generation. arXiv:2305.01210. Retrieved from https:\/\/arxiv.org\/abs\/2305.01210"},{"key":"e_1_3_2_113_2","unstructured":"Yue Liu Chakkrit Tantithamthavorn Yonghui Liu and Li Li. 2024. On the reliability and explainability of language models for program generation. arXiv:2302.09587. Retrieved from https:\/\/arxiv.org\/abs\/2302.09587"},{"key":"e_1_3_2_114_2","unstructured":"Shuai Lu Daya Guo Shuo Ren Junjie Huang Alexey Svyatkovskiy Ambrosio Blanco Colin Clement Dawn Drain Daxin Jiang Duyu Tang et al. 2021. CodeXGLUE: A machine learning benchmark dataset for code understanding and generation. arXiv:2102.04664. Retrieved from https:\/\/arxiv.org\/abs\/2102.04664"},{"key":"e_1_3_2_115_2","unstructured":"Dipeeka Luitel Shabnam Hassani and Mehrdad Sabetzadeh. 2023. Improving requirements completeness: Automated assistance through large language models. arXiv:2308.03784. Retrieved from https:\/\/arxiv.org\/abs\/2308.03784"},{"key":"e_1_3_2_116_2","doi-asserted-by":"crossref","first-page":"168","DOI":"10.1145\/3510454.3516829","volume-title":"Proceedings of the ACM\/IEEE 44th International Conference on Software Engineering: Companion Proceedings (ICSE \u201922)","author":"Lukasczyk Stephan","year":"2022","unstructured":"Stephan Lukasczyk and Gordon Fraser. 2022. Pynguin: Automated unit test generation for python. In Proceedings of the ACM\/IEEE 44th International Conference on Software Engineering: Companion Proceedings (ICSE \u201922). ACM, New York, NY, 168\u2013172. DOI: 10.1145\/3510454.3516829"},{"key":"e_1_3_2_117_2","first-page":"4768","volume-title":"Proceedings of the 31st International Conference on Neural Information Processing Systems (NIPS\u201917)","author":"Lundberg Scott M.","year":"2017","unstructured":"Scott M. Lundberg and Su-In Lee. 2017. A unified approach to interpreting model predictions. In Proceedings of the 31st International Conference on Neural Information Processing Systems (NIPS\u201917). Curran Associates Inc., Red Hook, NY, USA, 4768\u20134777."},{"key":"e_1_3_2_118_2","article-title":"Automatic programming: Large language models and beyond","author":"Lyu Michael","year":"2025","unstructured":"Michael Lyu, Ray Baishakhi Ray, Abhik Roychoudhury, Shin Hwei Tan, and Patanamon Thongtanunam. 2025. Automatic programming: Large language models and beyond. ACM Transaction on Software Engineering and Methodology 2030 Roadmap Special Issue.","journal-title":"ACM Transaction on Software Engineering and Methodology"},{"key":"e_1_3_2_119_2","doi-asserted-by":"publisher","DOI":"10.3390\/machines9120342"},{"key":"e_1_3_2_120_2","unstructured":"Wei Ma Shangqing Liu Mengjie Zhao Xiaofei Xie Wenhan Wang Qiang Hu Jie Zhang and Yang Liu. 2024. Unveiling code pre-trained models: Investigating syntax and semantics capacities. arXiv:2212.10017. Retrieved from https:\/\/arxiv.org\/abs\/2212.10017"},{"key":"e_1_3_2_121_2","doi-asserted-by":"crossref","first-page":"304","DOI":"10.1109\/ICSE.2019.00045","volume-title":"Proceedings of the 2019 IEEE\/ACM 41st International Conference on Software Engineering (ICSE)","author":"Malik Rabee Sohail","year":"2019","unstructured":"Rabee Sohail Malik, Jibesh Patra, and Michael Pradel. 2019. NL2Type: Inferring JavaScript function types from natural language information. In Proceedings of the 2019 IEEE\/ACM 41st International Conference on Software Engineering (ICSE). IEEE, 304\u2013315."},{"key":"e_1_3_2_122_2","doi-asserted-by":"publisher","DOI":"10.1145\/362566.362568"},{"key":"e_1_3_2_123_2","unstructured":"Antonio Mastropaolo Nathan Cooper David Nader Palacio Simone Scalabrino Denys Poshyvanyk Rocco Oliveto and Gabriele Bavota. 2022. Using transfer learning for code-related tasks. arXiv:2206.08574. Retrieved from https:\/\/arxiv.org\/abs\/2206.08574"},{"key":"e_1_3_2_124_2","doi-asserted-by":"crossref","DOI":"10.1145\/3709360","article-title":"From triumph to uncertainty: The journey of software engineering in the AI era","author":"Mastropaolo Antonio","year":"2025","unstructured":"Antonio Mastropaolo, Camilo Escobar-Vel\u00e1squez, and Mario Linares-V\u00e1squez. 2025. From triumph to uncertainty: The journey of software engineering in the AI era. ACM Transaction on Software Engineering and Methodology 2030 Roadmap Special Issue.","journal-title":"ACM Transaction on Software Engineering and Methodology"},{"key":"e_1_3_2_125_2","doi-asserted-by":"publisher","DOI":"10.20944\/preprints202104.0526.v1"},{"key":"e_1_3_2_126_2","unstructured":"Donella H. Meadows Dennis L. Meadows J\u00f8rgen Randers and William W. Behrens III. 1972. The Limits to Growth - Club of Rome. Retrieved from https:\/\/policycommons.net\/artifacts\/1529440\/the-limits-to-growth\/2219251\/"},{"key":"e_1_3_2_127_2","volume-title":"Proceedings of the 31st Annual Network and Distributed System Security Symposium (NDSS).","author":"Meng Ruijie","year":"2024","unstructured":"Ruijie Meng, Martin Mirchev, Marcel B\u00f6hme, and Abhik Roychoudhury. 2024. Large language model guided protocol fuzzing. In Proceedings of the 31st Annual Network and Distributed System Security Symposium (NDSS)."},{"issue":"5","key":"e_1_3_2_128_2","first-page":"1","article-title":"A bibliometric analysis of sustainable development goals (SDGs): A review of progress, challenges, and opportunities","volume":"26","author":"Mishra Manoranjan","year":"2024","unstructured":"Manoranjan Mishra, Sudarsan Desul, Celso Augusto Guimar\u00e3es Santos, Shailendra Kumar Mishra, Abu Hena Mustafa Kamal, Shreerup Goswami, Ahmed Mukalazi Kalumba, Ramakrishna Biswal, Richarde Marques da Silva, Carlos Antonio Costa Dos Santos, et al. 2024. A bibliometric analysis of sustainable development goals (SDGs): A review of progress, challenges, and opportunities. Environment, Development and Sustainability 26, 5 (2024), 1\u201343.","journal-title":"Environment, Development and Sustainability"},{"key":"e_1_3_2_129_2","unstructured":"Ahmad Haji Mohammadkhani Chakkrit Tantithamthavorn and Hadi Hemmati. 2023. Explainable AI for pre-trained code models: What do they learn? When they do not work? arXiv:2211.12821. Retrieved from https:\/\/arxiv.org\/abs\/2211.12821"},{"key":"e_1_3_2_130_2","article-title":"Test oracle automation in the era of LLMs","author":"Molina Facundo","year":"2025","unstructured":"Facundo Molina, Alessandra Gorla, and Marcelo d\u2019Amorim. 2025. Test oracle automation in the era of LLMs. ACM Transaction on Software Engineering and Methodology 2030 Roadmap Special Issue.","journal-title":"ACM Transaction on Software Engineering and Methodology"},{"key":"e_1_3_2_131_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2018.2844788"},{"key":"e_1_3_2_132_2","article-title":"A roadmap for integrating sustainability into software engineering education","author":"Moreira Ana","year":"2025","unstructured":"Ana Moreira, Patricia Lago, Rogardt Heldal, Stefanie Betz, Ian Brooks, Rafael Capilla, Vlad Coroama, Leticia Duboc, Joao Fernandes, Ola Leifler, et al. 2025. A roadmap for integrating sustainability into software engineering education. ACM Transaction on Software Engineering and Methodology 2030 Roadmap Special Issue.","journal-title":"ACM Transaction on Software Engineering and Methodology"},{"key":"e_1_3_2_133_2","volume-title":"Proceedings of ESEC\/FSE Ideas, Visions and Reflections (ESEC\/FSE \u201921).","author":"El Moussa Noura","year":"2021","unstructured":"Noura El Moussa, Davide Molinelli, Mauro Pezz\u00e8, and Martin Tappler. 2021. Health of smart ecosystems. In Proceedings of ESEC\/FSE Ideas, Visions and Reflections (ESEC\/FSE \u201921). DOI: 10.1145\/3468264.3473137"},{"key":"e_1_3_2_134_2","doi-asserted-by":"crossref","unstructured":"Jose Juan M. Murillo Frank Johanna Barzen Shaukat Ali Tao Yue Paolo Arcaini Ignacio Garc\u00eda Ricardo P\u00e9rez Antonio Ruiz-Cort\u00e9s Antonio Brogi Jianjun Zhao Andriy Miranskyy et al. 2025. Challenges of quantum software engineering for the next decade: The road ahead. ACM Transactions on Software Engineering and Methodology (TOSEM). arXiv:2404.06825. Retrieved from https:\/\/arxiv.org\/abs\/2404.06825","DOI":"10.1145\/3712002"},{"key":"e_1_3_2_135_2","article-title":"Quantum software engineering: Roadmap and challenges ahead","author":"Murillo Juan Manuel","year":"2025","unstructured":"Juan Manuel Murillo, Jose Garcia-Alonso, Enrique Moguel, Johanna Barzen, Frank Leymann, Shaukat Ali, Tao Yue, Paolo Arcaini, Ricardo Perez-Castillo, Ignacio Garc\u00eda-Rodr\u00edguez de Guzm\u00e1n, et al. 2025. Quantum software engineering: Roadmap and challenges ahead. ACM Transaction on Software Engineering and Methodology 2030 Roadmap Special Issue, 1049-331X.","journal-title":"ACM Transaction on Software Engineering and Methodology"},{"key":"e_1_3_2_136_2","doi-asserted-by":"publisher","DOI":"10.1109\/tse.2024.3379943"},{"issue":"4","key":"e_1_3_2_137_2","first-page":"294","article-title":"The GREENSOFT model: A reference model for green and sustainable software and its engineering","volume":"1","author":"Naumann Stefan","year":"2011","unstructured":"Stefan Naumann, Markus Dick, Eva Kern, and Timo Johann. 2011. The GREENSOFT model: A reference model for green and sustainable software and its engineering. Sustainable Computing: Informatics and Systems 1, 4 (2011), 294\u2013304.","journal-title":"Sustainable Computing: Informatics and Systems"},{"key":"e_1_3_2_138_2","article-title":"Testing and debugging quantum programs: The road to 2030","author":"de Souza Higor A.","year":"2025","unstructured":"Higor A. de Souza, Neilson C. L. Ramalho, and Marcos L. Chaim. 2025. Testing and debugging quantum programs: The road to 2030. ACM Transactions on Software Engineering and Methodology (TOSEM) Issue TOSEM-2024-0251.","journal-title":"ACM Transactions on Software Engineering and Methodology (TOSEM)"},{"key":"e_1_3_2_139_2","doi-asserted-by":"crossref","first-page":"1372","DOI":"10.1145\/3377811.3380926","volume-title":"Proceedings of the ACM\/IEEE 42nd International Conference on Software Engineering","author":"Nguyen Son","year":"2020","unstructured":"Son Nguyen, Hung Phan, Trinh Le, and Tien N. Nguyen. 2020. Suggesting natural method names to check name consistencies. In Proceedings of the ACM\/IEEE 42nd International Conference on Software Engineering, 1372\u20131384."},{"key":"e_1_3_2_140_2","unstructured":"Curtis G. Northcutt Anish Athalye and Jonas Mueller. 2021. Pervasive label errors in test sets destabilize machine learning benchmarks. arXiv:2103.14749. Retrieved from https:\/\/arxiv.org\/abs\/2103.14749"},{"key":"e_1_3_2_141_2","first-page":"2464","volume-title":"Proceedings of the 39th IEEE\/ACM International Conference on Automated Software Engineering(ASE \u201924)","author":"Ouedraogo Wendkuuni C.","year":"2024","unstructured":"Wendkuuni C. Ouedraogo, Kader Kabore, Haoye Tian, Yewei Song, Anil Koyuncu, Jacques Klein, David Lo, and Tegawende F. Bissyande. 2024. LLMs and prompting for unit test generation: A large-scale evaluation. In Proceedings of the 39th IEEE\/ACM International Conference on Automated Software Engineering(ASE \u201924). ACM, New York, NY, 2464\u20132465. DOI: 10.1145\/3691620.3695330"},{"issue":"7","key":"e_1_3_2_142_2","doi-asserted-by":"crossref","first-page":"2296","DOI":"10.3390\/su10072296","article-title":"A catalogue supporting software sustainability design","volume":"10","author":"Oyedeji Shola","year":"2018","unstructured":"Shola Oyedeji, Ahmed Seffah, and Birgit Penzenstadler. 2018. A catalogue supporting software sustainability design. Sustainability 10, 7 (2018), 2296.","journal-title":"Sustainability"},{"key":"e_1_3_2_143_2","first-page":"815","volume-title":"Proceedings of the Companion to the 22nd ACM SIGPLAN Conference on Object-Oriented Programming Systems and Applications Companion (OOPSLA \u201907)","author":"Pacheco Carlos","year":"2007","unstructured":"Carlos Pacheco and Michael D. Ernst. 2007. Randoop: Feedback-directed random testing for java. In Proceedings of the Companion to the 22nd ACM SIGPLAN Conference on Object-Oriented Programming Systems and Applications Companion (OOPSLA \u201907). ACM, New York, NY, 815\u2013816. DOI: 10.1145\/1297846.1297902"},{"key":"e_1_3_2_144_2","unstructured":"David N. Palacio Daniel Rodriguez-Cardenas Alejandro Velasco Dipin Khati Kevin Moran and Denys Poshyvanyk. 2024. Towards more trustworthy and interpretable LLMs for code through syntax-grounded explanations. arXiv:2407.08983. Retrieved from https:\/\/arxiv.org\/abs\/2407.08983"},{"key":"e_1_3_2_145_2","unstructured":"David N. Palacio Alejandro Velasco Daniel Rodriguez-Cardenas Kevin Moran and Denys Poshyvanyk. 2023. Evaluating and explaining large language models for code using syntactic structures. arXiv:2308.03873. Retrieved from https:\/\/arxiv.org\/abs\/2308.03873"},{"key":"e_1_3_2_146_2","first-page":"1","volume-title":"Proceedings of the IEEE\/ACM 46th International Conference on Software Engineering","author":"Pan Rangeet","year":"2024","unstructured":"Rangeet Pan, Ali Reza Ibrahimzada, Rahul Krishna, Divya Sankar, Lambert Pouguem Wassi, Michele Merler, Boris Sobolev, Raju Pavuluri, Saurabh Sinha, and Reyhaneh Jabbarvand. 2024. Lost in translation: A study of bugs introduced by large language models while translating code. In Proceedings of the IEEE\/ACM 46th International Conference on Software Engineering, 1\u201313."},{"key":"e_1_3_2_147_2","doi-asserted-by":"publisher","DOI":"10.1038\/S42256-023-00720-7"},{"key":"e_1_3_2_148_2","first-page":"2339","volume-title":"Proceedings of the IEEE Symposium on Security and Privacy (SP)","author":"Pearce H.","year":"2023","unstructured":"H. Pearce, B. Tan, B. Ahmad, R. Karri, and B. Dolan-Gavitt. 2023. Examining zero-shot vulnerability repair with large language models. In Proceedings of the IEEE Symposium on Security and Privacy (SP), 2339\u20132356."},{"key":"e_1_3_2_149_2","doi-asserted-by":"crossref","first-page":"1183","DOI":"10.1145\/2480362.2480585","volume-title":"Proceedings of the 28th Annual ACM Symposium on Applied Computing","author":"Penzenstadler Birgit","year":"2013","unstructured":"Birgit Penzenstadler. 2013. Towards a definition of sustainability in and for software engineering. In Proceedings of the 28th Annual ACM Symposium on Applied Computing, 1183\u20131185."},{"key":"e_1_3_2_150_2","first-page":"44","volume-title":"Proceedings of the International Workshop on Requirements Engineering for Sustainable Systems (RE4SuSy@ RE)","author":"Penzenstadler Birgit","year":"2014","unstructured":"Birgit Penzenstadler. 2014. Infusing green: Requirements engineering for green In and through software systems. In Proceedings of the International Workshop on Requirements Engineering for Sustainable Systems (RE4SuSy@ RE), 44\u201353."},{"key":"e_1_3_2_151_2","doi-asserted-by":"crossref","first-page":"130","DOI":"10.1016\/j.infsof.2017.11.011","article-title":"Sustainability analysis and ease of learning in artifact-based requirements engineering: The newest member of the family of studies (it\u2019sa girl!)","volume":"95","author":"Penzenstadler Birgit","year":"2018","unstructured":"Birgit Penzenstadler. 2018. Sustainability analysis and ease of learning in artifact-based requirements engineering: The newest member of the family of studies (it\u2019sa girl!). Information and Software Technology 95 (2018), 130\u2013146.","journal-title":"Information and Software Technology"},{"key":"e_1_3_2_152_2","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1109\/BoKSS52540.2021.00010","volume-title":"Proceedings of the 2021 IEEE\/ACM International Workshop on Body of Knowledge for Software Sustainability (BoKSS)","author":"Penzenstadler Birgit","year":"2021","unstructured":"Birgit Penzenstadler, Stefanie Betz, Leticia Duboc, Norbert Seyff, Jari Porras, Shola Oyedeji, Ian Brooks, and Colin C. Venters. 2021. Iterative sustainability impact assessment: When to propose? In Proceedings of the 2021 IEEE\/ACM International Workshop on Body of Knowledge for Software Sustainability (BoKSS). IEEE, 5\u20136."},{"issue":"4","key":"e_1_3_2_153_2","doi-asserted-by":"crossref","first-page":"22","DOI":"10.1109\/MS.2018.110154908","article-title":"Software engineering for sustainability: Find the leverage points!","volume":"35","author":"Penzenstadler Birgit","year":"2018","unstructured":"Birgit Penzenstadler, Leticia Duboc, Colin C. Venters, Stefanie Betz, Norbert Seyff, Krzsztof Wnuk, Ruzanna Chitchyan, Steve M. Easterbrook, and Christoph Becker. 2018. Software engineering for sustainability: Find the leverage points! IEEE Software 35, 4 (2018), 22\u201333.","journal-title":"IEEE Software"},{"key":"e_1_3_2_154_2","doi-asserted-by":"crossref","first-page":"70","DOI":"10.1109\/GREENS.2013.6606424","volume-title":"Proceedings of the 2013 2nd International Workshop on Green and Sustainable Software (GREENS)","author":"Penzenstadler Birgit","year":"2013","unstructured":"Birgit Penzenstadler, Henning Femmer, and Debra Richardson. 2013. Who is the advocate? Stakeholders for sustainability. In Proceedings of the 2013 2nd International Workshop on Green and Sustainable Software (GREENS). IEEE, 70\u201377."},{"key":"e_1_3_2_155_2","doi-asserted-by":"crossref","first-page":"454","DOI":"10.1109\/CSEET.2011.5876124","volume-title":"Proceedings of the 2011 24th IEEE-CS Conference on Software Engineering Education and Training (CSEE&T)","author":"Penzenstadler Birgit","year":"2011","unstructured":"Birgit Penzenstadler and Andreas Fleischmann. 2011. Teach sustainability in software engineering? In Proceedings of the 2011 24th IEEE-CS Conference on Software Engineering Education and Training (CSEE&T). IEEE, 454\u2013458."},{"issue":"1","key":"e_1_3_2_156_2","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3639060","article-title":"Sustainability in computing education: A systematic literature review","volume":"24","author":"Peters Anne-Kathrin","year":"2024","unstructured":"Anne-Kathrin Peters, Rafael Capilla, Vlad Constantin Coroam\u0103, Rogardt Heldal, Patricia Lago, Ola Leifler, Ana Moreira, Joao Paulo Fernandes, Birgit Penzenstadler, Jari Porras, et al. 2024. Sustainability in computing education: A systematic literature review. ACM Transactions on Computing Education 24, 1 (2024), 1\u201353.","journal-title":"ACM Transactions on Computing Education"},{"key":"e_1_3_2_157_2","volume-title":"Software Testing and Analysis: Process, Principles and Techniques","author":"Pezz\u00e8 Mauro","year":"2007","unstructured":"Mauro Pezz\u00e8 and Michal Young. 2007. Software Testing and Analysis: Process, Principles and Techniques. Wiley."},{"key":"e_1_3_2_158_2","doi-asserted-by":"crossref","first-page":"698","DOI":"10.1016\/j.jclepro.2019.02.018","article-title":"How LCA contributes to the environmental assessment of higher order effects of ICT application: A review of different approaches","volume":"219","author":"Pohl Johanna","year":"2019","unstructured":"Johanna Pohl, Lorenz M. Hilty, and Matthias Finkbeiner. 2019. How LCA contributes to the environmental assessment of higher order effects of ICT application: A review of different approaches. Journal of Cleaner Production 219 (2019), 698\u2013712.","journal-title":"Journal of Cleaner Production"},{"key":"e_1_3_2_159_2","first-page":"407","volume-title":"Proceedings of the 2021 36th IEEE\/ACM International Conference on Automated Software Engineering (ASE)","author":"Pornprasit Chanathip","year":"2021","unstructured":"Chanathip Pornprasit, Chakkrit Tantithamthavorn, Jirayus Jiarpakdee, Michael Fu, and Patanamon Thongtanunam. 2021. PyExplainer: Explaining the predictions of just-in-time defect models. In Proceedings of the 2021 36th IEEE\/ACM International Conference on Automated Software Engineering (ASE), 407\u2013418. DOI: 10.1109\/ASE51524.2021.9678763"},{"key":"e_1_3_2_160_2","first-page":"10","volume-title":"Proceedings of the 12th International Conference Software Business (ICSOB \u201921)","author":"Porras Jari","year":"2021","unstructured":"Jari Porras, Colin C. Venters, Birgit Penzenstadler, Leticia Duboc, Stefanie Betz, Norbert Seyff, Saeid Heshmatisafa, and Shola Oyedeji. 2021. How could we have known? Anticipating sustainability effects of a software product. In Proceedings of the 12th International Conference Software Business (ICSOB \u201921). Springer, 10\u201317."},{"key":"e_1_3_2_161_2","article-title":"From today\u2019s code to tomorrow\u2019s symphony: The AI transformation of developer\u2019s routine by 2030","author":"Qiu Ketai","year":"2025","unstructured":"Ketai Qiu, Niccol\u00f2 Puccinelli, Matteo Ciniselli, and Luca Di Grazia. 2025. From today\u2019s code to tomorrow\u2019s symphony: The AI transformation of developer\u2019s routine by 2030. ACM Transaction on Software Engineering and Methodology 2030 Roadmap Special Issue.","journal-title":"ACM Transaction on Software Engineering and Methodology"},{"key":"e_1_3_2_162_2","doi-asserted-by":"publisher","DOI":"10.1007\/S10586-022-03658-4"},{"key":"e_1_3_2_163_2","article-title":"Testing and debugging quantum programs: The road to 2030","author":"Ramalho Neilson","year":"2025","unstructured":"Neilson Ramalho, Higor Amario de Souza, and Marcos Lordello Chaim. 2025. Testing and debugging quantum programs: The road to 2030. ACM Transaction on Software Engineering and Methodology 2030 Roadmap Special Issue.","journal-title":"ACM Transaction on Software Engineering and Methodology"},{"key":"e_1_3_2_164_2","article-title":"Foundation model engineering: Engineering foundation models just as engineering software","author":"Ran Dezhi","year":"2025","unstructured":"Dezhi Ran, Mengzhou Wu, Wei Yang, and Tao Xie. 2025. Foundation model engineering: Engineering foundation models just as engineering software. ACM Transaction on Software Engineering and Methodology 2030 Roadmap Special Issue, 1049-331X.","journal-title":"ACM Transaction on Software Engineering and Methodology"},{"key":"e_1_3_2_165_2","doi-asserted-by":"crossref","unstructured":"Marco Tulio Ribeiro Sameer Singh and Carlos Guestrin. 2016. \u201cWhy should I trust you?\u201d: Explaining the predictions of any classifier. arXiv:1602.04938. Retrieved from https:\/\/arxiv.org\/abs\/1602.04938","DOI":"10.18653\/v1\/N16-3020"},{"issue":"1","key":"e_1_3_2_166_2","doi-asserted-by":"crossref","first-page":"3923","DOI":"10.1038\/s41467-020-17419-7","article-title":"Improving the accuracy of medical diagnosis with causal machine learning","volume":"11","author":"Richens Jonathan G.","year":"2020","unstructured":"Jonathan G. Richens, Ciar\u00e1n M. Lee, and Saurabh Johri. 2020. Improving the accuracy of medical diagnosis with causal machine learning. Nature Communications 11, 1 (2020), 3923.","journal-title":"Nature Communications"},{"key":"e_1_3_2_167_2","doi-asserted-by":"crossref","DOI":"10.1145\/3708524","article-title":"Requirements are all you need: The final frontier for End-User software engineering","author":"Robinson Diana","year":"2025","unstructured":"Diana Robinson, Christian Cabrera, Andrew Gordon, Neil Lawrence, and Lars Mennen. 2025. Requirements are all you need: The final frontier for End-User software engineering. ACM Transaction on Software Engineering and Methodology 2030 Roadmap Special Issue.","journal-title":"ACM Transaction on Software Engineering and Methodology"},{"key":"e_1_3_2_168_2","first-page":"159","volume-title":"Proceedings of the 2024 IEEE\/ACM 46th International Conference on Software Engineering: Companion Proceedings (ICSE-Companion \u201924)","author":"Rodriguez-Cardenas Daniel","year":"2024","unstructured":"Daniel Rodriguez-Cardenas. 2024. Beyond accuracy and robustness metrics for large language models for code. In Proceedings of the 2024 IEEE\/ACM 46th International Conference on Software Engineering: Companion Proceedings (ICSE-Companion \u201924). ACM, New York, NY, 159\u2013161. DOI: 10.1145\/3639478.3639792"},{"key":"e_1_3_2_169_2","doi-asserted-by":"crossref","unstructured":"Daniel Rodriguez-Cardenas David N. Palacio Dipin Khati Henry Burke and Denys Poshyvanyk. 2023. Benchmarking causal study to interpret large language models for source code. arXiv:2308.12415. Retrieved from https:\/\/arxiv.org\/abs\/2308.12415","DOI":"10.1109\/ICSME58846.2023.00040"},{"key":"e_1_3_2_170_2","unstructured":"Abhik Roychoudhury Corina Pasareanu Michael Pradel and Baishakhi Ray. 2025. AI software engineer: Programming with trust. arXiv:2502.13767. Retrieved from https:\/\/arxiv.org\/abs\/2502.13767"},{"key":"e_1_3_2_171_2","doi-asserted-by":"publisher","DOI":"10.1016\/J.JSS.2024.112115"},{"issue":"9832","key":"e_1_3_2_172_2","doi-asserted-by":"crossref","first-page":"2206","DOI":"10.1016\/S0140-6736(12)60685-0","article-title":"From millennium development goals to sustainable development goals","volume":"379","author":"Sachs Jeffrey D.","year":"2012","unstructured":"Jeffrey D. Sachs. 2012. From millennium development goals to sustainable development goals. The Lancet 379, 9832 (2012), 2206\u20132211.","journal-title":"The Lancet"},{"issue":"9","key":"e_1_3_2_173_2","doi-asserted-by":"crossref","first-page":"805","DOI":"10.1038\/s41893-019-0352-9","article-title":"Six transformations to achieve the sustainable development goals","volume":"2","author":"Sachs Jeffrey D.","year":"2019","unstructured":"Jeffrey D. Sachs, Guido Schmidt-Traub, Mariana Mazzucato, Dirk Messner, Nebojsa Nakicenovic, and Johan Rockstr\u00f6m. 2019. Six transformations to achieve the sustainable development goals. Nature Sustainability 2, 9 (2019), 805\u2013814.","journal-title":"Nature Sustainability"},{"key":"e_1_3_2_174_2","unstructured":"Mozhgan Salimiparsa Surajsinh Parmar San Lee Choongmin Kim Yonghwan Kim and Jang Yong Kim. 2023. Investigating poor performance regions of black boxes: LIME-based exploration in sepsis detection. arXiv:2306.12507. Retrieved from https:\/\/arxiv.org\/abs\/2306.12507"},{"issue":"8","key":"e_1_3_2_175_2","first-page":"e2254","article-title":"Addressing sustainability in the requirements engineering process: From elicitation to functional decomposition","volume":"32","author":"Saputri Theresia Ratih Dewi","year":"2020","unstructured":"Theresia Ratih Dewi Saputri and Seok-Won Lee. 2020. Addressing sustainability in the requirements engineering process: From elicitation to functional decomposition. Journal of Software: Evolution and Process 32, 8 (2020), e2254.","journal-title":"Journal of Software: Evolution and Process"},{"key":"e_1_3_2_176_2","doi-asserted-by":"publisher","DOI":"10.1016\/J.ICTE.2024.05.007"},{"key":"e_1_3_2_177_2","volume-title":"Adaptive User Interfaces: Principles and Practice","author":"Schneider-Hufschmidt J.","year":"1993","unstructured":"J. Schneider-Hufschmidt, T. K\u00fchme, and U. Malinowski. 1993. Adaptive User Interfaces: Principles and Practice. North Holland, London."},{"key":"e_1_3_2_178_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10664-024-10469-1"},{"key":"e_1_3_2_179_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2023.3334955"},{"key":"e_1_3_2_180_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2016.2532875"},{"key":"e_1_3_2_181_2","first-page":"304","volume-title":"Proceedings of the 2018 IEEE 26th International Requirements Engineering Conference (RE)","author":"Seyff Norbert","year":"2018","unstructured":"Norbert Seyff, Stefanie Betz, Leticia Duboc, Colin Venters, Christoph Becker, Ruzanna Chitchyan, Birgit Penzenstadler, and Markus N\u00f6bauer. 2018. Tailoring requirements negotiation to sustainability. In Proceedings of the 2018 IEEE 26th International Requirements Engineering Conference (RE). IEEE, 304\u2013314."},{"key":"e_1_3_2_182_2","doi-asserted-by":"crossref","first-page":"201","DOI":"10.1109\/ASE.2015.86","volume-title":"Proceedings of the 2015 30th IEEE\/ACM International Conference on Automated Software Engineering (ASE)","author":"Shamshiri Sina","year":"2015","unstructured":"Sina Shamshiri, Ren\u00e9 Just, Jos\u00e9 Miguel Rojas, Gordon Fraser, Phil McMinn, and Andrea Arcuri. 2015. Do automatically generated unit tests find real faults? An empirical study of effectiveness and challenges (T). In Proceedings of the 2015 30th IEEE\/ACM International Conference on Automated Software Engineering (ASE), 201\u2013211. DOI: 10.1109\/ASE.2015.86"},{"key":"e_1_3_2_183_2","article-title":"Efficient and green large language models for software engineering: Vision and the road ahead","author":"Shi Jieke","year":"2025","unstructured":"Jieke Shi, Zhou Yang, and David Lo. 2025. Efficient and green large language models for software engineering: Vision and the road ahead. ACM Transaction on Software Engineering and Methodology 2030 Roadmap Special Issue (April 2025).","journal-title":"ACM Transaction on Software Engineering and Methodology"},{"key":"e_1_3_2_184_2","unstructured":"Seung Yeob Shin Fabrizio Pastore Domenico Bianculli and Alexandra Baicoianu. 2024. Towards generating executable metamorphic relations using large language models. arXiv:2401.17019. Retrieved from https:\/\/arxiv.org\/abs\/2401.17019"},{"key":"e_1_3_2_185_2","unstructured":"Trevor Stalnaker Nathan Wintersgill Oscar Chaparro Laura A. Heymann Massimiliano Di Penta Daniel M. German and Denys Poshyvanyk. 2024. Developer perspectives on licensing and copyright issues arising from generative AI for coding. arXiv:2411.10877. Retrieved from https:\/\/arxiv.org\/abs\/2411.10877"},{"key":"e_1_3_2_186_2","unstructured":"Trevor Stalnaker Nathan Wintersgill Oscar Chaparro Laura A. Heymann Massimiliano Di Penta Daniel M. German and Denys Poshyvanyk. 2025. The ML supply chain in the era of software 2.0: Lessons learned from hugging face. arXiv:2502.04484. Retrieved from https:\/\/arxiv.org\/abs\/2502.04484"},{"issue":"3","key":"e_1_3_2_187_2","doi-asserted-by":"crossref","first-page":"100048","DOI":"10.1016\/j.dim.2023.100048","article-title":"Human-AI interaction","volume":"7","author":"Sun Yongqiang","year":"2023","unstructured":"Yongqiang Sun, Xiao-Liang Shen, and Kem Z. K. Zhang. 2023. Human-AI interaction. Data and Information Management 7, 3 (2023), 100048. Retrieved from https:\/\/doi.org\/10.1016\/J.DIM.2023.100048","journal-title":"Data and Information Management"},{"issue":"3","key":"e_1_3_2_188_2","doi-asserted-by":"crossref","first-page":"213","DOI":"10.1080\/02604020310132","article-title":"A framework for sustainability","volume":"59","author":"Tainter Joseph","year":"2003","unstructured":"Joseph Tainter. 2003. A framework for sustainability. World Futures 59, 3\u20134 (2003), 213\u2013223.","journal-title":"World Futures"},{"key":"e_1_3_2_189_2","first-page":"275","volume-title":"Proceedings of the 14th International Conference on Knowledge Science, Engineering and Management (KSEM \u201921)","author":"Tang Gaigai","year":"2021","unstructured":"Gaigai Tang, Long Zhang, Feng Yang, Lianxiao Meng, Weipeng Cao, Meikang Qiu, Shuangyin Ren, Lin Yang, and Huiqiang Wang. 2021. Interpretation of learning-based automatic source code vulnerability detection model using LIME. In Proceedings of the 14th International Conference on Knowledge Science, Engineering and Management (KSEM \u201921). Springer-Verlag, Berlin, 275\u2013286. DOI: 10.1007\/978-3-030-82153-1_23"},{"key":"e_1_3_2_190_2","doi-asserted-by":"crossref","DOI":"10.1145\/3715003","article-title":"The future of AI-driven software engineering","author":"Terragni Valerio","year":"2025","unstructured":"Valerio Terragni, Annie Vella, Partha Roop, and Kelly Blincoe. 2025. Apri. The future of AI-driven software engineering. ACM Transaction on Software Engineering and Methodology 2030 Roadmap Special Issue.","journal-title":"ACM Transaction on Software Engineering and Methodology"},{"key":"e_1_3_2_191_2","first-page":"207","volume-title":"Proceedings of the 2019 IEEE 26th International Conference on Software Analysis, Evolution and Reengineering (SANER)","author":"Thaller Hannes","year":"2019","unstructured":"Hannes Thaller, Lukas Linsbauer, and Alexander Egyed. 2019. Feature maps: A comprehensible software representation for design pattern detection. In Proceedings of the 2019 IEEE 26th International Conference on Software Analysis, Evolution and Reengineering (SANER). IEEE, 207\u2013217. DOI: 10.1109\/SANER.2019.8667978"},{"key":"e_1_3_2_192_2","unstructured":"Haoye Tian Weiqi Lu Tsz On Li Xunzhu Tang Shing-Chi Cheung Jacques Klein and Tegawend\u00e9 F. Bissyand\u00e9. 2023. Is ChatGPT the ultimate programming assistant \u2013 How far is it? arXiv:2304.11938. Retrieved from https:\/\/arxiv.org\/abs\/2304.11938"},{"issue":"7","key":"e_1_3_2_193_2","doi-asserted-by":"crossref","first-page":"352","DOI":"10.3390\/systems11070352","article-title":"Agile methodology for the standardization of engineering requirements using large language models","volume":"11","author":"Ray Archana Tikayat","year":"2023","unstructured":"Archana Tikayat Ray, Bjorn F. Cole, Olivia J. Pinon Fischer, Anirudh Prabhakara Bhat, Ryan T. White, and Dimitri N. Mavris. 2023. Agile methodology for the standardization of engineering requirements using large language models. Systems 11, 7 (2023), 352.","journal-title":"Systems"},{"key":"e_1_3_2_194_2","doi-asserted-by":"crossref","unstructured":"Sergey Troshin and Nadezhda Chirkova. 2022. Probing pretrained models of source code. arXiv:2202.08975. Retrieved from https:\/\/arxiv.org\/abs\/2202.08975","DOI":"10.18653\/v1\/2022.blackboxnlp-1.31"},{"key":"e_1_3_2_195_2","first-page":"678","volume-title":"Proceedings of the 2023 IEEE International Conference on Software Analysis, Evolution and Reengineering (SANER)","author":"Tsigkanos Christos","year":"2023","unstructured":"Christos Tsigkanos, Pooja Rani, Sebastian M\u00fcller, and Timo Kehrer. 2023. Large language models: The next frontier for variable discovery within metamorphic testing? In Proceedings of the 2023 IEEE International Conference on Software Analysis, Evolution and Reengineering (SANER), 678\u2013682. DOI: 10.1109\/SANER56733.2023.00070"},{"key":"e_1_3_2_196_2","unstructured":"Lam Nguyen Tung Steven Cho Xiaoning Du Neelofar Neelofar Valerio Terragni Stefano Ruberto and Aldeida Aleti. 2024. Automated trustworthiness oracle generation for machine learning text classifiers. arXiv:2410.22663. Retrieved from https:\/\/arxiv.org\/abs\/2410.22663"},{"key":"e_1_3_2_197_2","doi-asserted-by":"crossref","unstructured":"Keyon Vafa Yuntian Deng David M. Blei and Alexander M. Rush. 2021. Rationales for sequential predictions. arXiv:2109.06387. Retrieved from https:\/\/arxiv.org\/abs\/2109.06387","DOI":"10.18653\/v1\/2021.emnlp-main.807"},{"issue":"3","key":"e_1_3_2_198_2","doi-asserted-by":"crossref","first-page":"213","DOI":"10.1007\/s43681-021-00043-6","article-title":"Sustainable AI: AI for sustainability and the sustainability of AI","volume":"1","author":"Van Wynsberghe Aimee","year":"2021","unstructured":"Aimee Van Wynsberghe. 2021. Sustainable AI: AI for sustainability and the sustainability of AI. AI and Ethics 1, 3 (2021), 213\u2013218.","journal-title":"AI and Ethics"},{"key":"e_1_3_2_199_2","unstructured":"Alejandro Velasco Aya Garryyeva David N. Palacio Antonio Mastropaolo and Denys Poshyvanyk. 2025. Toward neurosymbolic program comprehension. arXiv:2502.01806. Retrieved from https:\/\/arxiv.org\/abs\/2502.01806"},{"key":"e_1_3_2_200_2","first-page":"72","volume-title":"Proceedings of the 2024 ACM\/IEEE 44th International Conference on Software Engineering: New Ideas and Emerging Results (ICSE-NIER\u201924)","author":"Velasco Alejandro","year":"2024","unstructured":"Alejandro Velasco, David N. Palacio, Daniel Rodriguez-Cardenas, and Denys Poshyvanyk. 2024. Which syntactic capabilities are statistically learned by masked language models for code? In Proceedings of the 2024 ACM\/IEEE 44th International Conference on Software Engineering: New Ideas and Emerging Results (ICSE-NIER\u201924). ACM, New York, NY, 72\u201376. DOI: 10.1145\/3639476.3639768"},{"key":"e_1_3_2_201_2","unstructured":"Alejandro Velasco Daniel Rodriguez-Cardenas Luftar Rahman Alif David N. Palacio and Poshyvanyk Denys.2025. How propense are large language models at producing code smells? A benchmarking study. arXiv:2412.18989. Retrieved from https:\/\/arxiv.org\/abs\/2412.18989"},{"issue":"1","key":"e_1_3_2_202_2","first-page":"e8","article-title":"The blind men and the elephant: Towards an empirical evaluation framework for software sustainability","volume":"2","author":"Venters Colin","year":"2014","unstructured":"Colin Venters, L. M. S. Lau, Michael Griffiths, Violeta Holmes, Rupert Ward, Caroline Jay, Charlie Dibsdale, and Jie Xu. 2014. The blind men and the elephant: Towards an empirical evaluation framework for software sustainability. Journal of Open Research Software 2, 1 (2014), e8.","journal-title":"Journal of Open Research Software"},{"key":"e_1_3_2_203_2","first-page":"20","volume-title":"Red Herring, or Just an Odd Fish, Proceedings of the 2017 IEEE\/ACM 39th International Conference on Software Engineering: Software Engineering in Society Track","author":"Venters Colin C.","year":"2017","unstructured":"Colin C. Venters, Norbert Seyff, Christoph Becker, Stephanie Betz, Ruzanna Chitchyan, Leticia Duboc, Dan McIntyre, and Birgit Penzenstadler. 2017. Characterising sustainability requirements: A new species. Red Herring, or Just an Odd Fish, Proceedings of the 2017 IEEE\/ACM 39th International Conference on Software Engineering: Software Engineering in Society Track, 20\u201328."},{"key":"e_1_3_2_204_2","doi-asserted-by":"crossref","first-page":"174","DOI":"10.1016\/j.jss.2017.12.026","article-title":"Software sustainability: Research and practice from a software architecture viewpoint","volume":"138","author":"Venters Colin C.","year":"2018","unstructured":"Colin C. Venters, Rafael Capilla, Stefanie Betz, Birgit Penzenstadler, Tom Crick, Steve Crouch, Elisa Yumi Nakagawa, Christoph Becker, and Carlos Carrillo. 2018. Software sustainability: Research and practice from a software architecture viewpoint. Journal of Systems and Software 138 (2018), 174\u2013188.","journal-title":"Journal of Systems and Software"},{"key":"e_1_3_2_205_2","doi-asserted-by":"crossref","first-page":"107316","DOI":"10.1016\/j.infsof.2023.107316","article-title":"Sustainable software engineering: Reflections on advances in research and practice","volume":"164","author":"Venters Colin C.","year":"2023","unstructured":"Colin C. Venters, Rafael Capilla, Elisa Yumi Nakagawa, Stefanie Betz, Birgit Penzenstadler, Tom Crick, and Ian Brooks. 2023. Sustainable software engineering: Reflections on advances in research and practice. Information and Software Technology 164 (2023), 107316.","journal-title":"Information and Software Technology"},{"key":"e_1_3_2_206_2","first-page":"7","volume-title":"Proceedings of the CEUR Workshop","volume":"1216","author":"Venters Colin C.","year":"2014","unstructured":"Colin C. Venters, Caroline Jay, L. M. S. Lau, Michael K. Griffiths, Violeta Holmes, Rupert R. Ward, Jim Austin, Charlie E. Dibsdale, and Jie Xu. 2014. Software sustainability: The modern tower of Babel. In Proceedings of the CEUR Workshop 1216 (2014), 7\u201312."},{"key":"e_1_3_2_207_2","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1109\/BoKSS52540.2021.00009","volume-title":"Proceedings of the 2021 IEEE\/ACM International Workshop on Body of Knowledge for Software Sustainability (BoKSS)","author":"Venters Colin C.","year":"2021","unstructured":"Colin C. Venters, Sedef Akinli Kocak, Stefanie Betz, Ian Brooks, Rafael Capilla, Ruzanna Chitchyan, Let\u00edcia Duboc, Rogardt Heldal, Ana Moreira, Shola Oyedeji, et al. 2021. Software sustainability: Beyond the tower of babel. In Proceedings of the 2021 IEEE\/ACM International Workshop on Body of Knowledge for Software Sustainability (BoKSS). IEEE, 3\u20134."},{"key":"e_1_3_2_208_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2024.3368208"},{"issue":"1","key":"e_1_3_2_209_2","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1155\/2020\/8867757","article-title":"Safety of autonomous vehicles","volume":"2020","author":"Wang Jun","year":"2020","unstructured":"Jun Wang, Li Zhang, Yanjun Huang, Jian Zhao, and Francesco Bella. 2020. Safety of autonomous vehicles. Journal of Advanced Transportation 2020, 1 (2020), 1\u201313.","journal-title":"Journal of Advanced Transportation"},{"key":"e_1_3_2_210_2","article-title":"A roadmap for software testing in open-collaborative and AI-powered era","author":"Wang Qing","year":"2025","unstructured":"Qing Wang, Junjie Wang, Mingyang Li, and Yawen Wang. 2025. A roadmap for software testing in open-collaborative and AI-powered era. ACM Transaction on Software Engineering and Methodology 2030 Roadmap Special Issue.","journal-title":"ACM Transaction on Software Engineering and Methodology"},{"key":"e_1_3_2_211_2","unstructured":"Shiqi Wang Zheng Li Haifeng Qian Chenghao Yang Zijian Wang Mingyue Shang Varun Kumar Samson Tan Baishakhi Ray Parminder Bhatia et al. 2022. ReCode: Robustness evaluation of code generation models. arXiv:2212.10264. Retrieved from http:\/\/arxiv.org\/abs\/2212.10264"},{"key":"e_1_3_2_212_2","article-title":"Large language model supply chain: A research agenda","author":"Wang Shenao","year":"2025","unstructured":"Shenao Wang, Yanjie Zhao, Xinyi Hou, and Haoyu Wang. 2025. Large language model supply chain: A research agenda. ACM Transaction on Software Engineering and Methodology 2030 Roadmap Special Issue.","journal-title":"ACM Transaction on Software Engineering and Methodology"},{"key":"e_1_3_2_213_2","first-page":"40","volume-title":"Proceedings of the 2018 IEEE 26th International Requirements Engineering Conference (RE)","author":"Wang Wentao","year":"2018","unstructured":"Wentao Wang, Nan Niu, Hui Liu, and Zhendong Niu. 2018. Enhancing automated requirements traceability by resolving polysemy. In Proceedings of the 2018 IEEE 26th International Requirements Engineering Conference (RE). IEEE, 40\u201351. DOI: 10.1109\/RE.2018.00-53"},{"key":"e_1_3_2_214_2","unstructured":"Zeng Wang Minghao Shao Jitendra Bhandari Likhitha Mankali Ramesh Karri Ozgur Sinanoglu Muhammad Shafique and Johann Knechtel. 2025. VeriContaminated: Assessing LLM-driven verilog coding for data contamination. arXiv:2503.13572. Retrieved from https:\/\/arxiv.org\/abs\/2503.13572"},{"key":"e_1_3_2_215_2","doi-asserted-by":"publisher","DOI":"10.1145\/3485275"},{"key":"e_1_3_2_216_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2020.3023177"},{"key":"e_1_3_2_217_2","first-page":"87","volume-title":"Proceedings of the 31st IEEE\/ACM International Conference on Automated Software Engineering (ASE \u201916)","author":"White Martin","year":"2016","unstructured":"Martin White, Michele Tufano, Christopher Vendome, and Denys Poshyvanyk. 2016. Deep learning code fragments for code clone detection. In Proceedings of the 31st IEEE\/ACM International Conference on Automated Software Engineering (ASE \u201916). ACM, New York, NY, 87\u201398. DOI: 10.1145\/2970276.2970326"},{"key":"e_1_3_2_218_2","doi-asserted-by":"crossref","first-page":"334","DOI":"10.1109\/MSR.2015.38","volume-title":"Proceedings of the 2015 IEEE\/ACM 12th Working Conference on Mining Software Repositories","author":"White Martin","year":"2015","unstructured":"Martin White, Christopher Vendome, Mario Linares-Vasquez, and Denys Poshyvanyk. 2015. Toward deep learning software repositories. In Proceedings of the 2015 IEEE\/ACM 12th Working Conference on Mining Software Repositories, 334\u2013345. DOI: 10.1109\/MSR.2015.38"},{"key":"e_1_3_2_219_2","article-title":"Impediments for software test automation: A systematic literature review","volume":"27","author":"Wiklund Kristian","year":"2017","unstructured":"Kristian Wiklund, Sigrid Eldh, Daniel Sundmark, and Kristina Lundqvist. 2017. Impediments for software test automation: A systematic literature review. Software Testing 27 (2017). Retrieved from https:\/\/api.semanticscholar.org\/CorpusID:32631031","journal-title":"Software Testing"},{"key":"e_1_3_2_220_2","doi-asserted-by":"crossref","DOI":"10.1145\/3714464","article-title":"Research directions in software supply chain security","author":"Williams Laurie","year":"2025","unstructured":"Laurie Williams, Giacomo Benedetti, Sivana Hamer, Ranindya Paramitha, Imranur Rahman, Mahzabin Tamanna, Greg Tystahl, Nusrat Zahan, Patrick Morrison, Yasemin Acar, et al. 2025. Research directions in software supply chain security. ACM Transaction on Software Engineering and Methodology 2030 Roadmap Special Issue.","journal-title":"ACM Transaction on Software Engineering and Methodology"},{"key":"e_1_3_2_221_2","first-page":"120","volume-title":"Proceedings of the 2019 IEEE 27th International Requirements Engineering Conference (RE)","author":"Winkler Jonas Paul","year":"2019","unstructured":"Jonas Paul Winkler, Jannis Gr\u00f6nberg, and Andreas Vogelsang. 2019. Predicting how to test requirements: An automated approach. In Proceedings of the 2019 IEEE 27th International Requirements Engineering Conference (RE). IEEE, 120\u2013130. DOI: 10.1109\/RE.2019.00023"},{"key":"e_1_3_2_222_2","unstructured":"Fangzhou Wu Xiaogeng Liu and Chaowei Xiao. 2023. DeceptPrompt: Exploiting LLM-driven code generation via adversarial natural language instructions. arXiv:2312.04730. Retrieved from https:\/\/arxiv.org\/abs\/2312.04730"},{"key":"e_1_3_2_223_2","first-page":"1482","volume-title":"Proceedings of the 45th International Conference on Software Engineering (ICSE \u201923)","author":"Xia Chunqiu Steven","year":"2023","unstructured":"Chunqiu Steven Xia, Yuxiang Wei, and Lingming Zhang. 2023. Automated program repair in the era of large pre-trained language models. In Proceedings of the 45th International Conference on Software Engineering (ICSE \u201923). IEEE Press, 1482\u20131494. DOI: 10.1109\/ICSE48619.2023.00129"},{"key":"e_1_3_2_224_2","unstructured":"Chunqiu Steven Xia and Lingming Zhang. 2023. Conversational automated program repair. arXiv:2301.13246. Retrieved from https:\/\/arxiv.org\/abs\/2301.13246"},{"key":"e_1_3_2_225_2","first-page":"819","volume-title":"Proceedings of the 33rd ACM SIGSOFT International Symposium on Software Testing and Analysis (ISSTA 2024)","author":"Steven Xia Chunqiu","year":"2024","unstructured":"Chunqiu Steven Xia and Lingming Zhang. 2024. Automated program repair via conversation: Fixing 162 out of 337 bugs for 0.42 each using ChatGPT. In Proceedings of the 33rd ACM SIGSOFT International Symposium on Software Testing and Analysis (ISSTA 2024). ACM, New York, NY, 819\u2013831. DOI: 10.1145\/3650212.3680323"},{"key":"e_1_3_2_226_2","unstructured":"Mingxuan Xiao Yan Xiao Shunhui Ji Yunhe Li Lei Xue and Pengcheng Zhang. 2025. ABFS: Natural robustness testing for LLM-based NLP software. arXiv:2503.01319. Retrieved from https:\/\/arxiv.org\/abs\/2503.01319"},{"key":"e_1_3_2_227_2","first-page":"1","volume-title":"Proceedings of the 6th ACM SIGPLAN International Symposium on Machine Programming (MAPS 2022)","author":"Xu Frank F.","year":"2022","unstructured":"Frank F. Xu, Uri Alon, Graham Neubig, and Vincent Josua Hellendoorn. 2022. A systematic evaluation of large language models of code. In Proceedings of the 6th ACM SIGPLAN International Symposium on Machine Programming (MAPS 2022). ACM, New York, NY, 1\u201310. DOI: 10.1145\/3520312.3534862"},{"key":"e_1_3_2_228_2","unstructured":"Frank F. Xu Uri Alon Graham Neubig and Vincent J. Hellendoorn. 2022. A systematic evaluation of large language models of code. arXiv:2202.13169. Retrieved from http:\/\/arxiv.org\/abs\/2202.13169"},{"key":"e_1_3_2_229_2","volume-title":"Proceedings of the 13th International Conference on Learning Representations (ICLR)","author":"Xu Junjielong","year":"2025","unstructured":"Junjielong Xu, Qinan Zhang, Zhiqing Zhong, Shilin He, Chaoyun Zhang, Qingwei Lin, Dan Pei, Pinjia He, Dongmei Zhang, and Qi Zhang. 2025. OpenRCA: Can large language models locate the root cause of software failures? In Proceedings of the 13th International Conference on Learning Representations (ICLR)."},{"key":"e_1_3_2_230_2","unstructured":"Tingting Xu Yun Miao Chunrong Fang Hanwei Qian Xia Feng Zhenpeng Chen Chong Wang Jian Zhang Weisong Sun Zhenyu Chen et al. 2024. A prompt learning framework for source code summarization. arXiv:2312.16066. Retrieved from https:\/\/arxiv.org\/abs\/2312.16066"},{"key":"e_1_3_2_231_2","doi-asserted-by":"crossref","first-page":"882","DOI":"10.1145\/3650212.3680328","volume-title":"Proceedings of the 33rd ACM SIGSOFT International Symposium on Software Testing and Analysis (ISSTA 2024)","author":"Yang Boyang","year":"2024","unstructured":"Boyang Yang, Haoye Tian, Weiguo Pian, Haoran Yu, Haitao Wang, Jacques Klein, Tegawend\u00e9 F. Bissyand\u00e9, and Shunfu Jin. 2024. CREF: An LLM-based conversational software repair framework for programming tutors. In Proceedings of the 33rd ACM SIGSOFT International Symposium on Software Testing and Analysis (ISSTA 2024). ACM, New York, NY, 882\u2013894. DOI: 10.1145\/3650212.3680328"},{"key":"e_1_3_2_232_2","first-page":"940","volume-title":"Proceedings of the 2023 IEEE International Conference on Software Analysis, Evolution and Reengineering (SANER)","author":"Yang Fengyu","year":"2023","unstructured":"Fengyu Yang, Guangdong Zeng, Fa Zhong, Wei Zheng, and Peng Xiao. 2023. Interpretable software defect prediction incorporating multiple rules. In Proceedings of the 2023 IEEE International Conference on Software Analysis, Evolution and Reengineering (SANER). IEEE Computer Society, Los Alamitos, CA, USA, 940\u2013947. DOI: 10.1109\/SANER56733.2023.00114"},{"key":"e_1_3_2_233_2","first-page":"1607","volume-title":"Proceedings of the 39th IEEE\/ACM International Conference on Automated Software Engineering(ASE \u201924)","author":"Yang Lin","year":"2024","unstructured":"Lin Yang, Chen Yang, Shutao Gao, Weijing Wang, Bo Wang, Qihao Zhu, Xiao Chu, Jianyi Zhou, Guangtai Liang, Qianxiang Wang, and Junjie Chen. 2024. On the evaluation of large language models in unit test generation. In Proceedings of the 39th IEEE\/ACM International Conference on Automated Software Engineering(ASE \u201924). ACM, New York, NY, 1607\u20131619. DOI: 10.1145\/3691620.3695529"},{"key":"e_1_3_2_234_2","doi-asserted-by":"publisher","DOI":"10.1016\/J.JII.2024.100645"},{"issue":"10","key":"e_1_3_2_235_2","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3505243","article-title":"A survey on deep learning for software engineering","volume":"54","author":"Yang Yanming","year":"2022","unstructured":"Yanming Yang, Xin Xia, David Lo, and John Grundy. 2022. A survey on deep learning for software engineering. ACM Computing Surveys, 54, 10s (2022), 1\u201373.","journal-title":"ACM Computing Surveys"},{"key":"e_1_3_2_236_2","unstructured":"Sixiang Ye Zeyu Sun Guoqing Wang Liwei Guo Qingyuan Liang Zheng Li and Yong Liu. 2025. Prompt alchemy: Automatic prompt refinement for enhancing code generation. arXiv:2503.11085. Retrieved from https:\/\/arxiv.org\/abs\/2503.11085"},{"key":"e_1_3_2_237_2","doi-asserted-by":"crossref","first-page":"62","DOI":"10.1145\/3558489.3559072","volume-title":"Proceedings of the 18th International Conference on Predictive Models and Data Analytics in Software Engineering","author":"Yetistiren Burak","year":"2022","unstructured":"Burak Yetistiren, Isik Ozsoy, and Eray Tuzun. 2022. Assessing the quality of GitHub copilot\u2019s code generation. In Proceedings of the 18th International Conference on Predictive Models and Data Analytics in Software Engineering, 62\u201371."},{"key":"e_1_3_2_238_2","first-page":"1","volume-title":"Proceedings of the 46th IEEE\/ACM International Conference on Software Engineering (ICSE)","author":"Yu Boxi","year":"2024","unstructured":"Boxi Yu, Jiayi Yao, Qiuai Fu, Zhiqing Zhong, Haotian Xie, Yaoliang Wu, Yuchi Ma, and Pinjia He. 2024. Deep learning or classical machine learning? An empirical study on log-based anomaly detection. In Proceedings of the 46th IEEE\/ACM International Conference on Software Engineering (ICSE), 1\u201313."},{"key":"e_1_3_2_239_2","first-page":"1703","volume-title":"Proceedings of the ACM on Software Engineering","volume":"1","author":"Yuan Zhiqiang","year":"2024","unstructured":"Zhiqiang Yuan, Mingwei Liu, Shiji Ding, Kaixin Wang, Yixuan Chen, Xin Peng, and Yiling Lou. 2024. Evaluating and improving ChatGPT for unit test generation. Proceedings of the ACM on Software Engineering 1, FSE (2024), 1703\u20131726. DOI: 10.1145\/3660783"},{"key":"e_1_3_2_240_2","first-page":"1","volume-title":"Software Architecture: Research Roadmaps from the Community","author":"Yue Tao","year":"2023","unstructured":"Tao Yue, Wolfgang Mauerer, Shaukat Ali, and Davide Taibi. 2023. Challenges and opportunities in quantum software architecture. Software Architecture: Research Roadmaps from the Community, 1\u201323."},{"key":"e_1_3_2_241_2","unstructured":"Wojciech Zaremba and Greg Brockman. 2021. OpenAI Codex. Retrieved from https:\/\/openai.com\/blog\/openai-codex\/"},{"key":"e_1_3_2_242_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2019.2962027"},{"key":"e_1_3_2_243_2","doi-asserted-by":"crossref","unstructured":"Y. Zhang H. Ruan Z. Fan and A. Roychoudhury. 2024. AutoCodeRover: Autonomous program improvement. arXiv:2405.02213. Retrieved from https:\/\/arxiv.org\/abs\/2405.02213","DOI":"10.1145\/3650212.3680384"},{"key":"e_1_3_2_244_2","article-title":"LLM App Store Analysis: A Vision and Roadmap","author":"Zhao Yanjie","year":"2025","unstructured":"Yanjie Zhao, Xinyi Hou, Shenao Wang, and Haoyu Wang. 2025. LLM App Store Analysis: A Vision and Roadmap. ACM Transaction on Software Engineering and Methodology 2030 Roadmap Special Issue (April 2025).","journal-title":"ACM Transaction on Software Engineering and Methodology"},{"key":"e_1_3_2_245_2","first-page":"46595","article-title":"Judging LLM-as-a-judge with mt-bench and chatbot arena","volume":"36","author":"Zheng Lianmin","year":"2023","unstructured":"Lianmin Zheng, Wei-Lin Chiang, Ying Sheng, Siyuan Zhuang, Zhanghao Wu, Yonghao Zhuang, Zi Lin, Zhuohan Li, Dacheng Li, Eric Xing, et al. 2023. Judging LLM-as-a-judge with mt-bench and chatbot arena. Advances in Neural Information Processing Systems 36 (2023), 46595\u201346623.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_2_246_2","article-title":"Open-source AI-based SE tools: Opportunities and challenges of collaborative software learning","author":"Lin Tao","year":"2025","unstructured":"Tao Lin, Yaowen Zheng, Jingquan Ge, Jun Wang, Jacques Klein, Tegawende Bissyande, Yang Liu, Zhihao Lin, Wei Ma, and Li Li. 2025. Open-source AI-based SE tools: Opportunities and challenges of collaborative software learning. ACM Transaction on Software Engineering and Methodology 2030 Roadmap Special Issue.","journal-title":"ACM Transaction on Software Engineering and Methodology"},{"key":"e_1_3_2_247_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2018.2887384"},{"key":"e_1_3_2_248_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2018.2887384"}],"container-title":["ACM Transactions on Software Engineering and Methodology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3731559","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3731559","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T01:57:19Z","timestamp":1750298239000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3731559"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,5,26]]},"references-count":247,"journal-issue":{"issue":"5","published-print":{"date-parts":[[2025,6,30]]}},"alternative-id":["10.1145\/3731559"],"URL":"https:\/\/doi.org\/10.1145\/3731559","relation":{},"ISSN":["1049-331X","1557-7392"],"issn-type":[{"value":"1049-331X","type":"print"},{"value":"1557-7392","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,5,26]]},"assertion":[{"value":"2025-04-13","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-04-16","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-05-26","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}