{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,8]],"date-time":"2026-07-08T12:22:58Z","timestamp":1783513378614,"version":"3.55.0"},"publisher-location":"New York, NY, USA","reference-count":30,"publisher":"ACM","license":[{"start":{"date-parts":[[2026,4,12]],"date-time":"2026-04-12T00:00:00Z","timestamp":1775952000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/legalcode"}],"funder":[{"DOI":"10.13039\/100018694","name":"HORIZON EUROPE Marie Sklodowska-Curie Actions","doi-asserted-by":"publisher","award":["101151798"],"award-info":[{"award-number":["101151798"]}],"id":[{"id":"10.13039\/100018694","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100000923","name":"Australian Research Council","doi-asserted-by":"publisher","award":["DP21010004"],"award-info":[{"award-number":["DP21010004"]}],"id":[{"id":"10.13039\/501100000923","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2026,4,12]]},"DOI":"10.1145\/3786582.3786827","type":"proceedings-article","created":{"date-parts":[[2026,7,8]],"date-time":"2026-07-08T11:52:47Z","timestamp":1783511567000},"page":"141-145","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["Empirical and Sustainability Aspects of Software Engineering Research in the Era of Large Language Models: A Reflection"],"prefix":"10.1145","author":[{"ORCID":"https:\/\/orcid.org\/0009-0004-9828-2639","authenticated-orcid":false,"given":"David","family":"Williams","sequence":"first","affiliation":[{"name":"University College London, London, United Kingdom"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9092-3244","authenticated-orcid":false,"given":"Maria","family":"Kechagia","sequence":"additional","affiliation":[{"name":"National and Kapodistrian University of Athens, Athens, Greece"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8684-5909","authenticated-orcid":false,"given":"Max","family":"Hort","sequence":"additional","affiliation":[{"name":"Simula Research Laboratory, Oslo, Norway"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1716-690X","authenticated-orcid":false,"given":"Aldeida","family":"Aleti","sequence":"additional","affiliation":[{"name":"Monash University, Melbourne, Australia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7833-6044","authenticated-orcid":false,"given":"Justyna","family":"Petke","sequence":"additional","affiliation":[{"name":"University College London, London, United Kingdom"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9146-442X","authenticated-orcid":false,"given":"Federica","family":"Sarro","sequence":"additional","affiliation":[{"name":"University College London, London, United Kingdom"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2026,7,8]]},"reference":[{"key":"e_1_3_3_1_2_2","doi-asserted-by":"publisher","DOI":"10.1145\/3597503.3639183"},{"key":"e_1_3_3_1_3_2","doi-asserted-by":"publisher","DOI":"10.1145\/3597503.3639133"},{"key":"e_1_3_3_1_4_2","unstructured":"Sebastian Baltes Florian Angermeir Chetan Arora Marvin\u00a0Mu\u00f1oz Bar\u00f3n Chunyang Chen Lukas B\u00f6hme Fabio Calefato Neil Ernst Davide Falessi Brian Fitzgerald Davide Fucci Marcos Kalinowski Stefano Lambiase Daniel Russo Mircea Lungu Lutz Prechelt Paul Ralph Rijnard van Tonder Christoph Treude and Stefan Wagner. 2025. Guidelines for Empirical Studies in Software Engineering involving Large Language Models. arxiv:https:\/\/arXiv.org\/abs\/2508.15503\u00a0[cs.SE] https:\/\/arxiv.org\/abs\/2508.15503"},{"key":"e_1_3_3_1_5_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE55347.2025.00100"},{"key":"e_1_3_3_1_6_2","first-page":"694","volume-title":"2025 IEEE\/ACM 47th International Conference on Software Engineering (ICSE)","author":"Bouzenia Islem","year":"2025","unstructured":"Islem Bouzenia, Premkumar Devanbu, and Michael Pradel. 2025. RepairAgent: An Autonomous, LLM-Based Agent for Program Repair. In 2025 IEEE\/ACM 47th International Conference on Software Engineering (ICSE). IEEE Computer Society, 694\u2013694."},{"key":"e_1_3_3_1_7_2","first-page":"469","volume-title":"2025 IEEE\/ACM 47th International Conference on Software Engineering (ICSE)","author":"Ding Yangruibo","year":"2024","unstructured":"Yangruibo Ding, Yanjun Fu, Omniyyah Ibrahim, Chawin Sitawarin, Xinyun Chen, Basel Alomair, David Wagner, Baishakhi Ray, and Yizheng Chen. 2024. Vulnerability Detection with Code Language Models: How Far Are We?. In 2025 IEEE\/ACM 47th International Conference on Software Engineering (ICSE). IEEE Computer Society, 469\u2013481."},{"key":"e_1_3_3_1_8_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE-FoSE59343.2023.00008"},{"key":"e_1_3_3_1_9_2","doi-asserted-by":"publisher","unstructured":"Shahriar Golchin and Mihai Surdeanu. 2025. Data Contamination Quiz: A Tool to Detect and Estimate Contamination in Large Language Models. Transactions of the Association for Computational Linguistics 13 (2025) 809\u2013830. 10.1162\/TACL.a.20","DOI":"10.1162\/TACL.a.20"},{"key":"e_1_3_3_1_10_2","first-page":"728","volume-title":"2025 IEEE\/ACM 47th International Conference on Software Engineering (ICSE)","author":"Guo Qi","year":"2025","unstructured":"Qi Guo, Xiaofei Xie, Shangqing Liu, Ming Hu, Xiaohong Li, and Lei Bu. 2025. Intention is All You Need: Refining Your Code from Your Intention. In 2025 IEEE\/ACM 47th International Conference on Software Engineering (ICSE). IEEE Computer Society, 728\u2013728."},{"key":"e_1_3_3_1_11_2","doi-asserted-by":"publisher","DOI":"10.1109\/ESEM56168.2023.10304803"},{"key":"e_1_3_3_1_12_2","unstructured":"Max Hort Maria Kechagia Federica Sarro and Mark Harman. 2021. A Survey of Performance Optimization for Mobile Applications. IEEE TSE (2021)."},{"key":"e_1_3_3_1_13_2","first-page":"670","volume-title":"2025 IEEE\/ACM 47th International Conference on Software Engineering (ICSE)","author":"Jiang Xue","year":"2025","unstructured":"Xue Jiang, Yihong Dong, Yongding Tao, Huanyu Liu, Zhi Jin, and Ge Li. 2025. ROCODE: Integrating Backtracking Mechanism and Program Analysis in Large Language Models for Code Generation. In 2025 IEEE\/ACM 47th International Conference on Software Engineering (ICSE). IEEE Computer Society, 670\u2013670."},{"key":"e_1_3_3_1_14_2","first-page":"762","volume-title":"2025 IEEE\/ACM 47th International Conference on Software Engineering (ICSE)","author":"Ke Kaiyao","year":"2025","unstructured":"Kaiyao Ke. 2025. NIODebugger: A novel approach to repair non-idempotent-outcome tests with LLM-based agent. In 2025 IEEE\/ACM 47th International Conference on Software Engineering (ICSE). IEEE Computer Society, 762\u2013762."},{"key":"e_1_3_3_1_15_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE55347.2025.00234"},{"key":"e_1_3_3_1_16_2","doi-asserted-by":"crossref","unstructured":"William Martin Federica Sarro Yue Jia Yuanyuan Zhang and Mark Harman. 2016. A survey of app store analysis for software engineering. IEEE TSE 43 9 (2016) 817\u2013847.","DOI":"10.1109\/TSE.2016.2630689"},{"key":"e_1_3_3_1_17_2","doi-asserted-by":"publisher","DOI":"10.1145\/3533767.3534405"},{"key":"e_1_3_3_1_18_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE55347.2025.00229"},{"key":"e_1_3_3_1_19_2","first-page":"782","volume-title":"2025 IEEE\/ACM 47th International Conference on Software Engineering (ICSE)","author":"Ouyang Shuyin","year":"2025","unstructured":"Shuyin Ouyang, Jie Zhang, Zeyu Sun, and Albert\u00a0Merono Penuela. 2025. Knowledge-Enhanced Program Repair for Data Science Code. In 2025 IEEE\/ACM 47th International Conference on Software Engineering (ICSE). IEEE Computer Society, 782\u2013782."},{"key":"e_1_3_3_1_20_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2023.findings-emnlp.722"},{"key":"e_1_3_3_1_21_2","doi-asserted-by":"publisher","DOI":"10.1145\/3639476.3639764"},{"key":"e_1_3_3_1_22_2","unstructured":"Lukas Twist Jie\u00a0M. Zhang Mark Harman Don Syme Joost Noppen Helen Yannakoudakis and Detlef Nauck. 2025. A Study of LLMs\u2019 Preferences for Libraries and Programming Languages. arxiv:https:\/\/arXiv.org\/abs\/2503.17181\u00a0[cs.SE] https:\/\/arxiv.org\/abs\/2503.17181"},{"key":"e_1_3_3_1_23_2","first-page":"668","volume-title":"2025 IEEE\/ACM 47th International Conference on Software Engineering (ICSE)","author":"Wang Chong","year":"2025","unstructured":"Chong Wang, Jianan Liu, Xin Peng, Yang Liu, and Yiling Lou. 2025. Boosting static resource leak detection via llm-based resource-oriented intention inference. In 2025 IEEE\/ACM 47th International Conference on Software Engineering (ICSE). IEEE Computer Society, 668\u2013668."},{"key":"e_1_3_3_1_24_2","doi-asserted-by":"publisher","DOI":"10.1145\/3597503.3639177"},{"key":"e_1_3_3_1_25_2","unstructured":"Dave Williams Max Hort Maria Kechagia Aldeida Aleti Justyna Petke and Federica Sarro. 2025. https:\/\/figshare.com\/s\/903589cadfd84c50613f."},{"key":"e_1_3_3_1_26_2","first-page":"553","volume-title":"2025 IEEE\/ACM 47th International Conference on Software Engineering (ICSE)","author":"Wu Yifan","year":"2025","unstructured":"Yifan Wu, Yunpeng Wang, Ying Li, Wei Tao, Siyu Yu, Haowen Yang, Wei Jiang, and Jianguo Li. 2025. An Empirical Study on Commit Message Generation Using LLMs via In-Context Learning. In 2025 IEEE\/ACM 47th International Conference on Software Engineering (ICSE). IEEE, 553\u2013565."},{"key":"e_1_3_3_1_27_2","first-page":"2548","volume-title":"2025 IEEE\/ACM 47th International Conference on Software Engineering (ICSE)","author":"Xu Junjielong","year":"2025","unstructured":"Junjielong Xu, Ying Fu, Shin\u00a0Hwei Tan, and Pinjia He. 2025. Aligning the Objective of LLM-Based Program Repair. In 2025 IEEE\/ACM 47th International Conference on Software Engineering (ICSE). IEEE, 2548\u20132560."},{"key":"e_1_3_3_1_28_2","doi-asserted-by":"publisher","DOI":"10.1145\/3597503.3639074"},{"key":"e_1_3_3_1_29_2","first-page":"683","volume-title":"2025 IEEE\/ACM 47th International Conference on Software Engineering (ICSE)","author":"Zahan Nusrat","year":"2025","unstructured":"Nusrat Zahan, Philipp Burckhardt, Mikola Lysenko, Feross Aboukhadijeh, and Laurie Williams. 2025. Leveraging Large Language Models to Detect npm Malicious Packages. In 2025 IEEE\/ACM 47th International Conference on Software Engineering (ICSE). IEEE Computer Society, 683\u2013683."},{"key":"e_1_3_3_1_30_2","doi-asserted-by":"crossref","first-page":"566","DOI":"10.1109\/ICSE55347.2025.00104","volume-title":"2025 IEEE\/ACM 47th International Conference on Software Engineering (ICSE)","author":"Zhang Tanghaoran","year":"2025","unstructured":"Tanghaoran Zhang, Yue Yu, Xinjun Mao, Shangwen Wang, Kang Yang, Yao Lu, Zhang Zhang, and Yuxin Zhao. 2025. Instruct or Interact? Exploring and Eliciting LLMs\u2019 Capability in Code Snippet Adaptation Through Prompt Engineering. In 2025 IEEE\/ACM 47th International Conference on Software Engineering (ICSE). IEEE, 566\u2013577."},{"key":"e_1_3_3_1_31_2","first-page":"619","volume-title":"2025 IEEE\/ACM 47th International Conference on Software Engineering (ICSE)","author":"Zhang Yuanliang","year":"2025","unstructured":"Yuanliang Zhang, Yifan Xie, Shanshan Li, Ke Liu, Chong Wang, Zhouyang Jia, Xiangbing Huang, Jie Song, Chaopeng Luo, Zhizheng Zheng, et\u00a0al. 2025. Unseen Horizons: Unveiling the Real Capability of LLM Code Generation Beyond the Familiar. In 2025 IEEE\/ACM 47th International Conference on Software Engineering (ICSE). IEEE Computer Society, 619\u2013619."}],"event":{"name":"ICSE-NIER '26: 2026 IEEE\/ACM 48th International Conference on Software Engineering","location":"Rio de Janeiro Brazil","acronym":"ICSE-NIER '26","sponsor":["SIGSOFT ACM Special Interest Group on Software Engineering"]},"container-title":["Proceedings of the IEEE\/ACM 48th International Conference on Software Engineering"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3786582.3786827","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,7,8]],"date-time":"2026-07-08T11:56:07Z","timestamp":1783511767000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3786582.3786827"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,4,12]]},"references-count":30,"alternative-id":["10.1145\/3786582.3786827","10.1145\/3786582"],"URL":"https:\/\/doi.org\/10.1145\/3786582.3786827","relation":{},"subject":[],"published":{"date-parts":[[2026,4,12]]},"assertion":[{"value":"2026-07-08","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}