{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,8]],"date-time":"2026-10-08T11:34:05Z","timestamp":1791459245703,"version":"4.3.4"},"reference-count":254,"publisher":"Association for Computing Machinery (ACM)","issue":"8","funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"crossref","award":["62572235"],"award-info":[{"award-number":["62572235"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Softw. Eng. Methodol."],"published-print":{"date-parts":[[2026,8,31]]},"abstract":"<jats:p>Automated Program Repair (APR) is a crucial task in software development and maintenance, aiming to patch software bugs automatically without human intervention. The rise of Large Language Models (LLMs) has significantly advanced APR. However, as researchers delve deeper into APR as a downstream task for LLMs, a key challenge remains: how to effectively integrate APR-specific information to complement LLMs capabilities. This survey revisits 124 existing APR studies, most from 2021 to 2024, from two perspectives: utilizing LLMs and APR-specific information. First, we define the concept of APR-specific information. Then, we summarize techniques for utilizing LLMs in patch generation in four dimensions. Next, we explore critical factors influencing the effectiveness of generating patches by LLMs, such as prompting context and fine-tuning configurations. After that, we focus on the evaluation of generated patches, including benchmarks, reasoning cost scaling, and so on. Furthermore, we distill all APR-specific information (e.g., bug-fix pairs and error messages), highlighting their unique importance and features. Finally, we comprehensively outline challenges, limitations, and potential future research directions in APR in the LLM era. To conclude, by adopting the two perspectives, we aim to provide valuable insights into mining and leveraging APR-specific information in utilizing LLMs process for the APR community.<\/jats:p>","DOI":"10.1145\/3764584","type":"journal-article","created":{"date-parts":[[2025,8,28]],"date-time":"2025-08-28T14:57:43Z","timestamp":1756393063000},"page":"1-62","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":2,"title":["Patch Generation in APR: A Survey from the Perspectives of Utilizing LLMs and Using APR-Specific Information"],"prefix":"10.1145","volume":"35","author":[{"ORCID":"https:\/\/orcid.org\/0009-0001-7550-0320","authenticated-orcid":false,"given":"Yaopeng","family":"Yang","sequence":"first","affiliation":[{"name":"State Key Laboratory for Novel Software Technology, Nanjing University, Nanjing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9270-5072","authenticated-orcid":false,"given":"Chuanyi","family":"Li","sequence":"additional","affiliation":[{"name":"State Key Laboratory for Novel Software Technology, Nanjing University, Nanjing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0009-6732-6826","authenticated-orcid":false,"given":"Zhifeng","family":"Han","sequence":"additional","affiliation":[{"name":"China Mobile Communications Corporation, Beijing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0002-6072-1822","authenticated-orcid":false,"given":"Rui","family":"Li","sequence":"additional","affiliation":[{"name":"China Mobile Communications Corporation, Beijing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0006-2022-5444","authenticated-orcid":false,"given":"Kui","family":"Xu","sequence":"additional","affiliation":[{"name":"China Mobile Communications Corporation, Beijing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0004-3975-6734","authenticated-orcid":false,"given":"Qingyuan","family":"Li","sequence":"additional","affiliation":[{"name":"State Key Laboratory for Novel Software Technology, Nanjing University, Nanjing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7426-1594","authenticated-orcid":false,"given":"Wenkang","family":"Zhong","sequence":"additional","affiliation":[{"name":"State Key Laboratory for Novel Software Technology, Nanjing University, Nanjing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0005-2492-2530","authenticated-orcid":false,"given":"Zongwen","family":"Shen","sequence":"additional","affiliation":[{"name":"State Key Laboratory for Novel Software Technology, Nanjing University, Nanjing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0009-3166-8525","authenticated-orcid":false,"given":"Zhiwei","family":"Fei","sequence":"additional","affiliation":[{"name":"State Key Laboratory for Novel Software Technology, Nanjing University, Nanjing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1773-0942","authenticated-orcid":false,"given":"Jidong","family":"Ge","sequence":"additional","affiliation":[{"name":"State Key Laboratory for Novel Software Technology, Nanjing University, Nanjing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0001-1102-9584","authenticated-orcid":false,"given":"Bin","family":"Luo","sequence":"additional","affiliation":[{"name":"State Key Laboratory for Novel Software Technology, Nanjing University, Nanjing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2026,7,17]]},"reference":[{"key":"e_1_3_3_2_2","unstructured":"OpenDevin: Code Less Make More. 2024. Retrieved September 27 2024 from https:\/\/github.com\/Network-Technology-Academy-Institute\/OpenDevin_from_OpenDevin"},{"key":"e_1_3_3_3_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-78292-4_1"},{"key":"e_1_3_3_4_2","doi-asserted-by":"crossref","unstructured":"Vaibhav Aggarwal Ojasv Kamal Abhinav Japesh Zhijing Jin and Bernhard Sch\u00f6lkopf. 2025. Dars: Dynamic action re-sampling to enhance coding agent performance by adaptive tree traversal. arXiv:2503.14269. Retrieved from https:\/\/arxiv.org\/abs\/2503.14269","DOI":"10.18653\/v1\/2025.acl-long.973"},{"key":"e_1_3_3_5_2","doi-asserted-by":"publisher","DOI":"10.1109\/TIFS.2024.3374558"},{"key":"e_1_3_3_6_2","volume-title":"Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies","author":"Ahmad W. U.","year":"2021","unstructured":"W. U. Ahmad, S. Chakraborty, B. Ray, and K. W. Chang. 2021. Unified pre-training for program understanding and generation. In Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies."},{"key":"e_1_3_3_7_2","unstructured":"Wasi Uddin Ahmad Saikat Chakraborty Baishakhi Ray and Kai-Wei Chang. 2021. Unified pre-training for program understanding and generation. arXiv:2103.06333. Retrieved from https:\/\/arxiv.org\/abs\/2103.06333"},{"key":"e_1_3_3_8_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2022.3212635"},{"key":"e_1_3_3_9_2","unstructured":"DeepSeek AI. 2023. DeepSeek Coder: Let the Code Write Itself. Retrieved from https:\/\/github.com\/deepseek-ai\/DeepSeek-Coder"},{"key":"e_1_3_3_10_2","doi-asserted-by":"crossref","unstructured":"Nadia Alshahwan Jubin Chheda Anastasia Finegenova Beliz Gokkaya Mark Harman Inna Harper Alexandru Marginean Shubho Sengupta and Eddy Wang. 2024. Automated unit test improvement using large language models at meta. arXiv:2402.09171. Retrieved from https:\/\/arxiv.org\/abs\/2402.09171","DOI":"10.1145\/3663529.3663839"},{"key":"e_1_3_3_11_2","unstructured":"Amazon. 2024. CodeWhisperer. Retrieved from https:\/\/docs.aws.amazon.com\/codewhisperer\/"},{"key":"e_1_3_3_12_2","first-page":"3423","article-title":"Learning to learn from corrupted data for few-shot learning","author":"An Yuexuan","year":"2023","unstructured":"Yuexuan An, Xingyu Zhao, and Hui Xue. 2023. Learning to learn from corrupted data for few-shot learning. In Proceedings of the 32nd International Joint Conference on Artificial Intelligence (IJCAI), 3423\u20133431.","journal-title":"Proceedings of the 32nd International Joint Conference on Artificial Intelligence (IJCAI)"},{"key":"e_1_3_3_13_2","unstructured":"Anthropic. 2024. Claude 3.5. Retrieved from https:\/\/www.anthropic.com\/claude"},{"key":"e_1_3_3_14_2","unstructured":"Antonis Antoniades Albert \u00d6rwall Kexun Zhang Yuxi Xie Anirudh Goyal and William Wang. 2024. SWE-Search: Enhancing software agents with Monte Carlo tree search and iterative refinement. arXiv:2410.20285. Retrieved from https:\/\/arxiv.org\/abs\/2410.20285"},{"key":"e_1_3_3_15_2","unstructured":"Anysphere. 2025. Cursor. Retrieved from https:\/\/www.cursor.com\/"},{"key":"e_1_3_3_16_2","doi-asserted-by":"publisher","DOI":"10.1145\/3360585"},{"key":"e_1_3_3_17_2","unstructured":"Google Bard. 2023. Retrieved October 22 2024 from https:\/\/bard.google.com\/"},{"key":"e_1_3_3_18_2","doi-asserted-by":"publisher","DOI":"10.1145\/2635868.2635898"},{"key":"e_1_3_3_19_2","unstructured":"SWE bench Team. 2025. SWE-Bench Leaderboards. Retrieved from https:\/\/www.swebench.com\/"},{"key":"e_1_3_3_20_2","unstructured":"Yoshua Bengio R\u00e9jean Ducharme Pascal Vincent and Christian Janvin. 2003. A neural probabilistic language model. Journal of Machine Learning Research 3 (March 2003) 1137\u20131155."},{"key":"e_1_3_3_21_2","first-page":"780","volume-title":"Proceedings of the 38th International Conference on Machine LearningProceedings of Machine Learning Research","volume":"139","author":"Berabi Berkay","year":"2021","unstructured":"Berkay Berabi, Jingxuan He, Veselin Raychev, and Martin Vechev. 2021. TFix: Learning to fix coding errors with a text-to-text transformer. In Proceedings of the 38th International Conference on Machine Learning. Marina Meila and Tong Zhang (Eds.), Proceedings of Machine Learning Research, Vol. 139, 780\u2013791. Retrieved from https:\/\/proceedings.mlr.press\/v139\/berabi21a.html"},{"key":"e_1_3_3_22_2","volume-title":"Proceedings of the 25th International Conference on Extending Database Technology (EDBT \u201922)","author":"Bogatu Alex","year":"2022","unstructured":"Alex Bogatu, Norman W. Paton, Mark Douthwaite, and Andr\u00e9 Freitas. 2022. Voyager: Data discovery and integration for data science. In Proceedings of the 25th International Conference on Extending Database Technology (EDBT \u201922)."},{"key":"e_1_3_3_23_2","unstructured":"Egor Bogomolov Aleksandra Eliseeva Timur Galimzyanov Evgeniy Glukhov Anton Shapkin Maria Tigina Yaroslav Golubev Alexander Kovrigin Arie van Deursen Maliheh Izadi et al. 2024. Long code arena: A set of benchmarks for long-context code models. arXiv:2406.11612. Retrieved from https:\/\/arxiv.org\/abs\/2406.11612"},{"key":"e_1_3_3_24_2","unstructured":"Islem Bouzenia Premkumar Devanbu and Michael Pradel. 2024. RepairAgent: An autonomous LLM-based agent for program repair. arXiv240317134. Retrieved from https:\/\/arxiv.org\/abs\/2403.17134"},{"key":"e_1_3_3_25_2","unstructured":"Bradley Brown Jordan Juravsky Ryan Ehrlich Ronald Clark Quoc V. Le Christopher R\u00e9 and Azalia Mirhoseini. 2024. Large language monkeys: Scaling inference compute with repeated sampling. arXiv:2407.21787. Retrieved from https:\/\/arxiv.org\/abs\/2407.21787"},{"key":"e_1_3_3_26_2","unstructured":"Tom B. Brown Benjamin Mann Nick Ryder Melanie Subbiah Jared Kaplan Prafulla Dhariwal Arvind Neelakantan Pranav Shyam Girish Sastry Amanda Askell et al. 2020. Language models are few-shot learners. arXiv:2005.14165. Retrieved from https:\/\/arxiv.org\/abs\/2005.14165"},{"key":"e_1_3_3_27_2","unstructured":"ByteDance. 2025. Trae. Retrieved from https:\/\/www.trae.com.cn\/"},{"key":"e_1_3_3_28_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR52733.2024.01227"},{"key":"e_1_3_3_29_2","unstructured":"Jiayi Geng Carlos E. Jimenez and John Yang. 2025. SWE-Bench-Lite. Retrieved from https:\/\/www.swebench.com\/lite.html"},{"key":"e_1_3_3_30_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2020.3020502"},{"key":"e_1_3_3_31_2","unstructured":"Jianming Chang Xin Zhou Lulu Wang David Lo Bixin Li and Bridging Bug. 2025. Localization and issue fixing: A hierarchical localization framework leveraging large language models. arXiv:2502.15292. Retrieved from https:\/\/arxiv.org\/abs\/2502.15292"},{"key":"e_1_3_3_32_2","doi-asserted-by":"publisher","DOI":"10.1145\/3641289"},{"key":"e_1_3_3_33_2","unstructured":"Yiannis Charalambous Edoardo Manino and Lucas C. Cordeiro. 2024. Automated repair of AI code with large language models and formal verification. arXiv:2405.08848. Retrieved from https:\/\/arxiv.org\/abs\/2405.08848"},{"key":"e_1_3_3_34_2","unstructured":"Dong Chen Shaoxin Lin Muhan Zeng Daoguang Zan Jian-Gang Wang Anton Cheshkov Jun Sun Hao Yu Guoliang Dong Artem Aliev et al. 2024. CodeR: Issue resolving with multi-agent and task graphs. arXiv:2406.01304. Retrieved from https:\/\/arxiv.org\/abs\/2406.01304"},{"key":"e_1_3_3_35_2","unstructured":"Haolong Chen Hanzhi Chen Zijian Zhao Kaifeng Han Guangxu Zhu Yichen Zhao Ying Du Wei Xu and Qingjiang Shi. 2024. An overview of domain-specific foundation model: Key technologies applications and challenges. arXiv:2409.04267. Retrieved from https:\/\/arxiv.org\/abs\/2409.04267"},{"key":"e_1_3_3_36_2","unstructured":"Mark Chen Jerry Tworek Heewoo Jun Qiming Yuan Henrique Ponde de Oliveira Pinto Jared Kaplan Harri Edwards Yuri Burda Nicholas Joseph Greg Brockman et al. 2021. Evaluating large language models trained on code. arXiv:2107.03374. Retrieved from https:\/\/arxiv.org\/abs\/2107.03374"},{"key":"e_1_3_3_37_2","doi-asserted-by":"crossref","unstructured":"Qiguang Chen Libo Qin Jinhao Liu Dengyun Peng Jiannan Guan Peng Wang Mengkang Hu Yuhang Zhou Te Gao and Wanxiang Che. 2025. Towards reasoning era: A survey of long chain-of-thought for reasoning large language models. arXiv:2503.09567. Retrieved from https:\/\/arxiv.org\/abs\/2503.09567","DOI":"10.1007\/s11432-025-4665-8"},{"key":"e_1_3_3_38_2","unstructured":"Yukang Chen Shengju Qian Haotian Tang Xin Lai Zhijian Liu Song Han and Jiaya Jia. 2023. Longlora: Efficient fine-tuning of long-context large language models. arXiv:2309.12307. Retrieved from https:\/\/arxiv.org\/abs\/2309.12307"},{"key":"e_1_3_3_39_2","doi-asserted-by":"publisher","DOI":"10.1145\/3639478.3647633"},{"key":"e_1_3_3_40_2","doi-asserted-by":"publisher","DOI":"10.1145\/3627703.3629553"},{"issue":"9","key":"e_1_3_3_41_2","first-page":"1943","article-title":"Sequencer: Sequence-to-sequence learning for end-to-end program repair","volume":"47","author":"Chen Zimin","year":"2019","unstructured":"Zimin Chen, Steve Kommrusch, Michele Tufano, Louis-No\u00ebl Pouchet, Denys Poshyvanyk, and Martin Monperrus. 2019. Sequencer: Sequence-to-sequence learning for end-to-end program repair. IEEE Transactions on Software Engineering 47, 9 (2019), 1943\u20131959.","journal-title":"IEEE Transactions on Software Engineering"},{"key":"e_1_3_3_42_2","unstructured":"Zhaoling Chen Xiangru Tang Gangda Deng Fang Wu Jialong Wu Zhiwei Jiang Viktor Prasanna Arman Cohan and Xingyao Wang. 2025. LocAgent: Graph-guided LLM agents for code localization. arXiv:2503.09089. Retrieved from https:\/\/arxiv.org\/abs\/2503.09089"},{"key":"e_1_3_3_43_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2022.3156637"},{"key":"e_1_3_3_44_2","first-page":"507","article-title":"Optimal structure identification with greedy search","volume":"3","author":"Maxwell Chickering David","year":"2002","unstructured":"David Maxwell Chickering. 2002. Optimal structure identification with greedy search. Journal of Machine Learning Research 3 (Nov. 2002), 507\u2013554.","journal-title":"Journal of Machine Learning Research"},{"key":"e_1_3_3_45_2","doi-asserted-by":"publisher","DOI":"10.1145\/3597503.3639184"},{"key":"e_1_3_3_46_2","unstructured":"Yung-Sung Chuang Yujia Xie Hongyin Luo Yoon Kim James Glass and Pengcheng He. 2023. Dola: Decoding by contrasting layers improves factuality in large language models. arXiv:2309.03883. Retrieved from https:\/\/arxiv.org\/abs\/2309.03883"},{"key":"e_1_3_3_47_2","unstructured":"CO Boulder. 2013. Failure to Adopt Reverse Debugging Costs Global Economy $41 Billion Annually. Retrieved September 1 2024 from https:\/\/totalview.io\/press-releases\/university-cambridge-study-failure-adopt-reverse-debugging-costs-global-economy-41"},{"key":"e_1_3_3_48_2","doi-asserted-by":"publisher","DOI":"10.1162\/tacl_a_00449"},{"key":"e_1_3_3_49_2","first-page":"284","volume-title":"Proceedings of the 2018 2nd International Conference on Electronics, Communication and Aerospace Technology (ICECA)","author":"Devalal Shilpa","year":"2018","unstructured":"Shilpa Devalal and A. Karthikeyan. 2018. LoRa technology\u2014An overview. In Proceedings of the 2018 2nd International Conference on Electronics, Communication and Aerospace Technology (ICECA). IEEE, 284\u2013290."},{"key":"e_1_3_3_50_2","unstructured":"Jacob Devlin Ming-Wei Chang Kenton Lee and Kristina Toutanova. 2019. BERT: Pre-training of deep bidirectional transformers for language understanding. arXiv:1810.04805. Retrieved from https:\/\/arxiv.org\/abs\/1810.04805"},{"key":"e_1_3_3_51_2","unstructured":"Xueying Du Mingwei Liu Juntao Li Hanlin Wang Xin Peng and Yiling Lou. 2023. Resolving crash bugs via large language models: An empirical study. arXiv:2312.10448. Retrieved from https:\/\/arxiv.org\/abs\/2312.10448"},{"key":"e_1_3_3_52_2","first-page":"1","volume-title":"Proceedings of the IEEE\/ACM 46th International Conference on Software Engineering","author":"Eladawy Hadeel","year":"2024","unstructured":"Hadeel Eladawy, Claire Le Goues, and Yuriy Brun. 2024. Automated program repair, what is it good for? Not absolutely nothing! In Proceedings of the IEEE\/ACM 46th International Conference on Software Engineering, 1\u201313."},{"key":"e_1_3_3_53_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2023.111741"},{"key":"e_1_3_3_54_2","doi-asserted-by":"publisher","DOI":"10.1145\/3702972"},{"key":"e_1_3_3_55_2","doi-asserted-by":"crossref","unstructured":"Zhangyin Feng Daya Guo Duyu Tang Nan Duan Xiaocheng Feng Ming Gong Linjun Shou Bing Qin Ting Liu Daxin Jiang et al. 2020. CodeBERT: A pre-trained model for programming and natural languages. arXiv:2002.08155. Retrieved from https:\/\/arxiv.org\/abs\/2002.08155","DOI":"10.18653\/v1\/2020.findings-emnlp.139"},{"key":"e_1_3_3_56_2","doi-asserted-by":"publisher","DOI":"10.1007\/s11023-020-09548-1"},{"key":"e_1_3_3_57_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10664-023-10346-3"},{"key":"e_1_3_3_58_2","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v33i01.33016407"},{"key":"e_1_3_3_59_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2017.2755013"},{"key":"e_1_3_3_60_2","doi-asserted-by":"publisher","DOI":"10.1002\/smr.2586"},{"key":"e_1_3_3_61_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10664-006-9004-6"},{"key":"e_1_3_3_62_2","doi-asserted-by":"publisher","DOI":"10.1145\/3293882.3330559"},{"key":"e_1_3_3_63_2","unstructured":"Daya Guo Shuo Ren Shuai Lu Zhangyin Feng Duyu Tang Shujie Liu Long Zhou Nan Duan Alexey Svyatkovskiy Shengyu Fu et al. 2021. GraphCodeBERT: Pre-training code representations with data flow. arXiv:2009.08366. Retrieved from https:\/\/arxiv.org\/abs\/2009.08366"},{"key":"e_1_3_3_64_2","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v31i1.10742"},{"key":"e_1_3_3_65_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICST.2019.00019"},{"key":"e_1_3_3_66_2","unstructured":"Zeyu Han Chao Gao Jinyang Liu Jeff Zhang and Sai Qian Zhang. 2024. Parameter-efficient fine-tuning for large models: A comprehensive survey. arXiv:2403.14608. Retrieved from https:\/\/arxiv.org\/abs\/2403.14608"},{"issue":"7","key":"e_1_3_3_67_2","article-title":"Exploring the potential of pre-trained language models of code for automated program repair","volume":"13","author":"Hao Sichong","year":"2024","unstructured":"Sichong Hao, Xianjun Shi, and Hongwei Liu. 2024. Exploring the potential of pre-trained language models of code for automated program repair. Electronics 13, 7 (2024), 1200. Retrieved from https:\/\/doi.org\/10.3390\/electronics13071200","journal-title":"Electronics"},{"key":"e_1_3_3_68_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICSME58846.2023.00024"},{"key":"e_1_3_3_69_2","unstructured":"D\u00e1vid Hidv\u00e9gi Khashayar Etemadi Sofia Bobadilla and Martin Monperrus. 2024. CigaR: Cost-efficient program repair with LLMs. arXiv:2402.06598. Retrieved from https:\/\/arxiv.org\/abs\/2402.06598"},{"key":"e_1_3_3_70_2","doi-asserted-by":"crossref","unstructured":"Jordan Hoffmann Sebastian Borgeaud Arthur Mensch Elena Buchatskaya Trevor Cai Eliza Rutherford Diego de Las Casas Lisa Anne Hendricks Johannes Welbl Aidan Clark et al. 2022. Training compute-optimal large language models. arXiv:2203.15556. Retrieved from https:\/\/arxiv.org\/abs\/2203.15556","DOI":"10.52202\/068431-2176"},{"key":"e_1_3_3_71_2","doi-asserted-by":"crossref","unstructured":"Soneya Binta Hossain Nan Jiang Qiang Zhou Xiaopeng Li Wen-Hao Chiang Yingjun Lyu Hoan Nguyen and Omer Tripp. 2024. A deep dive into large language models for automated bug localization and repair. arXiv:2404.11595. Retrieved from https:\/\/arxiv.org\/abs\/2404.11595","DOI":"10.1145\/3660773"},{"key":"e_1_3_3_72_2","first-page":"517","volume-title":"Proceedings of the 2021 36th IEEE\/ACM International Conference on Automated Software Engineering (ASE)","author":"Huang Huaxun","year":"2021","unstructured":"Huaxun Huang, Ming Wen, Lili Wei, Yepang Liu, and Shing-Chi Cheung. 2021. Characterizing and detecting configuration compatibility issues in android apps. In Proceedings of the 2021 36th IEEE\/ACM International Conference on Automated Software Engineering (ASE). IEEE, 517\u2013528."},{"key":"e_1_3_3_73_2","doi-asserted-by":"publisher","DOI":"10.1109\/ASE56229.2023.00181"},{"key":"e_1_3_3_74_2","unstructured":"Kai Huang Zhengzi Xu Su Yang Hongyu Sun Xuejun Li Zheng Yan and Yuqing Zhang. 2023. A survey on automated program repair techniques. arXiv:2303.18184. Retrieved from https:\/\/arxiv.org\/abs\/2303.18184"},{"key":"e_1_3_3_75_2","unstructured":"Huawei. 2024. DevEco. Retrieved from https:\/\/developer.huawei.com\/consumer\/cn\/deveco-studio\/"},{"key":"e_1_3_3_76_2","unstructured":"Faria Huq Masum Hasan Mahim Anzum Haque Pantho Sazan Mahbub Anindya Iqbal and Toufique Ahmed. 2020. Review4Repair: Code review aided automatic program repairing. arXiv:2010.01544. Retrieved from https:\/\/arxiv.org\/abs\/2010.01544"},{"key":"e_1_3_3_77_2","doi-asserted-by":"publisher","DOI":"10.1145\/3571730"},{"key":"e_1_3_3_78_2","unstructured":"Albert Q. Jiang Alexandre Sablayrolles Antoine Roux Arthur Mensch Blanche Savary Chris Bamford Devendra Singh Chaplot Diego de las Casas Emma Bou Hanna Florian Bressand et al. 2024. Mixtral of experts. arXiv:2401.04088. Retrieved from https:\/\/arxiv.org\/abs\/2401.04088"},{"key":"e_1_3_3_79_2","doi-asserted-by":"crossref","unstructured":"Dongwei Jiang Wubo Li Miao Cao Wei Zou and Xiangang Li. 2020. Speech simclr: Combining contrastive and reconstruction objective for self-supervised speech representation learning. arXiv:2010.13991. Retrieved from https:\/\/arxiv.org\/abs\/2010.13991","DOI":"10.21437\/Interspeech.2021-391"},{"key":"e_1_3_3_80_2","doi-asserted-by":"publisher","DOI":"10.1145\/3213846.3213871"},{"key":"e_1_3_3_81_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE48619.2023.00125"},{"key":"e_1_3_3_82_2","doi-asserted-by":"publisher","DOI":"10.1162\/tacl_a_00324"},{"key":"e_1_3_3_83_2","volume-title":"Proceedings of the 12th International Conference on Learning Representations","author":"Jimenez Carlos E.","year":"2024","unstructured":"Carlos E. Jimenez, John Yang, Alexander Wettig, Shunyu Yao, Kexin Pei, Ofir Press, and Karthik R. Narasimhan. 2024. SWE-bench: Can language models resolve real-world Github issues? In Proceedings of the 12th International Conference on Learning Representations. Retrieved from https:\/\/openreview.net\/forum?id=VTF8yNQM66"},{"key":"e_1_3_3_84_2","unstructured":"Matthew Jin Syed Shahriar Michele Tufano Xin Shi Shuai Lu Neel Sundaresan and Alexey Svyatkovskiy. 2023. InferFix: End-to-end program repair with LLMs. arXiv:2303.07263. Retrieved from https:\/\/arxiv.org\/abs\/2303.07263"},{"key":"e_1_3_3_85_2","doi-asserted-by":"publisher","DOI":"10.1007\/11513988_23"},{"key":"e_1_3_3_86_2","unstructured":"Alex L. Zhang Kilian Lieret Joyce Yang Xindi Wu Ori Press Niklas Muennighoff Gabriel Synnaeve Karthik Narasimhan Diyi Yang Sida I. Wang et al. 2025. SWE-Bench Multimodal. Retrieved from https:\/\/www.swebench.com\/multimodal.html"},{"key":"e_1_3_3_87_2","doi-asserted-by":"publisher","DOI":"10.1145\/2610384.2628055"},{"key":"e_1_3_3_88_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.scico.2020.102598"},{"key":"e_1_3_3_89_2","unstructured":"Jared Kaplan Sam McCandlish Tom Henighan Tom B. Brown Benjamin Chess Rewon Child Scott Gray Alec Radford Jeffrey Wu and Dario Amodei. 2020. Scaling laws for neural language models. arXiv:2001.08361. Retrieved from https:\/\/arxiv.org\/abs\/2001.08361"},{"key":"e_1_3_3_90_2","doi-asserted-by":"publisher","DOI":"10.1145\/3379597.3387491"},{"issue":"7","key":"e_1_3_3_91_2","doi-asserted-by":"crossref","first-page":"2658","DOI":"10.1109\/TSE.2021.3067156","article-title":"Evaluating automatic program repair capabilities to repair API misuses","volume":"48","author":"Kechagia Maria","year":"2021","unstructured":"Maria Kechagia, Sergey Mechtaev, Federica Sarro, and Mark Harman. 2021. Evaluating automatic program repair capabilities to repair API misuses. IEEE Transactions on Software Engineering 48, 7 (2021), 2658\u20132679.","journal-title":"IEEE Transactions on Software Engineering"},{"key":"e_1_3_3_92_2","volume-title":"Guidelines for Performing Systematic Literature Reviews in Software Engineering","author":"Kitchenham B.","year":"2007","unstructured":"B. Kitchenham and S. Charters. 2007. Guidelines for Performing Systematic Literature Reviews in Software Engineering. Technical Report, Ver. 2.3. EBSE Technical Report EBSE-2007-01. Keele University, Keele, Staffs, UK."},{"key":"e_1_3_3_93_2","doi-asserted-by":"publisher","DOI":"10.1109\/32.799945"},{"key":"e_1_3_3_94_2","doi-asserted-by":"crossref","first-page":"137","DOI":"10.1145\/3524842.3527997","volume-title":"Proceedings of the 19th International Conference on Mining Software Repositories","author":"Khoshnoud Fatemeh","year":"2022","unstructured":"Fatemeh Khoshnoud, Ali Rezaei Nasab, Zahra Toudeji, and Ashkan Sami. 2022. Which bugs are missed in code reviews: An empirical study on SmartSHARK dataset. In Proceedings of the 19th International Conference on Mining Software Repositories, 137\u2013141."},{"key":"e_1_3_3_95_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE.2013.6606626"},{"key":"e_1_3_3_96_2","unstructured":"Barbara Kitchenham and Stuart Charters. 2007. Guidelines for Performing Systematic Literature Reviews in Software Engineering. Technical Report. Technical report ver. 2.3 ebse technical report. ebse. Keele University and Durham University Joint Report."},{"key":"e_1_3_3_97_2","unstructured":"Jiaolong Kong Mingfei Cheng Xiaofei Xie Shangqing Liu Xiaoning Du and Qi Guo. 2024. ContrastRepair: Enhancing conversation-based automated program repair via contrastive test case pairs. arXiv:2403.01971. Retrieved from https:\/\/arxiv.org\/abs\/2403.01971"},{"key":"e_1_3_3_98_2","first-page":"61","volume-title":"Proceedings of the 2022 IEEE\/ACM International Workshop on Automated Program Repair (APR)","author":"Lajk\u00f3 M. \u00c1rk","year":"2022","unstructured":"M. \u00c1rk Lajk\u00f3, Viktor Csuvik, and L\u00e1szl\u00f3 Vid\u00e1cs. 2022. Towards JavaScript program repair with generative pre-trained transformer (GPT-2). In Proceedings of the 2022 IEEE\/ACM International Workshop on Automated Program Repair (APR), 61\u201368. Retrieved from https:\/\/doi.org\/10.1145\/3524459.3527350"},{"key":"e_1_3_3_99_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE.2019.00064"},{"key":"e_1_3_3_100_2","doi-asserted-by":"publisher","DOI":"10.1109\/SANER.2016.76"},{"key":"e_1_3_3_101_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2023.3255177"},{"key":"e_1_3_3_102_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2011.104"},{"key":"e_1_3_3_103_2","unstructured":"Cheryl Lee Chunqiu Steven Xia Jen Tse Huang Zhouruixin Zhu Lingming Zhang and Michael R. Lyu. 2024. A unified debugging approach via LLM-based multi-agent synergy. arXiv:2404.17153. Retrieved from https:\/\/arxiv.org\/abs\/2404.17153"},{"key":"e_1_3_3_104_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.renene.2018.08.087"},{"key":"e_1_3_3_105_2","unstructured":"Fengjie Li Jiajun Jiang Jiajun Sun and Hongyu Zhang. 2024. Hybrid automated program repair by combining large language models and program analysis. arXiv:2406.00992. Retrieved from https:\/\/arxiv.org\/abs\/2406.00992"},{"key":"e_1_3_3_106_2","unstructured":"Guochang Li Chen Zhi Jialiang Chen Junxiao Han and Shuiguang Deng. 2024. Exploring parameter-efficient fine-tuning of large language model on automated program repair. arXiv:2406.05639. Retrieved from https:\/\/arxiv.org\/abs\/2406.05639"},{"key":"e_1_3_3_107_2","unstructured":"Huayang Li Yixuan Su Deng Cai Yan Wang and Lemao Liu. 2022. A survey on retrieval-augmented text generation. arXiv:220201110. Retrieved from https:\/\/arxiv.org\/abs\/2202.01110"},{"key":"e_1_3_3_108_2","doi-asserted-by":"crossref","unstructured":"Lei Li Yankai Lin Deli Chen Shuhuai Ren Peng Li Jie Zhou and Xu Sun. 2020. Cascadebert: Accelerating inference of pre-trained language models via calibrated complete models cascade. arXiv:2012.14682. Retrieved from https:\/\/arxiv.org\/abs\/2012.14682","DOI":"10.18653\/v1\/2021.findings-emnlp.43"},{"issue":"7","key":"e_1_3_3_109_2","article-title":"Empirical study on the data leakage problem in neural program repair","volume":"35","author":"Li Qingyuan","year":"2024","unstructured":"Qingyuan Li, Wenkang Zhong, Chuanyi Li, Jidong Ge, and Luo Bin. 2024. Empirical study on the data leakage problem in neural program repair. Journal of Software 35, 7 (2024).","journal-title":"Journal of Software"},{"key":"e_1_3_3_110_2","first-page":"602","volume-title":"Proceedings of the 2020 IEEE\/ACM 42nd International Conference on Software Engineering (ICSE)","author":"Li Yi","year":"2020","unstructured":"Yi Li, Shaohua Wang, and Tien N. Nguyen. 2020. DLFix: Context-based code transformation learning for automated program repair. In Proceedings of the 2020 IEEE\/ACM 42nd International Conference on Software Engineering (ICSE), 602\u2013614."},{"key":"e_1_3_3_111_2","unstructured":"Zhiyu Li Shuai Lu Daya Guo Nan Duan Shailesh Jannu Grant Jenks Deep Majumder Jared Green Alexey Svyatkovskiy Shengyu Fu et al. 2022. CodeReviewer: Pre-training for automating code review activities. arXiv:220309095. Retrieved from https:\/\/api.semanticscholar.org\/CorpusID:247519151"},{"key":"e_1_3_3_112_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR52688.2022.00888"},{"key":"e_1_3_3_113_2","doi-asserted-by":"publisher","DOI":"10.1145\/3135932.3135941"},{"issue":"3","key":"e_1_3_3_114_2","first-page":"1","article-title":"The gap between trustworthy AI research and trustworthy software research: A tertiary study","volume":"57","author":"Liu Bohan","year":"2024","unstructured":"Bohan Liu, Gongyuan Li, He Zhang, Yuzhe Jin, Zikuan Wang, and Dong Shao. 2024. The gap between trustworthy AI research and trustworthy software research: A tertiary study. ACM Computing Surveys 57, 3 (2024), 1\u201340.","journal-title":"ACM Computing Surveys"},{"key":"e_1_3_3_115_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICST.2019.00020"},{"key":"e_1_3_3_116_2","doi-asserted-by":"publisher","DOI":"10.1145\/3293882.3330577"},{"key":"e_1_3_3_117_2","doi-asserted-by":"publisher","DOI":"10.1109\/SANER.2019.8667970"},{"key":"e_1_3_3_118_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2020.110817"},{"key":"e_1_3_3_119_2","doi-asserted-by":"publisher","DOI":"10.1145\/3377811.3380338"},{"key":"e_1_3_3_120_2","doi-asserted-by":"crossref","unstructured":"Shuo Liu Jacky Keung Zhen Yang Fang Liu Qilin Zhou and Yihan Liao. 2024. Delving into parameter-efficient fine-tuning in code change learning: An empirical study. arXiv:2402.06247. Retrieved from https:\/\/arxiv.org\/abs\/2402.06247","DOI":"10.1109\/SANER60148.2024.00055"},{"key":"e_1_3_3_121_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-46448-0_2"},{"key":"e_1_3_3_122_2","unstructured":"Zhe Liu Chunyang Chen Junjie Wang Mengzhuo Chen Boyu Wu Xing Che Dandan Wang and Qing Wang. 2023. Chatting with gpt-3 for zero-shot human-like mobile automated GUI testing. arXiv:2305.09434. Retrieved from https:\/\/arxiv.org\/abs\/2305.09434"},{"key":"e_1_3_3_123_2","unstructured":"Zhe Liu Cheng Li Chunyang Chen Junjie Wang Boyu Wu Yawen Wang Jun Hu and Qing Wang. 2024. Vision-driven automated mobile GUI testing via multimodal large language model. arXiv:2407.03037. Retrieved from https:\/\/arxiv.org\/abs\/2407.03037"},{"key":"e_1_3_3_124_2","unstructured":"Zhijie Liu Yutian Tang Meiyun Li Xin Jin Yunfei Long Liang Feng Zhang and Xiapu Luo. 2024. LLM-CompDroid: Repairing configuration compatibility bugs in android apps with pre-trained large language models. arXiv:2402.15078. Retrieved from https:\/\/arxiv.org\/abs\/2402.15078"},{"key":"e_1_3_3_125_2","first-page":"866","volume-title":"Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing: Industry Track","author":"Lomshakov Vadim","year":"2024","unstructured":"Vadim Lomshakov, Andrey Podivilov, Sergey Savin, Oleg Baryshnikov, Alena Lisevych, and Sergey Nikolenko. 2024. ProConSuL: Project context for code summarization with LLMs. In Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing: Industry Track, 866\u2013880."},{"issue":"4","key":"e_1_3_3_126_2","first-page":"1433","article-title":"Robust few-shot learning for user-provided data","volume":"32","author":"Lu Jiang","year":"2020","unstructured":"Jiang Lu, Sheng Jin, Jian Liang, and Changshui Zhang. 2020. Robust few-shot learning for user-provided data. IEEE Transactions on Neural Networks and Learning Systems 32, 4 (2020), 1433\u20131447.","journal-title":"IEEE Transactions on Neural Networks and Learning Systems"},{"key":"e_1_3_3_127_2","unstructured":"Shuai Lu Daya Guo Shuo Ren Junjie Huang Alexey Svyatkovskiy Ambrosio Blanco Colin Clement Dawn Drain Daxin Jiang Duyu Tang et al. 2021. Codexglue: A machine learning benchmark dataset for code understanding and generation. arXiv:2102.04664. Retrieved from https:\/\/arxiv.org\/abs\/2102.04664"},{"key":"e_1_3_3_128_2","doi-asserted-by":"publisher","DOI":"10.1145\/3395363.3397369"},{"key":"e_1_3_3_129_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR52733.2024.00650"},{"key":"e_1_3_3_130_2","doi-asserted-by":"publisher","DOI":"10.1145\/3639478.3643114"},{"key":"e_1_3_3_131_2","doi-asserted-by":"publisher","DOI":"10.1109\/MSR52588.2021.00063"},{"key":"e_1_3_3_132_2","unstructured":"CMorgan McFall-Johnsen. 2020. Catastrophic Software Errors Doomed Boeing\u2019s Airplanes and Nearly Destroyed Its NASA Spaceship. Experts Blame the Leadership\u2019s \u2018Lack of Engineering Culture\u2019. Retrieved September 1 2024 from https:\/\/www.isvworld.com\/search\/news\/353384"},{"key":"e_1_3_3_133_2","unstructured":"Sergey Mechtaev. 2024. program-repair.org. Retrieved October 22 2024 from https:\/\/en.wikipedia.org\/wiki\/Automatic_bug_fixing"},{"issue":"64","key":"e_1_3_3_134_2","first-page":"2","article-title":"Recurrent neural networks","volume":"5","author":"Medsker Larry R.","year":"2001","unstructured":"Larry R. Medsker and Lakhmi Jain. 2001. Recurrent neural networks. Design and Applications 5, 64\u201367 (2001), 2.","journal-title":"Design and Applications"},{"key":"e_1_3_3_135_2","doi-asserted-by":"publisher","DOI":"10.1145\/3597503.3639182"},{"key":"e_1_3_3_136_2","doi-asserted-by":"publisher","DOI":"10.1145\/2884781.2884853"},{"key":"e_1_3_3_137_2","doi-asserted-by":"publisher","DOI":"10.1145\/3105906"},{"key":"e_1_3_3_138_2","unstructured":"Martin Monperrus Matias Martinez He Ye Fernanda Madeiral Thomas Durieux and Zhongxing Yu. 2021. Megadiff: A dataset of 600k Java source code changes categorized by diff size. arXiv:2108.04631. Retrieved from https:\/\/arxiv.org\/abs\/2108.04631"},{"key":"e_1_3_3_139_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE48619.2023.00109"},{"key":"e_1_3_3_140_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE48619.2023.00205"},{"key":"e_1_3_3_141_2","first-page":"772","volume-title":"Proceedings of the 2013 35th International Conference on Software Engineering (ICSE)","author":"Duong Thien Nguyen Hoang","year":"2013","unstructured":"Hoang Duong Thien Nguyen, Dawei Qi, Abhik Roychoudhury, and Satish Chandra. 2013. Semfix: Program repair via semantic analysis. In Proceedings of the 2013 35th International Conference on Software Engineering (ICSE). IEEE, 772\u2013781."},{"key":"e_1_3_3_142_2","unstructured":"Erik Nijkamp Bo Pang Hiroaki Hayashi Lifu Tu Huan Wang Yingbo Zhou Silvio Savarese and Caiming Xiong. 2022. Codegen: An open large language model for code with multi-turn program synthesis. arXiv:2203.13474. Retrieved from https:\/\/arxiv.org\/abs\/2203.13474"},{"key":"e_1_3_3_143_2","doi-asserted-by":"publisher","DOI":"10.1145\/3524459.3527346"},{"key":"e_1_3_3_144_2","unstructured":"OpenAI. 2024. GPT Family. Retrieved from https:\/\/openai.com"},{"key":"e_1_3_3_145_2","unstructured":"Jiayi Pan Xingyao Wang Graham Neubig Navdeep Jaitly Ji Heng Alane Suhr and Yizhe Zhang. 2024. Training software engineering agents and verifiers with SWE-Gym. arXiv:2412.21139. Retrieved from https:\/\/arxiv.org\/abs\/2412.21139"},{"issue":"7","key":"e_1_3_3_146_2","article-title":"Unifying large language models and knowledge graphs: A roadmap","volume":"36","author":"Pan Shirui","year":"2024","unstructured":"Shirui Pan, Linhao Luo, Yufei Wang, Chen Chen, Jiapu Wang, and Xindong Wu. 2024. Unifying large language models and knowledge graphs: A roadmap. IEEE Transactions on Knowledge and Data Engineering 36, 7 (2024), 3580\u20133599.","journal-title":"IEEE Transactions on Knowledge and Data Engineering"},{"key":"e_1_3_3_147_2","first-page":"280","volume-title":"Proceedings of the 2011 17th IEEE Real-Time and Embedded Technology and Applications Symposium","author":"Paolieri Marco","year":"2011","unstructured":"Marco Paolieri, Eduardo Qui\u00f1ones, Francisco J. Cazorla, Robert I. Davis, and Mateo Valero. 2011. IA \\(\\hat{}\\) 3: An interference aware allocation algorithm for multicore hard real-time systems. In Proceedings of the 2011 17th IEEE Real-Time and Embedded Technology and Applications Symposium. IEEE, 280\u2013290."},{"key":"e_1_3_3_148_2","first-page":"311","volume-title":"Proceedings of the 40th Annual Meeting of the Association for Computational Linguistics","author":"Papineni Kishore","year":"2002","unstructured":"Kishore Papineni, Salim Roukos, Todd Ward, and Wei-Jing Zhu. 2002. Bleu: A method for automatic evaluation of machine translation. In Proceedings of the 40th Annual Meeting of the Association for Computational Linguistics, 311\u2013318."},{"key":"e_1_3_3_149_2","unstructured":"Nikhil Parasaram Huijie Yan Boyu Yang Zineb Flahy Abriele Qudsi Damian Ziaber Earl Barr and Sergey Mechtaev. 2024. The fact selection problem in LLM-based program repair. arXiv:2404.05520. Retrieved from https:\/\/arxiv.org\/abs\/2404.05520"},{"issue":"5","key":"e_1_3_3_150_2","article-title":"A review of current trends, techniques, and challenges in large language models (LLMs)","volume":"14","author":"Patil Rajvardhan","year":"2024","unstructured":"Rajvardhan Patil and Venkat Gudivada. 2024. A review of current trends, techniques, and challenges in large language models (LLMs). Applied Sciences 14, 5 (2024), 2074. Retrieved from https:\/\/doi.org\/10.3390\/app14052074","journal-title":"Applied Sciences"},{"key":"e_1_3_3_151_2","unstructured":"Rishov Paul Md Mohib Hossain Mohammed Latif Siddiq Masum Hasan Anindya Iqbal and Joanna C. S. Santos. 2023. Enhancing automated program repair through fine-tuning and prompt engineering. arXiv:2304.07840. Retrieved from https:\/\/arxiv.org\/abs\/2304.07840"},{"key":"e_1_3_3_152_2","doi-asserted-by":"publisher","DOI":"10.1145\/3597503.3608132"},{"key":"e_1_3_3_153_2","unstructured":"Minh V. T. Pham Huy N. Phan Hoang N. Phan Cuong Le Chi Tien N. Nguyen and Nghi D. Q. Bui. 2025. SWE-Synth: Synthesizing verifiable bug-fix data to enable large language models in resolving real-world bugs. arXiv:2504.14757. Retrieved from https:\/\/arxiv.org\/abs\/2504.14757"},{"key":"e_1_3_3_154_2","doi-asserted-by":"crossref","unstructured":"Emmanouil Antonios Platanios Otilia Stretcu Graham Neubig Barnabas Poczos and Tom M. Mitchell. 2019. Competence-based curriculum learning for neural machine translation. arXiv:1903.09848. Retrieved from https:\/\/arxiv.org\/abs\/1903.09848","DOI":"10.18653\/v1\/N19-1119"},{"key":"e_1_3_3_155_2","first-page":"69","volume-title":"Proceedings of the 2022 IEEE\/ACM International Workshop on Automated Program Repair (APR)","author":"Prenner Julian Aron","year":"2022","unstructured":"Julian Aron Prenner, Hlib Babii, and Romain Robbes. 2022. Can OpenAI\u2019s codex fix bugs? An evaluation on QuixBugs. In Proceedings of the 2022 IEEE\/ACM International Workshop on Automated Program Repair (APR), 69\u201375. Retrieved from https:\/\/doi.org\/10.1145\/3524459.3527351"},{"key":"e_1_3_3_156_2","unstructured":"Julian Aron Prenner and Romain Robbes. 2021. Automatic program repair with OpenAI\u2019s codex: Evaluating quixbugs. arXiv:2111.03922. Retrieved from https:\/\/arxiv.org\/abs\/2111.03922"},{"key":"e_1_3_3_157_2","unstructured":"Julian Aron Prenner and Romain Robbes. 2023. Out of context: How important is local context in neural program repair? arXiv:2312.04986. Retrieved from https:\/\/arxiv.org\/abs\/2312.04986"},{"key":"e_1_3_3_158_2","unstructured":"George Pu Anirudh Jain Jihan Yin and Russell Kaplan. 2023. Empirical analysis of the strengths and weaknesses of PEFT techniques for LLMs. arXiv:2304.14999. Retrieved from https:\/\/arxiv.org\/abs\/2304.14999"},{"key":"e_1_3_3_159_2","first-page":"8630","volume-title":"Proceedings of the International Conference on Machine Learning","author":"Qi Weizhen","year":"2021","unstructured":"Weizhen Qi, Yeyun Gong, Jian Jiao, Yu Yan, Weizhu Chen, Dayiheng Liu, Kewen Tang, Houqiang Li, Jiusheng Chen, Ruofei Zhang, et al. 2021. Bang: Bridging autoregressive and non-autoregressive generation with large scale pretraining. In Proceedings of the International Conference on Machine Learning. PMLR, 8630\u20138639."},{"key":"e_1_3_3_160_2","doi-asserted-by":"publisher","DOI":"10.1145\/2771783.2771791"},{"key":"e_1_3_3_161_2","unstructured":"Alec Radford and Karthik Narasimhan. 2018. Improving Language Understanding by Generative Pre-Training. Retrieved from https:\/\/api.semanticscholar.org\/CorpusID:49313245"},{"issue":"8","key":"e_1_3_3_162_2","first-page":"9","article-title":"Language models are unsupervised multitask learners","volume":"1","author":"Radford Alec","year":"2019","unstructured":"Alec Radford, Jeffrey Wu, Rewon Child, David Luan, Dario Amodei, and Ilya Sutskever. 2019. Language models are unsupervised multitask learners. OpenAI Blog 1, 8 (2019), 9.","journal-title":"OpenAI Blog"},{"key":"e_1_3_3_163_2","doi-asserted-by":"crossref","first-page":"53728","DOI":"10.52202\/075280-2338","article-title":"Direct preference optimization: Your language model is secretly a reward model","volume":"36","author":"Rafailov Rafael","year":"2023","unstructured":"Rafael Rafailov, Archit Sharma, Eric Mitchell, Christopher D. Manning, Stefano Ermon, and Chelsea Finn. 2023. Direct preference optimization: Your language model is secretly a reward model. In Proceedings of the Advances in Neural Information Processing Systems, Vol. 36, 53728\u201353741.","journal-title":"Proceedings of the Advances in Neural Information Processing Systems"},{"key":"e_1_3_3_164_2","unstructured":"Colin Raffel Noam Shazeer Adam Roberts Katherine Lee Sharan Narang Michael Matena Yanqi Zhou Wei Li and Peter J. Liu. 2023. Exploring the limits of transfer learning with a unified text-to-text transformer. arXiv:1910.10683. Retrieved from https:\/\/arxiv.org\/abs\/1910.10683"},{"key":"e_1_3_3_165_2","unstructured":"Daniel Ramos Claudia Mamede Kush Jain Paulo Canelas Catarina Gamboa and Claire Le Goues. 2024. Are large language models memorizing bug benchmarks? arXiv:2411.13323. Retrieved from https:\/\/arxiv.org\/abs\/2411.13323"},{"key":"e_1_3_3_166_2","doi-asserted-by":"publisher","DOI":"10.1561\/1500000019"},{"key":"e_1_3_3_167_2","doi-asserted-by":"publisher","DOI":"10.1145\/3663529.3663841"},{"key":"e_1_3_3_168_2","unstructured":"Baptiste Roziere Jonas Gehring Fabian Gloeckle Sten Sootla Itai Gat Xiaoqing Ellen Tan Yossi Adi Jingyu Liu Romain Sauvestre Tal Remez et al. 2023. Code Llama: Open foundation models for code. arXiv:2308.12950. Retrieved from https:\/\/arxiv.org\/abs\/2308.12950"},{"key":"e_1_3_3_169_2","doi-asserted-by":"publisher","DOI":"10.1109\/MSR.2019.00055"},{"key":"e_1_3_3_170_2","unstructured":"Murray Shanahan. 2023. Talking about large language models. arXiv:2212.03551. Retrieved from https:\/\/arxiv.org\/abs\/2212.03551"},{"key":"e_1_3_3_171_2","doi-asserted-by":"publisher","unstructured":"Zhidong Shen Si Chen and Luigi Coppolino. 2020. A survey of automatic software vulnerability detection program repair and defect prediction techniques. Security and Communication Networks 2020 (Jan. 2020) 16 pages. DOI: 10.1155\/2020\/8858010","DOI":"10.1155\/2020\/8858010"},{"key":"e_1_3_3_172_2","unstructured":"Andr\u00e9 Silva Sen Fang and Martin Monperrus. 2024. RepairLLaMA: Efficient representations and fine-tuned adapters for program repair. arXiv:231215698. Retrieved from https:\/\/arxiv.org\/abs\/2312.15698"},{"key":"e_1_3_3_173_2","doi-asserted-by":"publisher","DOI":"10.1145\/3643991.3644884"},{"key":"e_1_3_3_174_2","doi-asserted-by":"publisher","DOI":"10.1145\/2786805.2786825"},{"key":"e_1_3_3_175_2","unstructured":"Zhongxiang Sun. 2023. A short survey of viewing large language models in legal aspect. arXiv:2303.09136. Retrieved from https:\/\/arxiv.org\/abs\/2303.09136"},{"key":"e_1_3_3_176_2","unstructured":"Fahim Tajwar Anikait Singh Archit Sharma Rafael Rafailov Jeff Schneider Tengyang Xie Stefano Ermon Chelsea Finn and Aviral Kumar. 2024. Preference fine-tuning of LLMs should leverage suboptimal on-policy data. arXiv:2404.14367. Retrieved from https:\/\/arxiv.org\/abs\/2404.14367"},{"key":"e_1_3_3_177_2","first-page":"2024","article-title":"Domain-specific LLM development and evaluation\u2014A case-study for prostate cancer","author":"Tariq Amara","year":"2024","unstructured":"Amara Tariq, Man Luo, Aisha Urooj, Avisha Das, Jiwoong Jeong, Shubham Trivedi, Bhavik Patel, and Imon Banerjee. 2024. Domain-specific LLM development and evaluation\u2014A case-study for prostate cancer. medRxiv (2024), 2024\u20132003.","journal-title":"medRxiv"},{"key":"e_1_3_3_178_2","unstructured":"Hugo Touvron Louis Martin Kevin Stone Peter Albert Amjad Almahairi Yasmine Babaei Nikolay Bashlykov Soumya Batra Prajjwal Bhargava Shruti Bhosale et al. 2023. Llama 2: Open foundation and fine-tuned chat models. arXiv:2307.09288. Retrieved from https:\/\/arxiv.org\/abs\/2307.09288"},{"key":"e_1_3_3_179_2","unstructured":"Harsh Trivedi Niranjan Balasubramanian Tushar Khot and Ashish Sabharwal. 2022. Interleaving retrieval with chain-of-thought reasoning for knowledge-intensive multi-step questions. arXiv:2212.10509. Retrieved from https:\/\/arxiv.org\/abs\/2212.10509"},{"key":"e_1_3_3_180_2","doi-asserted-by":"publisher","DOI":"10.1145\/3340544"},{"key":"e_1_3_3_181_2","doi-asserted-by":"publisher","DOI":"10.1145\/3340544"},{"key":"e_1_3_3_182_2","doi-asserted-by":"publisher","DOI":"10.3389\/frobt.2017.00009"},{"key":"e_1_3_3_183_2","unstructured":"Ashish Vaswani Noam Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan N. Gomez Lukasz Kaiser and Illia Polosukhin. 2023. Attention is all you need. arXiv:1706.03762. Retrieved from https:\/\/arxiv.org\/abs\/1706.03762"},{"key":"e_1_3_3_184_2","doi-asserted-by":"publisher","DOI":"10.1145\/3643762"},{"key":"e_1_3_3_185_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2024.3368208"},{"key":"e_1_3_3_186_2","first-page":"1","volume-title":"Proceedings of the 2019 ACM\/IEEE International Symposium on Empirical Software Engineering and Measurement (ESEM)","author":"Wang Shangwen","year":"2019","unstructured":"Shangwen Wang, Ming Wen, Liqian Chen, Xin Yi, and Xiaoguang Mao. 2019. How different is it between machine-generated and developer-provided patches? An empirical study on the correct patches generated by automated program repair techniques. In Proceedings of the 2019 ACM\/IEEE International Symposium on Empirical Software Engineering and Measurement (ESEM). IEEE, 1\u201312."},{"key":"e_1_3_3_187_2","doi-asserted-by":"crossref","unstructured":"Weishi Wang Yue Wang Shafiq Joty and Steven C. H. Hoi. 2023. RAP-Gen: Retrieval-augmented patch generation with CodeT5 for automatic program repair. arXiv:2309.06057. Retrieved from https:\/\/arxiv.org\/abs\/2309.06057","DOI":"10.1145\/3611643.3616256"},{"key":"e_1_3_3_188_2","volume-title":"Proceedings of the 13th International Conference on Learning Representations","author":"Wang Xingyao","year":"2024","unstructured":"Xingyao Wang, Boxuan Li, Yufan Song, Frank F. Xu, Xiangru Tang, Mingchen Zhuge, Jiayi Pan, Yueqi Song, Bowen Li, Jaskirat Singh, et al. 2024. Openhands: An open platform for AI software developers as generalist agents. In Proceedings of the 13th International Conference on Learning Representations."},{"key":"e_1_3_3_189_2","unstructured":"Xingyao Wang Boxuan Li Yufan Song Frank F. Xu Xiangru Tang Mingchen Zhuge Jiayi Pan Yueqi Song Bowen Li Jaskirat Singh et al. 2025. OpenHands: An open platform for AI software developers as generalist agents. arXiv:2407.16741. Retrieved from https:\/\/arxiv.org\/abs\/2407.16741"},{"key":"e_1_3_3_190_2","doi-asserted-by":"publisher","DOI":"10.1109\/OJCS.2023.3300321"},{"key":"e_1_3_3_191_2","unstructured":"You Wang Michael Pradel and Zhongxin Liu. 2025. Are \u201csolved issues\u201d in SWE-bench really solved correctly? An empirical study. arXiv:2503.15223. Retrieved from https:\/\/arxiv.org\/abs\/2503.15223"},{"key":"e_1_3_3_192_2","doi-asserted-by":"crossref","unstructured":"Yue Wang Weishi Wang Shafiq Joty and Steven C. H. Hoi. 2021. CodeT5: Identifier-aware unified pre-trained encoder-decoder models for code understanding and generation. arXiv:2109.00859. Retrieved from https:\/\/arxiv.org\/abs\/2109.00859","DOI":"10.18653\/v1\/2021.emnlp-main.685"},{"key":"e_1_3_3_193_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR52688.2022.01426"},{"key":"e_1_3_3_194_2","unstructured":"Jason Wei Yi Tay Rishi Bommasani Colin Raffel Barret Zoph Sebastian Borgeaud Dani Yogatama Maarten Bosma Denny Zhou Donald Metzler et al. 2022. Emergent abilities of large language models. arXiv:220607682. Retrieved from https:\/\/arxiv.org\/abs\/2206.07682"},{"key":"e_1_3_3_195_2","doi-asserted-by":"crossref","unstructured":"Jason Wei Xuezhi Wang Dale Schuurmans Maarten Bosma Brian Ichter Fei Xia Ed Chi Quoc Le and Denny Zhou. 2023. Chain-of-thought prompting elicits reasoning in large language models. arXiv:2201.11903. Retrieved from https:\/\/arxiv.org\/abs\/2201.11903","DOI":"10.52202\/068431-1800"},{"key":"e_1_3_3_196_2","doi-asserted-by":"publisher","DOI":"10.1145\/3597503.3639177"},{"key":"e_1_3_3_197_2","doi-asserted-by":"publisher","DOI":"10.1145\/1831708.1831716"},{"key":"e_1_3_3_198_2","doi-asserted-by":"publisher","DOI":"10.1145\/3611643.3616271"},{"key":"e_1_3_3_199_2","unstructured":"Martin Weyssow Xin Zhou Kisub Kim David Lo and Houari Sahraoui. 2023. Exploring parameter-efficient fine-tuning techniques for code generation with large language models. arXiv:2308.10462. Retrieved from https:\/\/arxiv.org\/abs\/2308.10462"},{"key":"e_1_3_3_200_2","doi-asserted-by":"publisher","DOI":"10.1109\/SANER.2019.8668043"},{"key":"e_1_3_3_201_2","doi-asserted-by":"publisher","DOI":"10.1145\/3368089.3417943"},{"issue":"3","key":"e_1_3_3_202_2","doi-asserted-by":"crossref","first-page":"2497","DOI":"10.1007\/s10462-022-10228-y","article-title":"Monte Carlo tree search: A review of recent modifications and applications","volume":"56","author":"Wiechowski Maciej","year":"2023","unstructured":"Maciej Wiechowski, Konrad Godlewski, Bartosz Sawicki, and Jacek Ma\u0144dziuk. 2023. Monte Carlo tree search: A review of recent modifications and applications. Artificial Intelligence Review 56, 3 (2023), 2497\u20132562.","journal-title":"Artificial Intelligence Review"},{"issue":"1","key":"e_1_3_3_203_2","doi-asserted-by":"crossref","first-page":"419","DOI":"10.1109\/TSE.2022.3152089","article-title":"Let\u2019s talk with developers, not about developers: A review of automatic program repair research","volume":"49","author":"Winter Emily","year":"2022","unstructured":"Emily Winter, Vesna Nowack, David Bowes, Steve Counsell, Tracy Hall, S\u00e6mundur Haraldsson, and John Woodward. 2022. Let\u2019s talk with developers, not about developers: A review of automatic program repair research. IEEE Transactions on Software Engineering 49, 1 (2022), 419\u2013436.","journal-title":"IEEE Transactions on Software Engineering"},{"key":"e_1_3_3_204_2","doi-asserted-by":"publisher","DOI":"10.1145\/3468264.3468600"},{"key":"e_1_3_3_205_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2016.2521368"},{"key":"e_1_3_3_206_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR52688.2022.00780"},{"key":"e_1_3_3_207_2","volume-title":"Proceedings of the 13th International Conference on Learning Representations","author":"Wu Yangzhen","year":"2025","unstructured":"Yangzhen Wu, Zhiqing Sun, Shanda Li, Sean Welleck, and Yiming Yang. 2025. Inference scaling laws: An empirical analysis of compute-optimal inference for LLM problem-solving. In Proceedings of the 13th International Conference on Learning Representations."},{"key":"e_1_3_3_208_2","unstructured":"Zihao Wu Lu Zhang Chao Cao Xiaowei Yu Haixing Dai Chong Ma Zhengliang Liu Lin Zhao Gang Li Wei Liu et al. 2023. Exploring the trade-offs: Unified large language models vs local fine-tuned models for highly-specific radiology NLI task. arXiv:2304.09138. Retrieved from https:\/\/arxiv.org\/abs\/2304.09138"},{"key":"e_1_3_3_209_2","unstructured":"Zhiheng Xi Wenxiang Chen Xin Guo Wei He Yiwen Ding Boyang Hong Ming Zhang Junzhe Wang Senjie Jin Enyu Zhou et al. 2023. The rise and potential of large language model based agents: A survey. arXiv:2309.07864. Retrieved from https:\/\/arxiv.org\/abs\/2309.07864"},{"key":"e_1_3_3_210_2","unstructured":"Chunqiu Steven Xia Yinlin Deng Soren Dunn and Lingming Zhang. 2024. Agentless: Demystifying LLM-based software engineering agents. arXiv:240701489. Retrieved from https:\/\/arxiv.org\/abs\/2407.01489"},{"key":"e_1_3_3_211_2","doi-asserted-by":"publisher","DOI":"10.1109\/ASE56229.2023.00047"},{"key":"e_1_3_3_212_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE48619.2023.00129"},{"key":"e_1_3_3_213_2","doi-asserted-by":"publisher","DOI":"10.1145\/3540250.3549101"},{"key":"e_1_3_3_214_2","unstructured":"Chunqiu Steven Xia and Lingming Zhang. 2023. Conversational automated program repair. arXiv:2301.13246. Retrieved from https:\/\/arxiv.org\/abs\/2301.13246"},{"key":"e_1_3_3_215_2","unstructured":"Chunqiu Steven Xia and Lingming Zhang. 2023. Keep the conversation going: Fixing 162 out of 337 bugs for $0.42 each using ChatGPT. arXiv:2304.00385. Retrieved from https:\/\/arxiv.org\/abs\/2304.00385"},{"key":"e_1_3_3_216_2","unstructured":"Jiahong Xiang Xiaoyang Xu Fanchu Kong Mingyuan Wu Zizheng Zhang Haotian Zhang and Yuqun Zhang. 2024. How far can we go with practical function-level program repair? arXiv:2404.12833. Retrieved from https:\/\/arxiv.org\/abs\/2404.12833"},{"key":"e_1_3_3_217_2","unstructured":"Yijun Xiao and William Yang Wang. 2021. On hallucination and predictive uncertainty in conditional language generation. arXiv:2103.15025. Retrieved from https:\/\/arxiv.org\/abs\/2103.15025"},{"key":"e_1_3_3_218_2","doi-asserted-by":"publisher","DOI":"10.1109\/ASE56229.2023.00012"},{"key":"e_1_3_3_219_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2024.3359969"},{"key":"e_1_3_3_220_2","unstructured":"Chengxing Xie Bowen Li Chang Gao He Du Wai Lam Difan Zou and Kai Chen. 2025. SWE-Fixer: Training open-source LLMs for effective and efficient GitHub issue resolution. arXiv:2501.05040. Retrieved from https:\/\/arxiv.org\/abs\/2501.05040"},{"key":"e_1_3_3_221_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.knosys.2020.105548"},{"key":"e_1_3_3_222_2","first-page":"10","volume-title":"Proceedings of the 2019 IEEE\/ACM International Workshop on Genetic Improvement (GI)","author":"Xin Qi","year":"2019","unstructured":"Qi Xin and Steven Reiss. 2019. Better code search and reuse for better program repair. In Proceedings of the 2019 IEEE\/ACM International Workshop on Genetic Improvement (GI), 10\u201317. Retrieved from https:\/\/doi.org\/10.1109\/GI.2019.00012"},{"key":"e_1_3_3_223_2","unstructured":"Junjielong Xu Ying Fu Shin Hwei Tan and Pinjia He. 2024. Aligning the objective of LLM-based program repair. arXiv:2404.08877. Retrieved from https:\/\/arxiv.org\/abs\/2404.08877"},{"key":"e_1_3_3_224_2","unstructured":"Kangwei Xu Grace Li Zhang Xunzhao Yin Cheng Zhuo Ulf Schlichtmann and Bing Li. 2024. Automated C\/C++ program repair for high-level synthesis via large language models. arXiv:2407.03889. Retrieved from https:\/\/arxiv.org\/abs\/2407.03889"},{"key":"e_1_3_3_225_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2016.2560811"},{"key":"e_1_3_3_226_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.infsof.2022.107043"},{"key":"e_1_3_3_227_2","unstructured":"Aidan Z. H. Yang Sophia Kolak Vincent J. Hellendoorn Ruben Martins and Claire Le Goues. 2024. Revisiting unnaturalness for automated program repair in the era of large language models. arXiv:2404.15236. Retrieved from https:\/\/arxiv.org\/abs\/2404.15236"},{"key":"e_1_3_3_228_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10664-021-10003-7"},{"key":"e_1_3_3_229_2","doi-asserted-by":"crossref","unstructured":"John Yang Carlos E. Jimenez Alexander Wettig Kilian Lieret Shunyu Yao Karthik Narasimhan and Ofir Press. 2024. SWE-agent: Agent-computer interfaces enable automated software engineering. arXiv:2405.15793. Retrieved from https:\/\/arxiv.org\/abs\/2405.15793","DOI":"10.52202\/079017-1601"},{"key":"e_1_3_3_230_2","unstructured":"John Yang Carlos E. Jimenez Alex L. Zhang Kilian Lieret Joyce Yang Xindi Wu Ori Press Niklas Muennighoff Gabriel Synnaeve Karthik R. Narasimhan et al. 2024. SWE-bench multimodal: Do AI systems generalize to visual software domains? arXiv:2410.03859. Retrieved from https:\/\/arxiv.org\/abs\/2410.03859"},{"key":"e_1_3_3_231_2","volume-title":"Proceedings of the International Conference on Learning Representations (ICLR)","author":"Yao Shunyu","year":"2023","unstructured":"Shunyu Yao, Jeffrey Zhao, Dian Yu, Nan Du, Izhak Shafran, Karthik Narasimhan, and Yuan Cao. 2023. React: Synergizing reasoning and acting in language models. In Proceedings of the International Conference on Learning Representations (ICLR)."},{"key":"e_1_3_3_232_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2020.110825"},{"key":"e_1_3_3_233_2","doi-asserted-by":"publisher","DOI":"10.1145\/3510003.3510222"},{"key":"e_1_3_3_234_2","doi-asserted-by":"crossref","unstructured":"Xin Yin Chao Ni Shaohua Wang Zhenhao Li Limin Zeng and Xiaohu Yang. 2024. ThinkRepair: Self-directed automated program repair. arXiv:2407.20898. Retrieved from https:\/\/arxiv.org\/abs\/2407.20898","DOI":"10.1145\/3650212.3680359"},{"key":"e_1_3_3_235_2","unstructured":"Xiao Yu Lei Liu Xing Hu Jacky Wai Keung Jin Liu and Xin Xia. 2024. Fight fire with fire: How much can we trust chatgpt on source code-related tasks? arXiv:2405.12641. Retrieved from https:\/\/arxiv.org\/abs\/2405.12641"},{"key":"e_1_3_3_236_2","doi-asserted-by":"crossref","unstructured":"Wei Yuan Quanjun Zhang Tieke He Chunrong Fang Nguyen Quoc Viet Hung Xiaodong Hao and Hongzhi Yin. 2022. CIRCLE: Continual repair across programming languages. arXiv:2205.10956. Retrieved from https:\/\/arxiv.org\/abs\/2205.10956","DOI":"10.1145\/3533767.3534219"},{"key":"e_1_3_3_237_2","unstructured":"Lyuye Zhang Kaixuan Li Kairan Sun Daoyuan Wu Ye Liu Haoye Tian and Yang Liu. 2024. Acfix: Guiding LLMs with mined common RBAC practices for context-aware repair of access control vulnerabilities in smart contracts. arXiv:2403.06838. Retrieved from https:\/\/arxiv.org\/abs\/2403.06838"},{"key":"e_1_3_3_238_2","doi-asserted-by":"publisher","unstructured":"Quanjun Zhang Chunrong Fang Yuxiang Ma Weisong Sun and Zhenyu Chen. 2023. A survey of learning-based automated program repair. ACM Transactions on Software Engineering and Methodology 33 2 Article 55 (Dec. 2023) 69 pages. DOI: 10.1145\/3631974","DOI":"10.1145\/3631974"},{"key":"e_1_3_3_239_2","unstructured":"Quanjun Zhang Chunrong Fang Yang Xie YuXiang Ma Weisong Sun Yun Yang and Zhenyu Chen. 2024. A systematic literature review on large language models for automated program repair. arXiv:2405.01466. Retrieved from https:\/\/arxiv.org\/abs\/2405.01466"},{"key":"e_1_3_3_240_2","doi-asserted-by":"publisher","DOI":"10.1109\/ASE56229.2023.00063"},{"key":"e_1_3_3_241_2","unstructured":"Quanjun Zhang Tongke Zhang Juan Zhai Chunrong Fang Bowen Yu Weisong Sun and Zhenyu Chen. 2024. A critical review of large language model on software engineering: An example from ChatGPT and automated program repair. arXiv:2310.08879. Retrieved from https:\/\/arxiv.org\/abs\/2310.08879"},{"key":"e_1_3_3_242_2","unstructured":"Quanjun Zhang Yuan Zhao Weisong Sun Chunrong Fang Ziyuan Wang and Lingming Zhang. 2022. Program repair: Automated vs. manual. arXiv:2203.05166. Retrieved from https:\/\/arxiv.org\/abs\/2203.05166"},{"key":"e_1_3_3_243_2","unstructured":"Ting Zhang Ivana Clairine Irsan Ferdian Thung David Lo Asankhaya Sharma and Lingxiao Jiang. 2023. Evaluating pre-trained language models for repairing API misuses. arXiv:2310.16390. Retrieved from https:\/\/arxiv.org\/abs\/2310.16390"},{"key":"e_1_3_3_244_2","doi-asserted-by":"publisher","DOI":"10.1145\/3377813.3381356"},{"key":"e_1_3_3_245_2","doi-asserted-by":"crossref","unstructured":"Yuntong Zhang Haifeng Ruan Zhiyu Fan and Abhik Roychoudhury. 2024. AutoCodeRover: Autonomous program improvement. arXiv:2404.05427. Retrieved from https:\/\/arxiv.org\/abs\/2404.05427","DOI":"10.1145\/3650212.3680384"},{"key":"e_1_3_3_246_2","unstructured":"Wayne Xin Zhao Kun Zhou Junyi Li Tianyi Tang Xiaolei Wang Yupeng Hou Yingqian Min Beichen Zhang Junjie Zhang Zican Dong et al. 2024. A survey of large language models. arXiv:230318223. Retrieved from https:\/\/arxiv.org\/abs\/2303.18223"},{"key":"e_1_3_3_247_2","doi-asserted-by":"crossref","unstructured":"Yuze Zhao Zhenya Huang Yixiao Ma Rui Li Kai Zhang Hao Jiang Qi Liu Linbo Zhu and Yu Su. 2024. Repair: Automated program repair with process-based feedback. arXiv:2408.11296. Retrieved from https:\/\/arxiv.org\/abs\/2408.11296","DOI":"10.18653\/v1\/2024.findings-acl.973"},{"key":"e_1_3_3_248_2","doi-asserted-by":"publisher","DOI":"10.1145\/3545258.3545268"},{"key":"e_1_3_3_249_2","unstructured":"Xin Zhou Sicong Cao Xiaobing Sun and David Lo. 2024. Large language model for vulnerability detection and repair: Literature review and the road ahead. arXiv:2404.02525. Retrieved from https:\/\/arxiv.org\/abs\/2404.02525"},{"key":"e_1_3_3_250_2","doi-asserted-by":"publisher","DOI":"10.1145\/3597503.3639222"},{"key":"e_1_3_3_251_2","unstructured":"Xin Zhou Bowen Xu Kisub Kim DongGyun Han Thanh Le-Cong Junda He Bach Le and David Lo. 2023. PatchZero: Zero-shot automatic patch correctness assessment. arXiv:2303.00202. Retrieved from https:\/\/arxiv.org\/abs\/2303.00202"},{"key":"e_1_3_3_252_2","unstructured":"Zhi Zhou Jiang-Xin Shi Peng-Xiao Song Xiao-Wen Yang Yi-Xuan Jin Lan-Zhe Guo and Yu-Feng Li. 2024. LawGPT: A Chinese legal knowledge-enhanced large language model. arXiv:2406.04614. Retrieved from https:\/\/arxiv.org\/abs\/2406.04614"},{"key":"e_1_3_3_253_2","doi-asserted-by":"publisher","DOI":"10.1145\/3468264.3468544"},{"key":"e_1_3_3_254_2","unstructured":"Wentao Zou Qi Li Jidong Ge Chuanyi Li Xiaoyu Shen Liguo Huang and Bin Luo. 2023. A comprehensive evaluation of parameter-efficient fine-tuning on software engineering tasks. arXiv:2312.15614. Retrieved from https:\/\/arxiv.org\/abs\/2312.15614"},{"key":"e_1_3_3_255_2","unstructured":"Albert \u00d6rwall. 2024. Moatless Tools. Retrieved from https:\/\/github.com\/aorwall\/moatless-tools\/"}],"container-title":["ACM Transactions on Software Engineering and Methodology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3764584","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,7,17]],"date-time":"2026-07-17T16:04:51Z","timestamp":1784304291000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3764584"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,7,17]]},"references-count":254,"journal-issue":{"issue":"8","published-print":{"date-parts":[[2026,8,31]]}},"alternative-id":["10.1145\/3764584"],"URL":"https:\/\/doi.org\/10.1145\/3764584","relation":{},"ISSN":["1049-331X","1557-7392"],"issn-type":[{"value":"1049-331X","type":"print"},{"value":"1557-7392","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,7,17]]},"assertion":[{"value":"2025-01-04","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-08-17","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2026-07-17","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}