{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,11,18]],"date-time":"2026-11-18T03:36:57Z","timestamp":1794973017867,"version":"4.9.1"},"reference-count":53,"publisher":"Association for Computing Machinery (ACM)","issue":"7","funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"crossref","award":["62172311"],"award-info":[{"award-number":["62172311"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]},{"name":"Major Science and Technology Project of Hubei Province","award":["2024BAA008"],"award-info":[{"award-number":["2024BAA008"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Softw. Eng. Methodol."],"published-print":{"date-parts":[[2026,7,31]]},"abstract":"<jats:p>LLMs have garnered considerable attention for their potential to streamline Automated Program Repair (APR). LLM-based approaches can either insert the correct code using an infilling-style technique or directly generate patches when provided with buggy methods, aiming for plausible patches to pass all tests. However, most of LLM-based APR methods rely on a single type of software information, such as issue descriptions or error stack traces, without fully leveraging a combination of diverse software artifacts. Human developers, in contrast, often use a range of information\u2014such as debugging data, issue discussions, and error stack traces\u2014to diagnose and fix bugs. Despite this, many LLM-based approaches do not explore which specific types of software information best assist in localizing and repairing software bugs. Addressing this gap is crucial for advancing LLM-based APR techniques.<\/jats:p>\n                  <jats:p>\n                    To investigate this and mimic the way human developers fix bugs, we propose\n                    <jats:italic toggle=\"yes\">DEV<\/jats:italic>\n                    eloper\n                    <jats:italic toggle=\"yes\">Lo<\/jats:italic>\n                    calization and\n                    <jats:italic toggle=\"yes\">Re<\/jats:italic>\n                    pair (\n                    <jats:sc>DEVLoRe<\/jats:sc>\n                    ). In this framework, LLMs first use issue content (description and discussion) and stack error traces to localize buggy methods, then rely on debug information in buggy methods and issue content and stack error to localize buggy lines and generate valid patches. We evaluated the effectiveness of issue content, error stack traces, and debugging information in bug localization and automatic program repair. Our results show that while issue content and error stack is particularly effective in assisting LLMs with fault localization and program repair respectively, different types of software artifacts complement each other in addressing various bugs. By incorporating these three types of artifacts and using the Defects4J v2.0 dataset for evaluation,\n                    <jats:sc>DEVLoRe<\/jats:sc>\n                    successfully localizes 49.3% of single-method bugs and generates 56.0% plausible patches. Additionally,\n                    <jats:sc>DEVLoRe<\/jats:sc>\n                    can localize 47.6% of non-single-method bugs and generates 14.5% plausible patches. Moreover, our framework streamlines the end-to-end process from buggy source code to a complete repair, and achieves a 39.7% and 17.1% of single-method and non-single-method bug repair rate, outperforming current state-of-the-art APR methods. Furthermore, we re-implemented and evaluated our framework, demonstrating its effectiveness in resolving nine unique issues compared to other state-of-the-art frameworks using the same or more advanced models on SWE-bench Lite. We also discussed whether a leading framework for Python code can be directly applied to Java code, or vice versa. The source code and experimental results of this work for replication are available at\n                    <jats:ext-link xmlns:xlink=\"http:\/\/www.w3.org\/1999\/xlink\" ext-link-type=\"uri\" xlink:href=\"https:\/\/github.com\/XYZboom\/DEVLoRe\">https:\/\/github.com\/XYZboom\/DEVLoRe<\/jats:ext-link>\n                    .\n                  <\/jats:p>","DOI":"10.1145\/3770581","type":"journal-article","created":{"date-parts":[[2025,10,3]],"date-time":"2025-10-03T16:44:32Z","timestamp":1759509872000},"page":"1-25","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":6,"title":["Integrating Various Software Artifacts for Better LLM-based Bug Localization and Program Repair"],"prefix":"10.1145","volume":"35","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-1667-8062","authenticated-orcid":false,"given":"Qiong","family":"Feng","sequence":"first","affiliation":[{"name":"School of Computer Science and Engineering, Nanjing University of Science and Technology, Nanjing, China and State Key Laboratory for Novel Software Technology, Nanjing University, Nanjing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0008-9121-3656","authenticated-orcid":false,"given":"Xiaotian","family":"Ma","sequence":"additional","affiliation":[{"name":"School of Computer Science and Engineering, Nanjing University of Science and Technology, Nanjing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0009-4588-8780","authenticated-orcid":false,"given":"Jiayi","family":"Sheng","sequence":"additional","affiliation":[{"name":"School of Computer Science and Engineering, Nanjing University of Science and Technology, Nanjing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0000-4747-3831","authenticated-orcid":false,"given":"Ziyuan","family":"Feng","sequence":"additional","affiliation":[{"name":"School of Computer Science and Engineering, Nanjing University of Science and Technology, Nanjing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4324-3382","authenticated-orcid":false,"given":"Wei","family":"Song","sequence":"additional","affiliation":[{"name":"School of Computer Science and Engineering, Nanjing University of Science and Technology, Nanjing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2056-5346","authenticated-orcid":false,"given":"Peng","family":"Liang","sequence":"additional","affiliation":[{"name":"School of Computer Science, Wuhan University, Wuhan, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2026,6,17]]},"reference":[{"key":"e_1_3_1_2_2","unstructured":"Aider. 2024. Aider - AI Pair Programming in Your Terminal. Retrieved October 14 2024 from https:\/\/aider.chat"},{"key":"e_1_3_1_3_2","unstructured":"AppMap. 2024. AppMap Navie. Retrieved October 14 2024 from https:\/\/appmap.io\/product\/appmap-navie.html"},{"key":"e_1_3_1_4_2","unstructured":"Oracle. 2024. Instrumentation Documents in Java SE 8. Retrieved October 14 2024 from https:\/\/docs.oracle.com\/javase\/8\/docs\/api\/java\/lang\/instrument\/Instrumentation.html"},{"key":"e_1_3_1_5_2","unstructured":"Carlos E. Jimenez John Yang Alexander Wettig Shunyu Yao Kexin Pei Ofir Press and Karthik R. Narasimhan. 2024. SWE-Bench Lite. Retrieved October 14 2024 from https:\/\/www.swebench.com\/lite.html"},{"key":"e_1_3_1_6_2","doi-asserted-by":"publisher","DOI":"10.5555\/1308173.1308264"},{"key":"e_1_3_1_7_2","unstructured":"Islem Bouzenia Premkumar Devanbu and Michael Pradel. 2024. RepairAgent: An autonomous LLM-based agent for program repair. arXiv:2403.17134. Retrieved from https:\/\/arxiv.org\/abs\/2403.17134"},{"key":"e_1_3_1_8_2","first-page":"378","volume-title":"Proceedings of the 27th IEEE\/ACM International Conference on Automated Software Engineering (ASE)","author":"Campos Jos\u00e9","year":"2012","unstructured":"Jos\u00e9 Campos, Andr\u00e9 Riboira, Alexandre Perez, and Rui Abreu. 2012. GZoltar: An eclipse plug-in for testing and debugging. In Proceedings of the 27th IEEE\/ACM International Conference on Automated Software Engineering (ASE). IEEE, 378\u2013381."},{"key":"e_1_3_1_9_2","unstructured":"Viola Campos Ridwan Shariffdeen Adrian Ulges and Yannic Noller. 2025. Empirical evaluation of generalizable automated program repair with large language models. arXiv:2506.03283. Retrieved from https:\/\/arxiv.org\/abs\/2506.03283"},{"issue":"9","key":"e_1_3_1_10_2","first-page":"1943","article-title":"SequenceR: Sequence-to-sequence learning for end-to-end program repair","volume":"47","author":"Chen Zimin","year":"2019","unstructured":"Zimin Chen, Steve Kommrusch, Michele Tufano, Louis-No\u00ebl Pouchet, Denys Poshyvanyk, and Martin Monperrus. 2019. SequenceR: Sequence-to-sequence learning for end-to-end program repair. IEEE Transactions on Software Engineering 47, 9 (2019), 1943\u20131959.","journal-title":"IEEE Transactions on Software Engineering"},{"key":"e_1_3_1_11_2","doi-asserted-by":"publisher","DOI":"10.1145\/3702972"},{"key":"e_1_3_1_12_2","doi-asserted-by":"publisher","DOI":"10.1145\/3293882.3330559"},{"key":"e_1_3_1_13_2","doi-asserted-by":"publisher","DOI":"10.1145\/3660773"},{"key":"e_1_3_1_14_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE48619.2023.00125"},{"key":"e_1_3_1_15_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE43902.2021.00107"},{"key":"e_1_3_1_16_2","doi-asserted-by":"publisher","DOI":"10.1145\/3643795.3648390"},{"issue":"4","key":"e_1_3_1_17_2","doi-asserted-by":"crossref","first-page":"1443","DOI":"10.1109\/TSE.2022.3177713","article-title":"BugBuilder: An automated approach to building bug repository","volume":"49","author":"Jiang Yanjie","year":"2022","unstructured":"Yanjie Jiang, Hui Liu, Xiaoqing Luo, Zhihao Zhu, Xiaye Chi, Nan Niu, Yuxia Zhang, Yamin Hu, Pan Bian, and Lu Zhang. 2022. BugBuilder: An automated approach to building bug repository. IEEE Transactions on Software Engineering 49, 4 (2022), 1443\u20131463.","journal-title":"IEEE Transactions on Software Engineering"},{"key":"e_1_3_1_18_2","doi-asserted-by":"publisher","DOI":"10.1145\/2610384.2628055"},{"key":"e_1_3_1_19_2","doi-asserted-by":"publisher","DOI":"10.1145\/3660771"},{"key":"e_1_3_1_20_2","first-page":"213","volume-title":"Proceedings of the 23rd IEEE International Conference on Software Analysis, Evolution, and Reengineering (SANER)","author":"Bach Xuan","year":"2016","unstructured":"Xuan Bach, D. Le, David Lo, and Claire Le Goues. 2016. History driven program repair. In Proceedings of the 23rd IEEE International Conference on Software Analysis, Evolution, and Reengineering (SANER). IEEE, 213\u2013224."},{"key":"e_1_3_1_21_2","doi-asserted-by":"publisher","DOI":"10.1145\/3180155.3182536"},{"key":"e_1_3_1_22_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2011.104"},{"key":"e_1_3_1_23_2","doi-asserted-by":"publisher","DOI":"10.1145\/3318162"},{"key":"e_1_3_1_24_2","unstructured":"Cheryl Lee Chunqiu Steven Xia Longji Yang Jen-Tse Huang Zhouruixin Zhu Lingming Zhang and Michael R. Lyu. 2024. A unified debugging approach via LLM-based multi-agent synergy. arXiv:2404.17153. Retrieved from https:\/\/arxiv.org\/abs\/2404.17153"},{"key":"e_1_3_1_25_2","doi-asserted-by":"publisher","DOI":"10.1145\/3715004"},{"key":"e_1_3_1_26_2","doi-asserted-by":"crossref","first-page":"602","DOI":"10.1145\/3377811.3380345","volume-title":"Proceedings of the 42nd ACM\/IEEE International Conference on Software Engineering (ICSE)","author":"Li Yi","year":"2020","unstructured":"Yi Li, Shaohua Wang, and Tien N. Nguyen. 2020. DLFix: Context-based code transformation learning for automated program repair. In Proceedings of the 42nd ACM\/IEEE International Conference on Software Engineering (ICSE). ACM, 602\u2013614."},{"key":"e_1_3_1_27_2","first-page":"31","volume-title":"Proceedings of the 28th ACM SIGSOFT International Symposium on Software Testing and Analysis (ISSTA)","author":"Liu Kui","year":"2019","unstructured":"Kui Liu, Anil Koyuncu, Dongsun Kim, and Tegawend\u00e9 F. Bissyand\u00e9. 2019. TBar: Revisiting template-based automated program repair. In Proceedings of the 28th ACM SIGSOFT International Symposium on Software Testing and Analysis (ISSTA). ACM, 31\u201342."},{"key":"e_1_3_1_28_2","unstructured":"Yizhou Liu Pengfei Gao Xinchen Wang Jie Liu Yexuan Shi Zhao Zhang and Chao Peng. 2024. MarsCode agent: AI-native automated bug fixing. arXiv:2409.00899. Retrieved from https:\/\/arxiv.org\/abs\/2409.00899"},{"key":"e_1_3_1_29_2","first-page":"166","volume-title":"Proceedings of the 10th Joint Meeting on Foundations of Software Engineering (ESEC\/FSE)","author":"Long Fan","year":"2015","unstructured":"Fan Long and Martin Rinard. 2015. Staged program repair with condition synthesis. In Proceedings of the 10th Joint Meeting on Foundations of Software Engineering (ESEC\/FSE). ACM, 166\u2013178."},{"key":"e_1_3_1_30_2","doi-asserted-by":"publisher","DOI":"10.1145\/3468264.3468580"},{"key":"e_1_3_1_31_2","doi-asserted-by":"publisher","DOI":"10.1145\/2884781.2884807"},{"key":"e_1_3_1_32_2","unstructured":"Xiangxin Meng Zexiong Ma Pengfei Gao and Chao Peng. 2024. An empirical study on LLM-based agents for automated bug fixing. arXiv:2411.10213. Retrieved from https:\/\/arxiv.org\/abs\/2411.10213"},{"key":"e_1_3_1_33_2","unstructured":"Siru Ouyang Wenhao Yu Kaixin Ma Zilin Xiao Zhihan Zhang Mengzhao Jia Jiawei Han Hongming Zhang and Dong Yu. 2024. RepoGraph: Enhancing AI software engineering with repository-level code graph. arXiv:2410.14684. Retrieved from https:\/\/arxiv.org\/abs\/2410.14684"},{"key":"e_1_3_1_34_2","unstructured":"Nikhil Parasaram Huijie Yan Boyu Yang Zineb Flahy Abriele Qudsi Damian Ziaber Earl Barr and Sergey Mechtaev. 2024. The fact selection problem in LLM-based program repair. arXiv:2404.05520. Retrieved from https:\/\/arxiv.org\/abs\/2404.05520"},{"key":"e_1_3_1_35_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2025.3543187"},{"key":"e_1_3_1_36_2","unstructured":"Md Nakhla Rafi Dong Jae Kim Tse-Hsun Chen and Shaowei Wang. 2024. Enhancing fault localization through ordered code analysis with LLM agents and self-reflection. arXiv:2409.13642. Retrieved from https:\/\/arxiv.org\/abs\/2409.13642"},{"key":"e_1_3_1_37_2","unstructured":"Andr\u00e9 Silva Sen Fang and Martin Monperrus. 2023. RepairLLaMA: Efficient representations and fine-tuned adapters for program repair. arXiv:2312.15698. Retrieved from https:\/\/arxiv.org\/abs\/2312.15698"},{"key":"e_1_3_1_38_2","first-page":"532","volume-title":"Proceedings of the 10th Joint Meeting on Foundations of Software Engineering (ESEC\/FSE)","author":"Smith Edward K.","year":"2015","unstructured":"Edward K. Smith, Earl T. Barr, Claire Le Goues, and Yuriy Brun. 2015. Is the cure worse than the disease? Overfitting in automated program repair. In Proceedings of the 10th Joint Meeting on Foundations of Software Engineering (ESEC\/FSE). ACM, 532\u2013543."},{"key":"e_1_3_1_39_2","doi-asserted-by":"publisher","DOI":"10.1145\/3092703.3092717"},{"key":"e_1_3_1_40_2","doi-asserted-by":"publisher","DOI":"10.1145\/3611643.3616271"},{"key":"e_1_3_1_41_2","unstructured":"Chunqiu Steven Xia Yinlin Deng Soren Dunn and Lingming Zhang. 2024. Agentless: Demystifying LLM-based software engineering agents. arXiv:2407.01489. Retrieved from https:\/\/arxiv.org\/abs\/2407.01489"},{"key":"e_1_3_1_42_2","doi-asserted-by":"publisher","DOI":"10.1109\/ASE56229.2023.00047"},{"key":"e_1_3_1_43_2","unstructured":"Chunqiu Steven Xia Matteo Paltenghi Jia Le Tian Michael Pradel and Lingming Zhang. 2024. Fuzz4All: Universal fuzzing with large language models. arXiv:2308.04748. Retrieved from https:\/\/arxiv.org\/abs\/2308.04748"},{"key":"e_1_3_1_44_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE48619.2023.00129"},{"key":"e_1_3_1_45_2","unstructured":"Chunqiu Steven Xia and Lingming Zhang. 2023. Keep the conversation going: Fixing 162 out of 337 bugs for $0.42 each using ChatGPT. arXiv:2304.00385. Retrieved from https:\/\/arxiv.org\/abs\/2304.00385"},{"key":"e_1_3_1_46_2","unstructured":"Jiwei Yan Jinhao Huang Chunrong Fang Jun Yan and Jian Zhang. 2024. Better debugging: Combining static analysis and LLMs for explainable crashing fault localization. arXiv:2408.12070. Retrieved from https:\/\/arxiv.org\/abs\/2408.12070"},{"key":"e_1_3_1_47_2","first-page":"1","volume-title":"Proceedings of the 46th IEEE\/ACM International Conference on Software Engineering (ICSE)","author":"Yang Aidan Z. H.","year":"2024","unstructured":"Aidan Z. H. Yang, Claire Le Goues, Ruben Martins, and Vincent Hellendoorn. 2024. Large language models for test-free fault localization. In Proceedings of the 46th IEEE\/ACM International Conference on Software Engineering (ICSE). ACM, 1\u201312."},{"key":"e_1_3_1_48_2","doi-asserted-by":"crossref","first-page":"882","DOI":"10.1145\/3650212.3680328","volume-title":"Proceedings of the 33rd ACM SIGSOFT International Symposium on Software Testing and Analysis (ISSTA)","author":"Yang Boyang","year":"2024","unstructured":"Boyang Yang, Haoye Tian, Weiguo Pian, Haoran Yu, Haitao Wang, Jacques Klein, Tegawend\u00e9 F. Bissyand\u00e9, and Shunfu Jin. 2024. CREF: An LLM-based conversational software repair framework for programming tutors. In Proceedings of the 33rd ACM SIGSOFT International Symposium on Software Testing and Analysis (ISSTA). ACM, 882\u2013894."},{"key":"e_1_3_1_49_2","unstructured":"Boyang Yang Haoye Tian Jiadong Ren Hongyu Zhang Jacques Klein Tegawend\u00e9 F. Bissyand\u00e9 Claire Le Goues and Shunfu Jin. 2024. Multi-objective fine-tuning for enhanced program repair with LLMs. arXiv:2404.12636. Retrieved from https:\/\/arxiv.org\/abs\/2404.12636"},{"key":"e_1_3_1_50_2","first-page":"50528","article-title":"SWE-agent: Agent-computer interfaces enable automated software engineering","volume":"37","author":"Yang John","year":"2024","unstructured":"John Yang, Carlos E. Jimenez, Alexander Wettig, Kilian Lieret, Shunyu Yao, and Karthik Narasimhan. and Ofir Press. 2024. SWE-agent: Agent-computer interfaces enable automated software engineering. In Proceedings of the Advances in Neural Information Processing Systems, Vol. 37, 50528\u201350652.","journal-title":"Proceedings of the Advances in Neural Information Processing Systems"},{"key":"e_1_3_1_51_2","doi-asserted-by":"publisher","DOI":"10.1109\/ASE56229.2023.00063"},{"key":"e_1_3_1_52_2","doi-asserted-by":"crossref","first-page":"1592","DOI":"10.1145\/3650212.3680384","volume-title":"Proceedings of the 33rd ACM SIGSOFT International Symposium on Software Testing and Analysis (ISSTA)","author":"Zhang Yuntong","year":"2024","unstructured":"Yuntong Zhang, Haifeng Ruan, Zhiyu Fan, and Abhik Roychoudhury. 2024. AutoCodeRover: Autonomous program improvement. In Proceedings of the 33rd ACM SIGSOFT International Symposium on Software Testing and Analysis (ISSTA). ACM, 1592\u20131604."},{"key":"e_1_3_1_53_2","doi-asserted-by":"publisher","DOI":"10.1145\/3468264.3468544"},{"key":"e_1_3_1_54_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE48619.2023.00126"}],"container-title":["ACM Transactions on Software Engineering and Methodology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3770581","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,6,17]],"date-time":"2026-06-17T14:53:24Z","timestamp":1781708004000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3770581"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,6,17]]},"references-count":53,"journal-issue":{"issue":"7","published-print":{"date-parts":[[2026,7,31]]}},"alternative-id":["10.1145\/3770581"],"URL":"https:\/\/doi.org\/10.1145\/3770581","relation":{},"ISSN":["1049-331X","1557-7392"],"issn-type":[{"value":"1049-331X","type":"print"},{"value":"1557-7392","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,6,17]]},"assertion":[{"value":"2024-12-05","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-09-28","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2026-06-17","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}