{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,24]],"date-time":"2026-09-24T04:04:10Z","timestamp":1790222650290,"version":"4.1.0"},"reference-count":182,"publisher":"Association for Computing Machinery (ACM)","issue":"9","license":[{"start":{"date-parts":[[2026,8,21]],"date-time":"2026-08-21T00:00:00Z","timestamp":1787270400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/legalcode"}],"funder":[{"DOI":"10.13039\/501100004410","name":"T\u00dcB\u0130TAK","doi-asserted-by":"crossref","award":["Project No. 125E371"],"award-info":[{"award-number":["Project No. 125E371"]}],"id":[{"id":"10.13039\/501100004410","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Softw. Eng. Methodol."],"published-print":{"date-parts":[[2026,9,30]]},"abstract":"<jats:p>Traditional bug tracking systems rely heavily on manual reporting, reproduction, classification, and resolution. These tasks are performed by various stakeholders, including end users, customer support, developers, and testers. This division of responsibilities requires significant coordination in addition to the considerable human time and effort. This reliance widens the communication gap between non-technical end users and developers, who are more technically inclined, slowing the process from bug discovery to resolution and deployment. Moreover, current solutions tend to be highly asynchronous; end users often wait hours, days, or even weeks before receiving an initial response, further delaying fixes and contributing to frustration.<\/jats:p>\n                  <jats:p>In this study, we examine the evolution of bug tracking practices, moving from early paper-based and manual reporting methods to today\u2019s Web-based platforms that dominate modern software development. Building on this trajectory, we outline our vision for the future: an AI-powered bug tracking framework that augments existing systems with intelligent, large language models (LLMs) and agent-driven automation, and we report on early adaptations of key components of this framework that provide initial empirical grounding for its feasibility.<\/jats:p>\n                  <jats:p>Our approach tackles two main challenges: reducing the time to resolution and minimizing coordination overhead by bridging the gap between end users and developers. In the proposed framework, end users report bugs in natural language. AI-driven agents refine these reports, attempt to reproduce them, and request any missing details. Bug reports are classified according to their severity, priority, and type. Valid and invalid bugs are automatically determined, and the invalid bug reports are either dismissed or resolved via no-code fixes suggested by agents. Valid bugs, once confirmed, are localized and assigned to developers, who review LLM-generated patches and verify their correctness. Verified patches are deployed using continuous integration and continuous development (CI\/CD) pipelines.<\/jats:p>\n                  <jats:p>This article articulates our vision for an AI-powered bug tracking framework and examines the challenges and opportunities of integrating LLMs into bug tracking workflows. We position the framework as a forward-looking design that can also augment today\u2019s issue trackers, illustrating how automation can reduce turnaround time while reshaping software maintenance into a more efficient, collaborative, and user-centric process.<\/jats:p>","DOI":"10.1145\/3806655","type":"journal-article","created":{"date-parts":[[2026,4,11]],"date-time":"2026-04-11T13:25:21Z","timestamp":1775913921000},"page":"1-45","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":3,"title":["Past, Present, and Future of Bug Tracking in the Generative AI Era"],"prefix":"10.1145","volume":"35","author":[{"ORCID":"https:\/\/orcid.org\/0009-0000-9571-6287","authenticated-orcid":false,"given":"Utku Boran","family":"Torun","sequence":"first","affiliation":[{"name":"Department of Computer Engineering, Bilkent University, Ankara, Turkey"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0001-0707-1894","authenticated-orcid":false,"given":"Mehmet Taha","family":"Demircan","sequence":"additional","affiliation":[{"name":"Department of Computer Engineering, Bilkent University, Ankara, Turkey"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0009-2144-4069","authenticated-orcid":false,"given":"Mahmut Furkan","family":"G\u00f6n","sequence":"additional","affiliation":[{"name":"Department of Computer Engineering, Bilkent University, Ankara, Turkey"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5550-7816","authenticated-orcid":false,"given":"Eray","family":"T\u00fcz\u00fcn","sequence":"additional","affiliation":[{"name":"Department of Computer Engineering, Bilkent University, Ankara, Turkey"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2026,8,21]]},"reference":[{"key":"e_1_3_3_2_2","doi-asserted-by":"publisher","unstructured":"Jagrit Acharya and Gouri Ginde. 2025. Can we enhance bug report quality using LLMs? An empirical study of LLM-based bug report generation. In Proceedings of the 29th International Conference on Evaluation and Assessment in Software Engineering (EASE '25). Association for Computing Machinery New York NY USA 994\u20131003. DOI: 10.1145\/3756681.3756995","DOI":"10.1145\/3756681.3756995"},{"key":"e_1_3_3_3_2","unstructured":"Josh Achiam Steven Adler Sandhini Agarwal Lama Ahmad Ilge Akkaya Florencia Leoni Aleman Diogo Almeida Janko Altenschmidt Sam Altman Shyamal Anadkat et al. 2023. GPT-4 technical report. arXiv:2303.08774. Retrieved from https:\/\/arxiv.org\/abs\/2303.08774"},{"key":"e_1_3_3_4_2","volume-title":"Proceedings of the 30th International Conference on Evaluation and Assessment in Software Engineering (EASE \u201926)","author":"Akyol Emre Furkan","year":"2026","unstructured":"Emre Furkan Akyol, Mehmet Dedeler, and Eray T\u00fcz\u00fcn. 2026. ImproBR: Bug report improver using LLMs. In Proceedings of the 30th International Conference on Evaluation and Assessment in Software Engineering (EASE \u201926). ACM, New York, NY."},{"key":"e_1_3_3_5_2","unstructured":"Aisha Alansari and Hamzah Luqman. 2025. Large language models hallucination: A comprehensive survey. arXiv:2510.06265. Retrieved from https:\/\/arxiv.org\/abs\/2510.06265"},{"key":"e_1_3_3_6_2","first-page":"295","volume-title":"Proceedings of the International Conference on Conceptual Modeling","author":"Ali Syed Juned","year":"2024","unstructured":"Syed Juned Ali, Varun Naganathan, and Dominik Bork. 2024. Establishing traceability between natural language requirements and software artifacts by combining RAG and LLMs. In Proceedings of the International Conference on Conceptual Modeling. Springer, 295\u2013314."},{"key":"e_1_3_3_7_2","doi-asserted-by":"crossref","unstructured":"Ebube Alor SayedHassan Khatoonabadi and Emad Shihab. 2025. Evaluating the use of LLMs for documentation to code traceability. arXiv:2506.16440. Retrieved from https:\/\/arxiv.org\/abs\/2506.16440","DOI":"10.1145\/3819820"},{"issue":"5","key":"e_1_3_3_8_2","doi-asserted-by":"crossref","first-page":"115","DOI":"10.1007\/s10664-025-10664-8","article-title":"Process smells in practice: An evaluative case study","volume":"30","author":"Altun U\u011fur Can","year":"2025","unstructured":"U\u011fur Can Altun, Ismail Sergen G\u00f6\u00e7men, Emre S\u00fcl\u00fcn, Erdem Tuna, and Eray T\u00fcz\u00fcn. 2025. Process smells in practice: An evaluative case study. Empirical Software Engineering 30, 5 (2025), 115.","journal-title":"Empirical Software Engineering"},{"key":"e_1_3_3_9_2","doi-asserted-by":"crossref","first-page":"523","DOI":"10.1109\/ICSM.2009.5306337","volume-title":"Proceedings of the 2009 IEEE International Conference on Software Maintenance","author":"Anbalagan Prasanth","year":"2009","unstructured":"Prasanth Anbalagan and Mladen Vouk. 2009. On predicting the time taken to correct bug reports in open source projects. In Proceedings of the 2009 IEEE International Conference on Software Maintenance. IEEE, 523\u2013526."},{"key":"e_1_3_3_10_2","first-page":"361","volume-title":"Proceedings of 28th International Conference on Software Engineering","author":"Anvik John","year":"2006","unstructured":"John Anvik, Lyndon Hiew, and Gail C. Murphy. 2006. Who should fix this bug? In Proceedings of 28th International Conference on Software Engineering, 361\u2013370."},{"key":"e_1_3_3_11_2","unstructured":"Leonhard Applis Yuntong Zhang Shanchao Liang Nan Jiang Lin Tan and Abhik Roychoudhury. 2025. Unified software engineering agent as AI software engineer. arXiv:2506.14683. Retrieved from https:\/\/arxiv.org\/abs\/2506.14683"},{"key":"e_1_3_3_12_2","doi-asserted-by":"crossref","first-page":"112569","DOI":"10.1016\/j.jss.2025.112569","article-title":"A novel LLM-based classifier for predicting bug-fixing time in bug tracking systems","volume":"230","author":"Ardimento Pasquale","year":"2025","unstructured":"Pasquale Ardimento, Michele Capuzzimati, Gabriella Casalino, Daniele Schicchi, and Davide Taibi. 2025. A novel LLM-based classifier for predicting bug-fixing time in bug tracking systems. Journal of Systems and Software 230 (2025), 112569.","journal-title":"Journal of Systems and Software"},{"key":"e_1_3_3_13_2","volume-title":"Software Change Impact Analysis","author":"Arnold Robert S.","year":"1996","unstructured":"Robert S. Arnold. 1996. Software Change Impact Analysis. IEEE Computer Society Press."},{"key":"e_1_3_3_14_2","unstructured":"Akari Asai Zeqiu Wu Yizhong Wang Avirup Sil and Hannaneh Hajishirzi. 2024. Self-RAG: Learning to retrieve generate and critique through self-reflection. In The Twelfth International Conference on Learning Representations. Retrieved from https:\/\/openreview.net\/forum?id=hSyW5go0v8"},{"key":"e_1_3_3_15_2","volume-title":"Proceedings of 9th USENIX Symposium on Operating Systems Design and Implementation (OSDI \u201910)","author":"Attariyan Mona","year":"2010","unstructured":"Mona Attariyan and Jason Flinn. 2010. Automating configuration troubleshooting with dynamic information flow analysis. In Proceedings of 9th USENIX Symposium on Operating Systems Design and Implementation (OSDI \u201910)."},{"key":"e_1_3_3_16_2","doi-asserted-by":"crossref","first-page":"14","DOI":"10.1145\/3387904.3389251","volume-title":"Proceedings of 28th International Conference on Program Comprehension","author":"Aung Thazin Win Win","year":"2020","unstructured":"Thazin Win Win Aung, Huan Huo, and Yulei Sui. 2020. A literature review of automatic traceability links recovery for software change impact analysis. In Proceedings of 28th International Conference on Program Comprehension, 14\u201324."},{"key":"e_1_3_3_17_2","doi-asserted-by":"crossref","unstructured":"Yejin Bang Ziwei Ji Alan Schelten Anthony Hartshorn Tara Fowler Cheng Zhang Nicola Cancedda and Pascale Fung. 2025. Hallulens: LLM hallucination benchmark. arXiv:2504.17550. Retrieved from https:\/\/arxiv.org\/abs\/2504.17550","DOI":"10.18653\/v1\/2025.acl-long.1176"},{"key":"e_1_3_3_18_2","first-page":"297","volume-title":"Proceedings of the 2009 IEEE 17th International Conference on Program Comprehension","author":"Baysal Olga","year":"2009","unstructured":"Olga Baysal, Michael W. Godfrey, and Robin Cohen. 2009. A bug you like: A framework for automated assignment of bugs. In Proceedings of the 2009 IEEE 17th International Conference on Program Comprehension, 297\u2013298. DOI: 10.1109\/ICPC.2009.5090066"},{"key":"e_1_3_3_19_2","doi-asserted-by":"crossref","first-page":"291","DOI":"10.1145\/1718918.1718972","volume-title":"Proceedings of the 2010 ACM Conference on Computer Supported Cooperative Work","author":"Bertram Dane","year":"2010","unstructured":"Dane Bertram, Amy Voida, Saul Greenberg, and Robert Walker. 2010. Communication, collaboration, and bugs: The social nature of issue tracking in small, collocated teams. In Proceedings of the 2010 ACM Conference on Computer Supported Cooperative Work, 291\u2013300."},{"key":"e_1_3_3_20_2","doi-asserted-by":"crossref","first-page":"21","DOI":"10.1145\/1328279.1328284","volume-title":"Proceedings of the 2007 OOPSLA Workshop on Eclipse Technology eXchange","author":"Bettenburg Nicolas","year":"2007","unstructured":"Nicolas Bettenburg, Sascha Just, Adrian Schr\u00f6ter, Cathrin Wei\u00df, Rahul Premraj, and Thomas Zimmermann. 2007. Quality of bug reports in eclipse. In Proceedings of the 2007 OOPSLA Workshop on Eclipse Technology eXchange, 21\u201325."},{"key":"e_1_3_3_21_2","doi-asserted-by":"crossref","first-page":"308","DOI":"10.1145\/1453101.1453146","volume-title":"Proceedings of 16th ACM SIGSOFT International Symposium on Foundations of Software Engineering","author":"Bettenburg Nicolas","year":"2008","unstructured":"Nicolas Bettenburg, Sascha Just, Adrian Schr\u00f6ter, Cathrin Weiss, Rahul Premraj, and Thomas Zimmermann. 2008. What makes a good bug report? In Proceedings of 16th ACM SIGSOFT International Symposium on Foundations of Software Engineering, 308\u2013318."},{"key":"e_1_3_3_22_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2012.04.053"},{"issue":"8","key":"e_1_3_3_23_2","doi-asserted-by":"crossref","first-page":"85","DOI":"10.1145\/1536616.1536639","article-title":"Does distributed development affect software quality? An empirical case study of windows vista","volume":"52","author":"Bird Christian","year":"2009","unstructured":"Christian Bird, Nachiappan Nagappan, Premkumar Devanbu, Harald Gall, and Brendan Murphy. 2009. Does distributed development affect software quality? An empirical case study of windows vista. Communications of the ACM 52, 8 (2009), 85\u201393.","journal-title":"Communications of the ACM"},{"key":"e_1_3_3_24_2","first-page":"1472","volume-title":"Proceedings of 39th IEEE\/ACM International Conference on Automated Software Engineering","author":"Bo Lili","year":"2024","unstructured":"Lili Bo, Wangjie Ji, Xiaobing Sun, Ting Zhang, Xiaoxue Wu, and Ying Wei. 2024. ChatBR: Automated assessment and improvement of bug report quality using ChatGPT. In Proceedings of 39th IEEE\/ACM International Conference on Automated Software Engineering, 1472\u20131483."},{"key":"e_1_3_3_25_2","doi-asserted-by":"publisher","unstructured":"Silvia Breu Rahul Premraj Jonathan Sillito and Thomas Zimmermann. 2009. Frequently Asked Questions in Bug Reports. Technical Report 2009-924-03. University of Calgary Calgary AB Canada. DOI: 10.11575\/PRISM\/31259","DOI":"10.11575\/PRISM\/31259"},{"key":"e_1_3_3_26_2","doi-asserted-by":"crossref","first-page":"86","DOI":"10.1145\/3338906.3338947","volume-title":"Proceedings of the 2019 27th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering","author":"Chaparro Oscar","year":"2019","unstructured":"Oscar Chaparro, Carlos Bernal-C\u00e1rdenas, Jing Lu, Kevin Moran, Andrian Marcus, Massimiliano Di Penta, Denys Poshyvanyk, and Vincent Ng. 2019. Assessing the quality of the steps to reproduce in bug reports. In Proceedings of the 2019 27th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering, 86\u201396."},{"key":"e_1_3_3_27_2","doi-asserted-by":"crossref","first-page":"396","DOI":"10.1145\/3106237.3106285","volume-title":"Proceedings of the 2017 11th Joint Meeting on Foundations of Software Engineering","author":"Chaparro Oscar","year":"2017","unstructured":"Oscar Chaparro, Jing Lu, Fiorella Zampetti, Laura Moreno, Massimiliano Di Penta, Andrian Marcus, Gabriele Bavota, and Vincent Ng. 2017. Detecting missing information in bug descriptions. In Proceedings of the 2017 11th Joint Meeting on Foundations of Software Engineering, 396\u2013407."},{"key":"e_1_3_3_28_2","first-page":"1","volume-title":"Proceedings of the 2012 CSI 6th International Conference on Software Engineering (CONSEG)","author":"Chaturvedi Krishna Kumar","year":"2012","unstructured":"Krishna Kumar Chaturvedi and V. B. Singh. 2012. Determining bug severity using machine learning techniques. In Proceedings of the 2012 CSI 6th International Conference on Software Engineering (CONSEG). IEEE, 1\u20136."},{"key":"e_1_3_3_29_2","first-page":"172","volume-title":"Proceedings of the 2020 IEEE 27th International Conference on Software Analysis, Evolution and Reengineering (SANER)","author":"Chen Bo","year":"2020","unstructured":"Bo Chen, Zhenkun Yang, Li Lei, Kai Cong, and Fei Xie. 2020. Automated bug detection and replay for COTS Linux kernel modules with concolic execution. In Proceedings of the 2020 IEEE 27th International Conference on Software Analysis, Evolution and Reengineering (SANER). IEEE, 172\u2013183."},{"key":"e_1_3_3_30_2","unstructured":"Chaoran Chen Zhiping Zhang Bingcan Guo Shang Ma Ibrahim Khalilov Simret A. Gebreegziabher Yanfang Ye Ziang Xiao Yaxing Yao Tianshi Li et al. 2025. The obvious invisible threat: LLM-powered GUI agents\u2019 vulnerability to fine-print injections. arXiv:2504.11281. Retrieved from https:\/\/arxiv.org\/abs\/2504.11281"},{"key":"e_1_3_3_31_2","doi-asserted-by":"publisher","DOI":"10.1109\/MS.2015.27"},{"key":"e_1_3_3_32_2","unstructured":"QiHong Chen Jiachen Yu Jiawei Li Jiecheng Deng Justin Tian Jin Chen and Iftekhar Ahmed. 2024. A deep dive into large language model code generation mistakes: What and why? arXiv:2411.01414. Retrieved from https:\/\/arxiv.org\/abs\/2411.01414"},{"key":"e_1_3_3_33_2","unstructured":"Runxiang Cheng Michele Tufano J\u00fcrgen Cito Jos\u00e9 Cambronero Pat Rondon Renyao Wei Aaron Sun and Satish Chandra. 2025. Agentic bug reproduction for effective automated program repair at Google. arXiv:2502.01821. Retrieved from https:\/\/arxiv.org\/abs\/2502.01821"},{"key":"e_1_3_3_34_2","unstructured":"Gheorghe Comanici Eric Bieber Mike Schaekermann Ice Pasupat Noveen Sachdeva Inderjit Dhillon Marcel Blistein Ori Ram Dan Zhang Evan Rosen et al. 2025. Gemini 2.5: Pushing the frontier with advanced reasoning multimodality long context and next generation agentic capabilities. arXiv:2507.06261. Retrieved from https:\/\/arxiv.org\/abs\/2507.06261"},{"key":"e_1_3_3_35_2","volume-title":"Proceedings of the International Conference on Software Engineering and Knowledge Engineering","author":"Cubranic Davor","year":"2004","unstructured":"Davor Cubranic and Gail C. Murphy. 2004. Automatic bug triage using text categorization. In Proceedings of the International Conference on Software Engineering and Knowledge Engineering. Retrieved from https:\/\/api.semanticscholar.org\/CorpusID:16196403"},{"issue":"10","key":"e_1_3_3_36_2","doi-asserted-by":"crossref","first-page":"60","DOI":"10.1109\/2.796110","article-title":"Software development on internet time","volume":"32","author":"Cusumano Michael A.","year":"1999","unstructured":"Michael A. Cusumano and David B. Yoffie. 1999. Software development on internet time. Computer 32, 10 (1999), 60\u201369.","journal-title":"Computer"},{"key":"e_1_3_3_37_2","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.infsof.2016.01.002","article-title":"Challenges and strategies for motivating software testing personnel","volume":"73","author":"Deak Anca","year":"2016","unstructured":"Anca Deak, Tor St\u00e5lhane, and Guttorm Sindre. 2016. Challenges and strategies for motivating software testing personnel. Information and Software Technology 73 (2016), 1\u201315.","journal-title":"Information and Software Technology"},{"key":"e_1_3_3_38_2","doi-asserted-by":"crossref","first-page":"363","DOI":"10.1109\/SEAA.2016.20","volume-title":"Proceedings of the 2016 42th Euromicro Conference on Software Engineering and Advanced Applications (SEAA)","author":"Ded\u00edk V\u00e1clav","year":"2016","unstructured":"V\u00e1clav Ded\u00edk and Bruno Rossi. 2016. Automated bug triaging in an industrial context. In Proceedings of the 2016 42th Euromicro Conference on Software Engineering and Advanced Applications (SEAA), 363\u2013367. DOI: 10.1109\/SEAA.2016.20"},{"key":"e_1_3_3_39_2","unstructured":"Jacob Devlin Ming-Wei Chang Kenton Lee and Kristina Toutanova. 2019. BERT: Pre-training of deep bidirectional transformers for language understanding. arXiv:1810.04805. Retrieved from https:\/\/arxiv.org\/abs\/1810.04805"},{"key":"e_1_3_3_40_2","volume-title":"Proceedings of 2nd ACM International Conference on AI-Powered Software (AIware)","author":"Din\u00e7 Emre","year":"2025","unstructured":"Emre Din\u00e7 and Eray T\u00fcz\u00fcn. 2025. Judge the votes: A system to classify bug reports and give suggestions. In Proceedings of 2nd ACM International Conference on AI-Powered Software (AIware)."},{"key":"e_1_3_3_41_2","first-page":"192","volume-title":"Proceedings of the 2023 12th International Conference on Awareness Science and Technology (iCAST)","author":"Do Viet Tung","year":"2023","unstructured":"Tung Do Viet and Konstantin Markov. 2023. Using large language models for bug localization and fixing. In Proceedings of the 2023 12th International Conference on Awareness Science and Technology (iCAST). IEEE, 192\u2013197."},{"issue":"3","key":"e_1_3_3_42_2","doi-asserted-by":"crossref","first-page":"985","DOI":"10.1007\/s11219-024-09675-3","article-title":"LLM-BRC: A large language model-based bug report classification framework","volume":"32","author":"Du Xiaoting","year":"2024","unstructured":"Xiaoting Du, Zhihao Liu, Chenglong Li, Xiangyue Ma, Yingzhuo Li, and Xinyu Wang. 2024. LLM-BRC: A large language model-based bug report classification framework. Software Quality Journal 32, 3 (2024), 985\u20131005.","journal-title":"Software Quality Journal"},{"key":"e_1_3_3_43_2","first-page":"162","volume-title":"Proceedings of 27th International Conference on Evaluation and Assessment in Software Engineering","author":"Eren \u00c7a\u011fr\u0131","year":"2023","unstructured":"\u00c7a\u011fr\u0131 Eren, Kerem \u015eahin, and Eray T\u00fcz\u00fcn. 2023. Analyzing bug life cycles to derive practical insights. In Proceedings of 27th International Conference on Evaluation and Assessment in Software Engineering, 162\u2013171."},{"key":"e_1_3_3_44_2","doi-asserted-by":"crossref","first-page":"62","DOI":"10.1145\/2597073.2597098","volume-title":"Proceedings of 11th Working Conference on Mining Software Repositories","author":"Erfani Joorabchi Mona","year":"2014","unstructured":"Mona Erfani Joorabchi, Mehdi Mirzaaghaei, and Ali Mesbah. 2014. Works for me! characterizing non-reproducible bug reports. In Proceedings of 11th Working Conference on Mining Software Repositories, 62\u201371."},{"issue":"5","key":"e_1_3_3_45_2","first-page":"495","article-title":"Chaff from the wheat: Characterizing and determining valid bug reports","volume":"46","author":"Fan Yuanrui","year":"2018","unstructured":"Yuanrui Fan, Xin Xia, David Lo, and Ahmed E. Hassan. 2018. Chaff from the wheat: Characterizing and determining valid bug reports. IEEE Transactions on Software Engineering 46, 5 (2018), 495\u2013525.","journal-title":"IEEE Transactions on Software Engineering"},{"key":"e_1_3_3_46_2","first-page":"1","volume-title":"Proceedings of 46th IEEE\/ACM International Conference on Software Engineering","author":"Feng Sidong","year":"2024","unstructured":"Sidong Feng and Chunyang Chen. 2024. Prompting is all you need: Automated android bug replay with large language models. In Proceedings of 46th IEEE\/ACM International Conference on Software Engineering, 1\u201313."},{"key":"e_1_3_3_47_2","first-page":"1","volume-title":"Proceedings of the 2025 IEEE 22nd International Conference on Software Architecture (ICSA)","author":"Fuch\u00df Dominik","year":"2025","unstructured":"Dominik Fuch\u00df, Haoyu Liu, Tobias Hey, Jan Keim, and Anne Koziolek. 2025. Enabling architecture traceability by LLM-based architecture component name extraction. In Proceedings of the 2025 IEEE 22nd International Conference on Software Architecture (ICSA). IEEE, 1\u201312."},{"issue":"2","key":"e_1_3_3_48_2","doi-asserted-by":"crossref","first-page":"8","DOI":"10.1007\/s10515-021-00287-w","article-title":"Traceability recovery between bug reports and test cases\u2014A Mozilla Firefox case study","volume":"28","author":"Gadelha Guilherme","year":"2021","unstructured":"Guilherme Gadelha, Franklin Ramalho, and Tiago Massoni. 2021. Traceability recovery between bug reports and test cases\u2014A Mozilla Firefox case study. Automated Software Engineering 28, 2 (2021), 8.","journal-title":"Automated Software Engineering"},{"key":"e_1_3_3_49_2","first-page":"1301","volume-title":"Proceedings of the 2023 38th IEEE\/ACM International Conference on Automated Software Engineering (ASE)","author":"Ghanbari Ali","year":"2023","unstructured":"Ali Ghanbari, Deepak-George Thomas, Muhammad Arbab Arshad, and Hridesh Rajan. 2023. Mutation-based fault localization of deep neural networks. In Proceedings of the 2023 38th IEEE\/ACM International Conference on Automated Software Engineering (ASE). IEEE, 1301\u20131313."},{"key":"e_1_3_3_50_2","first-page":"193","volume-title":"Proceedings of the ICACNI 2018 on Smart Computing Paradigms New Progresses and Challenges","volume":"2","author":"Ghosh Debolina","year":"2019","unstructured":"Debolina Ghosh and Jagannath Singh. 2019. A systematic review on program debugging techniques. In Proceedings of the ICACNI 2018 on Smart Computing Paradigms New Progresses and Challenges, Vol. 2, 193\u2013199."},{"issue":"3","key":"e_1_3_3_51_2","doi-asserted-by":"crossref","first-page":"64","DOI":"10.1007\/s10664-024-10600-2","article-title":"Enhanced code reviews using pull request based change impact analysis","volume":"30","author":"G\u00f6\u00e7men Ismail Sergen","year":"2025","unstructured":"Ismail Sergen G\u00f6\u00e7men, Ahmed Salih Cezayir, and Eray T\u00fcz\u00fcn. 2025. Enhanced code reviews using pull request based change impact analysis. Empirical Software Engineering 30, 3 (2025), 64.","journal-title":"Empirical Software Engineering"},{"key":"e_1_3_3_52_2","doi-asserted-by":"crossref","first-page":"94","DOI":"10.1109\/ICRE.1994.292398","volume-title":"Proceedings of the IEEE International Conference on Requirements Engineering","author":"Gotel Orlena C. Z.","year":"1994","unstructured":"Orlena C. Z. Gotel and C. W. Finkelstein. 1994. An analysis of the requirements traceability problem. In Proceedings of the IEEE International Conference on Requirements Engineering. IEEE, 94\u2013101."},{"key":"e_1_3_3_53_2","doi-asserted-by":"crossref","first-page":"345","DOI":"10.1145\/2568225.2568260","volume-title":"Proceedings of 36th International Conference on Software Engineering","author":"Gousios Georgios","year":"2014","unstructured":"Georgios Gousios, Martin Pinzger, and Arie van Deursen. 2014. An exploratory study of the pull-based software development model. In Proceedings of 36th International Conference on Software Engineering, 345\u2013355."},{"issue":"5","key":"e_1_3_3_54_2","first-page":"1186","article-title":"An empirical study of non-reproducible bugs","volume":"10","author":"Goyal Anjali","year":"2019","unstructured":"Anjali Goyal and Neetu Sardana. 2019. An empirical study of non-reproducible bugs. International Journal of System Assurance Engineering and Management 10, 5 (2019), 1186\u20131220.","journal-title":"International Journal of System Assurance Engineering and Management"},{"key":"e_1_3_3_55_2","first-page":"3","volume-title":"Proceedings of the Symposium on Reliability in Distributed Software and Database Systems","author":"Gray Jim","year":"1986","unstructured":"Jim Gray. 1986. Why do computers stop and what can be done about it? In Proceedings of the Symposium on Reliability in Distributed Software and Database Systems, 3\u201312."},{"issue":"7","key":"e_1_3_3_56_2","first-page":"425","article-title":"A classification of software faults","volume":"27","author":"Grottke Michael","year":"2005","unstructured":"Michael Grottke and Kishor S. Trivedi. 2005. A classification of software faults. Journal of Reliability Engineering Association of Japan 27, 7 (2005), 425\u2013438.","journal-title":"Journal of Reliability Engineering Association of Japan"},{"key":"e_1_3_3_57_2","first-page":"89","volume-title":"Handbook on Natural Language Processing for Requirements Engineering","author":"Jin","year":"2025","unstructured":"Jin L. C. Guo, Jan-Philipp Stegh\u00f6fer, Andreas Vogelsang, and Jane Cleland-Huang. 2025. Natural language processing for requirements traceability. In Handbook on Natural Language Processing for Requirements Engineering. Alessio Ferrari and Gouri Ginde (Eds.), Springer, 89\u2013116."},{"key":"e_1_3_3_58_2","first-page":"495","volume-title":"Proceedings of 32nd ACM\/IEEE International Conference on Software Engineering","volume":"1","author":"Guo Philip J.","year":"2010","unstructured":"Philip J. Guo, Thomas Zimmermann, Nachiappan Nagappan, and Brendan Murphy. 2010. Characterizing and predicting which bugs get fixed: An empirical study of Microsoft Windows. In Proceedings of 32nd ACM\/IEEE International Conference on Software Engineering, Vol. 1, 495\u2013504."},{"key":"e_1_3_3_59_2","first-page":"78","volume-title":"Proceedings of the 2009 IEEE 31st International Conference on Software Engineering","author":"Hassan Ahmed E.","year":"2009","unstructured":"Ahmed E. Hassan. 2009. Predicting faults using the complexity of code changes. In Proceedings of the 2009 IEEE 31st International Conference on Software Engineering. IEEE, 78\u201388."},{"key":"e_1_3_3_60_2","doi-asserted-by":"crossref","unstructured":"Ahmed E. Hassan Dayi Lin Gopi Krishnan Rajbahadur Keheliya Gallaba Filipe R. Cogo Boyuan Chen Haoxiang Zhang Kishanthan Thangarajah Gustavo Ansaldi Oliva Jiahuei Lin et al. 2024. Rethinking software engineering in the foundation model era: A curated catalogue of challenges in the development of trustworthy FMware. arXiv:2402.15943. Retrieved from https:\/\/arxiv.org\/abs\/2402.15943","DOI":"10.1145\/3663529.3663849"},{"key":"e_1_3_3_61_2","first-page":"643","volume-title":"Proceedings of 28th International Conference on Evaluation and Assessment in Software Engineering (EASE \u201924)","author":"Hassine Jameleddine","year":"2024","unstructured":"Jameleddine Hassine. 2024. An LLM-based approach to recover traceability links between security requirements and goal models. In Proceedings of 28th International Conference on Evaluation and Assessment in Software Engineering (EASE \u201924). ACM, New York, NY, 643\u2013651. DOI: 10.1145\/3661167.3661261"},{"key":"e_1_3_3_62_2","unstructured":"Feng He Tianqing Zhu Dayong Ye Bo Liu Wanlei Zhou and Philip S. Yu. 2024. The emerged security and privacy of LLM agent: A survey with case studies. arXiv:2407.19354. Retrieved from https:\/\/arxiv.org\/abs\/2407.19354"},{"key":"e_1_3_3_63_2","first-page":"184","volume-title":"Proceedings of the 2020 IEEE 31st International Symposium on Software Reliability Engineering (ISSRE)","author":"He Jianjun","year":"2020","unstructured":"Jianjun He, Ling Xu, Yuanrui Fan, Zhou Xu, Meng Yan, and Yan Lei. 2020. Deep learning based valid bug reports determination and explanation. In Proceedings of the 2020 IEEE 31st International Symposium on Software Reliability Engineering (ISSRE). IEEE, 184\u2013194."},{"key":"e_1_3_3_64_2","volume-title":"Proceedings of the International Conference on Learning Representations","author":"Hong Sirui","year":"2024","unstructured":"Sirui Hong, Mingchen Zhuge, Jonathan Chen, Xiawu Zheng, Yuheng Cheng, Ceyao Zhang, Jinlin Wang, Zili Wang, Steven Ka Shing Yau, Zijuan Lin, et al. 2024. MetaGPT: Meta programming for a multi-agent collaborative framework. In Proceedings of the International Conference on Learning Representations, ICLR."},{"key":"e_1_3_3_65_2","volume-title":"Practical Guide to Software Quality Management","author":"Horch John W.","year":"2003","unstructured":"John W. Horch. 2003. Practical Guide to Software Quality Management. Artech House."},{"issue":"8","key":"e_1_3_3_66_2","first-page":"1","article-title":"Large language models for software engineering: A systematic literature review","volume":"33","author":"Hou Xinyi","year":"2024","unstructured":"Xinyi Hou, Yanjie Zhao, Yue Liu, Zhou Yang, Kailong Wang, Li Li, Xiapu Luo, David Lo, John Grundy, and Haoyu Wang. 2024. Large language models for software engineering: A systematic literature review. ACM Transactions on Software Engineering and Methodology 33, 8 (2024), 1\u201379.","journal-title":"ACM Transactions on Software Engineering and Methodology"},{"issue":"5","key":"e_1_3_3_67_2","doi-asserted-by":"crossref","first-page":"861","DOI":"10.1007\/s11390-016-1669-8","article-title":"Debugging concurrent software: Advances and challenges","volume":"31","author":"Huang Jeff","year":"2016","unstructured":"Jeff Huang and Charles Zhang. 2016. Debugging concurrent software: Advances and challenges. Journal of Computer Science and Technology 31, 5 (2016), 861\u2013868.","journal-title":"Journal of Computer Science and Technology"},{"issue":"2","key":"e_1_3_3_68_2","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3696450","article-title":"Evolving paradigms in automated program repair: Taxonomy, challenges, and opportunities","volume":"57","author":"Huang Kai","year":"2024","unstructured":"Kai Huang, Zhengzi Xu, Su Yang, Hongyu Sun, Xuejun Li, Zheng Yan, and Yuqing Zhang. 2024. Evolving paradigms in automated program repair: Taxonomy, challenges, and opportunities. ACM Computing Surveys 57, 2 (2024), 1\u201343.","journal-title":"ACM Computing Surveys"},{"issue":"2","key":"e_1_3_3_69_2","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3703155","article-title":"A survey on hallucination in large language models: Principles, taxonomy, challenges, and open questions","volume":"43","author":"Huang Lei","year":"2025","unstructured":"Lei Huang, Weijiang Yu, Weitao Ma, Weihong Zhong, Zhangyin Feng, Haotian Wang, Qianglong Chen, Weihua Peng, Xiaocheng Feng, Bing Qin, et al. 2025. A survey on hallucination in large language models: Principles, taxonomy, challenges, and open questions. ACM Transactions on Information Systems 43, 2 (2025), 1\u201355.","journal-title":"ACM Transactions on Information Systems"},{"key":"e_1_3_3_70_2","unstructured":"Yue Huang Lichao Sun Haoran Wang Siyuan Wu Qihui Zhang Yuan Li Chujie Gao Yixin Huang Wenhan Lyu Yixuan Zhang et al. 2024. TrustLLM: Trustworthiness in large language models. arXiv:2401.05561. Retrieved from https:\/\/arxiv.org\/abs\/2401.05561"},{"key":"e_1_3_3_71_2","first-page":"167","volume-title":"Proceedings of the 2021 IEEE\/ACM 18th International Conference on Mining Software Repositories (MSR)","author":"Imran Mia Mohammad","year":"2021","unstructured":"Mia Mohammad Imran, Agnieszka Ciborowska, and Kostadin Damevski. 2021. Automatically selecting follow-up questions for deficient bug reports. In Proceedings of the 2021 IEEE\/ACM 18th International Conference on Mining Software Repositories (MSR), 167\u2013178. DOI: 10.1109\/MSR52588.2021.00029"},{"key":"e_1_3_3_72_2","volume-title":"Proceedings of 3rd ACM International Conference on AI-Powered Software (AI-Ware \u201926)","author":"\u00d6zkan \u00cfr Mustafa","year":"2026","unstructured":"Mustafa \u00d6zkan \u00cfr, Mehmet Dedeler, An\u0131l Koyuncu, and Eray T\u00fcz\u00fcn. 2026. Fixpad++: Automated bug fix verification using LLM agents. In Proceedings of 3rd ACM International Conference on AI-Powered Software (AI-Ware \u201926). ACM."},{"key":"e_1_3_3_73_2","first-page":"1827","volume-title":"Proceedings of the Findings of the Association for Computational Linguistics (EMNLP \u201923)","author":"Ji Ziwei","year":"2023","unstructured":"Ziwei Ji, Tiezheng Yu, Yan Xu, Nayeon Lee, Etsuko Ishii, and Pascale Fung. 2023. Towards mitigating LLM hallucination via self reflection. In Proceedings of the Findings of the Association for Computational Linguistics (EMNLP \u201923), 1827\u20131843."},{"key":"e_1_3_3_74_2","unstructured":"Carlos E. Jimenez John Yang Alexander Wettig Shunyu Yao Kexin Pei Ofir Press and Karthik Narasimhan. 2023. SWE-bench: Can language models resolve real-world GitHub issues? arXiv:2310.06770. Retrieved from https:\/\/arxiv.org\/abs\/2310.06770"},{"key":"e_1_3_3_75_2","first-page":"1424","volume-title":"Proceedings of the ACM on Software Engineering","volume":"1","author":"Kang Sungmin","year":"2024","unstructured":"Sungmin Kang, Gabin An, and Shin Yoo. 2024. A quantitative and qualitative evaluation of LLM-based explainable fault localization. In Proceedings of the ACM on Software Engineering 1, FSE (2024), 1424\u20131446."},{"issue":"2","key":"e_1_3_3_76_2","doi-asserted-by":"crossref","first-page":"45","DOI":"10.1007\/s10664-024-10594-x","article-title":"Explainable automated debugging via large language model-driven scientific debugging","volume":"30","author":"Kang Sungmin","year":"2025","unstructured":"Sungmin Kang, Bei Chen, Shin Yoo, and Jian-Guang Lou. 2025. Explainable automated debugging via large language model-driven scientific debugging. Empirical Software Engineering 30, 2 (2025), 45.","journal-title":"Empirical Software Engineering"},{"issue":"10","key":"e_1_3_3_77_2","doi-asserted-by":"crossref","first-page":"2677","DOI":"10.1109\/TSE.2024.3450837","article-title":"Evaluating diverse large language models for automatic and general bug reproduction","volume":"50","author":"Kang Sungmin","year":"2024","unstructured":"Sungmin Kang, Juyeon Yoon, Nargiz Askarbekkyzy, and Shin Yoo. 2024. Evaluating diverse large language models for automatic and general bug reproduction. IEEE Transactions on Software Engineering 50, 10 (2024), 2677\u20132694.","journal-title":"IEEE Transactions on Software Engineering"},{"key":"e_1_3_3_78_2","first-page":"2312","volume-title":"Proceedings of the 2023 IEEE\/ACM 45th International Conference on Software Engineering (ICSE)","author":"Kang Sungmin","year":"2023","unstructured":"Sungmin Kang, Juyeon Yoon, and Shin Yoo. 2023. Large language models are few-shot testers: Exploring LLM-based general bug reproduction. In Proceedings of the 2023 IEEE\/ACM 45th International Conference on Software Engineering (ICSE). IEEE, 2312\u20132323."},{"key":"e_1_3_3_79_2","unstructured":"Sayash Kapoor Benedikt Stroebl Zachary S. Siegel Nitya Nadgir and Arvind Narayanan. 2024. AI agents that matter. arXiv240701502. Retrieved from https:\/\/arxiv.org\/abs\/2407.01502"},{"issue":"6","key":"e_1_3_3_80_2","first-page":"2278","article-title":"Effective bug tracking systems: Theories and implementation","volume":"4","author":"Kolluri Akhilesh Babu","year":"2012","unstructured":"Akhilesh Babu Kolluri, K. Tameezuddin, and Kalpana Gudikandula. 2012. Effective bug tracking systems: Theories and implementation. IOSR Journal of Computer Engineering 4, 6 (2012), 2278\u20130661.","journal-title":"IOSR Journal of Computer Engineering"},{"key":"e_1_3_3_81_2","first-page":"1","volume-title":"Proceedings of the Conference on AGILE 2006 (AGILE \u201906)","author":"Korkala Mikko","year":"2006","unstructured":"Mikko Korkala, Pekka Abrahamsson, and Pekka Kyllonen. 2006. A case study on the impact of customer communication on defects in agile software development. In Proceedings of the Conference on AGILE 2006 (AGILE \u201906). IEEE, 1\u201311."},{"issue":"3","key":"e_1_3_3_82_2","article-title":"Exploring fine-grained bug report categorization with large language models and prompt engineering: An empirical study","volume":"35","author":"Koyuncu Anil","year":"2025","unstructured":"Anil Koyuncu. 2025. Exploring fine-grained bug report categorization with large language models and prompt engineering: An empirical study. ACM Transactions on Software Engineering and Methodology 35, 3 (2025), 1\u201347.","journal-title":"ACM Transactions on Software Engineering and Methodology"},{"key":"e_1_3_3_83_2","unstructured":"Naveen Krishnan. 2025. Advancing multi-agent systems through model context protocol: Architecture implementation and applications. arXiv:2504.21030. Retrieved from https:\/\/arxiv.org\/abs\/2504.21030"},{"key":"e_1_3_3_84_2","doi-asserted-by":"crossref","first-page":"120573","DOI":"10.1016\/j.eswa.2023.120573","article-title":"Bug severity classification in software using ant colony optimization based feature weighting technique","volume":"230","author":"Kukkar Ashima","year":"2023","unstructured":"Ashima Kukkar, Yugal Kumar, Ashutosh Sharma, and Jasminder Kaur Sandhu. 2023. Bug severity classification in software using ant colony optimization based feature weighting technique. Expert Systems with Applications 230 (2023), 120573.","journal-title":"Expert Systems with Applications"},{"key":"e_1_3_3_85_2","doi-asserted-by":"crossref","first-page":"1345","DOI":"10.1016\/j.procs.2020.03.345","article-title":"Does bug report summarization help in enhancing the accuracy of bug severity classification","volume":"167","author":"Kukkar Ashima","year":"2020","unstructured":"Ashima Kukkar, Rajni Mohana, and Yugal Kumar. 2020. Does bug report summarization help in enhancing the accuracy of bug severity classification? Procedia Computer Science 167 (2020), 1345\u20131353.","journal-title":"Procedia Computer Science"},{"issue":"13","key":"e_1_3_3_86_2","doi-asserted-by":"crossref","first-page":"2964","DOI":"10.3390\/s19132964","article-title":"A novel deep-learning-based bug severity classification technique using convolutional neural networks and random forest with boosting","volume":"19","author":"Kukkar Ashima","year":"2019","unstructured":"Ashima Kukkar, Rajni Mohana, Anand Nayyar, Jeamin Kim, Byeong-Gwon Kang, and Naveen Chilamkurti. 2019. A novel deep-learning-based bug severity classification technique using convolutional neural networks and random forest with boosting. Sensors 19, 13 (2019), 2964.","journal-title":"Sensors"},{"key":"e_1_3_3_87_2","first-page":"438","volume-title":"Proceedings of the 2024 IEEE\/ACM 46th International Conference on Software Engineering: Companion Proceedings (ICSE-Companion \u201924)","author":"Kumar Dipongkor Atish","year":"2024","unstructured":"Atish Kumar Dipongkor. 2024. An ensemble method for bug triaging using large language models. In Proceedings of the 2024 IEEE\/ACM 46th International Conference on Software Engineering: Companion Proceedings (ICSE-Companion \u201924). ACM, New York, NY, 438\u2013440. DOI: 10.1145\/3639478.3641228"},{"issue":"5","key":"e_1_3_3_88_2","doi-asserted-by":"crossref","first-page":"130","DOI":"10.1007\/s10664-024-10502-3","article-title":"Industrial adoption of machine learning techniques for early identification of invalid bug reports","volume":"29","author":"Laiq Muhammad","year":"2024","unstructured":"Muhammad Laiq, Nauman bin Ali, J\u00fcrgen B\u00f6rstler, and Emelie Engstr\u00f6m. 2024. Industrial adoption of machine learning techniques for early identification of invalid bug reports. Empirical Software Engineering 29, 5 (2024), 130.","journal-title":"Empirical Software Engineering"},{"key":"e_1_3_3_89_2","first-page":"497","volume-title":"Proceedings of the International Conference on Product-Focused Software Process Improvement","author":"Laiq Muhammad","year":"2022","unstructured":"Muhammad Laiq, Nauman bin Ali, J\u00fcrgen B\u00f6stler, and Emelie Engstr\u00f6m. 2022. Early identification of invalid bug reports in industrial settings\u2013A case study. In Proceedings of the International Conference on Product-Focused Software Process Improvement. Springer, 497\u2013507."},{"key":"e_1_3_3_90_2","first-page":"1","volume-title":"Proceedings of the 2010 7th IEEE Working Conference on Mining Software Repositories (MSR \u201910)","author":"Lamkanfi Ahmed","year":"2010","unstructured":"Ahmed Lamkanfi, Serge Demeyer, Emanuel Giger, and Bart Goethals. 2010. Predicting the severity of a reported bug. In Proceedings of the 2010 7th IEEE Working Conference on Mining Software Repositories (MSR \u201910). IEEE, 1\u201310."},{"issue":"6","key":"e_1_3_3_91_2","first-page":"3411","article-title":"Invalidator: Automated patch correctness assessment via semantic and syntactic reasoning","volume":"49","author":"Le-Cong Thanh","year":"2023","unstructured":"Thanh Le-Cong, Duc-Minh Luong, Xuan Bach D. Le, David Lo, Nhat-Hoa Tran, Bui Quang-Huy, and Quyet-Thang Huynh. 2023. Invalidator: Automated patch correctness assessment via semantic and syntactic reasoning. IEEE Transactions on Software Engineering 49, 6 (2023), 3411\u20133429.","journal-title":"IEEE Transactions on Software Engineering"},{"issue":"1","key":"e_1_3_3_92_2","doi-asserted-by":"crossref","first-page":"54","DOI":"10.1109\/TSE.2011.104","article-title":"GenProg: A generic method for automatic software repair","volume":"38","author":"Le Goues Claire","year":"2011","unstructured":"Claire Le Goues, ThanhVu Nguyen, Stephanie Forrest, and Westley Weimer. 2011. GenProg: A generic method for automatic software repair. IEEE Transactions on Software Engineering 38, 1 (2011), 54\u201372.","journal-title":"IEEE Transactions on Software Engineering"},{"key":"e_1_3_3_93_2","first-page":"1","volume-title":"Proceedings of 37th IEEE\/ACM International Conference on Automated Software Engineering (ASE \u201922)","volume":"3","author":"Lee Jaehyung","year":"2023","unstructured":"Jaehyung Lee, Kisun Han, and Hwanjo Yu. 2023. A light bug triage framework for applying large pre-trained language model. In Proceedings of 37th IEEE\/ACM International Conference on Automated Software Engineering (ASE \u201922). ACM, New York, NY, Article 3, 1\u201311. DOI: 10.1145\/3551349.3556898"},{"key":"e_1_3_3_94_2","doi-asserted-by":"crossref","first-page":"112588","DOI":"10.1016\/j.knosys.2024.112588","article-title":"KnowBug: Enhancing large language models with bug report knowledge for deep learning framework bug prediction","volume":"305","author":"Li Chenglong","year":"2024","unstructured":"Chenglong Li, Zheng Zheng, Xiaoting Du, Xiangyue Ma, Zhengqi Wang, and Xinheng Li. 2024. KnowBug: Enhancing large language models with bug report knowledge for deep learning framework bug prediction. Knowledge-Based Systems 305 (2024), 112588.","journal-title":"Knowledge-Based Systems"},{"key":"e_1_3_3_95_2","unstructured":"Kefan Li and Yuan Yuan. 2024. Large language models as test case generators: Performance evaluation and enhancement. arXiv:2404.13340. Retrieved from https:\/\/arxiv.org\/abs\/2404.13340"},{"key":"e_1_3_3_96_2","first-page":"51","volume-title":"Proceedings of the ACM 42nd International Conference on Software Engineering: Software Engineering in Practice (ICSE-SEIP)","author":"Li Shuyue","year":"2020","unstructured":"Shuyue Li, Jiaqi Guo, Ming Fan, Jian-Guang Lou, Qinghua Zheng, and Ting Liu. 2020. Automated bug reproduction from user reviews for android applications. In Proceedings of the ACM 42nd International Conference on Software Engineering: Software Engineering in Practice (ICSE-SEIP). IEEE, 51\u201360."},{"key":"e_1_3_3_97_2","first-page":"2025 1914","volume-title":"Proceedings of the ACM on Software Engineering","author":"Li Yue","year":"2025","unstructured":"Yue Li, Bohan Liu, Ting Zhang, Zhiqi Wang, David Lo, Lanxin Yang, Jun Lyu, and He Zhang. 2025. A knowledge enhanced large language model for bug localization. In Proceedings of the ACM on Software Engineering 2, FSE (2025), 1914\u20131936."},{"key":"e_1_3_3_98_2","unstructured":"Xiao Liu Hao Yu Hanchen Zhang Yifan Xu Xuanyu Lei Hanyu Lai Yu Gu Hangliang Ding Kaiwen Men Kejuan Yang et al. 2023. AgentBench: Evaluating LLMs as agents. arXiv:2308.03688. Retrieved from https:\/\/arxiv.org\/abs\/2308.03688"},{"key":"e_1_3_3_99_2","unstructured":"Zhe Liu Cheng Li Chunyang Chen Junjie Wang Boyu Wu Yawen Wang Jun Hu and Qing Wang. 2024. Vision-driven automated mobile GUI testing via multimodal large language model. arXiv:2407.03037. Retrieved from https:\/\/arxiv.org\/abs\/2407.03037"},{"key":"e_1_3_3_100_2","first-page":"298","volume-title":"Proceedings of 43rd Annual ACM SIGPLAN-SIGACT Symposium on Principles of Programming Languages","author":"Long Fan","year":"2016","unstructured":"Fan Long and Martin Rinard. 2016. Automatic patch generation by learning correct code. In Proceedings of 43rd Annual ACM SIGPLAN-SIGACT Symposium on Principles of Programming Languages, 298\u2013312."},{"key":"e_1_3_3_101_2","doi-asserted-by":"publisher","DOI":"10.1145\/3750040"},{"key":"e_1_3_3_102_2","first-page":"643","volume-title":"Proceedings of 22nd ACM SIGSOFT International Symposium on Foundations of Software Engineering","author":"Luo Qingzhou","year":"2014","unstructured":"Qingzhou Luo, Farah Hariri, Lamyaa Eloussi, and Darko Marinov. 2014. An empirical analysis of flaky tests. In Proceedings of 22nd ACM SIGSOFT International Symposium on Foundations of Software Engineering, 643\u2013653."},{"issue":"5","key":"e_1_3_3_103_2","first-page":"1","article-title":"Automatic programming: Large language models and beyond","volume":"34","author":"Lyu Michael R.","year":"2025","unstructured":"Michael R. Lyu, Baishakhi Ray, Abhik Roychoudhury, Shin Hwei Tan, and Patanamon Thongtanunam. 2025. Automatic programming: Large language models and beyond. ACM Transactions on Software Engineering and Methodology 34, 5 (2025), 1\u201333.","journal-title":"ACM Transactions on Software Engineering and Methodology"},{"key":"e_1_3_3_104_2","doi-asserted-by":"crossref","first-page":"13334","DOI":"10.1109\/ACCESS.2023.3242294","article-title":"A systematic literature review of issue-based requirement traceability","volume":"11","author":"Lyu Yijing","year":"2023","unstructured":"Yijing Lyu, Heetae Cho, Pilsu Jung, and Seonah Lee. 2023. A systematic literature review of issue-based requirement traceability. IEEE Access 11 (2023), 13334\u201313348.","journal-title":"IEEE Access"},{"key":"e_1_3_3_105_2","doi-asserted-by":"crossref","unstructured":"Junayed Mahmud Antu Saha Oscar Chaparro Kevin Moran and Andrian Marcus. 2025. Combining language and App UI analysis for the automated assessment of bug reproduction steps. arXiv:2502.04251. Retrieved from https:\/\/arxiv.org\/abs\/2502.04251","DOI":"10.1109\/ICPC66645.2025.00010"},{"key":"e_1_3_3_106_2","first-page":"635","volume-title":"Proceedings of 2023 IEEE 34th International Symposium on Software Reliability Engineering (ISSRE)","author":"Mashhadi Ehsan","year":"2023","unstructured":"Ehsan Mashhadi, Hossein Ahmadvand, and Hadi Hemmati. 2023. Method-level bug severity prediction using source code metrics and LLMs. In Proceedings of 2023 IEEE 34th International Symposium on Software Reliability Engineering (ISSRE). IEEE, 635\u2013646."},{"key":"e_1_3_3_107_2","doi-asserted-by":"crossref","first-page":"52","DOI":"10.1145\/3651640.3651648","volume-title":"Proceedings of 4th European Symposium on Software Engineering","author":"Meng Qianru","year":"2023","unstructured":"Qianru Meng and Joost Visser. 2023. Which bug reports are valid and why? Using the BERT transformer to classify bug reports and explain their validity. In Proceedings of 4th European Symposium on Software Engineering, 52\u201360."},{"key":"e_1_3_3_108_2","doi-asserted-by":"crossref","first-page":"263","DOI":"10.1145\/337180.337209","volume-title":"Proceedings of 22nd International Conference on Software Engineering","author":"Mockus Audris","year":"2000","unstructured":"Audris Mockus, Roy T. Fielding, and James Herbsleb. 2000. A case study of open source software development: The apache server. In Proceedings of 22nd International Conference on Software Engineering, 263\u2013272."},{"issue":"3","key":"e_1_3_3_109_2","doi-asserted-by":"crossref","first-page":"309","DOI":"10.1145\/567793.567795","article-title":"Two case studies of open source software development: Apache and Mozilla","volume":"11","author":"Mockus Audris","year":"2002","unstructured":"Audris Mockus, Roy T. Fielding, and James D. Herbsleb. 2002. Two case studies of open source software development: Apache and Mozilla. ACM Transactions on Software Engineering and Methodology 11, 3 (2002), 309\u2013346.","journal-title":"ACM Transactions on Software Engineering and Methodology"},{"key":"e_1_3_3_110_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.infsof.2016.09.001"},{"key":"e_1_3_3_111_2","unstructured":"Yu Nong Haoran Yang Long Cheng Hongxin Hu and Haipeng Cai. 2024. Automated software vulnerability patching using large language models. arXiv:2408.13597. Retrieved from https:\/\/arxiv.org\/abs\/2408.13597"},{"key":"e_1_3_3_112_2","first-page":"1","volume-title":"Proceedings of 36th Annual ACM Symposium on User Interface Software and Technology","author":"Park Joon Sung","year":"2023","unstructured":"Joon Sung Park, Joseph O\u2019Brien, Carrie Jun Cai, Meredith Ringel Morris, Percy Liang, and Michael S. Bernstein. 2023. Generative agents: Interactive simulacra of human behavior. In Proceedings of 36th Annual ACM Symposium on User Interface Software and Technology, 1\u201322."},{"key":"e_1_3_3_113_2","doi-asserted-by":"publisher","unstructured":"Avinash Patil and Aryan Jadon. 2025. Next-generation bug reporting: Enhancing development with AI automation. In 2025 10th International Conference on Signal Processing and Communication (ICSC) 487\u2013493. DOI: 10.1109\/ICSC64553.2025.1096893","DOI":"10.1109\/ICSC64553.2025.1096893"},{"key":"e_1_3_3_114_2","doi-asserted-by":"crossref","first-page":"53","DOI":"10.1109\/ICDMW51313.2020.00017","volume-title":"Proceedings of the 2020 International Conference on Data Mining Workshops (ICDMW)","author":"Pohl Matthias","year":"2020","unstructured":"Matthias Pohl, Ali Hashaam, Sascha Bosse, Daniel Gunnar Staegemann, Matthias Volk, Frederik Kramer, and Klaus Turowski. 2020. Application of NLP to determine the state of issues in bug tracking systems. In Proceedings of the 2020 International Conference on Data Mining Workshops (ICDMW). IEEE, 53\u201361."},{"key":"e_1_3_3_115_2","volume-title":"Software Engineering: A Practitioner\u2019s Approach","author":"Pressman Roger S.","year":"2005","unstructured":"Roger S. Pressman. 2005. Software Engineering: A Practitioner\u2019s Approach. Palgrave Macmillan."},{"key":"e_1_3_3_116_2","doi-asserted-by":"crossref","first-page":"106972","DOI":"10.1016\/j.infsof.2022.106972","article-title":"Taxonomy of bug tracking process smells: Perceptions of practitioners and an empirical analysis","volume":"150","author":"Qamar Khushbakht Ali","year":"2022","unstructured":"Khushbakht Ali Qamar, Emre S\u00fcl\u00fcn, and Eray T\u00fcz\u00fcn. 2022. Taxonomy of bug tracking process smells: Perceptions of practitioners and an empirical analysis. Information and Software Technology 150 (2022), 106972.","journal-title":"Information and Software Technology"},{"key":"e_1_3_3_117_2","first-page":"254","volume-title":"Proceedings of 36th International Conference on Software Engineering","author":"Qi Yuhua","year":"2014","unstructured":"Yuhua Qi, Xiaoguang Mao, Yan Lei, Ziying Dai, and Chengsong Wang. 2014. The strength of random search on automated program repair. In Proceedings of 36th International Conference on Software Engineering, 254\u2013265."},{"key":"e_1_3_3_118_2","doi-asserted-by":"crossref","first-page":"1173","DOI":"10.1109\/TSE.2025.3543187","article-title":"SoapFL: A standard operating procedure for LLM-based method-level fault localization","volume":"51","author":"Qin Yihao","year":"2025","unstructured":"Yihao Qin, Shangwen Wang, Yiling Lou, Jinhao Dong, Kaixin Wang, Xiaoling Li, and Xiaoguang Mao. 2025. SoapFL: A standard operating procedure for LLM-based method-level fault localization. IEEE Transactions on Software Engineering 51 (2025), 1173\u20131187.","journal-title":"IEEE Transactions on Software Engineering"},{"key":"e_1_3_3_119_2","doi-asserted-by":"crossref","first-page":"834","DOI":"10.1145\/3180155.3180207","volume-title":"Proceedings of 40th International Conference on Software Engineering","author":"Rath Michael","year":"2018","unstructured":"Michael Rath, Jacob Rendall, Jin L. C. Guo, Jane Cleland-Huang, and Patrick M\u00e4der. 2018. Traceability in the wild: Automatically augmenting incomplete trace links. In Proceedings of 40th International Conference on Software Engineering, 834\u2013845."},{"key":"e_1_3_3_120_2","doi-asserted-by":"crossref","first-page":"110406","DOI":"10.1016\/j.jss.2019.110406","article-title":"DeepLink: Recovering issue-commit links based on deep learning","volume":"158","author":"Ruan Hai","year":"2019","unstructured":"Hai Ruan, Binyu Chen, Xin Peng, and Wen Zhao. 2019. DeepLink: Recovering issue-commit links based on deep learning. Journal of Systems and Software 158 (2019), 110406.","journal-title":"Journal of Systems and Software"},{"issue":"1","key":"e_1_3_3_121_2","doi-asserted-by":"crossref","first-page":"23","DOI":"10.1007\/s10664-024-10579-w","article-title":"Towards enhancing the reproducibility of deep learning bugs: An empirical study","volume":"30","author":"Shah Mehil B.","year":"2025","unstructured":"Mehil B. Shah, Mohammad Masudur Rahman, and Foutse Khomh. 2025. Towards enhancing the reproducibility of deep learning bugs: An empirical study. Empirical Software Engineering 30, 1 (2025), 23.","journal-title":"Empirical Software Engineering"},{"key":"e_1_3_3_122_2","first-page":"299","volume-title":"Proceedings of 44th International Conference on Software Engineering (ICSE \u201922)","author":"Shi Lin","year":"2022","unstructured":"Lin Shi, Fangwen Mu, Yumin Zhang, Ye Yang, Junjie Chen, Xiao Chen, Hanzhi Jiang, Ziyou Jiang, and Qing Wang. 2022. BugListener: Identifying and synthesizing bug reports from collaborative live chats. In Proceedings of 44th International Conference on Software Engineering (ICSE \u201922). ACM, New York, NY, 299\u2013311. DOI: 10.1145\/3510003.3510108"},{"key":"e_1_3_3_123_2","unstructured":"Smithsonian National Museum of American History. 1947. Log Book: Computer Bug (Harvard Mark II 1947). Retrieved September 15 2025 from https:\/\/www.si.edu\/object\/log-book-computer-bug%3Anmah_334663"},{"issue":"6","key":"e_1_3_3_124_2","doi-asserted-by":"crossref","first-page":"5255","DOI":"10.1007\/s10664-020-09882-z","article-title":"The significance of bug report elements","volume":"25","author":"Soltani Mozhan","year":"2020","unstructured":"Mozhan Soltani, Felienne Hermans, and Thomas B\u00e4ck. 2020. The significance of bug report elements. Empirical Software Engineering 25, 6 (2020), 5255\u20135294.","journal-title":"Empirical Software Engineering"},{"key":"e_1_3_3_125_2","first-page":"1551","volume-title":"Proceedings of 28th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering","author":"Song Yang","year":"2020","unstructured":"Yang Song and Oscar Chaparro. 2020. BEE: A tool for structuring and analyzing bug reports. In Proceedings of 28th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering, 1551\u20131555."},{"key":"e_1_3_3_126_2","doi-asserted-by":"crossref","first-page":"170","DOI":"10.1109\/ICSE-Companion58688.2023.00048","volume-title":"Proceedings of 2023 IEEE\/ACM 45th International Conference on Software Engineering: Companion Proceedings (ICSE-Companion)","author":"Song Yang","year":"2023","unstructured":"Yang Song, Junayed Mahmud, Nadeeshan De Silva, Ying Zhou, Oscar Chaparro, Kevin Moran, Andrian Marcus, and Denys Poshyvanyk. 2023. Burt: A chatbot for interactive bug reporting. In Proceedings of 2023 IEEE\/ACM 45th International Conference on Software Engineering: Companion Proceedings (ICSE-Companion). IEEE, 170\u2013174."},{"key":"e_1_3_3_127_2","first-page":"344","volume-title":"Proceedings of 30th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC\/FSE \u201922)","author":"Song Yang","year":"2022","unstructured":"Yang Song, Junayed Mahmud, Ying Zhou, Oscar Chaparro, Kevin Moran, Andrian Marcus, and Denys Poshyvanyk. 2022. Toward interactive bug reporting for (android app) end-users. In Proceedings of 30th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC\/FSE \u201922). ACM, New York, NY, 344\u2013356. DOI: 10.1145\/3540250.3549131"},{"issue":"1","key":"e_1_3_3_128_2","doi-asserted-by":"crossref","first-page":"11","DOI":"10.1108\/eb026526","article-title":"A statistical interpretation of term specificity and its application in retrieval","volume":"28","author":"Sparck Jones Karen","year":"1972","unstructured":"Karen Sparck Jones. 1972. A statistical interpretation of term specificity and its application in retrieval. Journal of Documentation 28, 1 (1972), 11\u201321.","journal-title":"Journal of Documentation"},{"issue":"12","key":"e_1_3_3_129_2","doi-asserted-by":"crossref","first-page":"2331","DOI":"10.1109\/JPROC.2018.2878986","article-title":"Debugging the ENIAC [scanning our past]","volume":"106","author":"Stuart Brian L.","year":"2018","unstructured":"Brian L. Stuart. 2018. Debugging the ENIAC [scanning our past]. Proceedings of the IEEE 106, 12 (2018), 2331\u20132345.","journal-title":"Proceedings of the IEEE"},{"issue":"6","key":"e_1_3_3_130_2","doi-asserted-by":"crossref","first-page":"237","DOI":"10.1145\/1323293.1294284","article-title":"AutoBash: Improving configuration management with operating system causality analysis","volume":"41","author":"Su Ya-Yunn","year":"2007","unstructured":"Ya-Yunn Su, Mona Attariyan, and Jason Flinn. 2007. AutoBash: Improving configuration management with operating system causality analysis. ACM SIGOPS Operating Systems Review 41, 6 (2007), 237\u2013250.","journal-title":"ACM SIGOPS Operating Systems Review"},{"key":"e_1_3_3_131_2","doi-asserted-by":"crossref","first-page":"738","DOI":"10.18653\/v1\/D18-1081","volume-title":"Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing","author":"Sulem Elior","year":"2018","unstructured":"Elior Sulem, Omri Abend, and Ari Rappoport. 2018. BLEU is not suitable for the evaluation of text simplification. In Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing. Ellen Riloff, David Chiang, Julia Hockenmaier, and Jun\u2019ichi Tsujii (Eds.), Association for Computational Linguistics, 738\u2013744. DOI: 10.18653\/v1\/D18-1081"},{"issue":"5","key":"e_1_3_3_132_2","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3643673","article-title":"An empirical analysis of issue templates usage in large-scale projects on GitHub","volume":"33","author":"S\u00fcl\u00fcn Emre","year":"2024","unstructured":"Emre S\u00fcl\u00fcn, Metehan Sa\u00e7ak\u00e7\u0131, and Eray T\u00fcz\u00fcn. 2024. An empirical analysis of issue templates usage in large-scale projects on GitHub. ACM Transactions on Software Engineering and Methodology 33, 5 (2024), 1\u201328.","journal-title":"ACM Transactions on Software Engineering and Methodology"},{"key":"e_1_3_3_133_2","first-page":"407","volume-title":"Proceedings of the 2011 4th IEEE International Conference on Software Testing, Verification and Validation","author":"Sun Jian","year":"2011","unstructured":"Jian Sun. 2011. Why are bug reports invalid? In Proceedings of the 2011 4th IEEE International Conference on Software Testing, Verification and Validation. IEEE, 407\u2013410."},{"key":"e_1_3_3_134_2","unstructured":"Rao Surapaneni Miku Jha Michael Vakoc and Todd Segal. 2025. Announcing the Agent2Agent Protocol (A2A). Google for Developers Blog. Retrieved January 7 2026 from https:\/\/developers.googleblog.com\/en\/a2a-a-new-era-of-agent-interoperability"},{"issue":"11","key":"e_1_3_3_135_2","doi-asserted-by":"crossref","first-page":"1200","DOI":"10.1109\/TSE.2018.2876537","article-title":"The impact of class rebalancing techniques on the performance and interpretation of defect prediction models","volume":"46","author":"Tantithamthavorn Chakkrit","year":"2018","unstructured":"Chakkrit Tantithamthavorn, Ahmed E. Hassan, and Kenichi Matsumoto. 2018. The impact of class rebalancing techniques on the performance and interpretation of defect prediction models. IEEE Transactions on Software Engineering 46, 11 (2018), 1200\u20131219.","journal-title":"IEEE Transactions on Software Engineering"},{"key":"e_1_3_3_136_2","unstructured":"Hugo Touvron Thibaut Lavril Gautier Izacard Xavier Martinet Marie-Anne Lachaux Timoth\u00e9e Lacroix Baptiste Rozi\u00e8re Naman Goyal Eric Hambro Faisal Azhar et al. 2023. Llama: Open and efficient foundation language models. arXiv:2302.13971. Retrieved from https:\/\/arxiv.org\/abs\/2302.13971"},{"key":"e_1_3_3_137_2","first-page":"224","volume-title":"Proceedings of the 2011 IEEE 17th Pacific Rim International Symposium on Dependable Computing","author":"Trivedi Kishor S.","year":"2011","unstructured":"Kishor S. Trivedi, Rajesh Mansharamani, Dong Seong Kim, Michael Grottke, and Manoj Nambiar. 2011. Recovery from failures due to mandelbugs in it systems. In Proceedings of the 2011 IEEE 17th Pacific Rim International Symposium on Dependable Computing. IEEE, 224\u2013233."},{"key":"e_1_3_3_138_2","doi-asserted-by":"crossref","first-page":"77","DOI":"10.1145\/3510457.3513080","volume-title":"Proceedings of 44th International Conference on Software Engineering: Software Engineering in Practice","author":"Tuna Erdem","year":"2022","unstructured":"Erdem Tuna, Vladimir Kovalenko, and Eray T\u00fcz\u00fcn. 2022. Bug tracking process smells in practice. In Proceedings of 44th International Conference on Software Engineering: Software Engineering in Practice, 77\u201386."},{"key":"e_1_3_3_139_2","first-page":"1","volume-title":"Proceedings of the CHI Conference on Human Factors in Computing Systems Extended Abstracts","author":"Vaithilingam Priyan","year":"2022","unstructured":"Priyan Vaithilingam, Tianyi Zhang, and Elena L. Glassman. 2022. Expectation vs. experience: Evaluating the usability of code generation tools powered by large language models. In Proceedings of the CHI Conference on Human Factors in Computing Systems Extended Abstracts, 1\u20137."},{"key":"e_1_3_3_140_2","first-page":"1","article-title":"Bug taxonomies: Use them to generate better tests","volume":"2003","author":"Vijayaraghavan Giri","year":"2003","unstructured":"Giri Vijayaraghavan and Cem Kaner. 2003. Bug taxonomies: Use them to generate better tests. Star East 2003 (2003), 1\u201340.","journal-title":"Star East"},{"key":"e_1_3_3_141_2","first-page":"189","volume-title":"Proceedings of 11th International Conference on the Design of Cooperative SystemsCOOP \u201914","author":"Vyas Dhaval","year":"2014","unstructured":"Dhaval Vyas, Thomas Fritz, and David Shepherd. 2014. Bug reproduction: A collaborative practice within software maintenance activities. In Proceedings of 11th International Conference on the Design of Cooperative Systems (COOP \u201914). Springer, 189\u2013207."},{"key":"e_1_3_3_142_2","unstructured":"Bo Wang Weiyi He Shenglai Zeng Zhen Xiang Yue Xing Jiliang Tang and Pengfei He. 2025. Unveiling privacy risks in LLM agent memory. arXiv:2502.13172. Retrieved from https:\/\/arxiv.org\/abs\/2502.13172"},{"key":"e_1_3_3_143_2","doi-asserted-by":"crossref","first-page":"111834","DOI":"10.1016\/j.jss.2023.111834","article-title":"Application monitoring for bug reproduction in web-based applications","volume":"207","author":"Wang Di","year":"2024","unstructured":"Di Wang, Matthias Galster, and Miguel Morales-Trujillo. 2024. Application monitoring for bug reproduction in web-based applications. Journal of Systems and Software 207 (2024), 111834.","journal-title":"Journal of Systems and Software"},{"key":"e_1_3_3_144_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2024.112230"},{"key":"e_1_3_3_145_2","first-page":"27","volume-title":"Proceedings of the 2025 IEEE\/ACM 22nd International Conference on Mining Software Repositories (MSR)","author":"Wang Dingbang","year":"2025","unstructured":"Dingbang Wang, Zhaoxu Zhang, Sidong Feng, William G. J. Halfond, and Tingting Yu. 2025. An empirical study on leveraging images in automated bug report reproduction. In Proceedings of the 2025 IEEE\/ACM 22nd International Conference on Mining Software Repositories (MSR). IEEE, 27\u201338."},{"key":"e_1_3_3_146_2","first-page":"1048","volume-title":"Proceedings of 33rd ACM SIGSOFT International Symposium on Software Testing and Analysis","author":"Wang Dingbang","year":"2024","unstructured":"Dingbang Wang, Yu Zhao, Sidong Feng, Zhaoxu Zhang, William G. J. Halfond, Chunyang Chen, Xiaoxia Sun, Jiangfan Shi, and Tingting Yu. 2024. Feedback-driven automated whole bug report reproduction for android apps. In Proceedings of 33rd ACM SIGSOFT International Symposium on Software Testing and Analysis, 1048\u20131060."},{"key":"e_1_3_3_147_2","first-page":"245","volume-title":"Proceedings of the 6th conference on Symposium on Operating Systems Design and Implementation (OSDI \u201904)","volume":"6","author":"Wang Helen J.","year":"2004","unstructured":"Helen J. Wang, John C. Platt, Yu Chen, Ruyun Zhang, and Yi-Min Wang. 2004. Automatic misconfiguration troubleshooting with peerpressure. In Proceedings of the 6th conference on Symposium on Operating Systems Design and Implementation (OSDI \u201904), Vol. 6, 245\u2013257."},{"issue":"6","key":"e_1_3_3_148_2","doi-asserted-by":"crossref","first-page":"186345","DOI":"10.1007\/s11704-024-40231-1","article-title":"A survey on large language model based autonomous agents","volume":"18","author":"Wang Lei","year":"2024","unstructured":"Lei Wang, Chen Ma, Xueyang Feng, Zeyu Zhang, Hao Yang, Jingsen Zhang, Zhiyuan Chen, Jiakai Tang, Xu Chen, Yankai Lin, et al. 2024. A survey on large language model based autonomous agents. Frontiers of Computer Science 18, 6 (2024), 186345.","journal-title":"Frontiers of Computer Science"},{"issue":"5","key":"e_1_3_3_149_2","doi-asserted-by":"crossref","first-page":"640","DOI":"10.1007\/s11227-025-07102-3","article-title":"DALO-APR: LLM-based automatic program repair with data augmentation and loss function optimization","volume":"81","author":"Wang Shaosheng","year":"2025","unstructured":"Shaosheng Wang, Lu Lu, Shaojian Qiu, Qingyan Tian, and Haishan Lin. 2025. DALO-APR: LLM-based automatic program repair with data augmentation and loss function optimization. Journal of Supercomputing 81, 5 (2025), 640.","journal-title":"Journal of Supercomputing"},{"key":"e_1_3_3_150_2","unstructured":"Wenhan Wang Chenyuan Yang Zhijie Wang Yuheng Huang Zhaoyang Chu Da Song Lingming Zhang An Ran Chen and Lei Ma. 2024. TestEval: Benchmarking large language models for test case generation. arXiv:2406.04531. Retrieved from https:\/\/arxiv.org\/abs\/2406.04531"},{"key":"e_1_3_3_151_2","unstructured":"Xingyao Wang Boxuan Li Yufan Song Frank F. Xu Xiangru Tang Mingchen Zhuge Jiayi Pan Yueqi Song Bowen Li Jaskirat Singh et al. 2024. Openhands: An open platform for AI software developers as generalist agents. arXiv:2407.16741. Retrieved from https:\/\/arxiv.org\/abs\/2407.16741"},{"key":"e_1_3_3_152_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10515-025-00544-2"},{"key":"e_1_3_3_153_2","first-page":"523","volume-title":"Proceedings of the 2024 IEEE 35th International Symposium on Software Reliability Engineering (ISSRE)","author":"Wang Zexin","year":"2024","unstructured":"Zexin Wang, Jianhui Li, Minghua Ma, Ze Li, Yu Kang, Chaoyun Zhang, Chetan Bansal, Murali Chintalapati, Saravan Rajmohan, Qingwei Lin, et al. 2024. Large language models can provide accurate and interpretable incident triage. In Proceedings of the 2024 IEEE 35th International Symposium on Software Reliability Engineering (ISSRE), 523\u2013534. DOI: 10.1109\/ISSRE62328.2024.00056"},{"issue":"11","key":"e_1_3_3_154_2","first-page":"2348","article-title":"Historical","volume":"47","author":"Wen Ming","year":"2019","unstructured":"Ming Wen, Junjie Chen, Yongqiang Tian, Rongxin Wu, Dan Hao, Shi Han, and Shing-Chi Cheung. 2019. Historical spectrum based fault localization. IEEE Transactions on Software Engineering 47, 11 (2019), 2348\u20132368.","journal-title":"IEEE Transactions on Software Engineering"},{"key":"e_1_3_3_155_2","doi-asserted-by":"crossref","first-page":"135","DOI":"10.1002\/9781119880929.ch3","volume-title":"Handbook of Software Fault Localization: Foundations and Advances","author":"Wong W. Eric","year":"2023","unstructured":"W. Eric Wong, Hira Agrawal, and Xiangyu Zhang. 2023. Slicing-based techniques for software fault localization. In Handbook of Software Fault Localization: Foundations and Advances. W. Eric Wong and T. H. Tse (Eds.), Wiley, 135\u2013200."},{"key":"e_1_3_3_156_2","doi-asserted-by":"crossref","first-page":"195","DOI":"10.1007\/s11219-019-09481-2","article-title":"Invalid bug reports complicate the software aging situation","volume":"28","author":"Wu Xiaoxue","year":"2020","unstructured":"Xiaoxue Wu, Wei Zheng, Minchao Pu, Jie Chen, and Dejun Mu. 2020. Invalid bug reports complicate the software aging situation. Software Quality Journal 28 (2020), 195\u2013220.","journal-title":"Software Quality Journal"},{"key":"e_1_3_3_157_2","first-page":"801","volume-title":"Proceedings of the ACM on Software Engineering","author":"Xia Chunqiu Steven","year":"2025","unstructured":"Chunqiu Steven Xia, Yinlin Deng, Soren Dunn, and Lingming Zhang. 2025. Demystifying LLM-based software engineering agents. Proceedings of the ACM on Software Engineering 2, FSE (2025), 801\u2013824."},{"key":"e_1_3_3_158_2","first-page":"1482","volume-title":"Proceedings of the 2023 IEEE\/ACM 45th International Conference on Software Engineering (ICSE)","author":"Xia Chunqiu Steven","year":"2023","unstructured":"Chunqiu Steven Xia, Yuxiang Wei, and Lingming Zhang. 2023. Automated program repair in the era of large pre-trained language models. In Proceedings of the 2023 IEEE\/ACM 45th International Conference on Software Engineering (ICSE). IEEE, 1482\u20131494."},{"key":"e_1_3_3_159_2","doi-asserted-by":"crossref","first-page":"365","DOI":"10.1002\/9781119880929.ch8","volume-title":"Handbook of Software Fault Localization: Foundations and Advances","author":"Xia Xin","year":"2023","unstructured":"Xin Xia and David Lo. 2023. Information retrieval-based techniques for software fault localization. In Handbook of Software Fault Localization: Foundations and Advances. W. Eric Wong and T. H. Tse (Eds.), Wiley, 365\u2013391."},{"key":"e_1_3_3_160_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2016.2576454"},{"key":"e_1_3_3_161_2","doi-asserted-by":"crossref","first-page":"58","DOI":"10.1109\/ICSE.2012.6227206","volume-title":"Proceedings of the 2012 34th International Conference on Software Engineering (ICSE)","author":"Xiong Yingfei","year":"2012","unstructured":"Yingfei Xiong, Arnaud Hubaux, Steven She, and Krzysztof Czarnecki. 2012. Generating range fixes for software configuration. In Proceedings of the 2012 34th International Conference on Software Engineering (ICSE). IEEE, 58\u201368."},{"key":"e_1_3_3_162_2","first-page":"416","volume-title":"Proceedings of the 2017 IEEE\/ACM 39th International Conference on Software Engineering (ICSE)","author":"Xiong Yingfei","year":"2017","unstructured":"Yingfei Xiong, Jie Wang, Runfa Yan, Jiachen Zhang, Shi Han, Gang Huang, and Lu Zhang. 2017. Precise condition synthesis for program repair. In Proceedings of the 2017 IEEE\/ACM 39th International Conference on Software Engineering (ICSE). IEEE, 416\u2013426."},{"issue":"5","key":"e_1_3_3_163_2","doi-asserted-by":"crossref","first-page":"1455","DOI":"10.1109\/TSE.2025.3553363","article-title":"FlexFL: Flexible and effective fault localization with open-source large language models","volume":"51","author":"Xu Chuyang","year":"2025","unstructured":"Chuyang Xu, Zhongxin Liu, Xiaoxue Ren, Gehao Zhang, Ming Liang, and David Lo. 2025. FlexFL: Flexible and effective fault localization with open-source large language models. IEEE Transactions on Software Engineering 51, 5 (2025), 1455\u20131471.","journal-title":"IEEE Transactions on Software Engineering"},{"key":"e_1_3_3_164_2","unstructured":"Ziwei Xu Sanjay Jain and Mohan Kankanhalli. 2024. Hallucination is inevitable: An innate limitation of large language models. arXiv:2401.11817. Retrieved from https:\/\/arxiv.org\/abs\/2401.11817"},{"key":"e_1_3_3_165_2","unstructured":"Jifeng Xuan He Jiang Zhilei Ren Jun Yan and Zhongxuan Luo. 2017. Automatic bug triage using semi-supervised text classification. arXiv:1704.04769. Retrieved from https:\/\/arxiv.org\/abs\/1704.04769"},{"key":"e_1_3_3_166_2","first-page":"1","volume-title":"Proceedings of 46th IEEE\/ACM International Conference on Software Engineering","author":"Yang Aidan Z. H.","year":"2024","unstructured":"Aidan Z. H. Yang, Claire Le Goues, Ruben Martins, and Vincent Hellendoorn. 2024. Large language models for test-free fault localization. In Proceedings of 46th IEEE\/ACM International Conference on Software Engineering, 1\u201312."},{"key":"e_1_3_3_167_2","first-page":"97","volume-title":"Proceedings of the 2014 IEEE 38th Annual Computer Software and Applications Conference","author":"Yang Geunseok","year":"2014","unstructured":"Geunseok Yang, Tao Zhang, and Byungjeong Lee. 2014. Towards semi-automatic bug triage and severity prediction based on topic model and multi-feature of bug reports. In Proceedings of the 2014 IEEE 38th Annual Computer Software and Applications Conference, 97\u2013106. DOI: 10.1109\/COMPSAC.2014.16"},{"key":"e_1_3_3_168_2","first-page":"3095","volume-title":"Proceedings of the 2025 40th IEEE\/ACM International Conference on Automated Software Engineering (ASE)","author":"Yapa\u011fc\u0131 Eray","year":"2025","unstructured":"Eray Yapa\u011fc\u0131, Yavuz Alp Sencer \u00d6zt\u00fcrk, and Eray T\u00fcz\u00fcn. 2025. Agents in the sandbox: End-to-end crash bug reproduction for minecraft. In Proceedings of the 2025 40th IEEE\/ACM International Conference on Automated Software Engineering (ASE), 3095\u20133107. DOI: 10.1109\/ASE63991.2025.00254"},{"key":"e_1_3_3_169_2","first-page":"80","volume-title":"Proceedings of the 2025 IEEE International Conference on Software Analysis, Evolution and Reengineering (SANER)","author":"Ya\u015fa Ayberk","year":"2025","unstructured":"Ayberk Ya\u015fa, Cemhan Kaan \u00d6zaltan, G\u00f6rkem Ayten, Fatih Kaplama, \u00d6mercan Devran, Baykal Mehmet U\u00e7ar, and Eray T\u00fcz\u00fcn. 2025. Evaluating relink for traceability link recovery in practice. In Proceedings of the 2025 IEEE International Conference on Software Analysis, Evolution and Reengineering (SANER). IEEE, 80\u201390."},{"key":"e_1_3_3_170_2","first-page":"629","volume-title":"Proceedings of the 2025 IEEE\/ACM 22nd International Conference on Mining Software Repositories (MSR)","author":"Ye Ziyang","year":"2025","unstructured":"Ziyang Ye, Triet Huynh Minh Le, and M. Ali Babar. 2025. LLMSecConfig: An LLM-based approach for fixing software container misconfigurations. In Proceedings of the 2025 IEEE\/ACM 22nd International Conference on Mining Software Repositories (MSR). IEEE, 629\u2013641."},{"key":"e_1_3_3_171_2","doi-asserted-by":"crossref","unstructured":"Asaf Yehudai Lilach Eden Alan Li Guy Uziel Yilun Zhao Roy Bar-Haim Arman Cohan and Michal Shmueli-Scheuer. 2025. Survey on evaluation of LLM-based agents. arXiv:2503.16416. Retrieved from https:\/\/arxiv.org\/abs\/2503.16416","DOI":"10.18653\/v1\/2026.findings-acl.1330"},{"issue":"2","key":"e_1_3_3_172_2","doi-asserted-by":"crossref","first-page":"67","DOI":"10.1002\/stv.430","article-title":"Regression testing minimization, selection and prioritization: A survey","volume":"22","author":"Yoo Shin","year":"2012","unstructured":"Shin Yoo and Mark Harman. 2012. Regression testing minimization, selection and prioritization: A survey. Software Testing, Verification and Reliability 22, 2 (2012), 67\u2013120.","journal-title":"Software Testing, Verification and Reliability"},{"key":"e_1_3_3_173_2","first-page":"1","volume-title":"Proceedings of the 1994 Conference of the Centre for Advanced Studies on Collaborative Research","author":"Yu Seong R.","year":"1994","unstructured":"Seong R. Yu. 1994. A versatile development process for small to large projects using IBM CMVC. In Proceedings of the 1994 Conference of the Centre for Advanced Studies on Collaborative Research, 1\u201375."},{"key":"e_1_3_3_174_2","unstructured":"Kaiyuan Zhang Zian Su Pin-Yu Chen Elisa Bertino Xiangyu Zhang and Ninghui Li. 2025. LLM agents should employ security principles. arXiv:2505.24019. Retrieved from https:\/\/arxiv.org\/abs\/2505.24019"},{"key":"e_1_3_3_175_2","first-page":"230","volume-title":"Proceedings of the 2017 IEEE\/ACM 25th International Conference on Program Comprehension (ICPC)","author":"Zhang Tao","year":"2017","unstructured":"Tao Zhang, Jiachi Chen, He Jiang, Xiapu Luo, and Xin Xia. 2017. Bug report enrichment with application of automated fixer recommendation. In Proceedings of the 2017 IEEE\/ACM 25th International Conference on Program Comprehension (ICPC). IEEE, 230\u2013240."},{"key":"e_1_3_3_176_2","first-page":"1592","volume-title":"Proceedings of 33rd ACM SIGSOFT International Symposium on Software Testing and Analysis","author":"Zhang Yuntong","year":"2024","unstructured":"Yuntong Zhang, Haifeng Ruan, Zhiyu Fan, and Abhik Roychoudhury. 2024. AutoCodeRover: Autonomous program improvement. In Proceedings of 33rd ACM SIGSOFT International Symposium on Software Testing and Analysis, 1592\u20131604."},{"key":"e_1_3_3_177_2","first-page":"481","volume-title":"Proceedings of the ACM on Software Engineering 2","author":"Zhang Ziyao","year":"2025","unstructured":"Ziyao Zhang, Chong Wang, Yanlin Wang, Ensheng Shi, Yuchi Ma, Wanjun Zhong, Jiachi Chen, Mingzhi Mao, and Zibin Zheng. 2025. LLM hallucinations in practical code generation: Phenomena, mechanism, and mitigation. Proceedings of the ACM on Software Engineering 2, ISSTA (2025), 481\u2013503."},{"key":"e_1_3_3_178_2","first-page":"100","volume-title":"Proceedings of the International Conference on Software and Systems Reuse","author":"Zhao Yu","year":"2019","unstructured":"Yu Zhao, Kye Miller, Tingting Yu, Wei Zheng, and Minchao Pu. 2019. Automatically extracting bug reproducing steps from android bug reports. In Proceedings of the International Conference on Software and Systems Reuse. Springer, 100\u2013111."},{"issue":"3","key":"e_1_3_3_179_2","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3488244","article-title":"ReCDroid+: Automated end-to-end crash reproduction from bug reports for android apps","volume":"31","author":"Zhao Yu","year":"2022","unstructured":"Yu Zhao, Ting Su, Yang Liu, Wei Zheng, Xiaoxue Wu, Ramakanth Kavuluru, William G. J. Halfond, and Tingting Yu. 2022. ReCDroid+: Automated end-to-end crash reproduction from bug reports for android apps. ACM Transactions on Software Engineering and Methodology 31, 3 (2022), 1\u201333.","journal-title":"ACM Transactions on Software Engineering and Methodology"},{"key":"e_1_3_3_180_2","first-page":"128","volume-title":"Proceedings of the 2019 IEEE\/ACM 41st International Conference on Software Engineering (ICSE)","author":"Zhao Yu","year":"2019","unstructured":"Yu Zhao, Tingting Yu, Ting Su, Yang Liu, Wei Zheng, Jingzhi Zhang, and William G. J. Halfond. 2019. ReCDroid: Automatically reproducing Android application crashes from bug reports. In Proceedings of the 2019 IEEE\/ACM 41st International Conference on Software Engineering (ICSE). IEEE, 128\u2013139."},{"issue":"11","key":"e_1_3_3_181_2","doi-asserted-by":"crossref","first-page":"2865","DOI":"10.1109\/TSE.2024.3452252","article-title":"Leveraging large language model for automatic patch correctness assessment","volume":"50","author":"Zhou Xin","year":"2024","unstructured":"Xin Zhou, Bowen Xu, Kisub Kim, DongGyun Han, Hung Huu Nguyen, Thanh Le-Cong, Junda He, Bach Le, and David Lo. 2024. Leveraging large language model for automatic patch correctness assessment. IEEE Transactions on Software Engineering 50, 11 (2024), 2865\u20132883.","journal-title":"IEEE Transactions on Software Engineering"},{"issue":"5","key":"e_1_3_3_182_2","doi-asserted-by":"crossref","first-page":"618","DOI":"10.1109\/TSE.2010.63","article-title":"What makes a good bug report","volume":"36","author":"Zimmermann Thomas","year":"2010","unstructured":"Thomas Zimmermann, Rahul Premraj, Nicolas Bettenburg, Sascha Just, Adrian Schroter, and Cathrin Weiss. 2010. What makes a good bug report? IEEE Transactions on Software Engineering 36, 5 (2010), 618\u2013643.","journal-title":"IEEE Transactions on Software Engineering"},{"key":"e_1_3_3_183_2","doi-asserted-by":"crossref","first-page":"247","DOI":"10.1109\/ICSE-COMPANION.2009.5070993","volume-title":"Proceedings of the 2009 31st International Conference on Software Engineering-Companion Volume","author":"Zimmermann Thomas","year":"2009","unstructured":"Thomas Zimmermann, Rahul Premraj, Jonathan Sillito, and Silvia Breu. 2009. Improving bug tracking systems. In Proceedings of the 2009 31st International Conference on Software Engineering-Companion Volume. IEEE, 247\u2013250."}],"container-title":["ACM Transactions on Software Engineering and Methodology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3806655","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,8,21]],"date-time":"2026-08-21T16:28:12Z","timestamp":1787329692000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3806655"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,8,21]]},"references-count":182,"journal-issue":{"issue":"9","published-print":{"date-parts":[[2026,9,30]]}},"alternative-id":["10.1145\/3806655"],"URL":"https:\/\/doi.org\/10.1145\/3806655","relation":{},"ISSN":["1049-331X","1557-7392"],"issn-type":[{"value":"1049-331X","type":"print"},{"value":"1557-7392","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,8,21]]},"assertion":[{"value":"2025-10-04","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2026-03-12","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2026-08-21","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}