{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,8,2]],"date-time":"2025-08-02T14:33:26Z","timestamp":1754145206241,"version":"3.41.2"},"reference-count":81,"publisher":"Association for Computing Machinery (ACM)","issue":"ISSTA","funder":[{"name":"RIE2025 Industry Alignment Fund ? Industry Collaboration Projects","award":["I2301E0026"],"award-info":[{"award-number":["I2301E0026"]}]},{"name":"Singapore Ministry of Education Academic Research Fund Tier 1","award":["RG12\/23"],"award-info":[{"award-number":["RG12\/23"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Proc. ACM Softw. Eng."],"published-print":{"date-parts":[[2025,6,22]]},"abstract":"<jats:p>Modern AI- and Data-intensive software systems rely heavily on data science and machine learning libraries that provide essential algorithmic implementations and computational frameworks. These libraries expose complex APIs whose correct usage has to follow constraints among multiple interdependent parameters. Developers using these APIs are expected to learn about the constraints through the provided documentation and any discrepancy may lead to unexpected behaviors. However, maintaining correct and consistent multi-parameter constraints in API documentation remains a significant challenge for API compatibility and reliability. To address this challenge, we propose MPChecker for detecting inconsistencies between code and documentation, specifically focusing on multi-parameter constraints. MPChecker identifies these constraints at the code level by exploring execution paths through symbolic execution and further extracts corresponding constraints from documentation using large language models (LLMs). We propose a customized fuzzy constraint logic to reconcile the unpredictability of LLM outputs and detect logical inconsistencies between the code and documentation constraints. We collected and constructed two datasets from four popular data science libraries and evaluated MPChecker on them. Our tool identified 117 of 126 inconsistent constraints, achieving a recall of 92.8% and demonstrating its effectiveness at detecting inconsistency issues. We further reported 14 detected inconsistency issues to the library developers, who have confirmed 11 issues at the time of writing.<\/jats:p>","DOI":"10.1145\/3728945","type":"journal-article","created":{"date-parts":[[2025,6,22]],"date-time":"2025-06-22T10:52:56Z","timestamp":1750589576000},"page":"1536-1558","source":"Crossref","is-referenced-by-count":0,"title":["Identifying Multi-parameter Constraint Errors in Python Data Science Library API Documentation"],"prefix":"10.1145","volume":"2","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-2564-6660","authenticated-orcid":false,"given":"Xiufeng","family":"Xu","sequence":"first","affiliation":[{"name":"Nanyang Technological University, Singapore, Singapore"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5446-3081","authenticated-orcid":false,"given":"Fuman","family":"Xie","sequence":"additional","affiliation":[{"name":"University of Queensland, Brisbane, Australia"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7343-8279","authenticated-orcid":false,"given":"Chenguang","family":"Zhu","sequence":"additional","affiliation":[{"name":"University of Texas at Austin, Austin, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6390-9890","authenticated-orcid":false,"given":"Guangdong","family":"Bai","sequence":"additional","affiliation":[{"name":"University of Queensland, Brisbane, Australia"}]},{"ORCID":"https:\/\/orcid.org\/0009-0009-7424-7819","authenticated-orcid":false,"given":"Sarfraz","family":"Khurshid","sequence":"additional","affiliation":[{"name":"University of Texas at Austin, Austin, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4562-8208","authenticated-orcid":false,"given":"Yi","family":"Li","sequence":"additional","affiliation":[{"name":"Nanyang Technological University, Singapore, Singapore"}]}],"member":"320","published-online":{"date-parts":[[2025,6,22]]},"reference":[{"key":"e_1_2_1_1_1","unstructured":"2024. Dask issue#11336.. https:\/\/github.com\/dask\/dask\/issues\/11336"},{"key":"e_1_2_1_2_1","unstructured":"2024. Keras issue#20141.. https:\/\/github.com\/keras-team\/keras\/issues\/20141"},{"key":"e_1_2_1_3_1","unstructured":"2024. Scikit-learn issue#28469.. https:\/\/github.com\/scikit-learn\/scikit-learn\/issues\/28469"},{"key":"e_1_2_1_4_1","unstructured":"2024. Scikit-learn issue#28470.. https:\/\/github.com\/scikit-learn\/scikit-learn\/issues\/28470"},{"key":"e_1_2_1_5_1","unstructured":"2024. Scikit-learn issue#28473.. https:\/\/github.com\/scikit-learn\/scikit-learn\/issues\/28473"},{"key":"e_1_2_1_6_1","unstructured":"2024. Scikit-learn issue#29440.. https:\/\/github.com\/scikit-learn\/scikit-learn\/issues\/29440"},{"key":"e_1_2_1_7_1","unstructured":"2024. Scikit-learn issue#29463.. https:\/\/github.com\/scikit-learn\/scikit-learn\/issues\/29463"},{"key":"e_1_2_1_8_1","unstructured":"2024. Scikit-learn issue#29464.. https:\/\/github.com\/scikit-learn\/scikit-learn\/issues\/29464"},{"key":"e_1_2_1_9_1","unstructured":"2024. Scikit-learn issue#29509.. https:\/\/github.com\/scikit-learn\/scikit-learn\/issues\/29509"},{"key":"e_1_2_1_10_1","unstructured":"2024. Scikit-learn issue#30099.. https:\/\/github.com\/scikit-learn\/scikit-learn\/issues\/30099"},{"key":"e_1_2_1_11_1","unstructured":"2024. Statsmodels issue#9304.. https:\/\/github.com\/statsmodels\/statsmodels\/issues\/9304"},{"key":"e_1_2_1_12_1","volume-title":"2018 IEEE International conference on software maintenance and evolution (ICSME). 25\u201335","author":"Aghajani Emad","year":"2018","unstructured":"Emad Aghajani, Csaba Nagy, Gabriele Bavota, and Michele Lanza. 2018. A large-scale empirical study on linguistic antipatterns affecting apis. In 2018 IEEE International conference on software maintenance and evolution (ICSME). 25\u201335."},{"key":"e_1_2_1_13_1","volume-title":"Proceedings of the ACM\/IEEE 42nd International Conference on Software Engineering (ICSE). 590\u2013601","author":"Aghajani Emad","year":"2020","unstructured":"Emad Aghajani, Csaba Nagy, Mario Linares-V\u00e1squez, Laura Moreno, Gabriele Bavota, Michele Lanza, and David C Shepherd. 2020. Software documentation: the practitioners\u2019 perspective. In Proceedings of the ACM\/IEEE 42nd International Conference on Software Engineering (ICSE). 590\u2013601."},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE.2019.00122"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10664-014-9350-8"},{"volume-title":"Dependable Software Systems Engineering","author":"Ball Thomas","key":"e_1_2_1_16_1","unstructured":"Thomas Ball and Jakub Daniel. 2015. Deconstructing dynamic symbolic execution. In Dependable Software Systems Engineering. IOS Press, 26\u201341."},{"key":"e_1_2_1_17_1","volume-title":"Proceedings of the 26th Conference on Program Comprehension. 320\u2013323","author":"Blasi Arianna","year":"2018","unstructured":"Arianna Blasi and Alessandra Gorla. 2018. Replicomment: identifying clones in code comments. In Proceedings of the 26th Conference on Program Comprehension. 320\u2013323."},{"key":"e_1_2_1_18_1","volume-title":"Constraint satisfaction problems: Algorithms and applications. European journal of operational research, 119, 3","author":"Brailsford Sally C","year":"1999","unstructured":"Sally C Brailsford, Chris N Potts, and Barbara M Smith. 1999. Constraint satisfaction problems: Algorithms and applications. European journal of operational research, 119, 3 (1999), 557\u2013581."},{"key":"e_1_2_1_19_1","unstructured":"Alessandro Disney Bruni Tim Disney and Cormac Flanagan. 2011. A peer architecture for lightweight symbolic execution. Universidad de California Santa Cruz."},{"key":"e_1_2_1_20_1","volume-title":"Proceedings of the eighteenth ACM SIGSOFT International Symposium on Foundations of Software Engineering (FSE). 127\u2013136","author":"Dagenais Barth\u00e9l\u00e9my","year":"2010","unstructured":"Barth\u00e9l\u00e9my Dagenais and Martin P Robillard. 2010. Creating and evolving developer documentation: understanding the decisions of open source contributors. In Proceedings of the eighteenth ACM SIGSOFT International Symposium on Foundations of Software Engineering (FSE). 127\u2013136."},{"key":"e_1_2_1_21_1","volume-title":"Proceedings of the 1st ACM International Conference on AI-Powered Software.","author":"Dvivedi Shubhang Shekhar","year":"2024","unstructured":"Shubhang Shekhar Dvivedi, Vyshnav Vijay, Sai Leela Rahul Pujari, Shoumik Lodh, and Dhruv Kumar. 2024. A comparative analysis of large language models for code documentation generation. In Proceedings of the 1st ACM International Conference on AI-Powered Software."},{"key":"e_1_2_1_22_1","unstructured":"Google. 2024. AI for every developer. https:\/\/ai.google.dev"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/3238147.3238212"},{"key":"e_1_2_1_24_1","volume-title":"Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. 3991\u20134008","author":"Han Chi","year":"2024","unstructured":"Chi Han, Qifan Wang, Hao Peng, Wenhan Xiong, Yu Chen, Heng Ji, and Sinong Wang. 2024. LM-Infinite: Zero-Shot Extreme Length Generalization for Large Language Models. In Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. 3991\u20134008."},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/174662.174663"},{"key":"e_1_2_1_26_1","volume-title":"Proceedings of the 40th International Conference on Software Engineering (ICSE). 643\u2013653","author":"Head Andrew","year":"2018","unstructured":"Andrew Head, Caitlin Sadowski, Emerson Murphy-Hill, and Andrea Knight. 2018. When not to comment: Questions and tradeoffs with API documentation for C++ projects. In Proceedings of the 40th International Conference on Software Engineering (ICSE). 643\u2013653."},{"key":"e_1_2_1_27_1","unstructured":"Hongye Jin Xiaotian Han Jingfeng Yang Zhimeng Jiang Zirui Liu Chia-Yuan Chang Huiyuan Chen and Xia Hu. 2024. Llm maybe longlm: Self-extend llm context window without tuning. arXiv preprint arXiv:2401.01325."},{"volume-title":"InferFix: End-to-End Program Repair with LLMs","author":"Jin Matthew","key":"e_1_2_1_28_1","unstructured":"Matthew Jin, Syed Shahriar, Michele Tufano, Xin Shi, Shuai Lu, Neel Sundaresan, and Alexey Svyatkovskiy. 2023. InferFix: End-to-End Program Repair with LLMs. ESEC\/FSE. Association for Computing Machinery."},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2021.3069978"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1016\/0096-0551(78)90009-7"},{"key":"e_1_2_1_31_1","doi-asserted-by":"crossref","first-page":"76","DOI":"10.1038\/scientificamerican0793-76","article-title":"Fuzzy logic","volume":"269","author":"Kosko Bart","year":"1993","unstructured":"Bart Kosko and Satoru Isaka. 1993. Fuzzy logic. Scientific American, 269, 1 (1993), 76\u201381.","journal-title":"Scientific American"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2019.2901459"},{"key":"e_1_2_1_33_1","volume-title":"2021 IEEE\/ACM 29th International Conference on Program Comprehension (ICPC). 36\u201346","author":"Lin Bo","year":"2021","unstructured":"Bo Lin, Shangwen Wang, Kui Liu, Xiaoguang Mao, and Tegawend\u00e9 F Bissyand\u00e9. 2021. Automated comment update: How far are we? In 2021 IEEE\/ACM 29th International Conference on Program Comprehension (ICPC). 36\u201346."},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/2642937.2642969"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/3324884.3416628"},{"key":"e_1_2_1_36_1","first-page":"1","article-title":"Just-in-time obsolete comment detection and update","volume":"49","author":"Liu Zhongxin","year":"2021","unstructured":"Zhongxin Liu, Xin Xia, David Lo, Meng Yan, and Shanping Li. 2021. Just-in-time obsolete comment detection and update. IEEE Transactions on Software Engineering, 49, 1 (2021), 1\u201323.","journal-title":"IEEE Transactions on Software Engineering"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/3324884.3416581"},{"key":"e_1_2_1_38_1","volume-title":"Proceedings of the 47th International Conference on Software Engineering (ICSE).","author":"Ma Lezhi","year":"2025","unstructured":"Lezhi Ma, Shangqing Liu, Yi Li, Xiaofei Xie, and Lei Bu. 2025. SpecGen: Automated Generation of Formal Program Specifications via Large Language Models. In Proceedings of the 47th International Conference on Software Engineering (ICSE)."},{"volume-title":"Foundations of Artificial Intelligence. 2","author":"Meseguer Pedro","key":"e_1_2_1_39_1","unstructured":"Pedro Meseguer, Francesca Rossi, and Thomas Schiex. 2006. Soft constraints. In Foundations of Artificial Intelligence. 2, Elsevier, 281\u2013328."},{"key":"e_1_2_1_40_1","unstructured":"Meta. 2024. Introducing Llama 3. https:\/\/www.llama.com"},{"key":"e_1_2_1_41_1","doi-asserted-by":"crossref","unstructured":"Sewon Min Xinxi Lyu Ari Holtzman Mikel Artetxe Mike Lewis Hannaneh Hajishirzi and Luke Zettlemoyer. 2022. Rethinking the role of demonstrations: What makes in-context learning work? arXiv preprint arXiv:2202.12837.","DOI":"10.18653\/v1\/2022.emnlp-main.759"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10664-011-9186-4"},{"key":"e_1_2_1_43_1","volume-title":"Proceedings of the IEEE\/ACM 46th International Conference on Software Engineering (ICSE). Association for Computing Machinery, 13 pages.","author":"Nam Daye","year":"2024","unstructured":"Daye Nam, Andrew Macvean, Vincent Hellendoorn, Bogdan Vasilescu, and Brad Myers. 2024. Using an LLM to Help With Code Understanding. In Proceedings of the IEEE\/ACM 46th International Conference on Software Engineering (ICSE). Association for Computing Machinery, 13 pages."},{"key":"e_1_2_1_44_1","volume-title":"Proceedings of the 27th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC\/FSE). 385\u2013396","author":"Nie Pengyu","year":"2019","unstructured":"Pengyu Nie, Rishabh Rai, Junyi Jessy Li, Sarfraz Khurshid, Raymond J Mooney, and Milos Gligoric. 2019. A framework for writing trigger-action todo comments in executable format. In Proceedings of the 27th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC\/FSE). 385\u2013396."},{"key":"e_1_2_1_45_1","unstructured":"OpenAI. 2024. OpenAI Models. https:\/\/platform.openai.com\/docs\/models\/o1"},{"key":"e_1_2_1_46_1","unstructured":"OpenAI. 2024. What are tokens and how to count them? https:\/\/help.openai.com\/en\/articles\/4936856-what-are-tokens-and-how-to-count-them"},{"key":"e_1_2_1_47_1","volume-title":"Proceedings of the AAAI Conference on Artificial Intelligence. 35","author":"Panthaplackel Sheena","year":"2021","unstructured":"Sheena Panthaplackel, Junyi Jessy Li, Milos Gligoric, and Raymond J Mooney. 2021. Deep just-in-time inconsistency detection between comments and source code. In Proceedings of the AAAI Conference on Artificial Intelligence. 35, 427\u2013435."},{"key":"e_1_2_1_48_1","unstructured":"PyExSMT. 2024. Python Symbolic Execution. https:\/\/github.com\/FedericoAureliano\/PyExSMT"},{"key":"e_1_2_1_49_1","unstructured":"PyExZ3. 2024. Python Exploration with Z3. https:\/\/github.com\/thomasjball\/PyExZ3"},{"key":"e_1_2_1_50_1","unstructured":"pySMT. 2024. A library for SMT formulae manipulation and solving. https:\/\/github.com\/pysmt\/pysmt"},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1145\/3519312"},{"key":"e_1_2_1_52_1","volume-title":"2021 IEEE 21st International Working Conference on Source Code Analysis and Manipulation (SCAM). 165\u2013169","author":"Rani Pooja","year":"2021","unstructured":"Pooja Rani, Suada Abukar, Nataliia Stulova, Alexandre Bergel, and Oscar Nierstrasz. 2021. Do comments follow commenting conventions? a case study in java and python. In 2021 IEEE 21st International Working Conference on Source Code Analysis and Manipulation (SCAM). 165\u2013169."},{"key":"e_1_2_1_53_1","volume-title":"2017 32nd IEEE\/ACM International Conference on Automated Software Engineering (ASE). 112\u2013122","author":"Ratol Inderjot Kaur","year":"2017","unstructured":"Inderjot Kaur Ratol and Martin P Robillard. 2017. Detecting fragile comments. In 2017 32nd IEEE\/ACM International Conference on Automated Software Engineering (ASE). 112\u2013122."},{"key":"e_1_2_1_54_1","volume-title":"2025 IEEE\/ACM 47th International Conference on Software Engineering (ICSE). 432\u2013443","author":"Rong Guoping","year":"2024","unstructured":"Guoping Rong, Yongda Yu, Song Liu, Xin Tan, Tianyi Zhang, Haifeng Shen, and Jidong Hu. 2024. Code Comment Inconsistency Detection and Rectification Using a Large Language Model. In 2025 IEEE\/ACM 47th International Conference on Software Engineering (ICSE). 432\u2013443."},{"key":"e_1_2_1_55_1","doi-asserted-by":"crossref","unstructured":"Ohad Rubin Jonathan Herzig and Jonathan Berant. 2021. Learning to retrieve prompts for in-context learning. arXiv preprint arXiv:2112.08633.","DOI":"10.18653\/v1\/2022.naacl-main.191"},{"key":"e_1_2_1_56_1","volume-title":"Proceedings of 1994 IEEE 3rd International Fuzzy Systems Conference. 1263\u20131268","author":"Ruttkay Zsofi","year":"1994","unstructured":"Zsofi Ruttkay. 1994. Fuzzy constraint satisfaction. In Proceedings of 1994 IEEE 3rd International Fuzzy Systems Conference. 1263\u20131268."},{"key":"e_1_2_1_57_1","volume-title":"2015 IEEE 22nd International conference on software analysis, evolution, and reengineering (SANER). 33\u201342","author":"Saied Mohamed Aymen","year":"2015","unstructured":"Mohamed Aymen Saied, Houari Sahraoui, and Bruno Dufour. 2015. An observational study on API usage constraints and their documentation. In 2015 IEEE 22nd International conference on software analysis, evolution, and reengineering (SANER). 33\u201342."},{"key":"e_1_2_1_58_1","first-page":"268","article-title":"Possibilistic constraint satisfaction problems or \u201cHow to handle soft constraints?","author":"Schiex Thomas","year":"1992","unstructured":"Thomas Schiex. 1992. Possibilistic constraint satisfaction problems or \u201cHow to handle soft constraints?\u201d. In Uncertainty in Artificial Intelligence. 268\u2013275.","journal-title":". In Uncertainty in Artificial Intelligence."},{"key":"e_1_2_1_59_1","unstructured":"scikit learn. 2024. Machine learning in Python. https:\/\/github.com\/scikit-learn\/scikit-learn"},{"key":"e_1_2_1_60_1","volume-title":"14th International Conference on Fundamental Approaches to Software Engineering (FASE), Held as Part of the Joint European Conferences on Theory and Practice of Software (ETAPS)","author":"Shi Lin","year":"2011","unstructured":"Lin Shi, Hao Zhong, Tao Xie, and Mingshu Li. 2011. An empirical study on evolution of API documentation. In 14th International Conference on Fundamental Approaches to Software Engineering (FASE), Held as Part of the Joint European Conferences on Theory and Practice of Software (ETAPS), Saarbr\u00fccken, Germany, March 26\u2013April 3, 2011. Proceedings 14. 416\u2013431."},{"key":"e_1_2_1_61_1","unstructured":"Sphnix. 2024. Example Google Style Python Docstrings. https:\/\/www.sphinx-doc.org\/en\/master\/usage\/extensions\/example_google.html"},{"key":"e_1_2_1_62_1","unstructured":"Sphnix. 2024. Example Numpy Style Python Docstrings. https:\/\/www.sphinx-doc.org\/en\/master\/usage\/extensions\/example_numpy.html"},{"key":"e_1_2_1_63_1","unstructured":"statsmodels. 2024. Statistical modeling and econometrics in Python. https:\/\/github.com\/statsmodels\/statsmodels"},{"key":"e_1_2_1_64_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICPC.2013.6613836"},{"key":"e_1_2_1_65_1","volume-title":"How API documentation fails. Ieee software, 32, 4","author":"Uddin Gias","year":"2015","unstructured":"Gias Uddin and Martin P Robillard. 2015. How API documentation fails. Ieee software, 32, 4 (2015), 68\u201375."},{"key":"e_1_2_1_66_1","volume-title":"Proc. ACM Softw. Eng., Article 36","author":"Wadhwa Nalin","year":"2024","unstructured":"Nalin Wadhwa, Jui Pradhan, Atharv Sonwane, Surya Prakash Sahu, Nagarajan Natarajan, Aditya Kanade, Suresh Parthasarathy, and Sriram Rajamani. 2024. CORE: Resolving Code Quality Issues using LLMs. Proc. ACM Softw. Eng., Article 36, 23 pages."},{"key":"e_1_2_1_67_1","volume-title":"Proceedings of the Thirty-Sixth Annual Conference on Neural Information Processing Systems (NeurIPS). 14 pages.","author":"Wei Jason","year":"2024","unstructured":"Jason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma, Brian Ichter, Fei Xia, Ed H. Chi, Quoc V. Le, and Denny Zhou. 2024. Chain-of-thought prompting elicits reasoning in large language models. In Proceedings of the Thirty-Sixth Annual Conference on Neural Information Processing Systems (NeurIPS). 14 pages."},{"key":"e_1_2_1_68_1","volume-title":"Chi, Quoc V Le, and Denny Zhou","author":"Wei Jason","year":"2022","unstructured":"Jason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma, Fei Xia, Ed Chi, Quoc V Le, and Denny Zhou. 2022. Chain-of-thought prompting elicits reasoning in large language models. Advances in neural information processing systems, 35 (2022), 24824\u201324837."},{"key":"e_1_2_1_69_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICPC.2019.00019"},{"key":"e_1_2_1_70_1","volume-title":"Proceedings of the 33rd ACM SIGSOFT International Symposium on Software Testing and Analysis (ISSTA). Association for Computing Machinery","author":"Xia Chunqiu Steven","year":"2024","unstructured":"Chunqiu Steven Xia and Lingming Zhang. 2024. Automated Program Repair via Conversation: Fixing 162 out of 337 Bugs for $0.42 Each using ChatGPT. In Proceedings of the 33rd ACM SIGSOFT International Symposium on Software Testing and Analysis (ISSTA). Association for Computing Machinery, New York, NY, USA. 819\u2013831."},{"key":"e_1_2_1_71_1","doi-asserted-by":"publisher","unstructured":"Xiufeng Xu. 2025. MPChecker. https:\/\/doi.org\/10.5281\/zenodo.15365409 10.5281\/zenodo.15365409","DOI":"10.5281\/zenodo.15365409"},{"key":"e_1_2_1_72_1","volume-title":"Proceedings of the 33rd ACM SIGSOFT International Symposium on Software Testing and Analysis (ISSTA). ACM, 882\u2013894","author":"Yang Boyang","year":"2024","unstructured":"Boyang Yang, Haoye Tian, Weiguo Pian, Haoran Yu, Haitao Wang, Jacques Klein, Tegawend\u00e9 F. Bissyand\u00e9, and Shunfu Jin. 2024. CREF: An LLM-Based Conversational Software Repair Framework for Programming Tutors. In Proceedings of the 33rd ACM SIGSOFT International Symposium on Software Testing and Analysis (ISSTA). ACM, 882\u2013894."},{"key":"e_1_2_1_73_1","doi-asserted-by":"crossref","unstructured":"Lotfi A Zadeh. 1965. Fuzzy sets. Information and Control.","DOI":"10.1016\/S0019-9958(65)90241-X"},{"key":"e_1_2_1_74_1","volume-title":"Proceedings of the ACM\/IEEE 42nd International Conference on Software Engineering (ICSE). 1359\u20131371","author":"Zhai Juan","year":"2020","unstructured":"Juan Zhai, Xiangzhe Xu, Yu Shi, Guanhong Tao, Minxue Pan, Shiqing Ma, Lei Xu, Weifeng Zhang, Lin Tan, and Xiangyu Zhang. 2020. CPC: Automatically classifying and propagating natural language comments via program analysis. In Proceedings of the ACM\/IEEE 42nd International Conference on Software Engineering (ICSE). 1359\u20131371."},{"key":"e_1_2_1_75_1","volume-title":"Companion Proceedings of the 32nd ACM International Conference on the Foundations of Software Engineering (FSE). Association for Computing Machinery, 683\u2013685","author":"Zhang Yichi","year":"2024","unstructured":"Yichi Zhang. 2024. Detecting Code Comment Inconsistencies using LLM and Program Analysis. In Companion Proceedings of the 32nd ACM International Conference on the Foundations of Software Engineering (FSE). Association for Computing Machinery, 683\u2013685."},{"key":"e_1_2_1_76_1","volume-title":"Companion Proceedings of the 32nd ACM International Conference on the Foundations of Software Engineering (FSE). Association for Computing Machinery, 683\u2013685","author":"Zhang Yichi","year":"2024","unstructured":"Yichi Zhang. 2024. Detecting Code Comment Inconsistencies using LLM and Program Analysis. In Companion Proceedings of the 32nd ACM International Conference on the Foundations of Software Engineering (FSE). Association for Computing Machinery, 683\u2013685."},{"key":"e_1_2_1_77_1","volume-title":"Proceedings of the 39th IEEE\/ACM International Conference on Automated Software Engineering (ASE). Association for Computing Machinery, 356\u2013366","author":"Zhang Yichi","year":"2024","unstructured":"Yichi Zhang, Zixi Liu, Yang Feng, and Baowen Xu. 2024. Leveraging Large Language Model to Assist Detecting Rust Code Comment Inconsistency. In Proceedings of the 39th IEEE\/ACM International Conference on Automated Software Engineering (ASE). Association for Computing Machinery, 356\u2013366."},{"key":"e_1_2_1_78_1","doi-asserted-by":"publisher","DOI":"10.1145\/3377811.3380922"},{"key":"e_1_2_1_79_1","doi-asserted-by":"publisher","DOI":"10.1145\/2509136.2509523"},{"key":"e_1_2_1_80_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE.2017.11"},{"key":"e_1_2_1_81_1","doi-asserted-by":"publisher","DOI":"10.1145\/3551349.3556963"}],"container-title":["Proceedings of the ACM on Software Engineering"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3728945","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,7,16]],"date-time":"2025-07-16T16:50:17Z","timestamp":1752684617000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3728945"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,6,22]]},"references-count":81,"journal-issue":{"issue":"ISSTA","published-print":{"date-parts":[[2025,6,22]]}},"alternative-id":["10.1145\/3728945"],"URL":"https:\/\/doi.org\/10.1145\/3728945","relation":{},"ISSN":["2994-970X"],"issn-type":[{"type":"electronic","value":"2994-970X"}],"subject":[],"published":{"date-parts":[[2025,6,22]]}}}