{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,18]],"date-time":"2026-05-18T03:19:38Z","timestamp":1779074378139,"version":"3.51.4"},"reference-count":64,"publisher":"Association for Computing Machinery (ACM)","issue":"FSE","funder":[{"name":"NSF","award":["2346561,2443763,CNS-2145493,CNS-1929771"],"award-info":[{"award-number":["2346561,2443763,CNS-2145493,CNS-1929771"]}]},{"DOI":"10.13039\/100000185","name":"DARPA","doi-asserted-by":"crossref","award":["230939"],"award-info":[{"award-number":["230939"]}],"id":[{"id":"10.13039\/100000185","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/100000140","name":"USDOT","doi-asserted-by":"crossref","award":["69A3552348327"],"award-info":[{"award-number":["69A3552348327"]}],"id":[{"id":"10.13039\/100000140","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Proc. ACM Softw. Eng."],"published-print":{"date-parts":[[2025,6,19]]},"abstract":"<jats:p>As autonomous driving systems (ADSes) become increasingly complex and integral to daily life, the importance of understanding the nature and mitigation of software bugs in these systems has grown correspondingly. Addressing the challenges of software maintenance in autonomous driving systems (e.g., handling real-time system decisions and ensuring safety-critical reliability) is crucial due to the unique combination of real-time decision-making requirements and the high stakes of operational failures in ADSes. The potential of automated tools in this domain is promising, yet there remains a gap in our comprehension of the challenges faced and the strategies employed during manual debugging and repair of such systems. In this paper, we present an empirical study that investigates bug-fix patterns in ADSes, with the aim of improving reliability and safety. We have analyzed the commit histories and bug reports of two major autonomous driving projects, Apollo and Autoware, from 1,331 bug fixes with the study of bug symptoms, root causes, and bug-fix patterns. Our study reveals several dominant bug-fix patterns, including those related to path planning, data flow, and configuration management. Additionally, we find that the frequency distribution of bug-fix patterns varies significantly depending on their nature and types and that certain categories of bugs are recurrent and more challenging to exterminate. Based on our findings, we propose a hierarchy of ADS bugs and two taxonomies of 15 syntactic bug-fix patterns and 27 semantic bug-fix patterns that offer guidance for bug identification and resolution. We also contribute a benchmark of 1,331 ADS bug-fix instances.<\/jats:p>","DOI":"10.1145\/3715733","type":"journal-article","created":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T15:15:34Z","timestamp":1750346134000},"page":"380-402","source":"Crossref","is-referenced-by-count":1,"title":["A Comprehensive Study of Bug-Fix Patterns in Autonomous Driving Systems"],"prefix":"10.1145","volume":"2","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-3497-4167","authenticated-orcid":false,"given":"Yuntianyi","family":"Chen","sequence":"first","affiliation":[{"name":"University of California at Irvine, Irvine, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4792-8215","authenticated-orcid":false,"given":"Yuqi","family":"Huai","sequence":"additional","affiliation":[{"name":"University of California at Irvine, Irvine, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0009-6248-2053","authenticated-orcid":false,"given":"Yirui","family":"He","sequence":"additional","affiliation":[{"name":"University of California at Irvine, Irvine, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0006-8875-983X","authenticated-orcid":false,"given":"Shilong","family":"Li","sequence":"additional","affiliation":[{"name":"University of California at Irvine, Irvine, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0000-3704-3379","authenticated-orcid":false,"given":"Changnam","family":"Hong","sequence":"additional","affiliation":[{"name":"University of California at Irvine, Irvine, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0316-9285","authenticated-orcid":false,"given":"Qi Alfred","family":"Chen","sequence":"additional","affiliation":[{"name":"University of California at Irvine, Irvine, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1696-8783","authenticated-orcid":false,"given":"Joshua","family":"Garcia","sequence":"additional","affiliation":[{"name":"University of California at Irvine, Irvine, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2025,6,19]]},"reference":[{"key":"e_1_2_1_1_1","unstructured":"April 2022. Toyota Follows Tesla In Developing A Vision-Based Self-Driving System. https:\/\/bit.ly\/3TQQNuw"},{"key":"e_1_2_1_2_1","unstructured":"December 2020. 40+ Corporations Working On Autonomous Vehicles. https:\/\/bit.ly\/3PdBpGu"},{"key":"e_1_2_1_3_1","unstructured":"December 2023. Baidu launches Apollo Open Source Platform 9.0. https:\/\/autonews.gasgoo.com\/m\/70030171.html"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","unstructured":"February 2025. Artifacts of the ADS Bug-Fix Pattern Study. https:\/\/doi.org\/10.5281\/zenodo.14807539 10.5281\/zenodo.14807539","DOI":"10.5281\/zenodo.14807539"},{"key":"e_1_2_1_5_1","unstructured":"January 2018. You can take a ride in a self-driving Lyft during CES - The Verge. https:\/\/bit.ly\/3Rh1p6s"},{"key":"e_1_2_1_6_1","unstructured":"July 2018. Baidu starts mass production of autonomous buses. https:\/\/bit.ly\/3oJXrSy"},{"key":"e_1_2_1_7_1","unstructured":"July 2018. Waymo\u2019s autonomous cars have driven 8 million miles on public roads. https:\/\/bit.ly\/43uSNwb"},{"key":"e_1_2_1_8_1","unstructured":"June 2019. CARMA Overview. https:\/\/bit.ly\/44JQ423"},{"key":"e_1_2_1_9_1","unstructured":"June 2021. Baidu is building Level 4 autonomous robotaxis called Apollo Moon in China. https:\/\/bit.ly\/3HQ46qH"},{"key":"e_1_2_1_10_1","unstructured":"June 2022. GM\u2019s Cruise starts charging fares for driverless rides in San Francisco. https:\/\/reut.rs\/40rtGJu"},{"key":"e_1_2_1_11_1","unstructured":"March 2022. Udacity: Self-Driving Fundamentals: Featuring Apollo. https:\/\/bit.ly\/3RnMVC0"},{"key":"e_1_2_1_12_1","unstructured":"November 2018. Baidu hits the gas on autonomous vehicles with Volvo and Ford deals. https:\/\/tcrn.ch\/3EL8Prj"},{"key":"e_1_2_1_13_1","doi-asserted-by":"crossref","unstructured":"October 2020. Ford unveils new self-driving test vehicle for 2022 launch. https:\/\/cnb.cx\/3zi2AIQ","DOI":"10.1016\/S1464-2859(20)30376-X"},{"key":"e_1_2_1_14_1","unstructured":"October 2021. Tesla Sold 2 Million Electric Cars: First Automaker To Reach Milestone. https:\/\/bit.ly\/3G1zDVm"},{"key":"e_1_2_1_15_1","unstructured":"September 2017. The 18 Companies Most Likely to Get Driverless Cars on the Road First. https:\/\/bit.ly\/3sFsNRo"},{"key":"e_1_2_1_16_1","unstructured":"September 2017. Waymo and Intel Collaborate on Self-Driving Car Technology. https:\/\/bit.ly\/4d71Mbg"},{"key":"e_1_2_1_17_1","unstructured":"September 2022. Past Present and the Future of Autoware - Autoware. https:\/\/bit.ly\/4clFkKW"},{"key":"e_1_2_1_18_1","unstructured":"September 2024. Apollo Architecture Evolution. https:\/\/bit.ly\/3PnTVwL"},{"key":"e_1_2_1_19_1","unstructured":"September 2024. Baidu Apollo: An open autonomous driving platform. https:\/\/en.apollo.auto\/apollo-self-driving"},{"key":"e_1_2_1_20_1","unstructured":"September 2024. Debug Autoware - Autoware Documentation. https:\/\/bit.ly\/3zkkTRg"},{"key":"e_1_2_1_21_1","unstructured":"September 2024. GitHub - Apollo: An open autonomous driving platform. https:\/\/bit.ly\/3XSQUa5"},{"key":"e_1_2_1_22_1","unstructured":"September 2024. GitHub - Autoware: An open-source software project for autonomous driving. https:\/\/bit.ly\/3MIaiCH"},{"key":"e_1_2_1_23_1","unstructured":"September 2024. GitHub - CARMA Platform. https:\/\/bit.ly\/45GZGvN"},{"key":"e_1_2_1_24_1","unstructured":"September 2024. How to Debug Apollo. https:\/\/bit.ly\/3TNhvpq"},{"key":"e_1_2_1_25_1","unstructured":"September 2024. Planning component design - Autoware Documentation. https:\/\/bit.ly\/3SDUzrE"},{"key":"e_1_2_1_26_1","unstructured":"September 2024. Waymo - Self-Driving Cars - Autonomous Vehicles. https:\/\/waymo.com\/"},{"key":"e_1_2_1_27_1","volume-title":"Parameter-Based Testing and Debugging of Autonomous Driving Systems. In IEEE Intelligent Vehicles Symposium Workshops, IV 2021 - Workshops","author":"Arcaini Paolo","year":"2021","unstructured":"Paolo Arcaini, Alessandro Cal\u00f2, Fuyuki Ishikawa, Thomas Laurent, Xiao-Yi Zhang, Shaukat Ali, Florian Hauer, and Anthony Ventresque. 2021. Parameter-Based Testing and Debugging of Autonomous Driving Systems. In IEEE Intelligent Vehicles Symposium Workshops, IV 2021 - Workshops, Nagoya, Japan, July 11-17, 2021. IEEE, 197\u2013202. https:\/\/doi.org\/10.1109\/IVWORKSHOPS54471.2021.9669254 10.1109\/IVWORKSHOPS54471.2021.9669254"},{"key":"e_1_2_1_28_1","volume-title":"IEEE Intelligent Vehicles Symposium, IV 2017","author":"Banzhaf Holger","year":"2017","unstructured":"Holger Banzhaf, Dennis Nienh\u00fcser, Steffen Knoop, and Johann Marius Z\u00f6llner. 2017. The future of parking: A survey on automated valet parking with an outlook on high density parking. In IEEE Intelligent Vehicles Symposium, IV 2017, Los Angeles, CA, USA, June 11-14, 2017. IEEE, 1827\u20131834. https:\/\/doi.org\/10.1109\/IVS.2017.7995971 10.1109\/IVS.2017.7995971"},{"key":"e_1_2_1_29_1","first-page":"14","article-title":"A reflexive exploration of two qualitative data coding techniques","volume":"6","author":"Blair Erik","year":"2015","unstructured":"Erik Blair. 2015. A reflexive exploration of two qualitative data coding techniques. Journal of Methods and Measurement in the Social Sciences, 6, 1 (2015), 14\u201329.","journal-title":"Journal of Methods and Measurement in the Social Sciences"},{"key":"e_1_2_1_30_1","volume-title":"Common Bug-Fix Patterns: A Large-Scale Observational Study. In 2017 ACM\/IEEE International Symposium on Empirical Software Engineering and Measurement, ESEM 2017","author":"Campos Eduardo Cunha","year":"2017","unstructured":"Eduardo Cunha Campos and Marcelo de Almeida Maia. 2017. Common Bug-Fix Patterns: A Large-Scale Observational Study. In 2017 ACM\/IEEE International Symposium on Empirical Software Engineering and Measurement, ESEM 2017, Toronto, ON, Canada, November 9-10, 2017, Ayse Bener, Burak Turhan, and Stefan Biffl (Eds.). IEEE Computer Society, 404\u2013413. https:\/\/doi.org\/10.1109\/ESEM.2017.55 10.1109\/ESEM.2017.55"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1002\/SMR.2173"},{"key":"e_1_2_1_32_1","volume-title":"Waterloo Intelligent Systems Engineering (WISE) Lab","author":"Czarnecki Krzysztof","unstructured":"Krzysztof Czarnecki. 2018. Operational design domain for automated driving systems. Taxonomy of Basic Terms \u201c, Waterloo Intelligent Systems Engineering (WISE) Lab, University of Waterloo, Canada."},{"key":"e_1_2_1_33_1","volume-title":"Proceedings of the 31st ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering, ESEC\/FSE 2023","author":"Du Xiaohu","year":"2023","unstructured":"Xiaohu Du, Xiao Chen, Jialun Cao, Ming Wen, Shing-Chi Cheung, and Hai Jin. 2023. Understanding the Bug Characteristics and Fix Strategies of Federated Learning Systems. In Proceedings of the 31st ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering, ESEC\/FSE 2023, San Francisco, CA, USA, December 3-9, 2023, Satish Chandra, Kelly Blincoe, and Paolo Tonella (Eds.). ACM, 1358\u20131370. https:\/\/doi.org\/10.1145\/3611643.3616347 10.1145\/3611643.3616347"},{"key":"e_1_2_1_34_1","volume-title":"First International Workshop on Assessment of Contemporary Modularization Techniques (ACoM \u201907)","author":"Eaddy Marc","year":"2007","unstructured":"Marc Eaddy, Alfred Aho, and Gail C. Murphy. 2007. Identifying, Assigning, and Quantifying Crosscutting Concerns. In First International Workshop on Assessment of Contemporary Modularization Techniques (ACoM \u201907). 2\u20132. https:\/\/doi.org\/10.1109\/ACOM.2007.4 10.1109\/ACOM.2007.4"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2008.36"},{"key":"e_1_2_1_36_1","volume-title":"Proceedings of the 32nd IEEE\/ACM International Conference on Automated Software Engineering, ASE 2017","author":"Franco Anthony Di","year":"2017","unstructured":"Anthony Di Franco, Hui Guo, and Cindy Rubio-Gonz\u00e1lez. 2017. A comprehensive study of real-world numerical bug characteristics. In Proceedings of the 32nd IEEE\/ACM International Conference on Automated Software Engineering, ASE 2017, Urbana, IL, USA, October 30 - November 03, 2017, Grigore Rosu, Massimiliano Di Penta, and Tien N. Nguyen (Eds.). IEEE Computer Society, 509\u2013519. https:\/\/doi.org\/10.1109\/ASE.2017.8115662 10.1109\/ASE.2017.8115662"},{"key":"e_1_2_1_37_1","volume-title":"42nd International Conference on Software Engineering","author":"Garcia Joshua","year":"2020","unstructured":"Joshua Garcia, Yang Feng, Junjie Shen, Sumaya Almanee, Yuan Xia, and Qi Alfred Chen. 2020. A comprehensive study of autonomous vehicle bugs. In ICSE \u201920: 42nd International Conference on Software Engineering, Seoul, South Korea, 27 June - 19 July, 2020, Gregg Rothermel and Doo-Hwan Bae (Eds.). ACM, 385\u2013396. https:\/\/doi.org\/10.1145\/3377811.3380397 10.1145\/3377811.3380397"},{"key":"e_1_2_1_38_1","volume-title":"Proceedings of the 31st ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering, ESEC\/FSE 2023","author":"Huang Kaifeng","year":"2023","unstructured":"Kaifeng Huang, Bihuan Chen, Susheng Wu, Junming Cao, Lei Ma, and Xin Peng. 2023. Demystifying Dependency Bugs in Deep Learning Stack. In Proceedings of the 31st ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering, ESEC\/FSE 2023, San Francisco, CA, USA, December 3-9, 2023, Satish Chandra, Kelly Blincoe, and Paolo Tonella (Eds.). ACM, 450\u2013462. https:\/\/doi.org\/10.1145\/3611643.3616325 10.1145\/3611643.3616325"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.48550\/ARXIV.2303.18184"},{"key":"e_1_2_1_40_1","volume-title":"2013 IEEE Intelligent Vehicles Symposium (IV)","author":"Ibisch Andr\u00e9","year":"2013","unstructured":"Andr\u00e9 Ibisch, Stefan St\u00fcmper, Harald Altinger, Marcel Neuhausen, Marc Tschentscher, Marc Schlipsing, Jan Salinen, and Alois C. Knoll. 2013. Towards autonomous driving in a parking garage: Vehicle localization and tracking using environment-embedded LIDAR sensors. In 2013 IEEE Intelligent Vehicles Symposium (IV), Gold Coast City, Australia, June 23-26, 2013. IEEE, 829\u2013834. https:\/\/doi.org\/10.1109\/IVS.2013.6629569 10.1109\/IVS.2013.6629569"},{"key":"e_1_2_1_41_1","volume-title":"Proceedings of the ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering, ESEC\/SIGSOFT FSE 2019","author":"Islam Md Johirul","year":"2019","unstructured":"Md Johirul Islam, Giang Nguyen, Rangeet Pan, and Hridesh Rajan. 2019. A comprehensive study on deep learning bug characteristics. In Proceedings of the ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering, ESEC\/SIGSOFT FSE 2019, Tallinn, Estonia, August 26-30, 2019, Marlon Dumas, Dietmar Pfahl, Sven Apel, and Alessandra Russo (Eds.). ACM, 510\u2013520. https:\/\/doi.org\/10.1145\/3338906.3338955 10.1145\/3338906.3338955"},{"key":"e_1_2_1_42_1","volume-title":"42nd International Conference on Software Engineering","author":"Islam Md Johirul","year":"2020","unstructured":"Md Johirul Islam, Rangeet Pan, Giang Nguyen, and Hridesh Rajan. 2020. Repairing deep neural networks: fix patterns and challenges. In ICSE \u201920: 42nd International Conference on Software Engineering, Seoul, South Korea, 27 June - 19 July, 2020, Gregg Rothermel and Doo-Hwan Bae (Eds.). ACM, 1135\u20131146. https:\/\/doi.org\/10.1145\/3377811.3380378 10.1145\/3377811.3380378"},{"key":"e_1_2_1_43_1","volume-title":"The 35th ACM\/SIGAPP Symposium on Applied Computing, online event, [Brno, Czech Republic]","author":"Islam Md Rakibul","year":"2020","unstructured":"Md Rakibul Islam and Minhaz F. Zibran. 2020. How bugs are fixed: exposing bug-fix patterns with edits and nesting levels. In SAC \u201920: The 35th ACM\/SIGAPP Symposium on Applied Computing, online event, [Brno, Czech Republic], March 30 - April 3, 2020, Chih-Cheng Hung, Tom\u00e1s Cern\u00fd, Dongwan Shin, and Alessio Bechini (Eds.). ACM, 1523\u20131531. https:\/\/doi.org\/10.1145\/3341105.3373880 10.1145\/3341105.3373880"},{"key":"e_1_2_1_44_1","volume-title":"Proceedings of the 30th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering, ESEC\/FSE 2022","author":"Lou Guannan","year":"2022","unstructured":"Guannan Lou, Yao Deng, Xi Zheng, Mengshi Zhang, and Tianyi Zhang. 2022. Testing of autonomous driving systems: where are we and where should we go? In Proceedings of the 30th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering, ESEC\/FSE 2022, Singapore, Singapore, November 14-18, 2022, Abhik Roychoudhury, Cristian Cadar, and Miryung Kim (Eds.). ACM, 31\u201343. https:\/\/doi.org\/10.1145\/3540250.3549111 10.1145\/3540250.3549111"},{"key":"e_1_2_1_45_1","first-page":"597","article-title":"Design principles and design patterns","volume":"1","author":"Martin Robert C","year":"2000","unstructured":"Robert C Martin. 2000. Design principles and design patterns. Object Mentor, 1, 34 (2000), 597.","journal-title":"Object Mentor"},{"key":"e_1_2_1_46_1","volume-title":"Interrater reliability: the kappa statistic. Biochemia medica, 22, 3","author":"McHugh Mary L","year":"2012","unstructured":"Mary L McHugh. 2012. Interrater reliability: the kappa statistic. Biochemia medica, 22, 3 (2012), 276\u2013282."},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ifacol.2016.07.612"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1177\/1609406919899220"},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10664-008-9077-5"},{"key":"e_1_2_1_50_1","volume-title":"ICRA workshop on open source software. 3, 5.","author":"Quigley Morgan","year":"2009","unstructured":"Morgan Quigley, Ken Conley, Brian Gerkey, Josh Faust, Tully Foote, Jeremy Leibs, Rob Wheeler, and Andrew Y Ng. 2009. ROS: an open-source Robot Operating System. In ICRA workshop on open source software. 3, 5."},{"key":"e_1_2_1_51_1","volume-title":"Proceedings of the 6th International Conference on Automotive User Interfaces and Interactive Vehicular Applications","author":"R\u00f6del Christina","year":"2014","unstructured":"Christina R\u00f6del, Susanne Stadler, Alexander Meschtscherjakov, and Manfred Tscheligi. 2014. Towards Autonomous Cars: The Effect of Autonomy Levels on Acceptance and User Experience. In Proceedings of the 6th International Conference on Automotive User Interfaces and Interactive Vehicular Applications, Seattle, WA, USA, September 17 - 19, 2014, Linda Ng Boyle, Gary E. Burnett, Peter Fr\u00f6hlich, Shamsi T. Iqbal, Erika Miller, and Yuqing Wu (Eds.). ACM, 11:1\u201311:8. https:\/\/doi.org\/10.1145\/2667317.2667330 10.1145\/2667317.2667330"},{"key":"e_1_2_1_52_1","volume-title":"Proceedings of the Second International Symposium on Empirical Software Engineering and Measurement, ESEM 2008","author":"Seaman Carolyn B.","year":"2008","unstructured":"Carolyn B. Seaman, Forrest Shull, Myrna Regardie, Denis Elbert, Raimund L. Feldmann, Yuepu Guo, and Sally Godfrey. 2008. Defect categorization: making use of a decade of widely varying historical data. In Proceedings of the Second International Symposium on Empirical Software Engineering and Measurement, ESEM 2008, October 9-10, 2008, Kaiserslautern, Germany, H. Dieter Rombach, Sebastian G. Elbaum, and J\u00fcrgen M\u00fcnch (Eds.). ACM, 149\u2013157. https:\/\/doi.org\/10.1145\/1414004.1414030 10.1145\/1414004.1414030"},{"key":"e_1_2_1_53_1","volume-title":"Proceedings of the 13th International Conference on Mining Software Repositories, MSR 2016","author":"Soto Mauricio","year":"2016","unstructured":"Mauricio Soto, Ferdian Thung, Chu-Pan Wong, Claire Le Goues, and David Lo. 2016. A deeper look into bug fixes: patterns, replacements, deletions, and additions. In Proceedings of the 13th International Conference on Mining Software Repositories, MSR 2016, Austin, TX, USA, May 14-22, 2016, Miryung Kim, Romain Robbes, and Christian Bird (Eds.). ACM, 512\u2013515. https:\/\/doi.org\/10.1145\/2901739.2903495 10.1145\/2901739.2903495"},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1145\/3020266"},{"key":"e_1_2_1_55_1","volume-title":"2018 IEEE 42nd Annual Computer Software and Applications Conference, COMPSAC 2018","volume":"1","author":"Tang Jie","year":"2018","unstructured":"Jie Tang, Shaoshan Liu, Songwen Pei, St\u00e9phane Zuckerman, Chen Liu, Weisong Shi, and Jean-Luc Gaudiot. 2018. Teaching Autonomous Driving Using a Modular and Integrated Approach. In 2018 IEEE 42nd Annual Computer Software and Applications Conference, COMPSAC 2018, Tokyo, Japan, 23-27 July 2018, Volume 1, Sorel Reisman, Sheikh Iqbal Ahamed, Claudio Demartini, Thomas M. Conte, Ling Liu, William R. Claycomb, Motonori Nakamura, Edmundo Tovar, Stelvio Cimato, Chung-Horng Lung, Hiroki Takakura, Ji-Jiang Yang, Toyokazu Akiyama, Zhiyong Zhang, and Kamrul Hasan (Eds.). IEEE Computer Society, 361\u2013366. https:\/\/doi.org\/10.1109\/COMPSAC.2018.00057 10.1109\/COMPSAC.2018.00057"},{"key":"e_1_2_1_56_1","volume-title":"2016 IEEE Intelligent Vehicles Symposium, IV 2016","author":"Tas \u00d6mer Sahin","year":"2016","unstructured":"\u00d6mer Sahin Tas, Florian Kuhnt, J. Marius Z\u00f6llner, and Christoph Stiller. 2016. Functional system architectures towards fully automated driving. In 2016 IEEE Intelligent Vehicles Symposium, IV 2016, Gotenburg, Sweden, June 19-22, 2016. IEEE, 304\u2013309. https:\/\/doi.org\/10.1109\/IVS.2016.7535402 10.1109\/IVS.2016.7535402"},{"key":"e_1_2_1_57_1","volume-title":"An Empirical Study of Bugs in Machine Learning Systems. In 23rd IEEE International Symposium on Software Reliability Engineering, ISSRE 2012","author":"Thung Ferdian","year":"2012","unstructured":"Ferdian Thung, Shaowei Wang, David Lo, and Lingxiao Jiang. 2012. An Empirical Study of Bugs in Machine Learning Systems. In 23rd IEEE International Symposium on Software Reliability Engineering, ISSRE 2012, Dallas, TX, USA, November 27-30, 2012. IEEE Computer Society, 271\u2013280. https:\/\/doi.org\/10.1109\/ISSRE.2012.22 10.1109\/ISSRE.2012.22"},{"key":"e_1_2_1_58_1","volume-title":"Proceedings of the 2015 10th Joint Meeting on Foundations of Software Engineering, ESEC\/FSE 2015","author":"Vasilescu Bogdan","year":"2015","unstructured":"Bogdan Vasilescu, Yue Yu, Huaimin Wang, Premkumar T. Devanbu, and Vladimir Filkov. 2015. Quality and productivity outcomes relating to continuous integration in GitHub. In Proceedings of the 2015 10th Joint Meeting on Foundations of Software Engineering, ESEC\/FSE 2015, Bergamo, Italy, August 30 - September 4, 2015, Elisabetta Di Nitto, Mark Harman, and Patrick Heymans (Eds.). ACM, 805\u2013816. https:\/\/doi.org\/10.1145\/2786805.2786850 10.1145\/2786805.2786850"},{"key":"e_1_2_1_59_1","volume-title":"IEEE International Conference on Fuzzy Systems","author":"Vieira Susana M.","year":"2010","unstructured":"Susana M. Vieira, Uzay Kaymak, and Jo\u00e3o M. C. Sousa. 2010. Cohen\u2019s kappa coefficient as a performance measure for feature selection. In FUZZ-IEEE 2010, IEEE International Conference on Fuzzy Systems, Barcelona, Spain, 18-23 July, 2010, Proceedings. IEEE, 1\u20138. https:\/\/doi.org\/10.1109\/FUZZY.2010.5584447 10.1109\/FUZZY.2010.5584447"},{"key":"e_1_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.1109\/32.44376"},{"key":"e_1_2_1_61_1","doi-asserted-by":"publisher","DOI":"10.1016\/J.JSS.2022.111425"},{"key":"e_1_2_1_62_1","doi-asserted-by":"publisher","DOI":"10.1145\/3631974"},{"key":"e_1_2_1_63_1","volume-title":"Proceedings of the 27th ACM SIGSOFT International Symposium on Software Testing and Analysis, ISSTA 2018","author":"Zhang Yuhao","year":"2018","unstructured":"Yuhao Zhang, Yifan Chen, Shing-Chi Cheung, Yingfei Xiong, and Lu Zhang. 2018. An empirical study on TensorFlow program bugs. In Proceedings of the 27th ACM SIGSOFT International Symposium on Software Testing and Analysis, ISSTA 2018, Amsterdam, The Netherlands, July 16-21, 2018, Frank Tip and Eric Bodden (Eds.). ACM, 129\u2013140. https:\/\/doi.org\/10.1145\/3213846.3213866 10.1145\/3213846.3213866"},{"key":"e_1_2_1_64_1","volume-title":"An Empirical Study on Real Bug Fixes. In 37th IEEE\/ACM International Conference on Software Engineering, ICSE 2015","volume":"1","author":"Zhong Hao","year":"2015","unstructured":"Hao Zhong and Zhendong Su. 2015. An Empirical Study on Real Bug Fixes. In 37th IEEE\/ACM International Conference on Software Engineering, ICSE 2015, Florence, Italy, May 16-24, 2015, Volume 1, Antonia Bertolino, Gerardo Canfora, and Sebastian G. Elbaum (Eds.). IEEE Computer Society, 913\u2013923. https:\/\/doi.org\/10.1109\/ICSE.2015.101 10.1109\/ICSE.2015.101"}],"container-title":["Proceedings of the ACM on Software Engineering"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3715733","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T15:30:57Z","timestamp":1750347057000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3715733"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,6,19]]},"references-count":64,"journal-issue":{"issue":"FSE","published-print":{"date-parts":[[2025,6,19]]}},"alternative-id":["10.1145\/3715733"],"URL":"https:\/\/doi.org\/10.1145\/3715733","relation":{},"ISSN":["2994-970X"],"issn-type":[{"value":"2994-970X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,6,19]]}}}