{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,27]],"date-time":"2026-04-27T17:12:33Z","timestamp":1777309953903,"version":"3.51.4"},"publisher-location":"New York, NY, USA","reference-count":41,"publisher":"ACM","license":[{"start":{"date-parts":[[2022,9,19]],"date-time":"2022-09-19T00:00:00Z","timestamp":1663545600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100000038","name":"Natural Sciences and Engineering Research Council of Canada","doi-asserted-by":"publisher","award":["RGPIN-2021-04232, DGECR-2021-00283"],"award-info":[{"award-number":["RGPIN-2021-04232, DGECR-2021-00283"]}],"id":[{"id":"10.13039\/501100000038","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2022,9,19]]},"DOI":"10.1145\/3544902.3546637","type":"proceedings-article","created":{"date-parts":[[2022,9,7]],"date-time":"2022-09-07T04:07:45Z","timestamp":1662523665000},"page":"295-300","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":5,"title":["An Experience Report on Technical Debt in Pull Requests: Challenges and Lessons Learned"],"prefix":"10.1145","author":[{"given":"Shubhashis","family":"Karmakar","sequence":"first","affiliation":[{"name":"University of Saskatchewan, Canada"}]},{"given":"Zadia","family":"Codabux","sequence":"additional","affiliation":[{"name":"University of Saskatchewan, Canada"}]},{"given":"Melina","family":"Vidoni","sequence":"additional","affiliation":[{"name":"Australian National University, Australia"}]}],"member":"320","published-online":{"date-parts":[[2022,9,19]]},"reference":[{"key":"e_1_3_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1109\/MTD.2014.9"},{"key":"e_1_3_2_1_2_1","first-page":"61","article-title":"An Overview and Comparison of Technical Debt Measurement Tools","volume":"38","author":"Avgeriou C.","year":"2021","unstructured":"Paris\u00a0 C. Avgeriou , Davide Taibi , Apostolos Ampatzoglou , Francesca Arcelli\u00a0Fontana , Terese Besker , Alexander Chatzigeorgiou , Valentina Lenarduzzi , Antonio Martini , Athanasia Moschou , Ilaria Pigazzini , Nyyti Saarimaki , Darius\u00a0Daniel Sas , Saulo\u00a0Soares de Toledo , and Angeliki\u00a0Agathi Tsintzira . 2021 . An Overview and Comparison of Technical Debt Measurement Tools . IEEE 38 , 3 (2021), 61 \u2013 71 . https:\/\/doi.org\/10.1109\/MS.2020.3024958 10.1109\/MS.2020.3024958 Paris\u00a0C. Avgeriou, Davide Taibi, Apostolos Ampatzoglou, Francesca Arcelli\u00a0Fontana, Terese Besker, Alexander Chatzigeorgiou, Valentina Lenarduzzi, Antonio Martini, Athanasia Moschou, Ilaria Pigazzini, Nyyti Saarimaki, Darius\u00a0Daniel Sas, Saulo\u00a0Soares de Toledo, and Angeliki\u00a0Agathi Tsintzira. 2021. An Overview and Comparison of Technical Debt Measurement Tools. IEEE 38, 3 (2021), 61\u201371. https:\/\/doi.org\/10.1109\/MS.2020.3024958","journal-title":"IEEE"},{"key":"e_1_3_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/2901739.2901742"},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/2901739.2901754"},{"key":"e_1_3_2_1_5_1","volume-title":"Modeling Annotated Data. In Conf. on Research and Development in Information Retrieval. Association for Computing Machinery","author":"Blei M","year":"2003","unstructured":"David\u00a0 M Blei and Michael\u00a0 I Jordan . 2003 . Modeling Annotated Data. In Conf. on Research and Development in Information Retrieval. Association for Computing Machinery , New York, NY, USA, 127\u2013134. David\u00a0M Blei and Michael\u00a0I Jordan. 2003. Modeling Annotated Data. In Conf. on Research and Development in Information Retrieval. Association for Computing Machinery, New York, NY, USA, 127\u2013134."},{"key":"e_1_3_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSA47634.2020.00016"},{"key":"e_1_3_2_1_7_1","volume-title":"Managing Technical Debt in Software-Reliant Systems. In Workshop on Future of SE Research(FoSER \u201910)","author":"Brown Nanette","year":"2010","unstructured":"Nanette Brown , Yuanfang Cai , Yuepu Guo , Rick Kazman , Miryung Kim , Philippe Kruchten , Erin Lim , Alan MacCormack , Robert Nord , Ipek Ozkaya , Raghvinder Sangwan , Carolyn Seaman , Kevin Sullivan , and Nico Zazworka . 2010 . Managing Technical Debt in Software-Reliant Systems. In Workshop on Future of SE Research(FoSER \u201910) . Association for Computing Machinery, New York, NY, USA, 47\u201352. https:\/\/doi.org\/10.1145\/ 1882362.1882373 10.1145\/1882362.1882373 Nanette Brown, Yuanfang Cai, Yuepu Guo, Rick Kazman, Miryung Kim, Philippe Kruchten, Erin Lim, Alan MacCormack, Robert Nord, Ipek Ozkaya, Raghvinder Sangwan, Carolyn Seaman, Kevin Sullivan, and Nico Zazworka. 2010. Managing Technical Debt in Software-Reliant Systems. In Workshop on Future of SE Research(FoSER \u201910). Association for Computing Machinery, New York, NY, USA, 47\u201352. https:\/\/doi.org\/10.1145\/1882362.1882373"},{"key":"e_1_3_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10664-021-10078-2"},{"key":"e_1_3_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/3512753.3512755"},{"key":"e_1_3_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2021.111160"},{"key":"e_1_3_2_1_11_1","volume-title":"Sentiment in Self-Admitted Technical Debt. In Int. Conf. on Mining Software Repositories. Springer","author":"Fucci Gianmarco","year":"2021","unstructured":"Gianmarco Fucci , Nathan Cassee , Fiorella Zampetti , Nicole Novielli , Alexander Serebrenik , and Massimiliano Di\u00a0Penta . 2021 . Waiting Around or Job Half-Done? Sentiment in Self-Admitted Technical Debt. In Int. Conf. on Mining Software Repositories. Springer , Madrid, Spain, 403\u2013414. https:\/\/doi.org\/10.1109\/MSR52588. 2021.00052 10.1109\/MSR52588.2021.00052 Gianmarco Fucci, Nathan Cassee, Fiorella Zampetti, Nicole Novielli, Alexander Serebrenik, and Massimiliano Di\u00a0Penta. 2021. Waiting Around or Job Half-Done? Sentiment in Self-Admitted Technical Debt. In Int. Conf. on Mining Software Repositories. Springer, Madrid, Spain, 403\u2013414. https:\/\/doi.org\/10.1109\/MSR52588.2021.00052"},{"key":"e_1_3_2_1_12_1","first-page":"23","article-title":"A New Algorithm for Data Compression","volume":"12","author":"Gage Philip","year":"1994","unstructured":"Philip Gage . 1994 . A New Algorithm for Data Compression . C Users J. 12 , 2 (1994), 23 \u2013 38 . Philip Gage. 1994. A New Algorithm for Data Compression. C Users J. 12, 2 (1994), 23\u201338.","journal-title":"C Users J."},{"key":"e_1_3_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/1985362.1985368"},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2021.110911"},{"key":"e_1_3_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE.2015.55"},{"key":"e_1_3_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2021.111097"},{"key":"e_1_3_2_1_17_1","first-page":"966","article-title":"Text Classification Using Machine Learning","volume":"4","author":"Ikonomakis M","year":"2005","unstructured":"M Ikonomakis , Sotiris Kotsiantis , and V Tampakas . 2005 . Text Classification Using Machine Learning Techniques.Trans. on Computers 4 , 8 (2005), 966 \u2013 974 . M Ikonomakis, Sotiris Kotsiantis, and V Tampakas. 2005. Text Classification Using Machine Learning Techniques.Trans. on Computers 4, 8 (2005), 966\u2013974.","journal-title":"Techniques.Trans. on Computers"},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.infsof.2021.106756"},{"key":"e_1_3_2_1_19_1","volume-title":"The Promises and Perils of Mining GitHub. In Conf. on Mining Software Repositories. Association for Computing Machinery","author":"Kalliamvakou Eirini","year":"2014","unstructured":"Eirini Kalliamvakou , Georgios Gousios , Kelly Blincoe , Leif Singer , Daniel\u00a0 M. German , and Daniela Damian . 2014 . The Promises and Perils of Mining GitHub. In Conf. on Mining Software Repositories. Association for Computing Machinery , New York, NY, USA, 92\u2013101. https:\/\/doi.org\/10.1145\/2597073.2597074 10.1145\/2597073.2597074 Eirini Kalliamvakou, Georgios Gousios, Kelly Blincoe, Leif Singer, Daniel\u00a0M. German, and Daniela Damian. 2014. The Promises and Perils of Mining GitHub. In Conf. on Mining Software Repositories. Association for Computing Machinery, New York, NY, USA, 92\u2013101. https:\/\/doi.org\/10.1145\/2597073.2597074"},{"key":"e_1_3_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.infsof.2022.106855"},{"key":"e_1_3_2_1_21_1","volume-title":"ALBERT: A Lite BERT for Self-supervised Learning of Language Representations.. In ICLR. OpenReview.net, Addis Ababa, Ethiopia.","author":"Lan Zhenzhong","year":"2020","unstructured":"Zhenzhong Lan , Mingda Chen , Sebastian Goodman , Kevin Gimpel , Piyush Sharma , and Radu Soricut . 2020 . ALBERT: A Lite BERT for Self-supervised Learning of Language Representations.. In ICLR. OpenReview.net, Addis Ababa, Ethiopia. Zhenzhong Lan, Mingda Chen, Sebastian Goodman, Kevin Gimpel, Piyush Sharma, and Radu Soricut. 2020. ALBERT: A Lite BERT for Self-supervised Learning of Language Representations.. In ICLR. OpenReview.net, Addis Ababa, Ethiopia."},{"key":"e_1_3_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2014.12.027"},{"key":"e_1_3_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10664-020-09854-3"},{"key":"e_1_3_2_1_24_1","volume-title":"Detecting and Quantifying Different Types of Self-Admitted Technical Debt. In Int. Workshop on Managing Technical Debt. IEEE","author":"Everton","year":"2015","unstructured":"Everton da\u00a0S. Maldonado and Emad Shihab. 2015 . Detecting and Quantifying Different Types of Self-Admitted Technical Debt. In Int. Workshop on Managing Technical Debt. IEEE , Bremen, Germany, 9\u201315. https:\/\/doi.org\/10.1109\/MTD. 2015 .7332619 10.1109\/MTD.2015.7332619 Everton da\u00a0S. Maldonado and Emad Shihab. 2015. Detecting and Quantifying Different Types of Self-Admitted Technical Debt. In Int. Workshop on Managing Technical Debt. IEEE, Bremen, Germany, 9\u201315. https:\/\/doi.org\/10.1109\/MTD.2015.7332619"},{"key":"e_1_3_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2017.2654244"},{"key":"e_1_3_2_1_26_1","volume-title":"Interrater Reliability: the Kappa Statistic. Biochemia medica 22 (10","author":"McHugh Mary","year":"2012","unstructured":"Mary McHugh . 2012. Interrater Reliability: the Kappa Statistic. Biochemia medica 22 (10 2012 ), 276\u201382. https:\/\/doi.org\/10.11613\/BM.2012.031 10.11613\/BM.2012.031 Mary McHugh. 2012. Interrater Reliability: the Kappa Statistic. Biochemia medica 22 (10 2012), 276\u201382. https:\/\/doi.org\/10.11613\/BM.2012.031"},{"key":"e_1_3_2_1_27_1","article-title":"Deep Learning\u2013Based Text Classification","volume":"54","author":"Minaee Shervin","year":"2021","unstructured":"Shervin Minaee , Nal Kalchbrenner , Erik Cambria , Narjes Nikzad , Meysam Chenaghlu , and Jianfeng Gao . 2021 . Deep Learning\u2013Based Text Classification : A Comprehensive Review. ACM Comput. Surv. 54 , 3, Article 62 (2021), 40\u00a0pages. https:\/\/doi.org\/10.1145\/3439726 10.1145\/3439726 Shervin Minaee, Nal Kalchbrenner, Erik Cambria, Narjes Nikzad, Meysam Chenaghlu, and Jianfeng Gao. 2021. Deep Learning\u2013Based Text Classification: A Comprehensive Review. ACM Comput. Surv. 54, 3, Article 62 (2021), 40\u00a0pages. https:\/\/doi.org\/10.1145\/3439726","journal-title":"A Comprehensive Review. ACM Comput. Surv."},{"key":"e_1_3_2_1_28_1","volume-title":"Long-Term Evaluation of Technical Debt in Open-Source Software. In Int. Symp. on Empirical SE and Measurement. Association for Computing Machinery","author":"Molnar Arthur-Jozsef","year":"2020","unstructured":"Arthur-Jozsef Molnar and Simona Motogna . 2020 . Long-Term Evaluation of Technical Debt in Open-Source Software. In Int. Symp. on Empirical SE and Measurement. Association for Computing Machinery , New York, NY, USA, Article 13, 9\u00a0pages. https:\/\/doi.org\/10.1145\/3382494.3410673 10.1145\/3382494.3410673 Arthur-Jozsef Molnar and Simona Motogna. 2020. Long-Term Evaluation of Technical Debt in Open-Source Software. In Int. Symp. on Empirical SE and Measurement. Association for Computing Machinery, New York, NY, USA, Article 13, 9\u00a0pages. https:\/\/doi.org\/10.1145\/3382494.3410673"},{"key":"e_1_3_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2020.3002663"},{"key":"e_1_3_2_1_30_1","volume-title":"An Exploratory Study on Self-Admitted Technical Debt. In Int. Conf. on Software Maintenance and Evolution. IEEE, Victoria, BC, Canada, 91\u2013100","author":"Potdar Aniket","year":"2014","unstructured":"Aniket Potdar and Emad Shihab . 2014 . An Exploratory Study on Self-Admitted Technical Debt. In Int. Conf. on Software Maintenance and Evolution. IEEE, Victoria, BC, Canada, 91\u2013100 . https:\/\/doi.org\/10.1109\/ICSME.2014.31 10.1109\/ICSME.2014.31 Aniket Potdar and Emad Shihab. 2014. An Exploratory Study on Self-Admitted Technical Debt. In Int. Conf. on Software Maintenance and Evolution. IEEE, Victoria, BC, Canada, 91\u2013100. https:\/\/doi.org\/10.1109\/ICSME.2014.31"},{"key":"e_1_3_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11219-020-09520-3"},{"key":"e_1_3_2_1_32_1","volume-title":"Technical Debt and Waste in Non-functional Requirements Documentation: An Exploratory Study","author":"Robiolo Gabriela","unstructured":"Gabriela Robiolo , Ezequiel Scott , Santiago Matalonga , and Michael Felderer . 2019. Technical Debt and Waste in Non-functional Requirements Documentation: An Exploratory Study . In Product-Focused Software Process Improvement, Xavier Franch, Tomi M\u00e4nnist\u00f6, and Silverio Mart\u00ednez-Fern\u00e1ndez (Eds.). Springer Int. Publishing , Cham , 220\u2013235. Gabriela Robiolo, Ezequiel Scott, Santiago Matalonga, and Michael Felderer. 2019. Technical Debt and Waste in Non-functional Requirements Documentation: An Exploratory Study. In Product-Focused Software Process Improvement, Xavier Franch, Tomi M\u00e4nnist\u00f6, and Silverio Mart\u00ednez-Fern\u00e1ndez (Eds.). Springer Int. Publishing, Cham, 220\u2013235."},{"key":"e_1_3_2_1_33_1","unstructured":"Victor Sanh Lysandre Debut Julien Chaumond and Thomas Wolf. 2019. DistilBERT A Distilled Version of BERT: Smaller Faster Cheaper and Lighter. CoRR abs\/1910.01108(2019).  Victor Sanh Lysandre Debut Julien Chaumond and Thomas Wolf. 2019. DistilBERT A Distilled Version of BERT: Smaller Faster Cheaper and Lighter. CoRR abs\/1910.01108(2019)."},{"key":"e_1_3_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICASSP.2012.6289079"},{"key":"e_1_3_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2012.12.052"},{"key":"e_1_3_2_1_36_1","volume-title":"Mining Knowledge on Technical Debt Propagation. 14th Symposium on Programming Languages and Software Tools 1525","author":"Tomi\u2018bgt\u2019Suovuo Johannes\u00a0Holvitie","year":"2015","unstructured":"Johannes\u00a0Holvitie Tomi\u2018bgt\u2019Suovuo , Jouni Smed , and Ville Lepp\u00e4nen . 2015 . Mining Knowledge on Technical Debt Propagation. 14th Symposium on Programming Languages and Software Tools 1525 (2015), 281\u2013295. Johannes\u00a0Holvitie Tomi\u2018bgt\u2019Suovuo, Jouni Smed, and Ville Lepp\u00e4nen. 2015. Mining Knowledge on Technical Debt Propagation. 14th Symposium on Programming Languages and Software Tools 1525 (2015), 281\u2013295."},{"key":"e_1_3_2_1_37_1","first-page":"1","article-title":"Demystifying Regular Expression Bugs","volume":"27","author":"Wang Peipei","year":"2022","unstructured":"Peipei Wang , Chris Brown , Jamie\u00a0 A Jennings , and Kathryn\u00a0 T Stolee . 2022 . Demystifying Regular Expression Bugs . Empirical SE 27 , 1 (2022), 1 \u2013 35 . Peipei Wang, Chris Brown, Jamie\u00a0A Jennings, and Kathryn\u00a0T Stolee. 2022. Demystifying Regular Expression Bugs. Empirical SE 27, 1 (2022), 1\u201335.","journal-title":"Empirical SE"},{"key":"e_1_3_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11219-013-9200-8"},{"key":"e_1_3_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSME.2018.00032"},{"key":"e_1_3_2_1_40_1","volume-title":"Chinese National Conference on Computational Linguistics. Chinese Information Processing Society of China","author":"Zhuang Liu","year":"2021","unstructured":"Liu Zhuang , Lin Wayne , Shi Ya , and Zhao Jun . 2021 . A Robustly Optimized BERT Pre-training Approach with Post-training . In Chinese National Conference on Computational Linguistics. Chinese Information Processing Society of China , Huhhot, China, 1218\u20131227. Liu Zhuang, Lin Wayne, Shi Ya, and Zhao Jun. 2021. A Robustly Optimized BERT Pre-training Approach with Post-training. In Chinese National Conference on Computational Linguistics. Chinese Information Processing Society of China, Huhhot, China, 1218\u20131227."},{"key":"e_1_3_2_1_41_1","volume-title":"How Does Code Style Inconsistency Affect Pull Request Integration? An Exploratory Study on 117 GitHub Projects. Empirical Software Engineering 24 (12","author":"Zou Weiqin","year":"2019","unstructured":"Weiqin Zou , Jifeng Xuan , Xiaoyuan Xie , Zhenyu Chen , and Baowen Xu. 2019. How Does Code Style Inconsistency Affect Pull Request Integration? An Exploratory Study on 117 GitHub Projects. Empirical Software Engineering 24 (12 2019 ). https:\/\/doi.org\/10.1007\/s10664-019-09720-x 10.1007\/s10664-019-09720-x Weiqin Zou, Jifeng Xuan, Xiaoyuan Xie, Zhenyu Chen, and Baowen Xu. 2019. How Does Code Style Inconsistency Affect Pull Request Integration? An Exploratory Study on 117 GitHub Projects. Empirical Software Engineering 24 (12 2019). https:\/\/doi.org\/10.1007\/s10664-019-09720-x"}],"event":{"name":"ESEM '22: ACM \/ IEEE International Symposium on Empirical Software Engineering and Measurement","location":"Helsinki Finland","acronym":"ESEM '22","sponsor":["SIGSOFT ACM Special Interest Group on Software Engineering"]},"container-title":["Proceedings of the 16th ACM \/ IEEE International Symposium on Empirical Software Engineering and Measurement"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3544902.3546637","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3544902.3546637","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T19:00:01Z","timestamp":1750186801000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3544902.3546637"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,9,19]]},"references-count":41,"alternative-id":["10.1145\/3544902.3546637","10.1145\/3544902"],"URL":"https:\/\/doi.org\/10.1145\/3544902.3546637","relation":{},"subject":[],"published":{"date-parts":[[2022,9,19]]},"assertion":[{"value":"2022-09-19","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}