{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,12]],"date-time":"2026-02-12T18:05:34Z","timestamp":1770919534659,"version":"3.50.1"},"publisher-location":"New York, NY, USA","reference-count":21,"publisher":"ACM","license":[{"start":{"date-parts":[[2020,6,29]],"date-time":"2020-06-29T00:00:00Z","timestamp":1593388800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100001659","name":"Deutsche Forschungsgemeinschaft","doi-asserted-by":"publisher","award":["402774445"],"award-info":[{"award-number":["402774445"]}],"id":[{"id":"10.13039\/501100001659","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2020,6,29]]},"DOI":"10.1145\/3379597.3387504","type":"proceedings-article","created":{"date-parts":[[2020,9,19]],"date-time":"2020-09-19T02:12:49Z","timestamp":1600481569000},"page":"611-614","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":3,"title":["Large-Scale Manual Validation of Bugfixing Changes"],"prefix":"10.1145","author":[{"given":"Steffen","family":"Herbold","sequence":"first","affiliation":[{"name":"University of Goettingen, G\u00f6ttingen, Germany"}]},{"given":"Alexander","family":"Trautsch","sequence":"additional","affiliation":[{"name":"University of Goettingen, G\u00f6ttingen, Germany"}]},{"given":"Benjamin","family":"Ledel","sequence":"additional","affiliation":[{"name":"University of Goettingen, G\u00f6ttingen, Germany"}]}],"member":"320","published-online":{"date-parts":[[2020,9,18]]},"reference":[{"key":"e_1_3_2_1_1_1","doi-asserted-by":"crossref","unstructured":"T. W. Anderson and D. A. Darling. 1952. Asymptotic Theory of Certain Criteria Based on Stochastic Processes. Ann. Math. Statist. 23 2 (06 1952) 193--212.  T. W. Anderson and D. A. Darling. 1952. Asymptotic Theory of Certain Criteria Based on Stochastic Processes. Ann. Math. Statist. 23 2 (06 1952) 193--212.","DOI":"10.1214\/aoms\/1177729437"},{"key":"e_1_3_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.5334\/joc.72"},{"key":"e_1_3_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1136\/bmj.296.6634.1454"},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1080\/01621459.1955.10501294"},{"key":"e_1_3_2_1_5_1","volume-title":"Measuring nominal scale agreement among many raters. Psychological bulletin 76, 5","author":"Fleiss Joseph L","year":"1971","unstructured":"Joseph L Fleiss . 1971. Measuring nominal scale agreement among many raters. Psychological bulletin 76, 5 ( 1971 ), 378. Joseph L Fleiss. 1971. Measuring nominal scale agreement among many raters. Psychological bulletin 76, 5 (1971), 378."},{"key":"e_1_3_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2017.2755013"},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.5555\/2487085.2487101"},{"key":"e_1_3_2_1_8_1","volume-title":"2019 12th IEEE Conference on Software Testing, Validation and Verification (ICST). 90--101","author":"Gyimesi P.","unstructured":"P. Gyimesi , B. Vancsics , A. Stocco , D. Mazinanian , A. Beszedes , R. Ferenc , and A. Mesbah . 2019. BugsJS: a Benchmark of JavaScript Bugs . In 2019 12th IEEE Conference on Software Testing, Validation and Verification (ICST). 90--101 . P. Gyimesi, B. Vancsics, A. Stocco, D. Mazinanian, A. Beszedes, R. Ferenc, and A. Mesbah. 2019. BugsJS: a Benchmark of JavaScript Bugs. In 2019 12th IEEE Conference on Software Testing, Validation and Verification (ICST). 90--101."},{"key":"e_1_3_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/3377816.3381721"},{"key":"e_1_3_2_1_10_1","unstructured":"Steffen Herbold Alexander Trautsch Fabian Trautsch and Benjamin Ledel. 2019. Issues with SZZ: An empirical assessment of the state of practice of defect prediction data collection. arXiv:cs.SE\/1911.08938  Steffen Herbold Alexander Trautsch Fabian Trautsch and Benjamin Ledel. 2019. Issues with SZZ: An empirical assessment of the state of practice of defect prediction data collection. arXiv:cs.SE\/1911.08938"},{"key":"e_1_3_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE.2013.6606585"},{"key":"e_1_3_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2017.2770124"},{"key":"e_1_3_2_1_13_1","volume-title":"Proc. of the 2014 Int. Symposium on Softw. Testing and Analysis (ISSTA). ACM.","author":"Just Ren\u00e9","unstructured":"Ren\u00e9 Just , Darioush Jalali , and Michael D. Ernst . 2014. Defects4J: A Database of Existing Faults to Enable Controlled Testing Studies for Java Programs . In Proc. of the 2014 Int. Symposium on Softw. Testing and Analysis (ISSTA). ACM. Ren\u00e9 Just, Darioush Jalali, and Michael D. Ernst. 2014. Defects4J: A Database of Existing Faults to Enable Controlled Testing Studies for Java Programs. In Proc. of the 2014 Int. Symposium on Softw. Testing and Analysis (ISSTA). ACM."},{"key":"e_1_3_2_1_14_1","volume-title":"Nonparametrics: Statistical Methods Based on Ranks","author":"Lehmann Erich L.","year":"2006","unstructured":"Erich L. Lehmann . 2006 . Nonparametrics: Statistical Methods Based on Ranks . Springer-Verlag New York . Erich L. Lehmann. 2006. Nonparametrics: Statistical Methods Based on Ranks. Springer-Verlag New York."},{"key":"e_1_3_2_1_15_1","volume-title":"IEEE Int. Conf. on Software Maintenance and Evolution (ICSME). 381--392","author":"Mills C.","unstructured":"C. Mills , J. Pantiuchina , E. Parra , G. Bavota , and S. Haiduc . 2018. Are Bug Reports Enough for Text Retrieval-Based Bug Localization? . In IEEE Int. Conf. on Software Maintenance and Evolution (ICSME). 381--392 . C. Mills, J. Pantiuchina, E. Parra, G. Bavota, and S. Haiduc. 2018. Are Bug Reports Enough for Text Retrieval-Based Bug Localization?. In IEEE Int. Conf. on Software Maintenance and Evolution (ICSME). 381--392."},{"key":"e_1_3_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.2307\/2333709"},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/1083142.1083147"},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/3377812.3382139"},{"key":"e_1_3_2_1_19_1","volume-title":"Addressing problems with replicability and validity of repository mining studies through a smart data platform. Emp. Softw. Eng. (08","author":"Trautsch Fabian","year":"2017","unstructured":"Fabian Trautsch , Steffen Herbold , Philip Makedonski , and Jens Grabowski . 2017. Addressing problems with replicability and validity of repository mining studies through a smart data platform. Emp. Softw. Eng. (08 Aug 2017 ). Fabian Trautsch, Steffen Herbold, Philip Makedonski, and Jens Grabowski. 2017. Addressing problems with replicability and validity of repository mining studies through a smart data platform. Emp. Softw. Eng. (08 Aug 2017)."},{"key":"e_1_3_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/3180155.3180206"},{"key":"e_1_3_2_1_21_1","volume-title":"For the win: How game thinking can revolutionize your business","author":"Werbach Kevin","unstructured":"Kevin Werbach and Dan Hunter . 2012. For the win: How game thinking can revolutionize your business . Wharton Digital Press . Kevin Werbach and Dan Hunter. 2012. For the win: How game thinking can revolutionize your business. Wharton Digital Press."}],"event":{"name":"MSR '20: 17th International Conference on Mining Software Repositories","location":"Seoul Republic of Korea","acronym":"MSR '20","sponsor":["SIGSOFT ACM Special Interest Group on Software Engineering","IEEE CS","SIGAI ACM Special Interest Group on Artificial Intelligence","SIGKDD ACM Special Interest Group on Knowledge Discovery in Data"]},"container-title":["Proceedings of the 17th International Conference on Mining Software Repositories"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3379597.3387504","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3379597.3387504","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T22:41:20Z","timestamp":1750200080000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3379597.3387504"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,6,29]]},"references-count":21,"alternative-id":["10.1145\/3379597.3387504","10.1145\/3379597"],"URL":"https:\/\/doi.org\/10.1145\/3379597.3387504","relation":{},"subject":[],"published":{"date-parts":[[2020,6,29]]},"assertion":[{"value":"2020-09-18","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}