{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,24]],"date-time":"2026-10-24T20:18:29Z","timestamp":1792873109201,"version":"4.5.0"},"reference-count":83,"publisher":"Springer Science and Business Media LLC","issue":"5","license":[{"start":{"date-parts":[[2022,5,30]],"date-time":"2022-05-30T00:00:00Z","timestamp":1653868800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2022,5,30]],"date-time":"2022-05-30T00:00:00Z","timestamp":1653868800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["1815503"],"award-info":[{"award-number":["1815503"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["1900903"],"award-info":[{"award-number":["1900903"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100003593","name":"Conselho Nacional de Desenvolvimento Cient\u00edfico e Tecnol\u00f3gico","doi-asserted-by":"publisher","award":["313067\/2020-1"],"award-info":[{"award-number":["313067\/2020-1"]}],"id":[{"id":"10.13039\/501100003593","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Empir Software Eng"],"published-print":{"date-parts":[[2022,9]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Software bots have been facilitating several development activities in Open Source Software (OSS) projects, including code review. However, these bots may bring unexpected impacts to group dynamics, as frequently occurs with new technology adoption. Understanding and anticipating such effects is important for planning and management. To analyze these effects, we investigate how several activity indicators change after the adoption of a code review bot. We employed a regression discontinuity design on 1,194 software projects from GitHub. We also interviewed 12 practitioners, including open-source maintainers and contributors. Our results indicate that the adoption of code review bots increases the number of monthly merged pull requests, decreases monthly non-merged pull requests, and decreases communication among developers. From the developers\u2019 perspective, these effects are explained by the transparency and confidence the bot comments introduce, in addition to the changes in the discussion focused on pull requests. Practitioners and maintainers may leverage our results to understand, or even predict, bot effects on their projects.<\/jats:p>","DOI":"10.1007\/s10664-022-10130-9","type":"journal-article","created":{"date-parts":[[2022,5,30]],"date-time":"2022-05-30T09:03:03Z","timestamp":1653901383000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":20,"title":["Quality gatekeepers: investigating the effects of code review bots on pull request activities"],"prefix":"10.1007","volume":"27","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-8619-726X","authenticated-orcid":false,"given":"Mairieli","family":"Wessel","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Alexander","family":"Serebrenik","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Igor","family":"Wiese","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Igor","family":"Steinmacher","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Marco A.","family":"Gerosa","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2022,5,30]]},"reference":[{"key":"10130_CR1","doi-asserted-by":"crossref","unstructured":"Aniche M, Treude C, Steinmacher I, Wiese I, Pinto G, Storey MA, Gerosa MA (2018) How modern news aggregators help development communities shape and share knowledge. In: ICSE\u201918, pp 499\u2013510","DOI":"10.1145\/3180155.3180180"},{"issue":"3","key":"10130_CR2","doi-asserted-by":"publisher","first-page":"679","DOI":"10.1007\/s10606-018-9310-8","volume":"27","author":"S Balali","year":"2018","unstructured":"Balali S, Steinmacher I, Annamalai U, Sarma A, Gerosa MA (2018) Newcomers\u2019 barriers... is that all? An analysis of mentors\u2019 and newcomers\u2019 barriers in oss projects. Computer Supported Cooperative Work (CSCW) 27(3):679\u2013714","journal-title":"Computer Supported Cooperative Work (CSCW)"},{"issue":"3","key":"10130_CR3","doi-asserted-by":"publisher","first-page":"932","DOI":"10.1007\/s10664-015-9366-8","volume":"21","author":"O Baysal","year":"2016","unstructured":"Baysal O, Kononenko O, Holmes R, Godfrey MW (2016) Investigating technical and non-technical factors influencing modern code review. Empir Softw Eng 21(3):932\u2013959","journal-title":"Empir Softw Eng"},{"issue":"1","key":"10130_CR4","doi-asserted-by":"crossref","first-page":"289","DOI":"10.1111\/j.2517-6161.1995.tb02031.x","volume":"57","author":"Y Benjamini","year":"1995","unstructured":"Benjamini Y, Hochberg Y (1995) Controlling the false discovery rate: a practical and powerful approach to multiple testing. J R Stat Soc: Ser B (Methodol) 57(1):289\u2013300","journal-title":"J R Stat Soc: Ser B (Methodol)"},{"key":"10130_CR5","unstructured":"Bernard HR (2017) Research methods in anthropology: qualitative and quantitative approaches. Rowman & Littlefield, Laham, Maryland"},{"key":"10130_CR6","doi-asserted-by":"crossref","unstructured":"Brown C, Parnin C (2019) Sorry to bother you: designing bots for effective recommendations. In: Proceedings of the 1st international workshop on bots in software engineering, BotSE","DOI":"10.1109\/BotSE.2019.00021"},{"key":"10130_CR7","doi-asserted-by":"crossref","unstructured":"Carvalho A, Luz W, Marc\u00edlio D, Bonif\u00e1cio R, Pinto G, Dias Canedo E (2020) c-3pr: a bot for fixing static analysis violations via pull requests. In: 2020 IEEE 27th International conference on software analysis, evolution and reengineering (SANER), pp 161\u2013171","DOI":"10.1109\/SANER48275.2020.9054842"},{"key":"10130_CR8","doi-asserted-by":"crossref","unstructured":"Cassee N, Vasilescu B, Serebrenik A (2020) The silent helper: the impact of continuous integration on code reviews. In: 27th IEEE international conference on software analysis, evolution and reengineering. IEEE Computer Society","DOI":"10.1109\/SANER48275.2020.9054818"},{"key":"10130_CR9","doi-asserted-by":"crossref","unstructured":"Cassee N, Kitsanelis C, Constantinou E, Serebrenik A (2021) Human, bot or both? A study on the capabilities of classification models on mixed accounts. In: 37th IEEE international conference on software maintenance and evolution. IEEE, pp xx\u2013xx","DOI":"10.1109\/ICSME52107.2021.00075"},{"key":"10130_CR10","doi-asserted-by":"publisher","first-page":"729","DOI":"10.1080\/10447318.2020.1841438","volume":"37","author":"AP Chaves","year":"2020","unstructured":"Chaves AP, Gerosa MA (2020) How should my chatbot interact? A survey on social characteristics in human\u2013chatbot interaction design. Int J Hum\u2013Comput Interact 37:729\u2013758","journal-title":"Int J Hum\u2013Comput Interact"},{"key":"10130_CR11","unstructured":"Cook T, Campbell D (1979) Quasi-experimentation: design and analysis issues for field settings. Houghton Mifflin, Chicago"},{"key":"10130_CR12","unstructured":"Creswell J (2003) Mixed methods procedures. Research design: qualitative, quantitative, and mixed methods approaches 3:203\u2013240"},{"key":"10130_CR13","doi-asserted-by":"publisher","unstructured":"Dabbish L, Stuart C, Tsay J, Herbsleb J (2012) Social coding in GitHub: transparency and collaboration in an open software repository. In: Proceedings of the ACM 2012 conference on computer supported cooperative work, CSCW \u201912. ACM, New York, pp 1277\u20131286, DOI https:\/\/doi.org\/10.1145\/2145204.2145396. http:\/\/doi.acm.org\/10.1145\/2145204.2145396","DOI":"10.1145\/2145204.2145396"},{"key":"10130_CR14","doi-asserted-by":"publisher","unstructured":"Dias LF, Steinmacher I, Pinto G, Costa DAD, Gerosa M (2016) How does the shift to GitHub impact project collaboration?. In: 2016 IEEE international conference on software maintenance and evolution (ICSME), pp 473\u2013477, DOI https:\/\/doi.org\/10.1109\/ICSME.2016.78","DOI":"10.1109\/ICSME.2016.78"},{"key":"10130_CR15","doi-asserted-by":"crossref","unstructured":"Easterbrook S, Singer J, Storey MA, Damian D (2008) Selecting empirical methods for software engineering research. In: Guide to advanced empirical software engineering. Springer, pp 285\u2013311","DOI":"10.1007\/978-1-84800-044-5_11"},{"key":"10130_CR16","doi-asserted-by":"crossref","unstructured":"Ebert F, Castor F, Novielli N, Serebrenik A (2019) Confusion in code reviews: reasons, impacts, and coping strategies. In: 2019 IEEE 26th international conference on software analysis, evolution and reengineering (SANER). IEEE, pp 49\u201360","DOI":"10.1109\/SANER.2019.8668024"},{"issue":"5","key":"10130_CR17","doi-asserted-by":"publisher","first-page":"812","DOI":"10.1080\/1359432X.2014.1000873","volume":"24","author":"T Ellwart","year":"2015","unstructured":"Ellwart T, Happ C, Gurtner A, Rack O (2015) Managing information overload in virtual teams: effects of a structured online team adaptation on cognition and performance. Eur J Work Org Psychol 24(5):812\u2013826","journal-title":"Eur J Work Org Psychol"},{"key":"10130_CR18","doi-asserted-by":"crossref","unstructured":"Erlenhov L, Gomes de Oliveira Neto F, Leitner P (2016) An empirical study of bots in software development\u2013characteristics and challenges from a practitioner\u2019s perspective. In: Proceedings of the 2020 28th ACM SIGSOFT international symposium on foundations of software engineering, FSE 2020","DOI":"10.1145\/3368089.3409680"},{"key":"10130_CR19","doi-asserted-by":"crossref","unstructured":"Ga\u0142ecki A, Burzykowski T (2013) Linear mixed-effects models using R: a step-by-step approach. Springer Science & Business Media","DOI":"10.1007\/978-1-4614-3900-4"},{"key":"10130_CR20","doi-asserted-by":"crossref","unstructured":"Glaser BG, Strauss AL (2017) Discovery of grounded theory: strategies for qualitative research. Routledge, New York","DOI":"10.4324\/9780203793206"},{"key":"10130_CR21","doi-asserted-by":"publisher","unstructured":"Golzadeh M, Decan A, Constantinou E, Mens T (2021) Identifying bot activity in github pull request and issue comments. In: 3rd IEEE\/ACM international workshop on bots in software engineering, botSE@ICSE 2021, Madrid, Spain, June 4, 2021. IEEE, pp 21\u201325, DOI https:\/\/doi.org\/10.1109\/BotSE52550.2021.00012","DOI":"10.1109\/BotSE52550.2021.00012"},{"key":"10130_CR22","doi-asserted-by":"crossref","unstructured":"Gousios G, Spinellis D (2012) GHTOrrent: GitHub\u2019s data from a firehose. In: 2012 9th IEEE working conference on mining software repositories (MSR). IEEE, pp 12\u201321","DOI":"10.1109\/MSR.2012.6224294"},{"key":"10130_CR23","doi-asserted-by":"crossref","unstructured":"Gousios G, Pinzger M, van Deursen A (2014) An exploratory study of the pull-based software development model. In: Proceedings of the 36th international conference on software engineering. ACM, pp 345\u2013355","DOI":"10.1145\/2568225.2568260"},{"key":"10130_CR24","doi-asserted-by":"publisher","unstructured":"Gousios G, Storey MA, Bacchelli A (2016) Work practices and challenges in pull-based development: the contributor\u2019s perspective. In: Proceedings of the 38th international conference on software engineering, ICSE \u201916. ACM, New York, pp 285\u2013296, DOI https:\/\/doi.org\/10.1145\/2884781.2884826. http:\/\/doi.acm.org\/10.1145\/2884781.2884826","DOI":"10.1145\/2884781.2884826"},{"key":"10130_CR25","doi-asserted-by":"publisher","first-page":"e245","DOI":"10.7717\/peerj-cs.245","volume":"5","author":"Y Guo","year":"2019","unstructured":"Guo Y, Leitner P (2019) Studying the impact of ci on pull request delivery time in open source projects\u2014a conceptual replication. PeerJ Computer Science 5:e245","journal-title":"PeerJ Computer Science"},{"key":"10130_CR26","unstructured":"Healy T (2012) The unanticipated consequences of technology. Nanotechnology: ethical and social Implications 155\u2013173"},{"key":"10130_CR27","unstructured":"Hove SE, Anda B (2005) Experiences from conducting semi-structured interviews in empirical software engineering research. In: 11th IEEE international software metrics symposium (METRICS\u201905). IEEE, p 10"},{"issue":"2","key":"10130_CR28","doi-asserted-by":"publisher","first-page":"615","DOI":"10.1016\/j.jeconom.2007.05.001","volume":"142","author":"GW Imbens","year":"2008","unstructured":"Imbens G W, Lemieux T (2008) Regression discontinuity designs: a guide to practice. J Econ 142(2):615\u2013635","journal-title":"J Econ"},{"key":"10130_CR29","doi-asserted-by":"publisher","unstructured":"Kalliamvakou E, Gousios G, Blincoe K, Singer L, German D M, Damian D (2014) The promises and perils of mining GitHub. In: Proceedings of the 11th working conference on mining software repositories, MSR 2014. ACM, New York, pp 92\u2013101, DOI https:\/\/doi.org\/10.1145\/2597073.2597074.http:\/\/doi.acm.org\/10.1145\/2597073.2597074","DOI":"10.1145\/2597073.2597074"},{"key":"10130_CR30","doi-asserted-by":"crossref","unstructured":"Kavaler D, Trockman A, Vasilescu B, Filkov V (2019) Tool choice matters: JavaScript quality assurance tools and usage outcomes in GitHub projects. In: Proceedings of the 41st international conference on software engineering. IEEE Press, pp 476\u2013487","DOI":"10.1109\/ICSE.2019.00060"},{"key":"10130_CR31","doi-asserted-by":"crossref","unstructured":"Khanan C, Luewichana W, Pruktharathikoon K, Jiarpakdee J, Tantithamthavorn C, Choetkiertikul M, Ragkhitwetsagul C, Sunetnanta T (2020) Jitbot: an explainable just-in-time defect prediction bot. In: 2020 35th IEEE\/ACM international conference on automated software engineering (ASE), pp 1336\u20131339","DOI":"10.1145\/3324884.3415295"},{"key":"10130_CR32","doi-asserted-by":"crossref","unstructured":"Kinsman T, Wessel M, Gerosa M, Treude C (2021) How do software developers use github actions to automate their workflows?. In: Mining software repositories conference (MSR). IEEE","DOI":"10.1109\/MSR52588.2021.00054"},{"issue":"13","key":"10130_CR33","doi-asserted-by":"publisher","first-page":"1","DOI":"10.18637\/jss.v082.i13","volume":"82","author":"A Kuznetsova","year":"2017","unstructured":"Kuznetsova A, Brockhoff PB, Christensen RHB (2017) lmertest package: tests in linear mixed effects models. J Stat Softw 82(13):1\u201326","journal-title":"J Stat Softw"},{"key":"10130_CR34","unstructured":"Lebeuf C, Storey MD, Zagalsky A (2017) How software developers mitigate collaboration friction with chatbots. In: Talking with conversational agents in collaborative action workshop at the 20th ACM conference on computer-supported cooperative work and social computing, CSCW \u201917. 1702.07011"},{"issue":"1","key":"10130_CR35","doi-asserted-by":"publisher","first-page":"18","DOI":"10.1109\/MS.2017.4541027","volume":"35","author":"C Lebeuf","year":"2018","unstructured":"Lebeuf C, Storey MA, Zagalsky A (2018) Software bots. IEEE Softw 35(1):18\u201323","journal-title":"IEEE Softw"},{"key":"10130_CR36","doi-asserted-by":"publisher","unstructured":"Lebeuf C, Zagalsky A, Foucault M, Storey MA (2019) Defining and classifying software bots: a faceted taxonomy. In: Proceedings of the 1st international workshop on bots in software engineering, BotSE \u201919. IEEE Press, Piscataway, pp 1\u20136, DOI https:\/\/doi.org\/10.1109\/BotSE.2019.00008","DOI":"10.1109\/BotSE.2019.00008"},{"key":"10130_CR37","doi-asserted-by":"publisher","unstructured":"Liu D, Smith MJ, Veeramachaneni K (2020) Understanding user-bot interactions for small-scale automation in open-source development. In: Extended abstracts of the 2020 CHI conference on human factors in computing systems, CHI EA \u201920. Association for Computing Machinery, New York, pp 1\u20138, DOI https:\/\/doi.org\/10.1145\/3334480.3382998","DOI":"10.1145\/3334480.3382998"},{"key":"10130_CR38","doi-asserted-by":"crossref","unstructured":"McIntosh S, Kamei Y, Adams B, Hassan AE (2014) The impact of code review coverage and code review participation on software quality: a case study of the qt, vtk, and itk projects. In: Proceedings of the 11th working conference on mining software repositories, pp 192\u2013201","DOI":"10.1145\/2597073.2597076"},{"key":"10130_CR39","doi-asserted-by":"crossref","unstructured":"Mendez C, Padala HS, Steine-Hanson Z, Hildebrand C, Horvath A, Hill C, Simpson L, Patil N, Sarma A, Burnett M (2018) Open source barriers to entry, revisited: a sociotechnical perspective. In: 2018 IEEE\/ACM 40th international conference on software engineering (ICSE), pp 1004\u20131015","DOI":"10.1145\/3180155.3180241"},{"key":"10130_CR40","doi-asserted-by":"crossref","unstructured":"Mirhosseini S, Parnin C (2017) Can automated pull requests encourage software developers to upgrade out-of-date dependencies?. In: Proceedings of the 32nd IEEE\/ACM international conference on automated software engineering, ASE 2017. http:\/\/dl.acm.org\/citation.cfm?id=3155562.3155577. IEEE Press, Piscataway, pp 84\u201394","DOI":"10.1109\/ASE.2017.8115621"},{"key":"10130_CR41","doi-asserted-by":"crossref","unstructured":"Moldon L, Strohmaier M, Wachs J (2020) How gamification affects software developers: cautionary evidence from a quasi-experiment on github. arXiv:200602371","DOI":"10.1109\/ICSE43902.2021.00058"},{"key":"10130_CR42","doi-asserted-by":"publisher","unstructured":"Monperrus M (2019) Explainable software bot contributions: case study of automated bug fixes. In: Proceedings of the 1st international workshop on bots in software engineering, BotSE \u201919. IEEE Press, Piscataway, pp 12\u201315, DOI https:\/\/doi.org\/10.1109\/BotSE.2019.00010","DOI":"10.1109\/BotSE.2019.00010"},{"key":"10130_CR43","doi-asserted-by":"crossref","unstructured":"Mulder K (2013) Impact of new technologies: how to assess the intended and unintended effects of new technologies. Handb Sustain Eng","DOI":"10.1007\/978-1-4020-8939-8_35"},{"key":"10130_CR44","doi-asserted-by":"publisher","unstructured":"Murphy-Hill E, Smith EK, Sadowski C, Jaspan C, Winter C, Jorde M, Knight A, Trenk A, Gross S (2019) Do developers discover new tools on the toilet?. In: Proceedings of the 41st international conference on software engineering, ICSE \u201919. IEEE Press, pp 465\u2013475, DOI https:\/\/doi.org\/10.1109\/ICSE.2019.00059","DOI":"10.1109\/ICSE.2019.00059"},{"issue":"2","key":"10130_CR45","doi-asserted-by":"publisher","first-page":"133","DOI":"10.1111\/j.2041-210x.2012.00261.x","volume":"4","author":"S Nakagawa","year":"2013","unstructured":"Nakagawa S, Schielzeth H (2013) A general and simple method for obtaining r2 from generalized linear mixed-effects models. Methods Ecol Evol 4 (2):133\u2013142","journal-title":"Methods Ecol Evol"},{"key":"10130_CR46","doi-asserted-by":"publisher","unstructured":"Paikari E, van der Hoek A (2018) A framework for understanding chatbots and their future. In: Proceedings of the 11th international workshop on cooperative and human aspects of software engineering, CHASE \u201918. ACM, New York, pp 13\u201316, DOI https:\/\/doi.org\/10.1145\/3195836.3195859. http:\/\/doi.acm.org\/10.1145\/3195836.3195859","DOI":"10.1145\/3195836.3195859"},{"key":"10130_CR47","unstructured":"Patton MQ (2014) Qualitative research & evaluation methods: integrating theory and practice. Sage Publications, Los Angeles"},{"key":"10130_CR48","doi-asserted-by":"crossref","unstructured":"Phan-udom P, Wattanakul N, Sakulniwat T, Ragkhitwetsagul C, Sunetnanta T, Choetkiertikul M, Kula RG (2020) Teddy: automatic recommendation of pythonic idiom usage for pull-based software projects. In: 2020 IEEE International conference on software maintenance and evolution (ICSME). IEEE, pp 806\u2013809","DOI":"10.1109\/ICSME46990.2020.00098"},{"key":"10130_CR49","doi-asserted-by":"crossref","unstructured":"Pinto G, Steinmacher I, Gerosa MA (2016) More common than you think: an in-depth study of casual contributors. In: 2016 IEEE 23rd international conference on software analysis, evolution, and reengineering (SANER), vol 1. IEEE, pp 112\u2013123","DOI":"10.1109\/SANER.2016.68"},{"key":"10130_CR50","doi-asserted-by":"crossref","unstructured":"Pinto GHL, Figueira Filho F, Steinmacher I, Gerosa MA (2017) Training software engineers using open-source software: the professors\u2019 perspective. In: 2017 IEEE 30th conference on software engineering education and training (CSEE&T). IEEE, pp 117\u2013121","DOI":"10.1109\/CSEET.2017.27"},{"key":"10130_CR51","unstructured":"Romano J, Kromrey JD, Coraggio J, Skowronek J (2006) Appropriate statistics for ordinal level data: should we really be using t-test and cohen\u2019sd for evaluating group differences on the nsse and other surveys. In: Annual meeting of the Florida Association of Institutional Research, pp 1\u201333"},{"issue":"2","key":"10130_CR52","doi-asserted-by":"publisher","first-page":"131","DOI":"10.1007\/s10664-008-9102-8","volume":"14","author":"P Runeson","year":"2009","unstructured":"Runeson P, H\u00f6st M (2009) Guidelines for conducting and reporting case study research in software engineering. Empir Softw Eng 14(2):131","journal-title":"Empir Softw Eng"},{"key":"10130_CR53","doi-asserted-by":"crossref","unstructured":"Serban D, Golsteijn B, Holdorp R, Serebrenik A (2021) Saw-bot: proposing fixes for static analysis warnings with github suggestions. In: Workshop on bots in software engineering. IEEE Computer Society","DOI":"10.1109\/BotSE52550.2021.00013"},{"key":"10130_CR54","doi-asserted-by":"crossref","unstructured":"Sheather S (2009) A modern approach to regression with R. Springer Science & Business Media","DOI":"10.1007\/978-0-387-09608-7"},{"key":"10130_CR55","doi-asserted-by":"crossref","unstructured":"Singer L, Figueira Filho F, Storey MA (2014) Software engineering at the speed of light: how developers stay current using Twitter. In: 36th ICSE, pp 211\u2013221","DOI":"10.1145\/2568225.2568305"},{"key":"10130_CR56","doi-asserted-by":"crossref","unstructured":"Steinmacher I, Wiese I, Chaves AP, Gerosa MA (2013) Why do newcomers abandon open source software projects?. In: 2013 6th international workshop on cooperative and human aspects of software engineering (CHASE). IEEE, pp 25\u201332","DOI":"10.1109\/CHASE.2013.6614728"},{"key":"10130_CR57","doi-asserted-by":"crossref","unstructured":"Steinmacher I, Conte T, Gerosa M A, Redmiles D (2015) Social barriers faced by newcomers placing their first contribution in open source software projects. In: Proceedings of the 18th ACM conference on Computer supported cooperative work & social computing, pp 1379\u20131392","DOI":"10.1145\/2675133.2675215"},{"key":"10130_CR58","doi-asserted-by":"publisher","unstructured":"Steinmacher I, Pinto G, Wiese IS, Gerosa MA (2018) Almost there: a study on quasi-contributors in open source software projects. In: Proceedings of the 40th international conference on software engineering, ICSE \u201918. ACM, New York, pp 256\u2013266, DOI https:\/\/doi.org\/10.1145\/3180155.3180208. http:\/\/doi.acm.org\/10.1145\/3180155.3180208","DOI":"10.1145\/3180155.3180208"},{"key":"10130_CR59","doi-asserted-by":"crossref","unstructured":"Stol KJ, Ralph P, Fitzgerald B (2016) Grounded theory in software engineering research: a critical review and guidelines. In: Proceedings of the 38th international conference on software engineering, pp 120\u2013131","DOI":"10.1145\/2884781.2884833"},{"key":"10130_CR60","doi-asserted-by":"publisher","unstructured":"Storey MA, Zagalsky A (2016) Disrupting developer productivity one bot at a time. In: Proceedings of the 2016 24th ACM SIGSOFT international symposium on foundations of software engineering, FSE 2016. ACM, New York, pp 928\u2013931, DOI https:\/\/doi.org\/10.1145\/2950290.2983989","DOI":"10.1145\/2950290.2983989"},{"key":"10130_CR61","doi-asserted-by":"crossref","unstructured":"Storey MA, Treude C, van Deursen A, Cheng LT (2010) The impact of social media on software engineering practices and tools. In: FSE\/SDP workshop on future of software engineering research, pp 359\u2013364","DOI":"10.1145\/1882362.1882435"},{"issue":"2","key":"10130_CR62","doi-asserted-by":"publisher","first-page":"185","DOI":"10.1109\/TSE.2016.2584053","volume":"43","author":"MA Storey","year":"2017","unstructured":"Storey M A, Zagalsky A, Filho F F, Singer L, German D M (2017) How social and communication channels shape and challenge a participatory culture in software development. IEEE Trans Softw Eng 43(2):185\u2013204. https:\/\/doi.org\/10.1109\/TSE.2016.2584053","journal-title":"IEEE Trans Softw Eng"},{"key":"10130_CR63","unstructured":"Strauss A, Corbin JM (1997) Grounded theory in practice. Sage, Los Angeles"},{"key":"10130_CR64","unstructured":"Strauss AL, Corbin J (1998) Basics of qualitative research: techniques and procedures for developing grounded theory sage publications. SAGE Publications, Los Angeles"},{"key":"10130_CR65","doi-asserted-by":"crossref","unstructured":"Strauss A, Corbin JM (2007) Basics of qualitative research : techniques and procedures for developing grounded theory, 3rd edn. SAGE Publications, Los Angeles","DOI":"10.4135\/9781452230153"},{"issue":"6","key":"10130_CR66","doi-asserted-by":"publisher","first-page":"309","DOI":"10.1037\/h0044319","volume":"51","author":"DL Thistlethwaite","year":"1960","unstructured":"Thistlethwaite DL, Campbell DT (1960) Regression-discontinuity analysis: an alternative to the ex post facto experiment. J Educ Psychol 51(6):309","journal-title":"J Educ Psychol"},{"key":"10130_CR67","doi-asserted-by":"crossref","unstructured":"Trockman A, Zhou S, K\u00e4stner C, Vasilescu B (2018) Adding sparkle to social coding: an empirical study of repository badges in the npm ecosystem. In: Proceedings of the 40th international conference on software engineering, pp 511\u2013522","DOI":"10.1145\/3180155.3180209"},{"key":"10130_CR68","doi-asserted-by":"publisher","unstructured":"Urli S, Yu Z, Seinturier L, Monperrus M (2018) How to design a program repair bot?: insights from the repairnator project. In: Proceedings of the 40th international conference on software engineering: software engineering in practice, ICSE-SEIP \u201918. ACM, New York, pp 95\u2013104, DOI https:\/\/doi.org\/10.1145\/3183519.3183540","DOI":"10.1145\/3183519.3183540"},{"key":"10130_CR69","doi-asserted-by":"publisher","unstructured":"Vorvoreanu M, Zhang L, Huang YH, Hilderbrand C, Steine-Hanson Z, Burnett M (2019) From gender biases to gender-inclusive design: an empirical investigation. In: Proceedings of the 2019 CHI conference on human factors in computing systems, CHI \u201919. Association for Computing Machinery, New York, pp 1\u201314, DOI https:\/\/doi.org\/10.1145\/3290605.3300283","DOI":"10.1145\/3290605.3300283"},{"key":"10130_CR70","doi-asserted-by":"crossref","unstructured":"Walden J (2020) The impact of a major security event on an open source project: the case of openssl. arXiv:200514242","DOI":"10.1145\/3379597.3387465"},{"key":"10130_CR71","doi-asserted-by":"publisher","unstructured":"Wessel M, Steinmacher I (2020) The inconvenient side of software bots on pull requests. In: Proceedings of the 2nd international workshop on bots in software engineering, BotSE. https:\/\/doi.org\/10.1145\/3387940.3391504","DOI":"10.1145\/3387940.3391504"},{"key":"10130_CR72","doi-asserted-by":"publisher","first-page":"182:1","DOI":"10.1145\/3274451","volume":"2(CSCW)","author":"M Wessel","year":"2018","unstructured":"Wessel M, de Souza BM, Steinmacher I, Wiese IS, Polato I, Chaves AP, Gerosa MA (2018) The power of bots: characterizing and understanding bots in OSS projects. Proc ACM Hum-Comput Interact 2(CSCW):182:1\u2013182:19. https:\/\/doi.org\/10.1145\/3274451. http:\/\/doi.acm.org\/10.1145\/3274451","journal-title":"Proc ACM Hum-Comput Interact"},{"key":"10130_CR73","doi-asserted-by":"crossref","unstructured":"Wessel M, Serebrenik A, Wiese I, Steinmacher I, Gerosa MA (2020a) What to expect from code review bots on GitHub? a survey with OSS maintainers. In: SBES 2020\u2014Ideias inovadoras e resultados emergentes","DOI":"10.1145\/3422392.3422459"},{"key":"10130_CR74","doi-asserted-by":"crossref","unstructured":"Wessel M, Serebrenik A, Wiese IS, Steinmacher I, Gerosa MA (2020b) Effects of adopting code review bots on pull requests to oss projects. In: IEEE International conference on software maintenance and evolution. IEEE Computer Society","DOI":"10.1109\/ICSME46990.2020.00011"},{"key":"10130_CR75","doi-asserted-by":"crossref","unstructured":"Wessel M, Wiese I, Steinmacher I, Gerosa M (2021) Don\u2019t disturb me: challenges of interacting with software bots on open source software projects. In: Proceedings of ACM human-computer interaction (CSCW)","DOI":"10.1145\/3476042"},{"key":"10130_CR76","unstructured":"Wilks DS (2011) Statistical methods in the atmospheric sciences, vol 100. Academic Press, San Diego, California"},{"key":"10130_CR77","doi-asserted-by":"crossref","unstructured":"Wohlin C, Runeson P, H\u00f6st M, Ohlsson MC, Regnell B, Wessl\u00e9n A (2012) Experimentation in software engineering. Springer Science & Business Media","DOI":"10.1007\/978-3-642-29044-2"},{"key":"10130_CR78","doi-asserted-by":"crossref","unstructured":"Woods DD, Patterson ES (2001) How unexpected events produce an escalation of cognitive and coordinative demands. In: Hancock PA, Desmond PA (eds) Stress, workload, and fatigue. L Erlbaum, Mahwah","DOI":"10.1201\/b12791-2.3"},{"key":"10130_CR79","doi-asserted-by":"publisher","unstructured":"Wyrich M, Bogner J (2019) Towards an autonomous bot for automatic source code refactoring. In: Proceedings of the 1st international workshop on bots in software engineering, BotSE \u201919. IEEE Press, Piscataway, pp 24\u201328, DOI https:\/\/doi.org\/10.1109\/BotSE.2019.00015","DOI":"10.1109\/BotSE.2019.00015"},{"key":"10130_CR80","unstructured":"Yin RK (2003) Design and methods. Case Study Research 3"},{"key":"10130_CR81","doi-asserted-by":"publisher","unstructured":"Yu Y, Wang H, Filkov V, Devanbu P, Vasilescu B (2015) Wait for it: determinants of pull request evaluation latency on GitHub. In: 2015 IEEE\/ACM 12th working conference on mining software repositories, pp 367\u2013371, DOI https:\/\/doi.org\/10.1109\/MSR.2015.42","DOI":"10.1109\/MSR.2015.42"},{"key":"10130_CR82","doi-asserted-by":"crossref","unstructured":"Zhao Y, Serebrenik A, Zhou Y, Filkov V, Vasilescu B (2017) The impact of continuous integration on other software development practices: a large-scale empirical study. In: Proceedings of the 32nd IEEE\/ACM international conference on automated software engineering. IEEE Press, pp 60\u201371","DOI":"10.1109\/ASE.2017.8115619"},{"key":"10130_CR83","doi-asserted-by":"crossref","unstructured":"Zimmermann T, Art\u00eds AC (2019) Impact of switching bug trackers: a case study on a medium-sized open source project. In: 2019 IEEE international conference on software maintenance and evolution (ICSME). IEEE, pp 13\u201323","DOI":"10.1109\/ICSME.2019.00011"}],"container-title":["Empirical Software Engineering"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10664-022-10130-9.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10664-022-10130-9\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10664-022-10130-9.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,9,26]],"date-time":"2024-09-26T02:35:24Z","timestamp":1727318124000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10664-022-10130-9"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,5,30]]},"references-count":83,"journal-issue":{"issue":"5","published-print":{"date-parts":[[2022,9]]}},"alternative-id":["10130"],"URL":"https:\/\/doi.org\/10.1007\/s10664-022-10130-9","relation":{},"ISSN":["1382-3256","1573-7616"],"issn-type":[{"value":"1382-3256","type":"print"},{"value":"1573-7616","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,5,30]]},"assertion":[{"value":"2 February 2022","order":1,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"30 May 2022","order":2,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors has no conflict of interest","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"<!--Emphasis Type='Bold' removed-->Conflict of Interest"}}],"article-number":"108"}}