{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,19]],"date-time":"2026-06-19T12:58:18Z","timestamp":1781873898948,"version":"3.54.5"},"reference-count":111,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2021,1,1]],"date-time":"2021-01-01T00:00:00Z","timestamp":1609459200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2021,1,27]],"date-time":"2021-01-27T00:00:00Z","timestamp":1611705600000},"content-version":"vor","delay-in-days":26,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100004933","name":"Instituto Nacional de Ci\u00eancia e Tecnologia","doi-asserted-by":"crossref","award":["88887.333966\/2019-00"],"award-info":[{"award-number":["88887.333966\/2019-00"]}],"id":[{"id":"10.13039\/501100004933","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100006162","name":"FACEPE","doi-asserted-by":"crossref","award":["BCT-0229-1.03-19"],"award-info":[{"award-number":["BCT-0229-1.03-19"]}],"id":[{"id":"10.13039\/501100006162","id-type":"DOI","asserted-by":"crossref"}]},{"name":"CNPQ","award":["304755\/2014-1"],"award-info":[{"award-number":["304755\/2014-1"]}]},{"name":"CNPQ","award":["406308\/2016-0"],"award-info":[{"award-number":["406308\/2016-0"]}]},{"name":"CNPQ","award":["465614\/2014-0"],"award-info":[{"award-number":["465614\/2014-0"]}]},{"DOI":"10.13039\/501100006162","name":"FACEPE","doi-asserted-by":"crossref","award":["APQ- 0839-1.03\/14"],"award-info":[{"award-number":["APQ- 0839-1.03\/14"]}],"id":[{"id":"10.13039\/501100006162","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100006162","name":"FACEPE","doi-asserted-by":"crossref","award":["0388-1.03\/14"],"award-info":[{"award-number":["0388-1.03\/14"]}],"id":[{"id":"10.13039\/501100006162","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100006162","name":"FACEPE","doi-asserted-by":"crossref","award":["0592-1.03\/15"],"award-info":[{"award-number":["0592-1.03\/15"]}],"id":[{"id":"10.13039\/501100006162","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Empir Software Eng"],"published-print":{"date-parts":[[2021,1]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:sec><jats:title>Context<\/jats:title><jats:p>Code review is a widely used technique of systematic examination of code changes which aims at increasing software quality. Code reviews provide several benefits for the project, including finding bugs, knowledge transfer, and assurance of adherence to project guidelines and coding style. However, code reviews have a major cost: they can delay the merge of the code change, and thus, impact the overall development process. This cost can be even higher if developers do not understand something, i.e., when developers face<jats:italic>confusion<\/jats:italic>during the code review.<\/jats:p><\/jats:sec><jats:sec><jats:title>Objective<\/jats:title><jats:p>This paper studies the phenomenon of<jats:italic>confusion<\/jats:italic>in code reviews. Understanding confusion is an important starting point to help reducing the cost of code reviews and enhance the effectiveness of this practice, and hence, improve the development process.<\/jats:p><\/jats:sec><jats:sec><jats:title>Method<\/jats:title><jats:p>We conducted two complementary studies. The first one aimed at identifying the reasons for confusion in code reviews, its impacts, and the coping strategies developers use to deal with it. Then, we surveyed developers to identify the most frequently experienced reasons for confusion, and conducted a systematic mapping study of solutions proposed for those reasons in the scientific literature.<\/jats:p><\/jats:sec><jats:sec><jats:title>Results<\/jats:title><jats:p>From the first study, we build a framework with 30 reasons for confusion, 14 impacts, and 13 coping strategies. The results of the systematic mapping study shows 38 articles addressing the most frequent reasons for confusion. From those articles, we found 13 different solutions for confusion proposed in the literature, and five impacts were established related to the most frequent reasons for confusion.<\/jats:p><\/jats:sec><jats:sec><jats:title>Conclusions<\/jats:title><jats:p>Based on the solutions identified in the mapping study, or the lack of them, we propose an actionable guideline for developers on how to cope with confusion during code reviews; we also make several suggestions how tool builders can support code reviews. Additionally, we propose a research agenda for researchers studying code reviews.<\/jats:p><\/jats:sec>","DOI":"10.1007\/s10664-020-09909-5","type":"journal-article","created":{"date-parts":[[2021,1,27]],"date-time":"2021-01-27T19:02:36Z","timestamp":1611774156000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":47,"title":["An exploratory study on confusion in code reviews"],"prefix":"10.1007","volume":"26","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-9945-4624","authenticated-orcid":false,"given":"Felipe","family":"Ebert","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Fernando","family":"Castor","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Nicole","family":"Novielli","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Alexander","family":"Serebrenik","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2021,1,27]]},"reference":[{"key":"9909_CR1","doi-asserted-by":"publisher","unstructured":"An L, Khomh F, Mcintosh S, Castelluccio M (2018) Why did this reviewed code crash? An empirical study of mozilla firefox. In: 2018 25th Asia-Pacific software engineering conference (APSEC), pp 396\u2013405. https:\/\/doi.org\/10.1109\/APSEC.2018.00054","DOI":"10.1109\/APSEC.2018.00054"},{"issue":"1","key":"9909_CR2","doi-asserted-by":"publisher","first-page":"32","DOI":"10.1111\/j.1442-9993.2001.01070.pp.x","volume":"26","author":"MJ Anderson","year":"2001","unstructured":"Anderson M J (2001) A new method for non-parametric multivariate analysis of variance. Austral Ecol 26 (1):32\u201346. https:\/\/doi.org\/10.1111\/j.1442-9993.2001.01070.pp.x. https:\/\/onlinelibrary.wiley.com\/doi\/abs\/10.1111\/j.1442-9993.2001.01070.pp.x","journal-title":"Austral Ecol"},{"issue":"10","key":"9909_CR3","doi-asserted-by":"publisher","first-page":"17","DOI":"10.1145\/352183.352194","volume":"43","author":"PG Armour","year":"2000","unstructured":"Armour P G (2000) The five orders of ignorance. Commun ACM 43 (10):17\u201320. https:\/\/doi.org\/10.1145\/352183.352194. http:\/\/doi.acm.org\/10.1145\/352183.352194","journal-title":"Commun ACM"},{"key":"9909_CR4","doi-asserted-by":"crossref","unstructured":"Bacchelli A, Bird C (2013) Expectations, outcomes, and challenges of modern code review. In: ICSE. IEEE, pp 712\u2013721","DOI":"10.1109\/ICSE.2013.6606617"},{"key":"9909_CR5","doi-asserted-by":"publisher","unstructured":"Barik T, Smith J, Lubick K, Holmes E, Feng J, Murphy-Hill E, Parnin C (2017) Do developers read compiler error messages?. In: Proceedings of the 39th international conference on software engineering. ICSE \u201917. IEEE Press, Piscataway, pp 575\u2013585. https:\/\/doi.org\/10.1109\/ICSE.2017.59","DOI":"10.1109\/ICSE.2017.59"},{"key":"9909_CR6","doi-asserted-by":"publisher","unstructured":"Barnett M, Bird C, Brunet J, Lahiri S K (2015) Helping developers help themselves: automatic decomposition of code review changesets. In: 2015 IEEE\/ACM 37th IEEE international conference on software engineering, vol 1, pp 134\u2013144 https:\/\/doi.org\/10.1109\/ICSE.2015.35","DOI":"10.1109\/ICSE.2015.35"},{"key":"9909_CR7","doi-asserted-by":"crossref","unstructured":"Baum T, Kortum F, Schneider K, Brack A, Schauder J (2016) Comparing pre commit reviews and post commit reviews using process simulation. In: 2016 IEEE\/ACM international conference on software and system processes (ICSSP), pp 26\u201335","DOI":"10.1145\/2904354.2904362"},{"key":"9909_CR8","doi-asserted-by":"publisher","unstructured":"Baum T, Schneider K, Bacchelli A (2017) On the optimal order of reading source code changes for review. In: 2017 IEEE international conference on software maintenance and evolution (ICSME), pp 329\u2013340. https:\/\/doi.org\/10.1109\/ICSME.2017.28","DOI":"10.1109\/ICSME.2017.28"},{"issue":"4","key":"9909_CR9","doi-asserted-by":"publisher","first-page":"1762","DOI":"10.1007\/s10664-018-9676-8","volume":"24","author":"T Baum","year":"2019","unstructured":"Baum T, Schneider K, Bacchelli A (2019) Associating working memory capacity and code change ordering with code review performance. Empir Softw Eng 24(4):1762\u20131798. https:\/\/doi.org\/10.1007\/s10664-018-9676-8","journal-title":"Empir Softw Eng"},{"key":"9909_CR10","doi-asserted-by":"crossref","unstructured":"Bavota G, Russo B (2015) Four eyes are better than two: on the impact of code reviews on software quality. In: ICSME, pp 81\u201390","DOI":"10.1109\/ICSM.2015.7332454"},{"key":"9909_CR11","doi-asserted-by":"publisher","unstructured":"Baysal O, Kononenko O, Holmes R, Godfrey MW (2013) The influence of non-technical factors on code review. In: 2013 20th working conference on reverse engineering (WCRE), pp 122\u2013131. https:\/\/doi.org\/10.1109\/WCRE.2013.6671287","DOI":"10.1109\/WCRE.2013.6671287"},{"issue":"3","key":"9909_CR12","doi-asserted-by":"publisher","first-page":"932","DOI":"10.1007\/s10664-015-9366-8","volume":"21","author":"O Baysal","year":"2016","unstructured":"Baysal O, Kononenko O, Holmes R, Godfrey M W (2016) Investigating technical and non-technical factors influencing modern code review. Empir Softw Eng 21(3):932\u2013959. https:\/\/doi.org\/10.1007\/s10664-015-9366-8","journal-title":"Empir Softw Eng"},{"key":"9909_CR13","doi-asserted-by":"publisher","unstructured":"Begel A, Vrzakova H (2018) Eye movements in code review. In: Proceedings of the workshop on eye movements in programming. EMIP \u201918. Association for Computing Machinery, New York. https:\/\/doi.org\/10.1145\/3216723.3216727","DOI":"10.1145\/3216723.3216727"},{"key":"9909_CR14","doi-asserted-by":"crossref","unstructured":"Begel A, Zimmermann T (2014) Analyze this! 145 questions for data scientists in software engineering. In: Proceedings of the 36th international conference on software engineering, ICSE 2014, pp 12\u201323","DOI":"10.1145\/2568225.2568233"},{"issue":"1","key":"9909_CR15","doi-asserted-by":"publisher","first-page":"135","DOI":"10.1109\/2.962984","volume":"34","author":"B Boehm","year":"2001","unstructured":"Boehm B, Basili V R (2001) Top 10 list [software development]. Computer 34(1):135\u2013137","journal-title":"Computer"},{"key":"9909_CR16","doi-asserted-by":"publisher","unstructured":"Bosu A, Carver J C, Hafiz M, Hilley P, Janni D (2014) Identifying the characteristics of vulnerable code changes: an empirical study. In: Proceedings of the 22nd ACM SIGSOFT international symposium on foundations of software engineering. FSE 2014. Association for Computing Machinery, New York, pp 257\u2013268. https:\/\/doi.org\/10.1145\/2635868.2635880","DOI":"10.1145\/2635868.2635880"},{"issue":"1","key":"9909_CR17","doi-asserted-by":"publisher","first-page":"56","DOI":"10.1109\/TSE.2016.2576451","volume":"43","author":"A Bosu","year":"2017","unstructured":"Bosu A, Carver J C, Bird C, Orbeck J, Chockley C (2017) Process aspects and social dynamics of contemporary code review: Insights from open source development and industrial practice at microsoft. IEEE Trans Softw Eng 43(1):56\u201375","journal-title":"IEEE Trans Softw Eng"},{"issue":"2","key":"9909_CR18","doi-asserted-by":"publisher","first-page":"854","DOI":"10.1007\/s10664-018-9642-5","volume":"24","author":"F Calefato","year":"2019","unstructured":"Calefato F, Lanubile F, Novielli N (2019) An empirical assessment of best-answer prediction models in technical q&a sites. Empir Softw Eng 24(2):854\u2013901. https:\/\/doi.org\/10.1007\/s10664-018-9642-5","journal-title":"Empir Softw Eng"},{"issue":"9","key":"9909_CR19","doi-asserted-by":"publisher","first-page":"e2156","DOI":"10.1002\/smr.2156","volume":"31","author":"G Catolino","year":"2019","unstructured":"Catolino G, Ferrucci F (2019) An extensive evaluation of ensemble techniques for software change prediction. J Softw: Evol Process 31(9):e2156. https:\/\/doi.org\/10.1002\/smr.2156. https:\/\/onlinelibrary.wiley.com\/doi\/abs\/10.1002\/smr.2156, https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/smr.2156","journal-title":"J Softw: Evol Process"},{"key":"9909_CR20","doi-asserted-by":"publisher","first-page":"117","DOI":"10.1111\/j.1442-9993.1993.tb00438.x","volume":"18","author":"KR Clarke","year":"1993","unstructured":"Clarke K R (1993) Non-parametric multivariate analysis of changes in community structure. Austral J Ecol 18:117\u2013143","journal-title":"Austral J Ecol"},{"key":"9909_CR21","doi-asserted-by":"publisher","unstructured":"Coelho F, Massoni T, LG Alves E (2019) Refactoring-aware code review: a systematic mapping study. In: 2019 IEEE\/ACM 3rd international workshop on refactoring (IWoR), pp 63\u201366. https:\/\/doi.org\/10.1109\/IWoR.2019.00019","DOI":"10.1109\/IWoR.2019.00019"},{"key":"9909_CR22","volume-title":"Best kept secrets of peer code review","author":"J Cohen","year":"2006","unstructured":"Cohen J, Teleki S, Brown E (2006) Best kept secrets of peer code review. Smart Bear Inc, Somerville"},{"key":"9909_CR23","doi-asserted-by":"publisher","first-page":"106","DOI":"10.1016\/j.actpsy.2014.06.005","volume":"151","author":"S D\u2019Mello","year":"2014","unstructured":"D\u2019Mello S, Graesser A (2014) Confusion and its dynamics during device comprehension with breakdown scenarios. Acta Psychol 151:106\u2013116","journal-title":"Acta Psychol"},{"key":"9909_CR24","doi-asserted-by":"publisher","first-page":"153","DOI":"10.1016\/j.learninstruc.2012.05.003","volume":"29","author":"S D\u2019Mello","year":"2014","unstructured":"D\u2019Mello S, Lehman B, Pekrun R, Graesser A (2014) Confusion can be beneficial for learning. Learn Instruct 29:153\u2013170. https:\/\/doi.org\/10.1016\/j.learninstruc.2012.05.003","journal-title":"Learn Instruct"},{"key":"9909_CR25","doi-asserted-by":"publisher","unstructured":"Easterbrook S, Singer J, Storey MA, Damian D (2008) Selecting empirical methods for software engineering research. In: Shull F, Singer J, Sj\u00f8berg DIK (eds) Guide to advanced empirical software engineering. Springer, London, pp 285\u2013311. https:\/\/doi.org\/10.1007\/978-1-84800-044-5_11","DOI":"10.1007\/978-1-84800-044-5_11"},{"key":"9909_CR26","doi-asserted-by":"crossref","unstructured":"Ebert F, Castor F, Novielli N, Serebrenik A (2017) Confusion detection in code reviews. In: ICSME, pp 549\u2013553","DOI":"10.1109\/ICSME.2017.40"},{"key":"9909_CR27","doi-asserted-by":"crossref","unstructured":"Ebert F, Castor F, Novielli N, Serebrenik A (2018) Communicative intention in code review questions. In: ICSME","DOI":"10.1109\/ICSME.2018.00061"},{"key":"9909_CR28","doi-asserted-by":"publisher","unstructured":"Ebert F, Castor F, Novielli N, Serebrenik A (2019) Confusion in code reviews: reasons, impacts, and coping strategies. In: 2019 IEEE 26th international conference on software analysis, evolution and reengineering (SANER), pp 49\u201360. https:\/\/doi.org\/10.1109\/SANER.2019.8668024","DOI":"10.1109\/SANER.2019.8668024"},{"issue":"3","key":"9909_CR29","doi-asserted-by":"publisher","first-page":"182","DOI":"10.1147\/sj.153.0182","volume":"15","author":"ME Fagan","year":"1976","unstructured":"Fagan M E (1976) Design and code inspections to reduce errors in program development. IBM Syst J 15(3):182\u2013211. https:\/\/doi.org\/10.1147\/sj.153.0182","journal-title":"IBM Syst J"},{"issue":"1","key":"9909_CR30","doi-asserted-by":"publisher","first-page":"35","DOI":"10.14232\/actacyb.22.1.2015.4","volume":"22","author":"C Farag\u00f3","year":"2015","unstructured":"Farag\u00f3 C (2015) Variance of source code quality change caused by version control operations. Acta Cybern 22(1):35\u201356. https:\/\/doi.org\/10.14232\/actacyb.22.1.2015.4","journal-title":"Acta Cybern"},{"issue":"3","key":"9909_CR31","doi-asserted-by":"publisher","first-page":"341","DOI":"10.1177\/1468794113481790","volume":"14","author":"D Finfgeld-Connett","year":"2014","unstructured":"Finfgeld-Connett D (2014) Use of content analysis to conduct knowledge-building and theory-generating qualitative systematic reviews. Qual Res 14(3):341\u2013352. https:\/\/doi.org\/10.1177\/1468794113481790","journal-title":"Qual Res"},{"key":"9909_CR32","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9780511518201","volume-title":"Constructing questions for interviews and questionnaires: theory and practice in social research","author":"WH Foddy","year":"1993","unstructured":"Foddy W H (1993) Constructing questions for interviews and questionnaires: theory and practice in social research. Cambridge University Press, Cambridge"},{"key":"9909_CR33","doi-asserted-by":"publisher","unstructured":"Gerede \u00c7E, Mazan Z (2018) Will it pass? Predicting the outcome of a source code review, cited By 0, vol 26, pp 1343\u2013135. https:\/\/doi.org\/10.3906\/elk-1707-173. https:\/\/www.scopus.com\/inward\/record.uri?eid=2-s2.0-85048211876&doi=10.39066","DOI":"10.3906\/elk-1707-173"},{"key":"9909_CR34","doi-asserted-by":"publisher","unstructured":"German DM, Robles G, Poo-Caama\u00f1o G, Yang X, Iida H, Inoue K (2018) \u201cWas my contribution fairly reviewed?\u201d: a framework to study the perception of fairness in modern code reviews. In: Proceedings of the 40th international conference on software engineering. ICSE \u201918. ACM, New York, pp 523\u2013534. https:\/\/doi.org\/10.1145\/3180155.3180217. http:\/\/doi.acm.org\/10.1145\/3180155.3180217","DOI":"10.1145\/3180155.3180217"},{"key":"9909_CR35","volume-title":"The discovery of grounded theory: strategies for qualitative research","author":"BG Glaser","year":"1967","unstructured":"Glaser B G, Strauss A L (1967) The discovery of grounded theory: strategies for qualitative research. Aldine de Gruyter, New York"},{"key":"9909_CR36","doi-asserted-by":"crossref","unstructured":"Gopstein D, Iannacone J, Yan Y, DeLong L, Zhuang Y, Yeh M K C, Cappos J (2017) Understanding misunderstandings in source code. In: ESEC\/FSE. ACM, New York, pp 129\u2013139","DOI":"10.1145\/3106237.3106264"},{"key":"9909_CR37","doi-asserted-by":"publisher","unstructured":"Gousios G, Pinzger M, Deursen AV (2014) An exploratory study of the pull-based software development model. In: Proceedings of the 36th international conference on software engineering. ICSE 2014. ACM, New York, pp 345\u2013355. https:\/\/doi.org\/10.1145\/2568225.2568260. http:\/\/doi.acm.org\/10.1145\/2568225.2568260","DOI":"10.1145\/2568225.2568260"},{"key":"9909_CR38","unstructured":"Greiler M (2016) On to code review: lessons learned @ microsoft. https:\/\/pt.slideshare.net\/mgreiler\/on-to-code-review-lessons-learned-at-microsoft, keynote for QUATIC 2016\u2014the 10th international conference on the quality of information and communication technology"},{"key":"9909_CR39","volume-title":"Survey methodology, 2nd edn","author":"RM Groves","year":"2009","unstructured":"Groves RM, Fowler FJ, Couper MP, Lepkowski JM, Singer E, Tourangeau R (2009) Survey methodology, 2nd edn. Wiley, New York"},{"key":"9909_CR40","doi-asserted-by":"publisher","unstructured":"Guo B, Song M (2017) Interactively decomposing composite changes to support code review and regression testing. In: 2017 IEEE 41st annual computer software and applications conference (COMPSAC), vol 1, pp 118\u201312. https:\/\/doi.org\/10.1109\/COMPSAC.2017.1537","DOI":"10.1109\/COMPSAC.2017.153"},{"issue":"2","key":"9909_CR41","doi-asserted-by":"publisher","first-page":"416","DOI":"10.1007\/s11390-019-1917-9","volume":"34","author":"B Guo","year":"2019","unstructured":"Guo B, Kwon Y W, Song M (2019) Decomposing composite changes for code review and regression test selection in evolving software. J Comput Sci Technol 34(2):416\u2013436. https:\/\/doi.org\/10.1007\/s11390-019-1917-9","journal-title":"J Comput Sci Technol"},{"key":"9909_CR42","doi-asserted-by":"crossref","unstructured":"Hamasaki K, Kula RG, Yoshida N, Cruz AEC, Fujiwara K, Iida H (2013) Who does what during a code review? Datasets of oss peer review repositories. In: MSR. IEEE, pp 49\u201352","DOI":"10.1109\/MSR.2013.6624003"},{"key":"9909_CR43","doi-asserted-by":"crossref","unstructured":"Hellendoorn VJ, Devanbu PT, Bacchelli A (2015) Will they like this? Evaluating code contributions with language models. In: 2015 IEEE\/ACM 12th working conference on mining software repositories, pp 157\u2013167","DOI":"10.1109\/MSR.2015.22"},{"key":"9909_CR44","doi-asserted-by":"crossref","unstructured":"Hentschel M, H\u00e4hnle R, Bubel R (2016) Can formal methods improve the efficiency of code reviews?. In: IFM. Springer, pp 3\u201319","DOI":"10.1007\/978-3-319-33693-0_1"},{"key":"9909_CR45","doi-asserted-by":"publisher","unstructured":"Huang Y, Jia N, Chen X, Hong K, Zheng Z (2018a) Salient-class location: help developers understand code change in code review. In: Proceedings of the 2018 26th ACM joint meeting on european software engineering conference and symposium on the foundations of software engineering. ESEC\/FSE 2018. ACM, New York, pp 770\u2013774. https:\/\/doi.org\/10.1145\/3236024.3264841. http:\/\/doi.acm.org\/10.1145\/3236024.3264841","DOI":"10.1145\/3236024.3264841"},{"key":"9909_CR46","doi-asserted-by":"crossref","unstructured":"Huang Y, Jia N, Zhou Q, Chen X, Yingfei X, Luo X (2018b) Guiding developers to make informative commenting decisions in source code. In: 2018 IEEE\/ACM 40th international conference on software engineering: companion (ICSE-Companion), pp 260\u2013261","DOI":"10.1145\/3183440.3194960"},{"key":"9909_CR47","doi-asserted-by":"publisher","unstructured":"Izquierdo-Cortazar D, Sekitoleko N, Gonzalez-Barahona JM, Kurth L (2017) Using metrics to track code review performance. In: Proceedings of the 21st international conference on evaluation and assessment in software engineering. EASE\u201917. ACM, New York, pp 214\u2013223. https:\/\/doi.org\/10.1145\/3084226.3084247. http:\/\/doi.acm.org\/10.1145\/3084226.3084247","DOI":"10.1145\/3084226.3084247"},{"key":"9909_CR48","doi-asserted-by":"crossref","unstructured":"Jean PA, Harispe S, Ranwez S, Bellot P, Montmain J (2016) Uncertainty detection in natural language: a probabilistic model. In: International conference on web intelligence, mining and semantics. ACM, New York, pp 10:1\u201310:10","DOI":"10.1145\/2912845.2912873"},{"issue":"8","key":"9909_CR49","doi-asserted-by":"publisher","first-page":"660","DOI":"10.1080\/0163853X.2012.722851","volume":"49","author":"ME Jordan","year":"2012","unstructured":"Jordan M E, Schallert D L, Park Y, Lee S, hui Vanessa Chiang Y, Cheng A C J, Song K, Chu H N R, Kim T, Lee H (2012) Expressing uncertainty in computer-mediated discourse: language as a marker of intellectual work. Discourse Process 49(8):660\u2013692","journal-title":"Discourse Process"},{"key":"9909_CR50","unstructured":"Kitchenham B, Charters S (2007) Guidelines for performing systematic literature reviews in software engineering. Tech. Rep. EBSE 2007-001, Keele University and Durham University Joint Report"},{"key":"9909_CR51","doi-asserted-by":"crossref","unstructured":"Kitchenham B, Pfleeger S L (2008) Personal opinion surveys. In: Shull F, Singer J, Sjoberg D I K (eds) Guide to advanced empirical software engineering, pp 63\u201392","DOI":"10.1007\/978-1-84800-044-5_3"},{"key":"9909_CR52","doi-asserted-by":"publisher","unstructured":"Kononenko O, Baysal O, Guerrouj L, Cao Y, Godfrey MW (2015) Investigating code review quality: do people and participation matter?. In: 2015 IEEE international conference on software maintenance and evolution (ICSME), pp 111\u2013120. https:\/\/doi.org\/10.1109\/ICSM.2015.7332457","DOI":"10.1109\/ICSM.2015.7332457"},{"key":"9909_CR53","doi-asserted-by":"publisher","unstructured":"Kononenko O, Rose T, Baysal O, Godfrey M, Theisen D, de Water B (2018) Studying pull request merges: a case study of shopify\u2019s active merchant. In: Proceedings of the 40th international conference on software engineering: software engineering in practice. ICSE-SEIP \u201918. ACM, New York, pp 124\u2013133. https:\/\/doi.org\/10.1145\/3183519.3183542. http:\/\/doi.acm.org\/10.1145\/3183519.3183542","DOI":"10.1145\/3183519.3183542"},{"key":"9909_CR54","doi-asserted-by":"publisher","unstructured":"Konopka M, Navrat P (2015) Untangling development tasks with software developer\u2019s activity. In: 2015 IEEE\/ACM 2nd international workshop on context for software development. https:\/\/doi.org\/10.1109\/CSD.2015.10, pp 13\u201314","DOI":"10.1109\/CSD.2015.10"},{"key":"9909_CR55","unstructured":"Kovalenko V, Tintarev N, Pasynkov E, Bird C, Bacchelli A (2018) Does reviewer recommendation help developers? IEEE Trans Softw Eng 1\u20131"},{"key":"9909_CR56","doi-asserted-by":"crossref","unstructured":"LaToza T D, Venolia G, DeLine R (2006) Maintaining mental models: a study of developer work habits. In: ICSE. ACM, New York, pp 492\u2013501","DOI":"10.1145\/1134285.1134355"},{"key":"9909_CR57","doi-asserted-by":"crossref","unstructured":"Lee A, Carver J C, Bosu A (2017) Understanding the impressions, motivations, and barriers of one time code contributors to FLOSS projects: a survey. In: Uchitel S, Orso A, Robillard M P (eds) Proceedings of the 39th international conference on software engineering, ICSE 2017, Buenos Aires, Argentina, May 20\u201328, 2017. IEEE\/ACM, pp 187\u2013197","DOI":"10.1109\/ICSE.2017.25"},{"key":"9909_CR58","unstructured":"Lenberg P, Feldt R, Tengberg LGW, Tidefors I, Graziotin D (2017) Behavioral software engineering\u2014guidelines for qualitative studies. CoRR arXiv:1712.08341"},{"key":"9909_CR59","unstructured":"Luna Freire VdC, Brunet J, de Figueiredo JCA (2018) Automatic decomposition of java open source pull requests: a replication study. In: Tjoa A M, Bellatreche L, Biffl S, van Leeuwen J, Wiedermann J (eds) SOFSEM 2018: theory and practice of computer science. Springer International Publishing, Cham, pp 255\u2013268"},{"issue":"4","key":"9909_CR60","doi-asserted-by":"publisher","first-page":"34","DOI":"10.1109\/MS.2017.265100500","volume":"35","author":"L MacLeod","year":"2018","unstructured":"MacLeod L, Greiler M, Storey MA, Bird C, Czerwonka J (2018) Code reviewing in the trenches: challenges and best practices. IEEE Softw 35 (4):34\u201342. https:\/\/doi.org\/10.1109\/MS.2017.265100500","journal-title":"IEEE Softw"},{"issue":"3","key":"9909_CR61","first-page":"430","volume":"35","author":"MV M\u00e4ntyl\u00e4","year":"2009","unstructured":"M\u00e4ntyl\u00e4 M V, Lassenius C (2009) What types of defects are really discovered in code reviews? TSE 35(3):430\u2013448","journal-title":"TSE"},{"key":"9909_CR62","volume-title":"Agile software development: principles, patterns, and practices","author":"RC Martin","year":"2003","unstructured":"Martin R C (2003) Agile software development: principles, patterns, and practices. Prentice Hall PTR, Upper Saddle River"},{"issue":"1","key":"9909_CR63","doi-asserted-by":"publisher","first-page":"290","DOI":"10.1890\/0012-9658(2001)082[0290:FMMTCD]2.0.CO;2","volume":"82","author":"BH McArdle","year":"2001","unstructured":"McArdle BH, Anderson MJ (2001) Fitting multivariate models to community data: a comment on distance-based redundancy analysis. Ecology 82(1):290\u2013297. https:\/\/doi.org\/10.1890\/0012-9658(2001)082[0290:FMMTCD]2.0.CO;2","journal-title":"Ecology"},{"key":"9909_CR64","unstructured":"McIntosh S, Kamei Y, Adams B, Hassan A E (2015) An empirical study of the impact of modern code review practices on software quality. In: ESE, pp 1\u201344"},{"key":"9909_CR65","doi-asserted-by":"publisher","unstructured":"Mishra R, Sureka A (2014) Mining peer code review system for computing effort and contribution metrics for patch reviewers. In: 2014 IEEE 4th workshop on mining unstructured data, pp 11\u201315. https:\/\/doi.org\/10.1109\/MUD.2014.11","DOI":"10.1109\/MUD.2014.11"},{"key":"9909_CR66","doi-asserted-by":"publisher","unstructured":"Mohamed A, Zhang L, Jiang J, Ktob A (2018) Predicting which pull requests will get reopened in github. In: 2018 25th Asia-Pacific software engineering conference (APSEC), pp 375\u2013385, pp 375\u2013385. https:\/\/doi.org\/10.1109\/APSEC.2018.00052","DOI":"10.1109\/APSEC.2018.00052"},{"key":"9909_CR67","doi-asserted-by":"publisher","unstructured":"Morales R, McIntosh S, Khomh F (2015) Do code review practices impact design quality? A case study of the qt, vtk, and itk projects. In: 2015 IEEE 22nd international conference on software analysis, evolution, and reengineering (SANER), pp 171\u2013180. https:\/\/doi.org\/10.1109\/SANER.2015.7081827","DOI":"10.1109\/SANER.2015.7081827"},{"key":"9909_CR68","doi-asserted-by":"crossref","unstructured":"Mukadam M, Bird C, Rigby PC (2013) Gerrit software code review data from android. In: MSR. IEEE, pp 45\u201348","DOI":"10.1109\/MSR.2013.6624002"},{"key":"9909_CR69","doi-asserted-by":"publisher","unstructured":"Norikane T, Ihara A, Matsumoto K (2017) Which review feedback did long-term contributors get on oss projects?. In: 2017 IEEE 24th international conference on software analysis, evolution and reengineering (SANER), pp 571\u2013572. https:\/\/doi.org\/10.1109\/SANER.2017.7884682","DOI":"10.1109\/SANER.2017.7884682"},{"key":"9909_CR70","doi-asserted-by":"crossref","unstructured":"Norikane T, Ihara A, Matsumoto K (2018) Do review feedbacks influence to a contributor\u2019s time spent on oss projects?. In: 2018 IEEE international conference on big data, cloud computing, data science engineering (BCD), pp 109\u2013113","DOI":"10.1109\/BCD2018.2018.00028"},{"key":"9909_CR71","unstructured":"Paix\u00e3o M, Maia PH (2019) Rebasing considered harmful: a large-scale investigation in modern code review. In: 2019 IEEE 19th international working conference on source code analysis and manipulation (SCAM)"},{"issue":"5","key":"9909_CR72","doi-asserted-by":"publisher","first-page":"462","DOI":"10.1109\/TSE.2014.2372760","volume":"41","author":"F Palomba","year":"2015","unstructured":"Palomba F, Bavota G, Di Penta M, Oliveto R, Poshyvanyk D, De Lucia A (2015) Mining version histories for detecting code smells. IEEE Trans Softw Eng 41(5):462\u2013489. https:\/\/doi.org\/10.1109\/TSE.2014.2372760","journal-title":"IEEE Trans Softw Eng"},{"key":"9909_CR73","doi-asserted-by":"publisher","unstructured":"Palomba F, Tamburri DA, Serebrenik A, Zaidman A, Fontana FA, Oliveto R (2018) How do community smells influence code smells?. In: Proceedings of the 40th international conference on software engineering: companion proceedings. ICSE \u201918. ACM, New York, pp 240\u2013241. https:\/\/doi.org\/10.1145\/3183440.3194950. http:\/\/doi.acm.org\/10.1145\/3183440.3194950","DOI":"10.1145\/3183440.3194950"},{"key":"9909_CR74","doi-asserted-by":"publisher","unstructured":"Pangsakulyanont T, Thongtanunam P, Port D, Iida H (2014) Assessing MCR discussion usefulness using semantic similarity. In: 2014 6th International workshop on empirical software engineering in practice (IWESEP), pp 49\u201354. https:\/\/doi.org\/10.1109\/IWESEP.2014.11","DOI":"10.1109\/IWESEP.2014.11"},{"key":"9909_CR75","doi-asserted-by":"crossref","unstructured":"Pascarella L, Spadini D, Palomba F, Bruntik M, Bacchelli A (2018) Information needs in contemporary code review. In: Proceedings of the ACM conference on computer supported cooperative work, CSCW \u201918","DOI":"10.1145\/3274404"},{"key":"9909_CR76","doi-asserted-by":"publisher","unstructured":"Pascarella L, Palomba F, Bacchelli A (2019) Fine-grained just-in-time defect prediction, vol 150, pp 22\u201336. https:\/\/doi.org\/10.1016\/j.jss.2018.12.001. http:\/\/www.sciencedirect.com\/science\/article\/pii\/S0164121218302656","DOI":"10.1016\/j.jss.2018.12.001"},{"key":"9909_CR77","doi-asserted-by":"crossref","unstructured":"Petersen K, Feldt R, Mujtaba S, Mattsson M (2008) Systematic mapping studies in software engineering. In: Proceedings of the 12th international conference on evaluation and assessment in software engineering. EASE\u201908. BCS Learning & Development Ltd., Swindon, pp 68\u201377. http:\/\/dl.acm.org\/citation.cfm?id=2227115.2227123","DOI":"10.14236\/ewic\/EASE2008.8"},{"key":"9909_CR78","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/j.infsof.2015.03.007","volume":"64","author":"K Petersen","year":"2015","unstructured":"Petersen K, Vakkalanka S, Kuzniarz L (2015) Guidelines for conducting systematic mapping studies in software engineering: an update. Inf Softw Technol 64:1\u201318. https:\/\/doi.org\/10.1016\/j.infsof.2015.03.007. http:\/\/www.sciencedirect.com\/science\/article\/pii\/S0950584915000646","journal-title":"Inf Softw Technol"},{"key":"9909_CR79","doi-asserted-by":"crossref","unstructured":"Qiu H S, Nolte A, Brown A, Serebrenik A, Vasilescu B (2019) Going farther together: the impact of social capital on sustained participation in open source. In: ICSE. IEEE","DOI":"10.1109\/ICSE.2019.00078"},{"key":"9909_CR80","unstructured":"Ram A, Ashok Sawant A, Marco C, Bacchelli A (2018). In: 26th ACM Joint European software engineering conference and symposium on the foundations of software engineering, ESEC\/FSE \u201918"},{"key":"9909_CR81","unstructured":"Rigby PC (2011) Understanding open source software peer review: review processes, parameters and statistical models, and underlying behaviours and mechanisms. PhD thesis, University of Victoria, Victoria, B.C., Canada, Canada. http:\/\/hdl.handle.net\/1828\/3258"},{"key":"9909_CR82","doi-asserted-by":"publisher","unstructured":"Rigby P C, Bird C (2013) Convergent contemporary software peer review practices. In: Proceedings of the 2013 9th joint meeting on foundations of software engineering. ESEC\/FSE, vol 2013. ACM, New York, pp 202\u2013212. https:\/\/doi.org\/10.1145\/2491411.2491444. http:\/\/doi.acm.org\/10.1145\/2491411.2491444","DOI":"10.1145\/2491411.2491444"},{"key":"9909_CR83","unstructured":"Rigby P C, Storey M D (2011) Understanding broadcast based peer review on open source software projects. In: Taylor R N, Gall H C, Medvidovic N (eds) 2011 33rd International conference on software engineering (ICSE). ACM, pp 541\u2013550"},{"key":"9909_CR84","doi-asserted-by":"publisher","unstructured":"Rigby PC, German DM, Storey MA (2008) Open source software peer review practices: a case study of the apache server. In: Proceedings of the 30th international conference on software engineering. ICSE \u201908. Association for Computing Machinery, New York, pp 541\u2013550. https:\/\/doi.org\/10.1145\/1368088.1368162","DOI":"10.1145\/1368088.1368162"},{"key":"9909_CR85","doi-asserted-by":"publisher","unstructured":"Sadowski C, S\u00f6derberg E, Church L, Sipko M, Bacchelli A (2018) Modern code review: a case study at Google. In: Proceedings of the 40th international conference on software engineering: software engineering in practice. ICSE-SEIP \u201918. ACM, New York, pp 181\u2013190. https:\/\/doi.org\/10.1145\/3183519.3183525. http:\/\/doi.acm.org\/10.1145\/3183519.3183525","DOI":"10.1145\/3183519.3183525"},{"key":"9909_CR86","unstructured":"Schettino V J, Ara\u00fajo M A P, David J M N, Braga R M M (2019) Towards code reviewer recommendation: a systematic review and mapping of the literature. In: Proceedings of the XXII Iberoamerican conference on software engineering, CIbSE 2019, La Habana, Cuba, April 22\u201326, 2019, pp 558\u2013571"},{"issue":"3","key":"9909_CR87","doi-asserted-by":"publisher","first-page":"507","DOI":"10.2307\/2529204","volume":"30","author":"AJ Scott","year":"1974","unstructured":"Scott AJ, Knott M (1974) A cluster analysis method for grouping means in the analysis of variance. Biometrics 30(3):507\u2013512. http:\/\/www.jstor.org\/stable\/2529204","journal-title":"Biometrics"},{"issue":"12","key":"9909_CR88","doi-asserted-by":"publisher","first-page":"1171","DOI":"10.1109\/TSE.2002.1158289","volume":"28","author":"J Singer","year":"2002","unstructured":"Singer J, Vinson N G (2002) Ethical issues in empirical studies of software engineering. IEEE Trans Softw Eng 28(12):1171\u20131180. https:\/\/doi.org\/10.1109\/TSE.2002.1158289","journal-title":"IEEE Trans Softw Eng"},{"issue":"5","key":"9909_CR89","doi-asserted-by":"publisher","first-page":"797","DOI":"10.1037\/0022-3514.69.5.797","volume":"69","author":"CM Steele","year":"1995","unstructured":"Steele C M, Aronson J (1995) Stereotype threat and the intellectual test performance of African Americans. J Pers Social Psychol 69(5):797\u2013811","journal-title":"J Pers Social Psychol"},{"key":"9909_CR90","doi-asserted-by":"publisher","unstructured":"Stol KJ, Ralph P, Fitzgerald B (2016) Grounded theory in software engineering research: a critical review and guidelines. In: ICSE, pp 120\u2013131. https:\/\/doi.org\/10.1145\/2884781.2884833","DOI":"10.1145\/2884781.2884833"},{"key":"9909_CR91","doi-asserted-by":"crossref","unstructured":"Sutherland A, Venolia G (2009) Can peer code reviews be exploited for later information needs?. In: ICSE-Companion, pp 259\u2013262","DOI":"10.1109\/ICSE-COMPANION.2009.5070996"},{"issue":"1","key":"9909_CR92","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1109\/TSE.2016.2584050","volume":"43","author":"C Tantithamthavorn","year":"2017","unstructured":"Tantithamthavorn C, McIntosh S, Hassan A E, Matsumoto K (2017) An empirical comparison of model validation techniques for defect prediction models. IEEE Trans Softw Eng (TSE) 43(1):1\u201318","journal-title":"IEEE Trans Softw Eng (TSE)"},{"key":"9909_CR93","doi-asserted-by":"publisher","unstructured":"Tao Y, Kim S (2015) Partitioning composite code changes to facilitate code review. In: 2015 IEEE\/ACM 12th working conference on mining software repositories, pp 180\u2013190. https:\/\/doi.org\/10.1109\/MSR.2015.24","DOI":"10.1109\/MSR.2015.24"},{"key":"9909_CR94","doi-asserted-by":"publisher","unstructured":"Tao Y, Dang Y, Xie T, Zhang D, Kim S (2012) How do software engineers understand code changes?: an exploratory study in industry. In: Proceedings of the ACM SIGSOFT 20th international symposium on the foundations of software engineering. FSE \u201912. ACM, New York, pp 51:1\u201351:11. https:\/\/doi.org\/10.1145\/2393596.2393656. http:\/\/doi.acm.org\/10.1145\/2393596.2393656","DOI":"10.1145\/2393596.2393656"},{"key":"9909_CR95","doi-asserted-by":"publisher","unstructured":"Thompson C, Wagner D (2017) A large-scale study of modern code review and security in open source projects. In: Proceedings of the 13th international conference on predictive models and data analytics in software engineering. ACM, New York, pp 83\u201392. PROMISE. https:\/\/doi.org\/10.1145\/3127005.3127014. http:\/\/doi.acm.org\/10.1145\/3127005.3127014","DOI":"10.1145\/3127005.3127014"},{"key":"9909_CR96","doi-asserted-by":"crossref","unstructured":"Thongtanunam P, Yang X, Yoshida N, Kula RG, Cruz AEC, Fujiwara K, Iida H (2014) Reda: a web-based visualization tool for analyzing modern code review dataset. In: ICSME, pp 605\u2013608","DOI":"10.1109\/ICSME.2014.106"},{"key":"9909_CR97","first-page":"637","volume":"15","author":"WF Tichy","year":"1985","unstructured":"Tichy W F (1985) Rcs\u2014a system for version control. Softw: Pract Exp 15:637\u2013654","journal-title":"Softw: Pract Exp"},{"key":"9909_CR98","doi-asserted-by":"publisher","unstructured":"Uwano H, Nakamura M, Monden A, Matsumoto K (2006) Analyzing individual performance of source code review using reviewers\u2019 eye movement. In: Proceedings of the 2006 symposium on eye tracking research & applications. ETRA \u201906. ACM, New York, pp 133\u2013140. https:\/\/doi.org\/10.1145\/1117309.1117357. http:\/\/doi.acm.org\/10.1145\/1117309.1117357","DOI":"10.1145\/1117309.1117357"},{"key":"9909_CR99","doi-asserted-by":"publisher","unstructured":"Vasilescu B, Filkov V, Serebrenik A (2015a) Perceptions of diversity on git hub: a user survey. In: 2015 IEEE\/ACM 8th international workshop on cooperative and human aspects of software engineering, pp 50\u201356. https:\/\/doi.org\/10.1109\/CHASE.2015.14","DOI":"10.1109\/CHASE.2015.14"},{"key":"9909_CR100","doi-asserted-by":"publisher","unstructured":"Vasilescu B, Posnett D, Ray B, van den Brand MGJ, Serebrenik A, Devanbu P, Filkov V (2015b) Gender and tenure diversity in github teams. In: Proceedings of the 33rd annual ACM conference on human factors in computing systems. CHI \u201915. ACM, New York, pp 3789\u20133798. https:\/\/doi.org\/10.1145\/2702123.2702549. http:\/\/doi.acm.org\/10.1145\/2702123.2702549","DOI":"10.1145\/2702123.2702549"},{"issue":"C","key":"9909_CR101","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/j.infsof.2015.06.002","volume":"67","author":"J Wang","year":"2015","unstructured":"Wang J, Shih P C, Wu Y, Carroll J M (2015) Comparative case studies of open source software peer review practices. Inf Softw Technol 67(C):1\u201312. https:\/\/doi.org\/10.1016\/j.infsof.2015.06.002","journal-title":"Inf Softw Technol"},{"key":"9909_CR102","doi-asserted-by":"publisher","unstructured":"Wang C, Xie X, Liang P, Xuan J (2017) Multi-perspective visualization to assist code change review. In: 2017 24th Asia-Pacific software engineering conference (APSEC), pp 564\u2013569. https:\/\/doi.org\/10.1109\/APSEC.2017.66","DOI":"10.1109\/APSEC.2017.66"},{"key":"9909_CR103","doi-asserted-by":"crossref","unstructured":"van Wesel P, Lin B, Robles G, Serebrenik A (2017) Reviewing career paths of the openstack developers. In: ICSME. IEEE Computer Society, pp 544\u2013548","DOI":"10.1109\/ICSME.2017.25"},{"key":"9909_CR104","volume-title":"Peer reviews in software: a practical guide","author":"KE Wiegers","year":"2002","unstructured":"Wiegers K E (2002) Peer reviews in software: a practical guide. Addison-Wesley Longman Publishing Co., Inc., Boston"},{"key":"9909_CR105","doi-asserted-by":"crossref","unstructured":"Yang D, Wen M, Howley I, Kraut R, Rose C (2015) Exploring the effect of confusion in discussion forums of massive open online courses. In: ACM conference on learning @ scale. ACM, pp 121\u2013130","DOI":"10.1145\/2724660.2724677"},{"key":"9909_CR106","doi-asserted-by":"crossref","unstructured":"Yang L, Li X, Yu Y (2017) Vuldigger: a just-in-time and cost-aware tool for digging vulnerability-contributing changes. In: GLOBECOM 2017\u20142017 IEEE global communications conference, pp 1\u20137","DOI":"10.1109\/GLOCOM.2017.8254428"},{"key":"9909_CR107","doi-asserted-by":"crossref","unstructured":"Yang X, Kula RG, Yoshida N, Iida H (2016) Mining the modern code review repositories: a dataset of people, process and product. In: MSR. ACM, pp 460\u2013463","DOI":"10.1145\/2901739.2903504"},{"key":"9909_CR108","doi-asserted-by":"publisher","unstructured":"Zanaty FE, Hirao T, McIntosh S, Ihara A, Matsumoto K (2018) An empirical study of design discussions in code review. In: Proceedings of the 12th ACM\/IEEE international symposium on empirical software engineering and measurement. ESEM \u201918. Association for Computing Machinery, New York. https:\/\/doi.org\/10.1145\/3239235.3239525","DOI":"10.1145\/3239235.3239525"},{"key":"9909_CR109","doi-asserted-by":"crossref","unstructured":"Zhang F, Khomh F, Zou Y, Hassan AE (2012) An empirical study on factors impacting bug fixing time. In: 2012 19th Working conference on reverse engineering, pp 225\u2013234","DOI":"10.1109\/WCRE.2012.32"},{"key":"9909_CR110","doi-asserted-by":"crossref","unstructured":"Zhang T, Song M, Pinedo J, Kim M (2015) Interactive code review for systematic changes. In: Proceedings of the 37th international conference on software engineering, vol 1. ICSE \u201915. IEEE Press, Piscataway, pp 111\u2013122. http:\/\/dl.acm.org\/citation.cfm?id=2818754.2818771","DOI":"10.1109\/ICSE.2015.33"},{"key":"9909_CR111","doi-asserted-by":"publisher","unstructured":"Zimmermann T (2016). In: Menzies T, Williams L, Zimmermann T (eds) Card-sorting: from text to themes. Morgan Kaufmann, Boston, pp 137\u2013141. https:\/\/doi.org\/10.1016\/B978-0-12-804206-9.00027-1. https:\/\/www.sciencedirect.com\/science\/article\/pii\/B9780128042069000271","DOI":"10.1016\/B978-0-12-804206-9.00027-1"}],"container-title":["Empirical Software Engineering"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s10664-020-09909-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/article\/10.1007\/s10664-020-09909-5\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s10664-020-09909-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,12,13]],"date-time":"2022-12-13T16:38:47Z","timestamp":1670949527000},"score":1,"resource":{"primary":{"URL":"http:\/\/link.springer.com\/10.1007\/s10664-020-09909-5"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,1]]},"references-count":111,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2021,1]]}},"alternative-id":["9909"],"URL":"https:\/\/doi.org\/10.1007\/s10664-020-09909-5","relation":{},"ISSN":["1382-3256","1573-7616"],"issn-type":[{"value":"1382-3256","type":"print"},{"value":"1573-7616","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,1]]},"assertion":[{"value":"23 October 2020","order":1,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"27 January 2021","order":2,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}],"article-number":"12"}}