{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,12]],"date-time":"2026-09-12T02:00:26Z","timestamp":1789178426134,"version":"build-2803163510"},"reference-count":69,"publisher":"Springer Science and Business Media LLC","issue":"4","license":[{"start":{"date-parts":[[2022,5,7]],"date-time":"2022-05-07T00:00:00Z","timestamp":1651881600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2022,5,7]],"date-time":"2022-05-07T00:00:00Z","timestamp":1651881600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100006447","name":"University of Zurich","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100006447","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Empir Software Eng"],"published-print":{"date-parts":[[2022,7]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>\n                    Code review is an important process in software engineering \u2013 yet, a very expensive one. Therefore, understanding code review and how to improve reviewers\u2019 performance is paramount. In the study presented in this work, we test whether providing developers with explicit reviewing strategies improves their review effectiveness and efficiency. Moreover, we verify if review guidance lowers developers\u2019 cognitive load. We employ an experimental design where professional developers have to perform three code review tasks. Participants are assigned to one of three treatments: ad hoc reviewing, checklist, and guided checklist. The guided checklist was developed to provide an explicit reviewing strategy to developers. While the checklist is a simple form of signaling (a method to reduce cognitive load), the guided checklist incorporates further methods to lower cognitive demands of the task such as segmenting and weeding. The majority of the participants are\n                    <jats:italic>novice reviewers<\/jats:italic>\n                    with low or no code review experience. Our results indicate that the guided checklist is a more effective aid for a simple review,while the checklist supports reviewers\u2019 efficiency and effectiveness in a complex task. However, we did not identify a strong relationship between the guidance provided and code review performance. The checklist has the potential to lower developers\u2019 cognitive load, but higher cognitive load led to better performance possibly due to the generally low effectiveness and efficiency of the study participants. Data and materials:\n                    <jats:ext-link xmlns:xlink=\"http:\/\/www.w3.org\/1999\/xlink\" ext-link-type=\"doi\" xlink:href=\"https:\/\/doi.org\/10.5281\/zenodo.5653341\">10.5281\/zenodo.5653341<\/jats:ext-link>\n                    . Registered report:\n                    <jats:ext-link xmlns:xlink=\"http:\/\/www.w3.org\/1999\/xlink\" ext-link-type=\"doi\" xlink:href=\"https:\/\/doi.org\/10.17605\/OSF.IO\/5FPTJ\">10.17605\/OSF.IO\/5FPTJ<\/jats:ext-link>\n                    .\n                  <\/jats:p>","DOI":"10.1007\/s10664-022-10123-8","type":"journal-article","created":{"date-parts":[[2022,5,7]],"date-time":"2022-05-07T04:04:05Z","timestamp":1651896245000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":16,"title":["Do explicit review strategies improve code review performance? Towards understanding the role of cognitive load"],"prefix":"10.1007","volume":"27","author":[{"given":"Pavl\u00edna Wurzel","family":"Gon\u00e7alves","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6897-7665","authenticated-orcid":false,"given":"Enrico","family":"Fregnan","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tobias","family":"Baum","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kurt","family":"Schneider","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Alberto","family":"Bacchelli","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2022,5,7]]},"reference":[{"key":"10123_CR1","doi-asserted-by":"crossref","unstructured":"Abdelnabi Z, Cantone G, Ciolkowski M, Rombach D (2004) Comparing code reading techniques applied to object-oriented software frameworks with regard to effectiveness and defect detection rate. In: Proceedings 2004 international symposium on empirical software engineering, 2004. ISESE\u201904. IEEE, pp 239\u2013248","DOI":"10.1109\/ISESE.2004.1334911"},{"key":"10123_CR2","doi-asserted-by":"crossref","unstructured":"Bacchelli A, Bird C (2013) Expectations, outcomes, and challenges of modern code review. In: Proceedings of the 2013 international conference on software engineering. IEEE Press, pp 712\u2013721","DOI":"10.1109\/ICSE.2013.6606617"},{"issue":"1","key":"10123_CR3","doi-asserted-by":"publisher","first-page":"139","DOI":"10.1016\/S0959-4752(01)00021-4","volume":"12","author":"M Bannert","year":"2002","unstructured":"Bannert M (2002) Managing cognitive load\u2013recent trends in cognitive load theory. Learning and Instruction 12(1):139\u2013146","journal-title":"Learning and Instruction"},{"key":"10123_CR4","doi-asserted-by":"crossref","unstructured":"Barnett M, Bird C, Brunet J, Lahiri SK (2015) Helping developers help themselves: Automatic decomposition of code review changesets. In: 2015 IEEE\/ACM 37Th IEEE international conference on software engineering, vol 1. IEEE, pp 134\u2013144","DOI":"10.1109\/ICSE.2015.35"},{"key":"10123_CR5","unstructured":"Basili V, Caldiera G, Lanubile F, Shull F (1996) Studies on reading techniques. In: Proceedings of the twenty-first annual software engineering workshop, vol 96, p 002"},{"key":"10123_CR6","unstructured":"Baum T (2019) Cognitive-support code review tools: improved efficiency of change-based code review by guiding and assisting reviewers. PhD thesis, Hannover: Institutionelles Repositorium der Universit\u00e4t Hannover"},{"key":"10123_CR7","doi-asserted-by":"crossref","unstructured":"Baum T, Schneider K (2016) On the need for a new generation of code review tools. In: International conference on product-focused software process improvement. Springer, pp 301\u2013308","DOI":"10.1007\/978-3-319-49094-6_19"},{"key":"10123_CR8","doi-asserted-by":"crossref","unstructured":"Baum T, Le\u00dfmann H, Schneider K (2017a) The choice of code review process: A survey on the state of the practice. In: Product-focused software process improvement. Springer International Publishing, Cham, pp 111\u2013127","DOI":"10.1007\/978-3-319-69926-4_9"},{"key":"10123_CR9","doi-asserted-by":"crossref","unstructured":"Baum T, Schneider K, Bacchelli A (2017b) On the optimal order of reading source code changes for review. In: 2017 IEEE International conference on software maintenance and evolution (ICSME). IEEE, pp 329\u2013340","DOI":"10.1109\/ICSME.2017.28"},{"key":"10123_CR10","doi-asserted-by":"crossref","unstructured":"Baum T, Schneider K, Bacchelli A (2018) Online material for Associating working memory capacity and code change ordering with code review performance","DOI":"10.1007\/s10664-018-9676-8"},{"issue":"4","key":"10123_CR11","doi-asserted-by":"publisher","first-page":"1762","DOI":"10.1007\/s10664-018-9676-8","volume":"24","author":"T Baum","year":"2019","unstructured":"Baum T, Schneider K, Bacchelli A (2019) Associating working memory capacity and code change ordering with code review performance. Empir Softw Eng 24(4):1762\u20131798","journal-title":"Empir Softw Eng"},{"key":"10123_CR12","doi-asserted-by":"crossref","unstructured":"Biffl S (2000) Analysis of the impact of reading technique and inspector capability on individual inspection performance. In: Software engineering conference, 2000. APSEC. 2000. Proceedings. Seventh Asia-Pacific. IEEE, pp 136\u2013145","DOI":"10.1109\/APSEC.2000.896692"},{"issue":"194","key":"10123_CR13","first-page":"4","volume":"189","author":"J Brooke","year":"1996","unstructured":"Brooke J et al (1996) Sus-a quick and dirty usability scale. Usability evaluation in industry 189(194):4\u20137","journal-title":"Usability evaluation in industry"},{"issue":"1","key":"10123_CR14","doi-asserted-by":"publisher","first-page":"121","DOI":"10.1016\/S0959-4752(01)00019-6","volume":"12","author":"JM van Bruggen","year":"2002","unstructured":"van Bruggen JM, Kirschner PA, Jochems W (2002) External representation of argumentation in cscl and the management of cognitive load. Learning and Instruction 12(1):121\u2013138","journal-title":"Learning and Instruction"},{"key":"10123_CR15","unstructured":"Carver JC (2003) The impact of educational background and experience on software inspections. PhD thesis, University of Maryland"},{"issue":"12","key":"10123_CR16","doi-asserted-by":"publisher","first-page":"866","DOI":"10.1109\/32.553635","volume":"22","author":"Y Chernak","year":"1996","unstructured":"Chernak Y (1996) A statistical approach to the inspection checklist formal synthesis and improvement. IEEE Trans Softw Eng 22(12):866\u2013874","journal-title":"IEEE Trans Softw Eng"},{"key":"10123_CR17","doi-asserted-by":"crossref","unstructured":"Ciurumelea A, Proksch S, Gall HC (2020) Suggesting comment completions for python using neural language models. In: 2020 IEEE 27Th international conference on software analysis, evolution and reengineering (SANER). IEEE, pp 456\u2013467","DOI":"10.1109\/SANER48275.2020.9054866"},{"issue":"3","key":"10123_CR18","doi-asserted-by":"publisher","first-page":"98","DOI":"10.1111\/1467-8721.ep10768783","volume":"1","author":"J Cohen","year":"1992","unstructured":"Cohen J (1992) Statistical power analysis. Current Directions in Psychological Science 1(3):98\u2013101","journal-title":"Current Directions in Psychological Science"},{"key":"10123_CR19","unstructured":"Cohen J (2010) Modern code review Oram A, Wilson G (eds), vol 18, Making Software, O\u2019Reilly, chap"},{"key":"10123_CR20","unstructured":"Degani A, Wiener EL (1991) Human factors of flight-deck checklists: the normal checklist. Tech. rep"},{"issue":"1","key":"10123_CR21","doi-asserted-by":"publisher","first-page":"223","DOI":"10.1037\/0022-0663.100.1.223","volume":"100","author":"KE DeLeeuw","year":"2008","unstructured":"DeLeeuw KE, Mayer RE (2008) A comparison of three measures of cognitive load: Evidence for separable measures of intrinsic, extraneous, and germane load. Journal of educational psychology 100(1):223","journal-title":"Journal of educational psychology"},{"key":"10123_CR22","unstructured":"Denger C, Ciolkowski M, Lanubile F (2004) Does active guidance improve software inspections? a preliminary empirical study. In: IASTED Conf. on software engineering, pp 408\u2013413"},{"key":"10123_CR23","doi-asserted-by":"crossref","unstructured":"Dias M, Bacchelli A, Gousios G, Cassou D, Ducasse S (2015) Untangling fine-grained code changes. In: 2015 IEEE 22Nd international conference on software analysis, evolution, and reengineering (SANER). IEEE, pp 341\u2013350","DOI":"10.1109\/SANER.2015.7081844"},{"issue":"4","key":"10123_CR24","doi-asserted-by":"publisher","first-page":"500","DOI":"10.1037\/0882-7974.4.4.500","volume":"4","author":"AR Dobbs","year":"1989","unstructured":"Dobbs AR, Rule BG (1989) Adult age differences in working memory. Psychology and aging 4(4):500","journal-title":"Psychology and aging"},{"key":"10123_CR25","doi-asserted-by":"crossref","unstructured":"Dunsmore A, Roper M, Wood M (2001) Systematic object-oriented inspection\u2014an empirical study. In: Proceedings of the 23rd international conference on software engineering. IEEE Computer Society, pp 135\u2013144","DOI":"10.1109\/ICSE.2001.919088"},{"issue":"4","key":"10123_CR26","doi-asserted-by":"publisher","first-page":"21","DOI":"10.1109\/MS.2003.1207450","volume":"20","author":"A Dunsmore","year":"2003","unstructured":"Dunsmore A, Roper M, Wood M (2003) Practical code inspection techniques for object-oriented systems: an experimental comparison. IEEE Software 20(4):21\u201329","journal-title":"IEEE Software"},{"issue":"3","key":"10123_CR27","first-page":"213","volume":"32","author":"SA Ebad","year":"2017","unstructured":"Ebad SA (2017) Inspection reading techniques applied to software artifacts-a systematic review. Comput Syst Sci Eng 32(3):213\u2013226","journal-title":"Comput Syst Sci Eng"},{"key":"10123_CR28","doi-asserted-by":"crossref","unstructured":"Fagan M (2002) Design and code inspections to reduce errors in program development. In: Software pioneers. Springer, pp 575\u2013607","DOI":"10.1007\/978-3-642-59412-0_35"},{"key":"10123_CR29","doi-asserted-by":"crossref","unstructured":"Gon\u00e7alves PW, Fregnan E, Baum T, Schneider K, Bacchelli A (2020) Do explicit review strategies improve code review performance?. In: Proceedings of the 17th international conference on mining software repositories, pp 606\u2013610","DOI":"10.1145\/3379597.3387509"},{"key":"10123_CR30","doi-asserted-by":"crossref","unstructured":"Gousios G, Pinzger M, Deursen Av (2014) An exploratory study of the pull-based software development model. In: Proceedings of the 36th international conference on software engineering, pp 345\u2013355","DOI":"10.1145\/2568225.2568260"},{"key":"10123_CR31","unstructured":"Greiler M (2021) How code reviews work at microsoft. https:\/\/www.michaelagreiler.com\/code-reviews-at-microsoft-how-to-code-review-at-a-large-software-company\/"},{"key":"10123_CR32","unstructured":"Gridnev A (2017) Examples of code review checklists and guides. https:\/\/andreigridnev.medium.com\/examples-of-code-review-checklists-and-guides-2dfed082a86d"},{"key":"10123_CR33","unstructured":"Gutha SR (2015) Code review checklist \u2013 to perform effective code reviews. https:\/\/www.evoketechnologies.com\/blog\/code-review-checklist-perform-effective-code-reviews\/"},{"issue":"4","key":"10123_CR34","doi-asserted-by":"publisher","first-page":"309","DOI":"10.1037\/a0020761","volume":"15","author":"K Imai","year":"2010","unstructured":"Imai K, Keele L, Tingley D (2010) A general approach to causal mediation analysis. Psychological Methods 15(4):309","journal-title":"Psychological Methods"},{"key":"10123_CR35","doi-asserted-by":"crossref","unstructured":"Jedlitschka A, Ciolkowski M, Pfahl D (2008) Reporting experiments in software engineering. In: Guide to advanced empirical software engineering. Springer, pp 201\u2013228","DOI":"10.1007\/978-1-84800-044-5_8"},{"key":"10123_CR36","doi-asserted-by":"crossref","unstructured":"Kamsties E, Lott CM (1995) An empirical evaluation of three defect-detection techniques. In: European software engineering conference. Springer, pp 362\u2013383","DOI":"10.1007\/3-540-60406-5_25"},{"key":"10123_CR37","doi-asserted-by":"crossref","unstructured":"Khandelwal S, Sripada SK, Reddy YR (2017) Impact of gamification on code review process: An experimental study. In: Proceedings of the 10th innovations in software engineering conference, pp 122\u2013126","DOI":"10.1145\/3021460.3021474"},{"key":"10123_CR38","doi-asserted-by":"crossref","unstructured":"Ko AJ, LaToza TD, Hull S, Ko EA, Kwok W, Quichocho J, Akkaraju H, Pandit R (2019) Teaching explicit programming strategies to adolescents. In: Proceedings of the 50th ACM technical symposium on computer science education, pp 469\u2013475","DOI":"10.1145\/3287324.3287371"},{"issue":"1","key":"10123_CR39","doi-asserted-by":"publisher","first-page":"1280256","DOI":"10.1080\/2331186X.2017.1280256","volume":"4","author":"M Krell","year":"2017","unstructured":"Krell M (2017) Evaluating an instrument to measure mental load and mental effort considering different sources of validity evidence. Cogent Education 4(1):1280256","journal-title":"Cogent Education"},{"issue":"1","key":"10123_CR40","doi-asserted-by":"publisher","first-page":"223","DOI":"10.2466\/pr0.1989.65.1.223","volume":"65","author":"TO Kv\u00e5lseth","year":"1989","unstructured":"Kv\u00e5lseth TO (1989) Note on cohen\u2019s kappa. Psychological Reports 65(1):223\u2013226","journal-title":"Psychological Reports"},{"key":"10123_CR41","doi-asserted-by":"crossref","unstructured":"Lanubile F, Mallardo T, Calefato F, Denger C, Ciolkowski M (2004) Assessing the impact of active guidance for defect detection: a replicated experiment. In: 10Th international symposium on software metrics 2004 Proceedings. IEEE, pp 269\u2013278","DOI":"10.1109\/METRIC.2004.1357909"},{"issue":"4","key":"10123_CR42","doi-asserted-by":"publisher","first-page":"2416","DOI":"10.1007\/s10664-020-09810-1","volume":"25","author":"TD LaToza","year":"2020","unstructured":"LaToza TD, Arab M, Loksa D, Ko AJ (2020) Explicit programming strategies. Empir Softw Eng 25(4):2416\u20132449","journal-title":"Empir Softw Eng"},{"issue":"1","key":"10123_CR43","doi-asserted-by":"publisher","first-page":"16","DOI":"10.1111\/j.1467-8721.2009.01598.x","volume":"18","author":"DP MacKinnon","year":"2009","unstructured":"MacKinnon DP, Fairchild AJ (2009) Current directions in mediation analysis. Current Directions in Psychological Science 18(1):16\u201320","journal-title":"Current Directions in Psychological Science"},{"key":"10123_CR44","doi-asserted-by":"publisher","first-page":"593","DOI":"10.1146\/annurev.psych.58.110405.085542","volume":"58","author":"DP MacKinnon","year":"2007","unstructured":"MacKinnon DP, Fairchild AJ, Fritz MS (2007) Mediation analysis. Annu Rev Psychol 58:593\u2013614","journal-title":"Annu Rev Psychol"},{"issue":"4","key":"10123_CR45","doi-asserted-by":"publisher","first-page":"34","DOI":"10.1109\/MS.2017.265100500","volume":"35","author":"L MacLeod","year":"2017","unstructured":"MacLeod L, Greiler M, Storey MA, Bird C, Czerwonka J (2017) Code reviewing in the trenches: Challenges and best practices. IEEE Softw 35 (4):34\u201342","journal-title":"IEEE Softw"},{"key":"10123_CR46","doi-asserted-by":"crossref","unstructured":"Matthews G, Wohleber R, Lin J (2019) Stress, skilled performance, and expertise: Overload and beyond. The Oxford handbook of expertise, 1\u201339","DOI":"10.1093\/oxfordhb\/9780198795872.013.22"},{"issue":"1","key":"10123_CR47","doi-asserted-by":"publisher","first-page":"43","DOI":"10.1207\/S15326985EP3801_6","volume":"38","author":"RE Mayer","year":"2003","unstructured":"Mayer RE, Moreno R (2003) Nine ways to reduce cognitive load in multimedia learning. Educational Psychologist 38(1):43\u201352","journal-title":"Educational Psychologist"},{"key":"10123_CR48","doi-asserted-by":"publisher","first-page":"308","DOI":"10.1109\/TSE.1976.233837","volume":"4","author":"TJ McCabe","year":"1976","unstructured":"McCabe TJ (1976) A complexity measure. IEEE Trans Softw Eng 4:308\u2013320","journal-title":"IEEE Trans Softw Eng"},{"key":"10123_CR49","volume-title":"Code complete","author":"S McConnell","year":"2004","unstructured":"McConnell S (2004) Code complete. Pearson Education, London"},{"key":"10123_CR50","doi-asserted-by":"crossref","unstructured":"McMeekin DA, von Konsky BR, Robey M, Cooper DJ (2009) The significance of participant experience when evaluating software inspection techniques. In: 2009 Australian software engineering conference. IEEE, pp 200\u2013209","DOI":"10.1109\/ASWEC.2009.13"},{"key":"10123_CR51","doi-asserted-by":"crossref","unstructured":"Oosterwaal S, Deursen Av, Coelho R, Sawant AA, Bacchelli A (2016) Visualizing code and coverage changes for code review. In: Proceedings of the 2016 24th ACM SIGSOFT international symposium on foundations of software engineering, pp 1038\u20131041","DOI":"10.1145\/2950290.2983929"},{"issue":"1","key":"10123_CR52","doi-asserted-by":"publisher","first-page":"63","DOI":"10.1207\/S15326985EP3801_8","volume":"38","author":"F Paas","year":"2003","unstructured":"Paas F, Tuovinen JE, Tabbers H, Van Gerven PW (2003) Cognitive load measurement as a means to advance cognitive load theory. Educational Psychologist 38(1):63\u201371","journal-title":"Educational Psychologist"},{"issue":"4","key":"10123_CR53","doi-asserted-by":"publisher","first-page":"351","DOI":"10.1007\/BF02213420","volume":"6","author":"FG Paas","year":"1994","unstructured":"Paas FG, Van Merri\u00ebnboer JJ (1994) Instructional control of cognitive load in the training of complex cognitive tasks. Educational Psychology Review 6 (4):351\u2013371","journal-title":"Educational Psychology Review"},{"issue":"CSCW","key":"10123_CR54","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3274404","volume":"2","author":"L Pascarella","year":"2018","unstructured":"Pascarella L, Spadini D, Palomba F, Bruntink M, Bacchelli A (2018) Information needs in contemporary code review. Proceedings of the ACM on Human-Computer Interaction 2(CSCW):1\u201327","journal-title":"Proceedings of the ACM on Human-Computer Interaction"},{"key":"10123_CR55","doi-asserted-by":"crossref","unstructured":"Rafi DM, Moses KRK, Petersen K, M\u00e4ntyl\u00e4 MV (2012) Benefits And limitations of automated software testing: Systematic literature review and practitioner survey. In: 2012 7Th international workshop on automation of software test (AST). IEEE, pp 36\u201342","DOI":"10.1109\/IWAST.2012.6228988"},{"key":"10123_CR56","doi-asserted-by":"crossref","unstructured":"Rigby PC, Bird C (2013) Convergent contemporary software peer review practices. In: Proceedings of the 2013 9th joint meeting on foundations of software engineering, pp 202\u2013212","DOI":"10.1145\/2491411.2491444"},{"key":"10123_CR57","doi-asserted-by":"crossref","unstructured":"Rong G, Li J, Xie M, Zheng T (2012) The effect of checklist in code review for inexperienced students: An empirical study. In: 2012 IEEE 25th conference on software engineering education and training. IEEE, pp 120\u2013124","DOI":"10.1109\/CSEET.2012.22"},{"issue":"3","key":"10123_CR58","doi-asserted-by":"publisher","first-page":"579","DOI":"10.1109\/TSE.2011.42","volume":"38","author":"D Rothlisberger","year":"2012","unstructured":"Rothlisberger D, Harry M, Binder W, Moret P, Ansaloni D, Villazon A, Nierstrasz O (2012) Exploiting dynamic information in ides improves speed and correctness of software maintenance tasks. IEEE Trans Softw Eng 38 (3):579\u2013591","journal-title":"IEEE Trans Softw Eng"},{"key":"10123_CR59","doi-asserted-by":"crossref","unstructured":"Sadowski C, S\u00f6derberg E, Church L, Sipko M, Bacchelli A (2018) Modern code review: a case study at google. In: Proceedings of the 40th international conference on software engineering: Software engineering in practice, pp 181\u2013190","DOI":"10.1145\/3183519.3183525"},{"issue":"6","key":"10123_CR60","doi-asserted-by":"publisher","first-page":"845","DOI":"10.1037\/0022-3514.89.6.845","volume":"89","author":"SJ Spencer","year":"2005","unstructured":"Spencer SJ, Zanna MP, Fong GT (2005) Establishing a causal chain: why experiments are often more effective than mediational analyses in examining psychological processes. Journal of Personality and Social Psychology 89(6):845","journal-title":"Journal of Personality and Social Psychology"},{"key":"10123_CR61","doi-asserted-by":"crossref","unstructured":"Tao Y, Kim S (2015) Partitioning composite code changes to facilitate code review. In: 2015 IEEE\/ACM 12th working conference on mining software repositories. IEEE, pp 180\u2013190","DOI":"10.1109\/MSR.2015.24"},{"key":"10123_CR62","doi-asserted-by":"crossref","unstructured":"Tao Y, Dang Y, Xie T, Zhang D, Kim S (2012) How do software engineers understand code changes? an exploratory study in industry. In: Proceedings of the ACM SIGSOFT 20th international symposium on the foundations of software engineering, pp 1\u201311","DOI":"10.1145\/2393596.2393656"},{"issue":"8","key":"10123_CR63","doi-asserted-by":"publisher","first-page":"687","DOI":"10.1109\/TSE.2003.1223644","volume":"29","author":"T Thelin","year":"2003","unstructured":"Thelin T, Runeson P, Wohlin C (2003) An experimental comparison of usage-based and checklist-based reading. IEEE Trans Softw Eng 29 (8):687\u2013704","journal-title":"IEEE Trans Softw Eng"},{"key":"10123_CR64","doi-asserted-by":"crossref","unstructured":"Tingley D, Yamamoto T, Hirose K, Keele L, Imai K (2014) Mediation: R package for causal mediation analysis. Journal of Statistical Software","DOI":"10.18637\/jss.v059.i05"},{"key":"10123_CR65","doi-asserted-by":"crossref","unstructured":"Tymchuk Y, Mocci A, Lanza M (2015) Code Review: veni, vidi, vici. In: 2015 IEEE 22nd international conference on software analysis, evolution, and reengineering (SANER). IEEE, pp 151\u2013160","DOI":"10.1109\/SANER.2015.7081825"},{"key":"10123_CR66","doi-asserted-by":"crossref","unstructured":"Unkelos-Shpigel N, Hadar I (2015) Gamifying software engineering tasks based on cognitive principles: The case of code review. In: 2015 IEEE\/ACM 8th international workshop on cooperative and human aspects of software engineering. IEEE, pp 119\u2013120","DOI":"10.1109\/CHASE.2015.21"},{"key":"10123_CR67","unstructured":"UsabiliTEST (2020) System usability scale (sus) plus. https:\/\/www.usabilitest.com\/system-usability-scale"},{"key":"10123_CR68","doi-asserted-by":"crossref","unstructured":"Uwano H, Nakamura M, Monden A, Matsumoto K (2006) Analyzing individual performance of source code review using reviewers\u2019 eye movement. In: Proceedings of the 2006 symposium on Eye tracking research & applications, pp 133\u2013140","DOI":"10.1145\/1117309.1117357"},{"key":"10123_CR69","doi-asserted-by":"crossref","unstructured":"Zhang T, Song M, Pinedo J, Kim M (2015) Interactive code review for systematic changes. In: 2015 IEEE\/ACM 37Th IEEE international conference on software engineering, vol 1. IEEE, pp 111\u2013122","DOI":"10.1109\/ICSE.2015.33"}],"container-title":["Empirical Software Engineering"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10664-022-10123-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10664-022-10123-8\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10664-022-10123-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,6,9]],"date-time":"2022-06-09T17:05:38Z","timestamp":1654794338000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10664-022-10123-8"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,5,7]]},"references-count":69,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2022,7]]}},"alternative-id":["10123"],"URL":"https:\/\/doi.org\/10.1007\/s10664-022-10123-8","relation":{},"ISSN":["1382-3256","1573-7616"],"issn-type":[{"value":"1382-3256","type":"print"},{"value":"1573-7616","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,5,7]]},"assertion":[{"value":"6 January 2022","order":1,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"7 May 2022","order":2,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}],"article-number":"99"}}