{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,25]],"date-time":"2026-02-25T18:40:51Z","timestamp":1772044851993,"version":"3.50.1"},"reference-count":69,"publisher":"Association for Computing Machinery (ACM)","issue":"CSCW","license":[{"start":{"date-parts":[[2018,11,1]],"date-time":"2018-11-01T00:00:00Z","timestamp":1541030400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"European Union's Horizon 2020","award":["642954"],"award-info":[{"award-number":["642954"]}]},{"DOI":"10.13039\/501100001711","name":"Swiss National Science Foundation","doi-asserted-by":"crossref","award":["PP00P2_170529"],"award-info":[{"award-number":["PP00P2_170529"]}],"id":[{"id":"10.13039\/501100001711","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Hum.-Comput. Interact."],"published-print":{"date-parts":[[2018,11]]},"abstract":"<jats:p>Contemporary code review is a widespread practice used by software engineers to maintain high software quality and share project knowledge. However, conducting proper code review takes time and developers often have limited time for review. In this paper, we aim at investigating the information that reviewers need to conduct a proper code review, to better understand this process and how research and tool support can make developers become more effective and efficient reviewers. Previous work has provided evidence that a successful code review process is one in which reviewers and authors actively participate and collaborate. In these cases, the threads of discussions that are saved by code review tools are a precious source of information that can be later exploited for research and practice. In this paper, we focus on this source of information as a way to gather reliable data on the aforementioned reviewers' needs. We manually analyze 900 code review comments from three large open-source projects and organize them in categories by means of a card sort. Our results highlight the presence of seven high-level information needs, such as knowing the uses of methods and variables declared\/modified in the code under review. Based on these results we suggest ways in which future code review tools can better support collaboration and the reviewing task.<\/jats:p>","DOI":"10.1145\/3274404","type":"journal-article","created":{"date-parts":[[2018,11,1]],"date-time":"2018-11-01T21:21:27Z","timestamp":1541107287000},"page":"1-27","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":101,"title":["Information Needs in Contemporary Code Review"],"prefix":"10.1145","volume":"2","author":[{"given":"Luca","family":"Pascarella","sequence":"first","affiliation":[{"name":"Delft University of Technology, Delft, Netherlands"}]},{"given":"Davide","family":"Spadini","sequence":"additional","affiliation":[{"name":"Software Improvement Group, Amsterdam, Netherlands"}]},{"given":"Fabio","family":"Palomba","sequence":"additional","affiliation":[{"name":"University of Zurich, Zurich, Switzerland"}]},{"given":"Magiel","family":"Bruntink","sequence":"additional","affiliation":[{"name":"Software Improvement Group, Amsterdam, Netherlands"}]},{"given":"Alberto","family":"Bacchelli","sequence":"additional","affiliation":[{"name":"University of Zurich, Zurich, Switzerland"}]}],"member":"320","published-online":{"date-parts":[[2018,11]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10664-013-9278-4"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.5555\/2486788.2486882"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/253228.253461"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.5555\/2486788.2486915"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.5555\/2818754.2818773"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1109\/QRS.2016.19"},{"key":"e_1_2_1_7_1","volume-title":"On the Optimal Order of Reading Source Code Changes for Review. In 33rd IEEE International Conference on Software Maintenance and Evolution (ICSME), Proceedings .","author":"Baum Tobias","year":"2017","unstructured":"Tobias Baum, Kurt Schneider, and Alberto Bacchelli. 2017. On the Optimal Order of Reading Source Code Changes for Review. In 33rd IEEE International Conference on Software Maintenance and Evolution (ICSME), Proceedings ."},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSM.2015.7332454"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1109\/WCRE.2013.6671287"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/2597073.2597082"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.5555\/851006.856041"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/1718918.1718973"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/1858996.1859005"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.5555\/2337223.2337343"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE.2009.5070564"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1109\/SANER.2018.8330261"},{"key":"e_1_2_1_17_1","first-page":"329","article-title":"Modern Code Review. In Making Software , , Andy Oram and Greg Wilson (Eds.). O'Reilly","volume":"18","author":"Cohen Jason","year":"2010","unstructured":"Jason Cohen. 2010. Modern Code Review. In Making Software , , Andy Oram and Greg Wilson (Eds.). O'Reilly, Chapter 18, 329--338.","journal-title":"Chapter"},{"key":"e_1_2_1_18_1","volume-title":"Practical Nonparametric Statistics","author":"Conover W. J.","unstructured":"W. J. Conover. 1999. Practical Nonparametric Statistics 3rd ed.). John Wiley & Sons, Inc.","edition":"3"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1109\/SCAM.2014.14"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.5555\/2819009.2819015"},{"key":"e_1_2_1_21_1","volume-title":"The effects of change-decomposition on code review-A Controlled Experiment. arXiv preprint arXiv:1805.10978","author":"di Biase Marco","year":"2018","unstructured":"Marco di Biase, Magiel Bruntink, Arie van Deursen, and Alberto Bacchelli. 2018. The effects of change-decomposition on code review-A Controlled Experiment. arXiv preprint arXiv:1805.10978 (2018)."},{"key":"e_1_2_1_22_1","volume-title":"Evolution and Reengineering (SANER), 2015 IEEE 22nd International Conference on. IEEE, 341--350","author":"Dias Mart'in","year":"2015","unstructured":"Mart'in Dias, Alberto Bacchelli, Georgios Gousios, Damien Cassou, and St\u00e9phane Ducasse. 2015. Untangling fine-grained code changes. In Software Analysis, Evolution and Reengineering (SANER), 2015 IEEE 22nd International Conference on. IEEE, 341--350."},{"key":"e_1_2_1_23_1","volume-title":"Confusion Detection in Code Reviews. In 33rd International Conference on Software Maintenance and Evolution (ICSME), Proceedings. ICSME.","author":"Ebert Felipe","year":"2017","unstructured":"Felipe Ebert, Fernando Castor, Nicole Novielli, and Alexander Serebrenik. 2017. Confusion Detection in Code Reviews. In 33rd International Conference on Software Maintenance and Evolution (ICSME), Proceedings. ICSME."},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1177\/1468794113481790"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/2884781.2884826"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.5555\/2818754.2818800"},{"key":"e_1_2_1_27_1","volume-title":"Effect sizes for research: A broad practical approach","author":"Grissom Robert J","unstructured":"Robert J Grissom and John J Kim. 2005. Effect sizes for research: A broad practical approach. Lawrence Erlbaum Associates Publishers."},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.5555\/2487085.2487096"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/169059.169061"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.5555\/2487085.2487113"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.5555\/2487085.2487111"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/2897586.2897605"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE.2007.45"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSM.2015.7332457"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1080\/19312458.2011.568376"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.5555\/1197887"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2008.71"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/2597073.2597076"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10664-015-9381-9"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1086\/219886"},{"key":"e_1_2_1_41_1","volume-title":"Evolution and Reengineering (SANER), 2015 IEEE 22nd International Conference on. IEEE, 171--180","author":"Morales Rodrigo","year":"2015","unstructured":"Rodrigo Morales, Shane McIntosh, and Foutse Khomh. 2015. Do code review practices impact design quality? a case study of the qt, vtk, and itk projects. In Software Analysis, Evolution and Reengineering (SANER), 2015 IEEE 22nd International Conference on. IEEE, 171--180."},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0010-9452(76)80035-4"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2014.2372760"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/3180155.3182530"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1145\/1370750.1370765"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE.2017.17"},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1145\/268411.268421"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1145\/3236024.3236080"},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1145\/2491411.2491444"},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1145\/2594458"},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1145\/3183519.3183525"},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1109\/32.825763"},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1145\/1181775.1181779"},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1145\/3180155.3180192"},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE-COMPANION.2009.5070996"},{"key":"e_1_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE-COMPANION.2009.5070996"},{"key":"e_1_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.1145\/2393596.2393656"},{"key":"e_1_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.5555\/2820518.2820541"},{"key":"e_1_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.1145\/2593702.2593705"},{"key":"e_1_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.5555\/2820518.2820540"},{"key":"e_1_2_1_61_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10664-016-9452-6"},{"key":"e_1_2_1_62_1","doi-asserted-by":"publisher","DOI":"10.1145\/2884781.2884852"},{"key":"e_1_2_1_63_1","volume-title":"Evolution and Reengineering (SANER), 2015 IEEE 22nd International Conference on. IEEE, 141--150","author":"Thongtanunam Patanamon","year":"2015","unstructured":"Patanamon Thongtanunam, Chakkrit Tantithamthavorn, Raula Gaikovina Kula, Norihiro Yoshida, Hajimu Iida, and Ken-ichi Matsumoto. 2015b. Who should review my code? A file location-based code-reviewer recommendation approach for modern code review. In Software Analysis, Evolution and Reengineering (SANER), 2015 IEEE 22nd International Conference on. IEEE, 141--150."},{"key":"e_1_2_1_64_1","doi-asserted-by":"publisher","DOI":"10.1145\/2635868.2635882"},{"key":"e_1_2_1_65_1","volume-title":"Evolution and Reengineering (SANER), 2015 IEEE 22nd International Conference on. IEEE, 151--160","author":"Tymchuk Yuriy","year":"2015","unstructured":"Yuriy Tymchuk, Andrea Mocci, and Michele Lanza. 2015. Code Review: Veni, ViDI, Vici. In Software Analysis, Evolution and Reengineering (SANER), 2015 IEEE 22nd International Conference on. IEEE, 151--160."},{"key":"e_1_2_1_66_1","doi-asserted-by":"publisher","DOI":"10.1145\/2702123.2702549"},{"key":"e_1_2_1_67_1","doi-asserted-by":"publisher","DOI":"10.1561\/2500000028"},{"key":"e_1_2_1_68_1","volume-title":"Learning from strangers: The art and method of qualitative interview studies","author":"Weiss Robert S","unstructured":"Robert S Weiss. 1995. Learning from strangers: The art and method of qualitative interview studies .Simon and Schuster."},{"key":"e_1_2_1_69_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSME.2014.63"}],"container-title":["Proceedings of the ACM on Human-Computer Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3274404","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3274404","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T00:44:35Z","timestamp":1750207475000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3274404"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,11]]},"references-count":69,"journal-issue":{"issue":"CSCW","published-print":{"date-parts":[[2018,11]]}},"alternative-id":["10.1145\/3274404"],"URL":"https:\/\/doi.org\/10.1145\/3274404","relation":{},"ISSN":["2573-0142"],"issn-type":[{"value":"2573-0142","type":"electronic"}],"subject":[],"published":{"date-parts":[[2018,11]]},"assertion":[{"value":"2018-11-01","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}