{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,13]],"date-time":"2026-03-13T22:57:00Z","timestamp":1773442620403,"version":"3.50.1"},"reference-count":34,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2024,10,17]],"date-time":"2024-10-17T00:00:00Z","timestamp":1729123200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,10,17]],"date-time":"2024-10-17T00:00:00Z","timestamp":1729123200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100003170","name":"Stiftelsen f\u00f6r Kunskaps- och Kompetensutveckling","doi-asserted-by":"publisher","award":["2018\/010"],"award-info":[{"award-number":["2018\/010"]}],"id":[{"id":"10.13039\/501100003170","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Empir Software Eng"],"published-print":{"date-parts":[[2025,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n          <jats:sec>\n            <jats:title>Background<\/jats:title>\n            <jats:p>Code review, the discussion around a code change among humans, forms a communication network that enables its participants to exchange and spread information. Although reported by qualitative studies, our understanding of the capability of code review as a communication network is still limited.<\/jats:p>\n          <\/jats:sec>\n          <jats:sec>\n            <jats:title>Objective<\/jats:title>\n            <jats:p>In this article, we report on a first step towards understanding and evaluating the capability of code review as a communication network by quantifying how fast and how far information can spread through code review: the upper bound of information diffusion in code review.<\/jats:p>\n          <\/jats:sec>\n          <jats:sec>\n            <jats:title>Method<\/jats:title>\n            <jats:p>In an <jats:italic>in-silico<\/jats:italic> experiment, we simulate an artificial information diffusion within large (Microsoft), mid-sized (Spotify), and small code review systems (Trivago) modelled as communication networks. We then measure the minimal topological and temporal distances between the participants to quantify how far and how fast information can spread in code review.<\/jats:p>\n          <\/jats:sec>\n          <jats:sec>\n            <jats:title>Results<\/jats:title>\n            <jats:p>An average code review participants in the small and mid-sized code review systems can spread information to between 72\u00a0% and 85\u00a0% of all code review participants within four weeks independently of network size and tooling; for the large code review systems, we found an absolute boundary of about 11\u00a0000 reachable participants. On average (median), information can spread between two participants in code review in less than five hops and less than five days.<\/jats:p>\n          <\/jats:sec>\n          <jats:sec>\n            <jats:title>Conclusion<\/jats:title>\n            <jats:p>We found evidence that the communication network emerging from code review scales well and spreads information fast and broadly, corroborating the findings of prior qualitative work. The study lays the foundation for understanding and improving code review as a communication network.<\/jats:p>\n          <\/jats:sec>","DOI":"10.1007\/s10664-024-10442-y","type":"journal-article","created":{"date-parts":[[2024,10,17]],"date-time":"2024-10-17T13:03:35Z","timestamp":1729170215000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["The upper bound of information diffusion in code review"],"prefix":"10.1007","volume":"30","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-8879-6450","authenticated-orcid":false,"given":"Michael","family":"Dorner","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Daniel","family":"Mendez","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Krzysztof","family":"Wnuk","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ehsan","family":"Zabardast","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jacek","family":"Czerwonka","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2024,10,17]]},"reference":[{"key":"10442_CR1","doi-asserted-by":"publisher","unstructured":"Al-Zubaidi WHA, Thongtanunam P, Dam HK, Tantithamthavorn C, Ghose A (2020) Workload-aware reviewer recommendation using a multi-objective search-based approach. ACM 21\u201330. https:\/\/doi.org\/10.1145\/3416508.3417115","DOI":"10.1145\/3416508.3417115"},{"key":"10442_CR2","doi-asserted-by":"publisher","unstructured":"Anger I, Kittl C (2011) Measuring influence on twitter. ACM 1\u20134. https:\/\/doi.org\/10.1145\/2024288.2024326","DOI":"10.1145\/2024288.2024326"},{"key":"10442_CR3","doi-asserted-by":"publisher","unstructured":"Armstrong F, Khomh F, Adams B (2017) Broadcast vs. unicast review technology: Does it matter? IEEE 219\u2013229. https:\/\/doi.org\/10.1109\/ICST.2017.27","DOI":"10.1109\/ICST.2017.27"},{"key":"10442_CR4","doi-asserted-by":"crossref","unstructured":"Bacchelli A, Bird C (2013) Expectations, outcomes, and challenges of modern code review. Proc - Int Conf Softw Eng 712\u2013721","DOI":"10.1109\/ICSE.2013.6606617"},{"key":"10442_CR5","doi-asserted-by":"publisher","DOI":"10.1145\/3585004","author":"D Badampudi","year":"2023","unstructured":"Badampudi D, Unterkalmsteiner M, Britto R (2023) Modern code reviews - a survey of literature and practice. ACM Trans Softw Eng Methodol. https:\/\/doi.org\/10.1145\/3585004","journal-title":"ACM Trans Softw Eng Methodol"},{"key":"10442_CR6","doi-asserted-by":"publisher","first-page":"94","DOI":"10.1007\/s10664-021-10072-8","volume":"27","author":"S Baltes","year":"2022","unstructured":"Baltes S, Ralph P (2022) Sampling in software engineering research: a critical review and guidelines. Empir Softw Eng 27:94. https:\/\/doi.org\/10.1007\/s10664-021-10072-8","journal-title":"Empir Softw Eng"},{"key":"10442_CR7","first-page":"1","volume":"5589","author":"A Barcomb","year":"2020","unstructured":"Barcomb A, Stol KJ, Fitzgerald B, Riehle D (2020) Managing episodic volunteers in free\/libre\/open source software communities. IEEE Trans Softw Eng 5589:1\u20131","journal-title":"IEEE Trans Softw Eng"},{"key":"10442_CR8","doi-asserted-by":"crossref","unstructured":"Baum T, Liskin O, Niklas K, Schneider K (2016) Factors influencing code review processes in industry","DOI":"10.1145\/2950290.2950323"},{"key":"10442_CR9","doi-asserted-by":"publisher","unstructured":"Bosu A, Greiler M, Bird C (2015) Characteristics of useful code reviews: An empirical study at microsoft. IEEE, vol 2015-Augus, pp 146\u2013156. https:\/\/doi.org\/10.1109\/MSR.2015.21, http:\/\/ieeexplore.ieee.org\/document\/7180075\/","DOI":"10.1109\/MSR.2015.21"},{"key":"10442_CR10","doi-asserted-by":"publisher","first-page":"56","DOI":"10.1109\/TSE.2016.2576451","volume":"43","author":"A Bosu","year":"2017","unstructured":"Bosu A, Carver JC, Bird C, Orbeck J, Chockley C (2017) Process aspects and social dynamics of contemporary code review: Insights from open source development and industrial practice at microsoft. IEEE Trans Softw Eng 43:56\u201375","journal-title":"IEEE Trans Softw Eng"},{"key":"10442_CR11","doi-asserted-by":"publisher","DOI":"10.1016\/j.asoc.2020.106908","volume":"100","author":"M Chouchen","year":"2021","unstructured":"Chouchen M, Ouni A, Mkaouer MW, Kula RG, Inoue K (2021) Whoreview: A multi-objective search-based approach for code reviewers recommendation in modern code review. Appl Soft Comput 100:106908. https:\/\/doi.org\/10.1016\/j.asoc.2020.106908","journal-title":"Appl Soft Comput"},{"key":"10442_CR12","doi-asserted-by":"publisher","unstructured":"Cunha A, Conte T, Gadelha B (2021) Code review is just reviewing code? a qualitative study with practitioners in industry. Assoc Comput Mach 269\u2013274. https:\/\/doi.org\/10.1145\/3474624.3477063","DOI":"10.1145\/3474624.3477063"},{"key":"10442_CR13","doi-asserted-by":"publisher","DOI":"10.5281\/zenodo.8042256","author":"M Dorner","year":"2023","unstructured":"Dorner M (2023). The upper bound of information diffusion in code review. https:\/\/doi.org\/10.5281\/zenodo.8042256","journal-title":"The upper bound of information diffusion in code review."},{"key":"10442_CR14","doi-asserted-by":"publisher","unstructured":"Dorner M, Bauer A (2023) michaeldorner\/information-diffusion-boundaries-in- code-review: 1.0. https:\/\/doi.org\/10.5281\/zenodo.10417852","DOI":"10.5281\/zenodo.10417852"},{"key":"10442_CR15","doi-asserted-by":"publisher","unstructured":"Dorner M, \u0160mite D, Mendez D, Wnuk K, Czerwonka J (2022) Only time will tell: Modelling information diffusion in code review with time-varying hypergraphs. ACM 95\u2013204. https:\/\/doi.org\/10.1145\/3544902.3546254","DOI":"10.1145\/3544902.3546254"},{"key":"10442_CR16","doi-asserted-by":"publisher","first-page":"26","DOI":"10.1609\/icwsm.v3i1.13941","volume":"3","author":"M Goetz","year":"2009","unstructured":"Goetz M, Leskovec J, McGlohon M, Faloutsos C (2009) Modeling blog dynamics. Proc Int AAAI Conf Web Soc Media 3:26\u201333. https:\/\/doi.org\/10.1609\/icwsm.v3i1.13941","journal-title":"Proc Int AAAI Conf Web Soc Media"},{"key":"10442_CR17","doi-asserted-by":"publisher","unstructured":"Leskovec J, Backstrom L, Kleinberg J (2009) Meme-tracking and the dynamics of the news cycle. ACM 497\u2013506. https:\/\/doi.org\/10.1145\/1557019.1557077","DOI":"10.1145\/1557019.1557077"},{"key":"10442_CR18","doi-asserted-by":"publisher","first-page":"4633","DOI":"10.1073\/pnas.0708471105","volume":"105","author":"D Liben-Nowell","year":"2008","unstructured":"Liben-Nowell D, Kleinberg J (2008) Tracing information flow on a global scale using internet chain-letter data. Proc Nat Acad Sci 105:4633\u20134638. https:\/\/doi.org\/10.1073\/pnas.0708471105","journal-title":"Proc Nat Acad Sci"},{"key":"10442_CR19","doi-asserted-by":"publisher","unstructured":"M\u00fcller M, Pfahl D (2008) Simulation methods. In: Shull F, Singer J, Sj\u00f6berg DIK (eds) Guide to advanced empirical software engineering. Springer London, pp 117\u2013152. https:\/\/doi.org\/10.1007\/978-1-84800-044-5_5","DOI":"10.1007\/978-1-84800-044-5_5"},{"key":"10442_CR20","doi-asserted-by":"crossref","unstructured":"Mockus A, Herbsleb JD (2002) Expertise browser: a quantitative approach to identifying expertise. ACM Press, p 503","DOI":"10.1109\/ICSE.2002.1007994"},{"key":"10442_CR21","doi-asserted-by":"publisher","unstructured":"Nazir S, Fatima N, Chuprat S (2020) Modern code review benefits-primary findings of a systematic literature review. ACM 210\u2013215. https:\/\/doi.org\/10.1145\/3378936.3378954","DOI":"10.1145\/3378936.3378954"},{"key":"10442_CR22","doi-asserted-by":"publisher","unstructured":"Ouvrard X (2020) Hypergraphs: an introduction and review. https:\/\/doi.org\/10.48550\/arXiv.2002.05014","DOI":"10.48550\/arXiv.2002.05014"},{"key":"10442_CR23","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3274404","volume":"2","author":"L Pascarella","year":"2018","unstructured":"Pascarella L, Spadini D, Palomba F, Bruntink M, Bacchelli A (2018) Information needs in contemporary code review. Proc ACM Human-Comput Interact 2:1\u201327. https:\/\/doi.org\/10.1145\/3274404","journal-title":"Proc ACM Human-Comput Interact"},{"key":"10442_CR24","doi-asserted-by":"publisher","first-page":"78","DOI":"10.1145\/2854146","volume":"59","author":"R Potvin","year":"2016","unstructured":"Potvin R, Levenberg J (2016) Why google stores billions of lines of code in a single repository. Commun ACM 59:78\u201387","journal-title":"Commun ACM"},{"key":"10442_CR25","unstructured":"Priestley E (2021) Phacility is winding down operations. https:\/\/admin.phacility.com\/phame\/post\/view\/11\/phacility_is_winding_down_operations\/, last access on 16.05.2023"},{"key":"10442_CR26","doi-asserted-by":"crossref","unstructured":"Rigby PC, Bird C (2013) Convergent contemporary software peer review practices. Proc 2013 9th Joint Meet Found Softw Eng - ESEC\/FSE 2013 202","DOI":"10.1145\/2491411.2491444"},{"key":"10442_CR27","doi-asserted-by":"publisher","unstructured":"Rigby PC, Storey MA (2011) Understanding broadcast based peer review on open source software projects. ACM 541\u2013550. https:\/\/doi.org\/10.1145\/1985793.1985867","DOI":"10.1145\/1985793.1985867"},{"key":"10442_CR28","doi-asserted-by":"publisher","unstructured":"Rigby PC, German DM, Storey MA (2008) Open source software peer review practices: A case study of the apache server. ACM Press, p 541. https:\/\/doi.org\/10.1145\/1368088.1368162, http:\/\/portal.acm.org\/citation.cfm?doid=1368088.1368162","DOI":"10.1145\/1368088.1368162"},{"key":"10442_CR29","doi-asserted-by":"publisher","unstructured":"R\u00f6seler L, Scholtes I, Gote C (2023) A network perspective on the influence of code review bots on the structure of developer collaborations. https:\/\/doi.org\/10.48550\/arXiv.2304.14787","DOI":"10.48550\/arXiv.2304.14787"},{"key":"10442_CR30","doi-asserted-by":"crossref","unstructured":"Sadowski C, S\u00f6derberg E, Church L, Sipko M, Bacchelli A (2018) Modern code review: A case study at google. Proc 40th Int Conf Softw Eng Softw Eng Pract - ICSE-SEIP \u201918 181\u2013190","DOI":"10.1145\/3183519.3183525"},{"key":"10442_CR31","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3241743","volume":"27","author":"KJ Stol","year":"2018","unstructured":"Stol KJ, Fitzgerald B (2018) The abc of software engineering research. ACM Trans Softw Eng Methodol 27:1\u201351","journal-title":"ACM Trans Softw Eng Methodol"},{"key":"10442_CR32","doi-asserted-by":"publisher","unstructured":"Strand A, Gunnarson M, Britto R, Usman M (2020) Using a context-aware approach to recommend code reviewers. ACM 1\u201310. https:\/\/doi.org\/10.1145\/3377813.3381365","DOI":"10.1145\/3377813.3381365"},{"key":"10442_CR33","doi-asserted-by":"publisher","first-page":"77","DOI":"10.1177\/1558689806292430","volume":"1","author":"C Teddlie","year":"2009","unstructured":"Teddlie C (2009) Mixed methods sampling: A typology with examples. J Mixed Methods Res 1:77\u2013100","journal-title":"J Mixed Methods Res"},{"key":"10442_CR34","doi-asserted-by":"publisher","unstructured":"Wessel M, Wiese I, Steinmacher I, Gerosa MA (2021) Don\u2019t disturb me: Challenges of interacting with software bots on open source software projects. Proc ACM Human-Comput Interact 5. https:\/\/doi.org\/10.1145\/3476042","DOI":"10.1145\/3476042"}],"container-title":["Empirical Software Engineering"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10664-024-10442-y.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10664-024-10442-y\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10664-024-10442-y.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,2,22]],"date-time":"2025-02-22T14:09:46Z","timestamp":1740233386000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10664-024-10442-y"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,10,17]]},"references-count":34,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2025,1]]}},"alternative-id":["10442"],"URL":"https:\/\/doi.org\/10.1007\/s10664-024-10442-y","relation":{},"ISSN":["1382-3256","1573-7616"],"issn-type":[{"value":"1382-3256","type":"print"},{"value":"1573-7616","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,10,17]]},"assertion":[{"value":"3 January 2024","order":1,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"17 October 2024","order":2,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declared that they have no conflict of interest.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of Interest"}}],"article-number":"2"}}