{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,13]],"date-time":"2026-03-13T22:56:37Z","timestamp":1773442597522,"version":"3.50.1"},"reference-count":34,"publisher":"Springer Science and Business Media LLC","issue":"5","license":[{"start":{"date-parts":[[2021,7,8]],"date-time":"2021-07-08T00:00:00Z","timestamp":1625702400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2021,7,8]],"date-time":"2021-07-08T00:00:00Z","timestamp":1625702400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"Australian Research Council\u2019s Discovery Early Career Researcher Award","award":["DE210101091"],"award-info":[{"award-number":["DE210101091"]}]},{"DOI":"10.13039\/501100001691","name":"Japan Society for the Promotion of Science","doi-asserted-by":"crossref","award":["18H04094"],"award-info":[{"award-number":["18H04094"]}],"id":[{"id":"10.13039\/501100001691","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100001691","name":"Japan Society for the Promotion of Science","doi-asserted-by":"crossref","award":["20K19774"],"award-info":[{"award-number":["20K19774"]}],"id":[{"id":"10.13039\/501100001691","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100001691","name":"Japan Society for the Promotion of Science","doi-asserted-by":"crossref","award":["20H05706"],"award-info":[{"award-number":["20H05706"]}],"id":[{"id":"10.13039\/501100001691","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Empir Software Eng"],"published-print":{"date-parts":[[2021,9]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Code reviews serve as a quality assurance activity for software teams. Especially for Modern Code Review, sharing a link during a review discussion serves as an effective awareness mechanism where \u201cCode reviews are good FYIs [for your information].\u201d. Although prior work has explored link sharing and the information needs of a code review, the extent to which links are used to properly conduct a review is unknown. In this study, we performed a mixed-method approach to investigate the practice of link sharing and their intentions. First, through a quantitative study of the OpenStack and Qt projects, we identify 19,268 reviews that have 39,686 links to explore the extent to which the links are shared, and analyze a correlation between link sharing and review time. Then in a qualitative study, we manually analyze 1,378 links to understand the role and usefulness of link sharing. Results indicate that internal links are more widely referred to (93% and 80% for the two projects). Importantly, although the majority of the internal links are referencing to reviews, bug reports and source code are also shared in review discussions. The statistical models show that the number of internal links as an explanatory factor does have an increasing relationship with the review time. Finally, we present seven intentions of link sharing, with providing context being the most common intention for sharing links. Based on the findings and a developer survey, we encourage the patch author to provide clear context and explore both internal and external resources, while the review team should continue link sharing activities. Future research directions include the investigation of causality between sharing links and the review process, as well as the potential for tool support.<\/jats:p>","DOI":"10.1007\/s10664-021-09997-x","type":"journal-article","created":{"date-parts":[[2021,7,8]],"date-time":"2021-07-08T14:03:59Z","timestamp":1625753039000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":26,"title":["Understanding shared links and their intentions to meet information needs in modern code review:"],"prefix":"10.1007","volume":"26","author":[{"given":"Dong","family":"Wang","sequence":"first","affiliation":[]},{"given":"Tao","family":"Xiao","sequence":"additional","affiliation":[]},{"given":"Patanamon","family":"Thongtanunam","sequence":"additional","affiliation":[]},{"given":"Raula Gaikovina","family":"Kula","sequence":"additional","affiliation":[]},{"given":"Kenichi","family":"Matsumoto","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2021,7,8]]},"reference":[{"key":"9997_CR1","doi-asserted-by":"crossref","unstructured":"Bacchelli A, Bird C (2013) Expectations, outcomes, and challenges of modern code review. In: Proceedings of the 35th International conference on software engineering, pp 712\u2013721","DOI":"10.1109\/ICSE.2013.6606617"},{"key":"9997_CR2","doi-asserted-by":"crossref","unstructured":"Baltes S, Diehl S (2019) Usage and attribution of stack overflow code snippets in github projects. Empir Softw Eng :1259\u20131295","DOI":"10.1007\/s10664-018-9650-5"},{"key":"9997_CR3","doi-asserted-by":"crossref","unstructured":"Baysal O, Kononenko O, Holmes R, Godfrey MW (2016) Investigating technical and non-technical factors influencing modern code review. Empir Softw Eng :932\u2013959","DOI":"10.1007\/s10664-015-9366-8"},{"key":"9997_CR4","doi-asserted-by":"crossref","unstructured":"Boisselle V, Adams B (2015) The impact of cross-distribution bug duplicates, empirical study on debian and ubuntu. In: 2015 IEEE 15th International working conference on source code analysis and manipulation (SCAM), pp 131\u2013140","DOI":"10.1109\/SCAM.2015.7335409"},{"key":"9997_CR5","doi-asserted-by":"crossref","unstructured":"Ebert F, Castor F, Novielli N, Serebrenik A (2019) Confusion in code reviews: Reasons, impacts, and coping strategies. In: 2019 IEEE 26th International conference on software analysis, evolution and reengineering (SANER), pp 49\u201360","DOI":"10.1109\/SANER.2019.8668024"},{"issue":"3","key":"9997_CR6","doi-asserted-by":"publisher","first-page":"182","DOI":"10.1147\/sj.153.0182","volume":"15","author":"ME Fagan","year":"1976","unstructured":"Fagan ME (1976) Design and code inspections to reduce errors in program development. IBM Syst J 15(3):182\u2013211","journal-title":"IBM Syst J"},{"key":"9997_CR7","doi-asserted-by":"crossref","unstructured":"Gomez C, Cleary B, Singer L (2013) A study of innovation diffusion through link sharing on stack overflow. In: IEEE international working conference on mining software repositories, pp 81\u201384","DOI":"10.1109\/MSR.2013.6624011"},{"key":"9997_CR8","doi-asserted-by":"crossref","unstructured":"Harrell F.E. Jr., Lee KL, Califf RM, Pryor DB, Rosati RA (1984) Regression modelling strategies for improved prognostic prediction. Stat Med :143\u2013152","DOI":"10.1002\/sim.4780030207"},{"key":"9997_CR9","volume-title":"The elements of statistical learning, data mining, inference, and prediction","author":"T Hastie","year":"2009","unstructured":"Hastie T, Tibshirani R, Friedman J (2009) The elements of statistical learning, data mining, inference, and prediction. Springer, Berlin"},{"key":"9997_CR10","doi-asserted-by":"crossref","unstructured":"Hata H, Treude C, Kula RG, Ishio T (2019) 9.6 Million links in source code comments: purpose, evolution, and decay. In: Proceedings of the 41st international conference on software engineering, pp 1211\u20131221","DOI":"10.1109\/ICSE.2019.00123"},{"key":"9997_CR11","doi-asserted-by":"crossref","unstructured":"Hirao T, McIntosh S, Ihara A, Matsumoto K (2019) The review linkage graph for code review analytics: a recovery approach and empirical study. In: Proceedings of the international symposium on the foundations of software engineering (FSE), pp 578\u2013589","DOI":"10.1145\/3338906.3338949"},{"key":"9997_CR12","doi-asserted-by":"publisher","DOI":"10.1002\/9780470165171","volume-title":"Automated defect prevention: best practices in software management","author":"D Huizinga","year":"2007","unstructured":"Huizinga D, Kolawa A (2007) Automated defect prevention: best practices in software management. Wiley, Hoboken"},{"key":"9997_CR13","doi-asserted-by":"crossref","unstructured":"Jiang J, Cao J, Zhang L (2019) An empirical study of link sharing in review comments. In: Li Z, Jiang H, Li G, Zhou M, Li M (eds) Software engineering and methodology for emerging domains, pp 101\u2013114","DOI":"10.1007\/978-981-15-0310-8_7"},{"key":"9997_CR14","doi-asserted-by":"crossref","unstructured":"Kononenko O, Rose T, Baysal O, Godfrey M, Theisen D, de Water B (2018) Studying pull request merges: A case study of shopify\u2019s active merchant. In: 2018 IEEE\/ACM 40th International conference on software engineering: software engineering in practice track (ICSE-SEIP), pp 124\u2013133","DOI":"10.1145\/3183519.3183542"},{"issue":"3","key":"9997_CR15","doi-asserted-by":"publisher","first-page":"607","DOI":"10.1177\/001316447003000308","volume":"30","author":"RV Krejcie","year":"1970","unstructured":"Krejcie RV, Morgan DW (1970) Determining sample size for research activities. Educ Psychol Meas 30(3):607\u2013610","journal-title":"Educ Psychol Meas"},{"key":"9997_CR16","doi-asserted-by":"crossref","unstructured":"McIntosh S, Kamei Y, Adams B, Hassan AE (2014) The impact of code review coverage and code review participation on software quality: A case study of the qt, vtk, and itk projects. In: Proceedings of the 11th working conference on mining software repositories, pp 192\u2013201","DOI":"10.1145\/2597073.2597076"},{"key":"9997_CR17","doi-asserted-by":"crossref","unstructured":"Mcintosh S, Kamei Y, Adams B, Hassan AE (2016) An empirical study of the impact of modern code review practices on software quality. Empir Softw Eng :2146\u20132189","DOI":"10.1007\/s10664-015-9381-9"},{"key":"9997_CR18","unstructured":"Moksony F (1999) Small is beautiful: The use and interpretation of r2 in social research. Szociologiai Szemle:130\u2013138"},{"key":"9997_CR19","doi-asserted-by":"crossref","unstructured":"Pascarella L, Spadini D, Palomba F, Bruntink M, Bacchelli A (2018) Information needs in contemporary code review. In: Proceedings of the ACM Conference on computer supported cooperative work, vol 2, pp 135:1\u2013135:27","DOI":"10.1145\/3274404"},{"key":"9997_CR20","doi-asserted-by":"crossref","unstructured":"Rath M, Rendall J, Guo JLC, Cleland-Huang J, M\u00e4der P (2018) Traceability in the wild: Automatically augmenting incomplete trace links. In: Proceedings of the 40th International conference on software engineering, ICSE \u201918, pp 834\u2013845","DOI":"10.1145\/3180155.3180207"},{"key":"9997_CR21","doi-asserted-by":"crossref","unstructured":"Rigby PC, Bird C (2013) Convergent contemporary software peer review practices. In: Proceedings of the 9th joint meeting on foundations of software engineering, pp 202\u2013212","DOI":"10.1145\/2491411.2491444"},{"key":"9997_CR22","doi-asserted-by":"crossref","unstructured":"Rigby PC, Storey MA (2011) Understanding broadcast based peer review on open source software projects. In: Proceedings of the 33rd International conference on software engineering, pp 541\u2013550","DOI":"10.1145\/1985793.1985867"},{"key":"9997_CR23","doi-asserted-by":"crossref","unstructured":"Ruangwan S, Thongtanunam P, Ihara A, Matsumoto K (2018) The impact of human factors on the participation decision of reviewers in modern code review. Empir Softw Eng :973\u20131016","DOI":"10.1007\/s10664-018-9646-1"},{"key":"9997_CR24","doi-asserted-by":"crossref","unstructured":"Sadowski C, S\u00f6derberg E, Church L, Sipko M, Bacchelli A (2018) Modern code review: a case study at Google. In: Proceedings of the 39th International conference on software engineering: software engineering in practice track, pp 181\u2013190","DOI":"10.1145\/3183519.3183525"},{"key":"9997_CR25","doi-asserted-by":"crossref","unstructured":"Tao Y, Dang Y, Xie T, Zhang D, Kim S (2012) How do software engineers understand code changes? an exploratory study in industry. In: Proceedings of the ACM SIGSOFT 20th International symposium on the foundations of software engineering, pp 51:1\u201351:11","DOI":"10.1145\/2393596.2393656"},{"key":"9997_CR26","doi-asserted-by":"crossref","unstructured":"Thongtanunam P, Hassan AE (2020) Review dynamics and their impact on software quality. IEEE Trans Softw Eng :1\u20131","DOI":"10.1109\/TSE.2020.2964660"},{"key":"9997_CR27","doi-asserted-by":"crossref","unstructured":"Thongtanunam P, McIntosh S, Hassan AE, Iida H (2016) Revisiting code ownership and its relationship with software quality in the scope of modern code review. In: Proceedings of the 38th international conference on software engineering, pp 1039\u20131050","DOI":"10.1145\/2884781.2884852"},{"issue":"2","key":"9997_CR28","doi-asserted-by":"publisher","first-page":"768","DOI":"10.1007\/s10664-016-9452-6","volume":"22","author":"P Thongtanunam","year":"2017","unstructured":"Thongtanunam P, Mcintosh S, Hassan AE, Iida H (2017) Review participation in modern code review. Empir Softw Eng 22(2):768\u2013817","journal-title":"Empir Softw Eng"},{"issue":"5","key":"9997_CR29","first-page":"360","volume":"37","author":"AJ Viera","year":"2005","unstructured":"Viera AJ, Garrett JM, et al. (2005) Understanding interobserver agreement: The kappa statistic. Fam Med 37(5):360\u2013363","journal-title":"Fam Med"},{"key":"9997_CR30","doi-asserted-by":"crossref","unstructured":"Ye D, Xing Z, Kapre N (2017) The structure and dynamics of knowledge network in domain-specific q&a sites: A case study of stack overflow. Empirical Softw Eng :375\u2013406","DOI":"10.1007\/s10664-016-9430-z"},{"key":"9997_CR31","doi-asserted-by":"crossref","unstructured":"Zampetti F, Ponzanelli L, Bavota G, Mocci A, Di Penta M, Lanza M (2017) How developers document pull requests with external references. In: Proceedings of the 25th international conference on program comprehension, pp 23\u201333","DOI":"10.1109\/ICPC.2017.30"},{"key":"9997_CR32","doi-asserted-by":"crossref","unstructured":"Zhang Y, Yu Y, Wang H, Vasilescu B, Filkov V (2018) Within-ecosystem issue linking: A large-scale study of rails. In: Proceedings of the 7th international workshop on software mining, SoftwareMining, vol 2018, pp 12\u201319","DOI":"10.1145\/3242887.3242891"},{"key":"9997_CR33","doi-asserted-by":"crossref","unstructured":"Zhang Y, Zhou M, Mockus A, Jin Z (2019) Companies\u2019 participation in oss development - an empirical study of openstack. IEEE Trans Softw Eng 1\u20131","DOI":"10.1109\/TSE.2019.2946156"},{"key":"9997_CR34","doi-asserted-by":"publisher","first-page":"1589","DOI":"10.1007\/s11280-019-00770-1","volume":"23","author":"Y Zhang","year":"2020","unstructured":"Zhang Y, Wu Y, Wang T, Wang H (2020) ilinker: a novel approach for issue knowledge acquisition in github projects. World Wide Web 23:1589\u20131619","journal-title":"World Wide Web"}],"container-title":["Empirical Software Engineering"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10664-021-09997-x.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10664-021-09997-x\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10664-021-09997-x.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,8,27]],"date-time":"2021-08-27T19:51:32Z","timestamp":1630093892000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10664-021-09997-x"}},"subtitle":["A case study of the OpenStack and Qt projects"],"short-title":[],"issued":{"date-parts":[[2021,7,8]]},"references-count":34,"journal-issue":{"issue":"5","published-print":{"date-parts":[[2021,9]]}},"alternative-id":["9997"],"URL":"https:\/\/doi.org\/10.1007\/s10664-021-09997-x","relation":{},"ISSN":["1382-3256","1573-7616"],"issn-type":[{"value":"1382-3256","type":"print"},{"value":"1573-7616","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,7,8]]},"assertion":[{"value":"1 June 2021","order":1,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"8 July 2021","order":2,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}],"article-number":"96"}}