{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,13]],"date-time":"2026-03-13T22:56:33Z","timestamp":1773442593371,"version":"3.50.1"},"reference-count":22,"publisher":"Public Library of Science (PLoS)","issue":"9","license":[{"start":{"date-parts":[[2024,9,5]],"date-time":"2024-09-05T00:00:00Z","timestamp":1725494400000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100000025","name":"National Institute of Mental Health","doi-asserted-by":"publisher","award":["MH121868"],"award-info":[{"award-number":["MH121868"]}],"id":[{"id":"10.13039\/100000025","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000025","name":"National Institute of Mental Health","doi-asserted-by":"publisher","award":["MH121867"],"award-info":[{"award-number":["MH121867"]}],"id":[{"id":"10.13039\/100000025","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["1934292"],"award-info":[{"award-number":["1934292"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000070","name":"National Institute of Biomedical Imaging and Bioengineering","doi-asserted-by":"publisher","award":["EB027585"],"award-info":[{"award-number":["EB027585"]}],"id":[{"id":"10.13039\/100000070","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100014989","name":"Chan Zuckerberg Initiative","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100014989","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000879","name":"Alfred P. Sloan Foundation","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100000879","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000936","name":"Gordon and Betty Moore Foundation","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100000936","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["www.ploscompbiol.org"],"crossmark-restriction":false},"short-container-title":["PLoS Comput Biol"],"abstract":"<jats:p>As large, high-dimensional data have become more common, software development is playing an increasingly important role in research across many different fields. This creates a need to adopt software engineering practices in research settings. Code review is the engineering practice of giving and receiving detailed feedback on a computer program. Consistent and continuous examination of the evolution of computer programs by others has been shown to be beneficial, especially when reviewers are familiar with the technical aspects of the software and also when they possess relevant domain expertise. The rules described in the present article provide information about the why, when, and how of code review. They provide the motivation for continual code reviews as a natural part of a rigorous research program. They provide practical guidelines for conducting review of code both in person, as a \u201clab meeting for code,\u201d as well as asynchronously, using industry-standard online tools. A set of guidelines is provided for the nitty-gritty details of code review, as well as for the etiquette of such a review. Both the technical and the social aspects of code review are covered to provide the reader with a comprehensive approach that facilitates an effective, enjoyable, and educational approach to code review.<\/jats:p>","DOI":"10.1371\/journal.pcbi.1012375","type":"journal-article","created":{"date-parts":[[2024,9,5]],"date-time":"2024-09-05T17:32:57Z","timestamp":1725557577000},"page":"e1012375","update-policy":"https:\/\/doi.org\/10.1371\/journal.pcbi.corrections_policy","source":"Crossref","is-referenced-by-count":7,"title":["Ten simple rules for scientific code review"],"prefix":"10.1371","volume":"20","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-0679-1985","authenticated-orcid":true,"given":"Ariel","family":"Rokem","sequence":"first","affiliation":[]}],"member":"340","published-online":{"date-parts":[[2024,9,5]]},"reference":[{"issue":"10","key":"pcbi.1012375.ref001","doi-asserted-by":"crossref","first-page":"e1005755","DOI":"10.1371\/journal.pcbi.1005755","article-title":"Unmet needs for analyzing biological big data: A survey of 704 NSF principal investigators","volume":"13","author":"L Barone","year":"2017","journal-title":"PLoS Comput Biol"},{"issue":"2","key":"pcbi.1012375.ref002","article-title":"Software engineering practices in academia: Promoting the 3Rs\u2014readability, resilience, and reuse","volume":"5","author":"A Connolly","year":"2023","journal-title":"Harv Data Sci Rev"},{"issue":"5","key":"pcbi.1012375.ref003","doi-asserted-by":"crossref","first-page":"4","DOI":"10.1109\/MIC.2014.88","article-title":"Better Software, Better Research","volume":"18","author":"C. Goble","year":"2014","journal-title":"IEEE Internet Comput"},{"issue":"2.3","key":"pcbi.1012375.ref004","doi-asserted-by":"crossref","first-page":"258","DOI":"10.1147\/sj.382.0258","article-title":"Design and code inspections to reduce errors in program development","volume":"38","author":"ME Fagan","year":"1999","journal-title":"IBM Syst J"},{"issue":"5","key":"pcbi.1012375.ref005","doi-asserted-by":"crossref","first-page":"2146","DOI":"10.1007\/s10664-015-9381-9","article-title":"An empirical study of the impact of modern code review practices on software quality","volume":"21","author":"S McIntosh","year":"2016","journal-title":"Empir Softw Eng"},{"key":"pcbi.1012375.ref006","author":"M Petre","year":"2014","journal-title":"Code review for and by scientists"},{"issue":"10","key":"pcbi.1012375.ref007","doi-asserted-by":"crossref","first-page":"e1003285","DOI":"10.1371\/journal.pcbi.1003285","article-title":"Ten simple rules for reproducible computational research","volume":"9","author":"GK Sandve","year":"2013","journal-title":"PLoS Comput Biol"},{"issue":"5807","key":"pcbi.1012375.ref008","doi-asserted-by":"crossref","first-page":"1856","DOI":"10.1126\/science.314.5807.1856","article-title":"Scientific publishing. A scientist\u2019s nightmare: software problem leads to five retractions","volume":"314","author":"G. Miller","year":"2006","journal-title":"Science"},{"issue":"6","key":"pcbi.1012375.ref009","doi-asserted-by":"crossref","first-page":"1498","DOI":"10.1016\/j.jss.2012.12.052","article-title":"An exploration of technical debt","volume":"86","author":"E Tom","year":"2013","journal-title":"J Syst Softw"},{"key":"pcbi.1012375.ref010","volume-title":"Neuroimaging and Data Science: An Introduction.","author":"A Rokem","year":"2023"},{"key":"pcbi.1012375.ref011","author":"H Wickham","year":"2023","edition":"2"},{"key":"pcbi.1012375.ref012","doi-asserted-by":"crossref","first-page":"8","DOI":"10.3389\/fninf.2014.00008","article-title":"Dipy, a library for the analysis of diffusion MRI data","volume":"8","author":"E Garyfallidis","year":"2014","journal-title":"Front Neuroinform"},{"key":"pcbi.1012375.ref013","first-page":"1","article-title":"Evaluating the reliability of human brain white matter tractometry","volume":"1","author":"J Kruper","year":"2021","journal-title":"Aperture"},{"issue":"7","key":"pcbi.1012375.ref014","doi-asserted-by":"crossref","first-page":"e1004947","DOI":"10.1371\/journal.pcbi.1004947","article-title":"Ten Simple Rules for Taking Advantage of Git and GitHub","volume":"12","author":"Y Perez-Riverol","year":"2016","journal-title":"PLoS Comput Biol"},{"issue":"4","key":"pcbi.1012375.ref015","doi-asserted-by":"crossref","first-page":"e1005412","DOI":"10.1371\/journal.pcbi.1005412","article-title":"Ten simple rules for making research software more robust","volume":"13","author":"M Taschuk","year":"2017","journal-title":"PLoS Comput Biol"},{"key":"pcbi.1012375.ref016","volume-title":"The Practice of Reproducible Research: Case Studies and Lessons from the Data-Intensive Sciences","author":"A Rokem","year":"2018"},{"issue":"2","key":"pcbi.1012375.ref017","doi-asserted-by":"crossref","first-page":"31","DOI":"10.1109\/MCSE.2010.118","article-title":"Cython: The best of both worlds","volume":"13","author":"S Behnel","year":"2010","journal-title":"Comput Sci Eng"},{"key":"pcbi.1012375.ref018","first-page":"1","author":"SK Lam","year":"2015","journal-title":"Numba: A llvm-based python jit compiler: Proceedings of the Second Workshop on the LLVM Compiler Infrastructure in HPC"},{"issue":"4","key":"pcbi.1012375.ref019","doi-asserted-by":"crossref","first-page":"534","DOI":"10.1109\/TSE.2009.27","article-title":"The Impact of Design and Code Reviews on Software Quality: An Empirical Study Based on PSP Data","volume":"35","author":"CF Kemerer","year":"2009","journal-title":"IEEE Trans Software Eng"},{"issue":"3","key":"pcbi.1012375.ref020","doi-asserted-by":"crossref","first-page":"424","DOI":"10.1037\/edu0000061","article-title":"Computing whether she belongs: Stereotypes undermine girls\u2019 interest and sense of belonging in computer science","volume":"108","author":"A Master","year":"2016","journal-title":"J Educ Psychol"},{"key":"pcbi.1012375.ref021","doi-asserted-by":"crossref","first-page":"49","DOI":"10.3389\/fpsyg.2015.00049","article-title":"Cultural stereotypes as gatekeepers: increasing girls\u2019 interest in computer science and engineering by diversifying stereotypes","volume":"6","author":"S Cheryan","year":"2015","journal-title":"Front Psychol"},{"key":"pcbi.1012375.ref022","first-page":"654","author":"A Zavaleta Bernuy","year":"2022"}],"container-title":["PLOS Computational Biology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pcbi.1012375","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,9,5]],"date-time":"2024-09-05T17:33:15Z","timestamp":1725557595000},"score":1,"resource":{"primary":{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pcbi.1012375"}},"subtitle":[],"editor":[{"given":"Scott","family":"Markel","sequence":"first","affiliation":[]}],"short-title":[],"issued":{"date-parts":[[2024,9,5]]},"references-count":22,"journal-issue":{"issue":"9","published-online":{"date-parts":[[2024,9,5]]}},"URL":"https:\/\/doi.org\/10.1371\/journal.pcbi.1012375","relation":{},"ISSN":["1553-7358"],"issn-type":[{"value":"1553-7358","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,9,5]]}}}