{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,17]],"date-time":"2025-10-17T14:31:09Z","timestamp":1760711469105,"version":"3.44.0"},"reference-count":87,"publisher":"Association for Computing Machinery (ACM)","issue":"1","license":[{"start":{"date-parts":[[2025,1,10]],"date-time":"2025-01-10T00:00:00Z","timestamp":1736467200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100006374","name":"NSF","doi-asserted-by":"publisher","award":["1453548"],"award-info":[{"award-number":["1453548"]}],"id":[{"id":"10.13039\/501100006374","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Hum.-Comput. Interact."],"published-print":{"date-parts":[[2025,1,10]]},"abstract":"<jats:p>Software is crucial to science, but sustaining projects for long term impact is challenging. Scientists and funders look to ''the open source way'' (known as peer production in the organizational literature) as a promising route to sustainability. We studied scientific software projects funded by research grants and which were encouraged by their funder to develop a sustainable community around their open source code. Using interviews and content analysis of online presences, we studied the projects over a seven year period, from receiving grants around 2014 through the typically three years of funding, and for up to four years following the funding. We make four contributions: First, we find that by far the most successful route to peer production was beginning as peer production, a result with clear policy implications. Second, through our taxonomies of organizational forms and of organizational change, we paint a landscape of the variety of forms that scientific software development can take on and transition between providing language for discussion in the literature and among communities of practice. Third, we use these taxonomies to describe multiple routes to sustainable software development. Finally, we discuss the challenges and strategies involved in sustaining scientific software, including choices not to pursue peer production at all.<\/jats:p>","DOI":"10.1145\/3701208","type":"journal-article","created":{"date-parts":[[2025,1,10]],"date-time":"2025-01-10T16:06:46Z","timestamp":1736525206000},"page":"1-25","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":1,"title":["Tales of Transitions: Seeking Scientific Software Sustainability"],"prefix":"10.1145","volume":"9","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-3352-9766","authenticated-orcid":false,"given":"Johanna","family":"Cohoon","sequence":"first","affiliation":[{"name":"Lawrence Berkeley National Lab, Berkeley, CA, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2538-607X","authenticated-orcid":false,"given":"Caifan","family":"Du","sequence":"additional","affiliation":[{"name":"University of Texas at Austin, Austin, TX, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5702-149X","authenticated-orcid":false,"given":"James","family":"Howison","sequence":"additional","affiliation":[{"name":"University of Texas at Austin, Austin, TX, USA"}]}],"member":"320","published-online":{"date-parts":[[2025,1,10]]},"reference":[{"key":"e_1_2_1_1_1","unstructured":"Daniel Atkins. 2003. Report of the National Science Foundation Blue-Ribbon Advisory Panel on Cyberinfrastructure. Technical Report. http:\/\/www.nsf.gov\/od\/oci\/reports\/toc.jsp"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1287\/mnsc.1060.0546"},{"key":"e_1_2_1_3_1","volume-title":"Proceedings of the 5th Americas Conference on Information Systems.","author":"Barry Evelyn J","year":"1999","unstructured":"Evelyn J Barry, Chris F Kemerer, and Sandra A Slaughter. 1999. Toward a detailed classification scheme for software maintenance activities. In Proceedings of the 5th Americas Conference on Information Systems."},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1109\/MS.2015.158"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.2307\/1562247"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1177\/1476127016652606"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1098\/rsta.2011.0136"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.5210\/fm.v4i10.696"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10606-010--9114-y"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/2145204.2145339"},{"key":"e_1_2_1_11_1","volume-title":"When Authorship Isn't Enough: Lessons from CERN on the Implications of Formal and Informal Credit Attribution Mechanisms in Collaborative Research","author":"Birnholtz J","year":"2008","unstructured":"J Birnholtz. 2008. When Authorship Isn't Enough: Lessons from CERN on the Implications of Formal and Informal Credit Attribution Mechanisms in Collaborative Research. Journal of Electronic Publishing, Vol. 11, 1 (2008)."},{"key":"e_1_2_1_12_1","volume-title":"Cost models for future software life cycle processes: COCOMO 2.0. Annals of software engineering","author":"Boehm Barry","year":"1995","unstructured":"Barry Boehm, Bradford Clark, Ellis Horowitz, Chris Westland, Ray Madachy, and Richard Selby. 1995. Cost models for future software life cycle processes: COCOMO 2.0. Annals of software engineering, Vol. 1, 1 (1995), 57--94."},{"key":"e_1_2_1_13_1","doi-asserted-by":"crossref","unstructured":"Geoffrey C. Bowker Paul N. Edwards Steven J. Jackson and C. P. Knobel. 2010. The Long Now of Cyberinfrastructure. In World Wide Research: Reshaping the Sciences and Humanities. MIT Press Cambridge MA.","DOI":"10.7551\/mitpress\/9780262014397.003.0028"},{"key":"e_1_2_1_14_1","volume-title":"Technology transfer and public policy: a review of research and theory. Research policy","author":"Bozeman Barry","year":"2000","unstructured":"Barry Bozeman. 2000. Technology transfer and public policy: a review of research and theory. Research policy, Vol. 29, 4 (2000), 627--655."},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1191\/1478088706qp063oa"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.21105\/joss.02017"},{"key":"e_1_2_1_17_1","volume-title":"Read","author":"Brunson Jason Cory","year":"2020","unstructured":"Jason Cory Brunson and Quentin D. Read. 2020. ggalluvial: Alluvial Plots in 'ggplot2'. http:\/\/corybrunson.github.io\/ggalluvial\/"},{"key":"e_1_2_1_18_1","unstructured":"Chan Zuckerberg Institute. 2021. New Grants Support Software Tools and Diversity in Open Source. https:\/\/chanzuckerberg.com\/newsroom\/czi-awards-16-million-for-foundational-open-source-software-tools-essential-to-biomedicine\/"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.7560\/IC56201"},{"volume-title":"Basics of Qualitative Research","author":"Corbin Juliet","key":"e_1_2_1_20_1","unstructured":"Juliet Corbin and Anselm Strauss. 2014. Basics of Qualitative Research. SAGE. Google-Books-ID: Dc45DQAAQBAJ."},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1109\/MCSE.2013.133"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1002\/spip.259"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/2089125.2089127"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1049\/ic:20040262"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1109\/JCDL.2017.7991584"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.scaman.2012.10.003"},{"key":"e_1_2_1_27_1","volume-title":"arXiv:2008.07753 [cs] (Oct","author":"Dorner Michael","year":"2020","unstructured":"Michael Dorner, Maximilian Capraro, and Ann Barcomb. 2020. Quo Vadis, Open Source? The Limits of Open Source Growth. arXiv:2008.07753 [cs] (Oct. 2020). http:\/\/arxiv.org\/abs\/2008.07753 arXiv: 2008.07753."},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.5334\/jors.bt"},{"volume-title":"A vast machine: Computer models, climate data, and the politics of global warming","author":"Edwards Paul N","key":"e_1_2_1_29_1","unstructured":"Paul N Edwards. 2010. A vast machine: Computer models, climate data, and the politics of global warming. MIT Press, Cambridge, Mass."},{"volume-title":"Working in public: the making and maintenance of open source software \/ by Nadia Eghbal","author":"Eghbal Nadia","key":"e_1_2_1_30_1","unstructured":"Nadia Eghbal. 2020. Working in public: the making and maintenance of open source software \/ by Nadia Eghbal first edition ed.). Stripe Press, San Francisco, California. Book Title: Working in public : the making and maintenance of open source software."},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/299157.299167"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-9280.1997.tb00540.x"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.5465\/amr.2007.26586092"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.5555\/2017296.2017298"},{"volume-title":"Producing open source software: How to run a successful free software project. \" O'Reilly Media","author":"Fogel Karl","key":"e_1_2_1_35_1","unstructured":"Karl Fogel. 2005. Producing open source software: How to run a successful free software project. \" O'Reilly Media, Inc.\"."},{"key":"e_1_2_1_36_1","volume-title":"The Venture Capital Secret: 3 Out of 4 Start-Ups Fail. Wall Street Journal (Sept","author":"Gage Deborah","year":"2012","unstructured":"Deborah Gage. 2012. The Venture Capital Secret: 3 Out of 4 Start-Ups Fail. Wall Street Journal (Sept. 2012). http:\/\/online.wsj.com\/article\/SB10000872396390443720204578004980476429190.html"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/3449249"},{"key":"e_1_2_1_38_1","volume-title":"David De Roure, and Sean Bechhofer","author":"Goble Carole","year":"2013","unstructured":"Carole Goble, David De Roure, and Sean Bechhofer. 2013. Accelerating Scientists' Knowledge Turns. In Knowledge Discovery, Knowledge Engineering and Knowledge Management,, Ana Fred, Jan L. G. Dietz, Kecheng Liu, and Joaquim Filipe (Eds.). Number 348 in Communications in Computer and Information Science. Springer Berlin Heidelberg, 3--25."},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.25300\/MISQ\/2014\/38.1.02"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/1958824.1958904"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/2441776.2441828"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/2441776.2441825"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1109\/MC.2018.2885970"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/2441776.2441902"},{"volume-title":"Lab girl","author":"Jahren Hope","key":"e_1_2_1_45_1","unstructured":"Hope Jahren. 2016. Lab girl first edition. ed.). Alfred AKnopf, New York."},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.12688\/f1000research.25561.1"},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.5334\/jors.an"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.24251\/HICSS.2021.873"},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1109\/MCSE.2018.2883051"},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.2307\/257028"},{"volume-title":"Harvard Education Press","author":"Knorr-Cetina Karin","key":"e_1_2_1_51_1","unstructured":"Karin Knorr-Cetina. 1999. Epistemic Communities. Harvard Education Press, Cambridge, MA."},{"key":"e_1_2_1_52_1","volume-title":"Laboratory Life: The Construction of Scientific Facts","author":"Latour Bruno","year":"1986","unstructured":"Bruno Latour and Steve Woolgar. 1986. Laboratory Life: The Construction of Scientific Facts. Princeton University Press. Google-Books-ID: XTcjm0flPdYC."},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1145\/1180875.1180950"},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1287\/orsc.2013.0872"},{"key":"e_1_2_1_55_1","volume-title":"Meyer and Ralph Schroeder","author":"Eric","year":"2015","unstructured":"Eric T. Meyer and Ralph Schroeder. 2015. Knowledge Machines: Digital Transformations of the Sciences and Humanities. MIT Press, Cambridge, MA, USA."},{"key":"e_1_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.1287\/mnsc.26.3.322"},{"key":"e_1_2_1_57_1","unstructured":"NSF. 2016. Software Infrastructure for Sustained Innovation (SI2: SSE & SSI). https:\/\/www.nsf.gov\/pubs\/2016\/nsf16532\/nsf16532.htm"},{"volume-title":"Transforming Science Through Cyberinfrastructure: NSF's Blueprint for a National Cyberinfrastructure Ecosystem for Science and Engineering in the 21st Century. (2019), 33","author":"NSF.","key":"e_1_2_1_58_1","unstructured":"NSF. 2019. Transforming Science Through Cyberinfrastructure: NSF's Blueprint for a National Cyberinfrastructure Ecosystem for Science and Engineering in the 21st Century. (2019), 33."},{"volume-title":"Scientific Collaboration on the Internet","author":"Olson Gary M.","key":"e_1_2_1_59_1","unstructured":"Gary M. Olson, Ann Zimmerman, Nathan Bos, and William Wulf. 2008. Scientific Collaboration on the Internet. The MIT Press, Cambridge, MA."},{"key":"e_1_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10606-020-09372--2"},{"key":"e_1_2_1_61_1","doi-asserted-by":"publisher","DOI":"10.1049\/ic.2012.0004"},{"key":"e_1_2_1_62_1","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pcbi.1002802"},{"key":"e_1_2_1_63_1","doi-asserted-by":"publisher","DOI":"10.5210\/fm.v3i2.578"},{"volume-title":"Proceedings of the Third International Conference on e-Social Science. http:\/\/davidribes.com\/docs\/RibesFinholt-LearningFromEScience(submitted).pdf","author":"Ribes David","key":"e_1_2_1_64_1","unstructured":"David Ribes and Thomas A. Finholt. 2007. Planning infrastructure for the long-term: Learning from cases in the natural sciences. In Proceedings of the Third International Conference on e-Social Science. http:\/\/davidribes.com\/docs\/RibesFinholt-LearningFromEScience(submitted).pdf"},{"key":"e_1_2_1_65_1","doi-asserted-by":"publisher","DOI":"10.1287\/mnsc.1060.0554"},{"key":"e_1_2_1_66_1","volume-title":"Proceedings of the First International Conference on Open Source Systems,, Marco Scotto and Giancarlo Succi (Eds.). 107","author":"Robles Gregorio","year":"2005","unstructured":"Gregorio Robles, Jesus M. Gonzalez-Barahona, and Martin Michlmayr. 2005. Evolution of Volunteer Participation in Libre Software Projects: Evidence from Debian. In Proceedings of the First International Conference on Open Source Systems,, Marco Scotto and Giancarlo Succi (Eds.). 107."},{"key":"e_1_2_1_67_1","volume-title":"English","author":"Schweik Charles M.","year":"2012","unstructured":"Charles M. Schweik and Robert C. English. 2012. Internet Success: A Study of Open-Source Software Commons. MIT Press. Google-Books-ID: 1tbxCwAAQBAJ."},{"key":"e_1_2_1_68_1","volume-title":"Proc. 2008 Workshop Software Eng. in Computational Science and Eng. (SecSe 08)","author":"Segal J.","year":"2008","unstructured":"J. Segal. 2008. Models of Scientific Software Development. In Proc. 2008 Workshop Software Eng. in Computational Science and Eng. (SecSe 08). http:\/\/www.cse.msstate.edu\/ SECSE08\/Papers\/Segal.pdf"},{"key":"e_1_2_1_69_1","doi-asserted-by":"publisher","DOI":"10.1287\/mnsc.1060.0553"},{"key":"e_1_2_1_70_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.infoandorg.2017.04.001"},{"volume-title":"The Scientific Life: A Moral History of a Late Modern Vocation illustrated edition ed.)","author":"Shapin Steven","key":"e_1_2_1_71_1","unstructured":"Steven Shapin. 2010. The Scientific Life: A Moral History of a Late Modern Vocation illustrated edition ed.). University of Chicago Press, Chicago."},{"key":"e_1_2_1_72_1","doi-asserted-by":"publisher","DOI":"10.1177\/0149206308324324"},{"key":"e_1_2_1_73_1","doi-asserted-by":"publisher","DOI":"10.1145\/192844.193021"},{"volume-title":"How Economics Shapes Science 1 ed.)","author":"Stephan Paula","key":"e_1_2_1_74_1","unstructured":"Paula Stephan. 2012. How Economics Shapes Science 1 ed.). Harvard University Press."},{"key":"e_1_2_1_75_1","volume-title":"The Success of Open Source - Steven Weber","author":"Weber Steven","year":"1858","unstructured":"Steven Weber. 2005. The Success of Open Source - Steven Weber. Harvard University Press, Boston, MA. https:\/\/www.hup.harvard.edu\/catalog.php?isbn=9780674018587"},{"volume-title":"Genre analysis: English in academic and research settings","author":"Swales John","key":"e_1_2_1_76_1","unstructured":"John Swales. 1990. Genre analysis: English in academic and research settings. Cambridge University Press, Cambridge [England] ; New York."},{"key":"e_1_2_1_77_1","volume-title":"Profiting from technological innovation: Implications for integration, collaboration, licensing and public policy. Research policy","author":"Teece David J","year":"1986","unstructured":"David J Teece. 1986. Profiting from technological innovation: Implications for integration, collaboration, licensing and public policy. Research policy, Vol. 15, 6 (1986), 285--305."},{"key":"e_1_2_1_78_1","doi-asserted-by":"publisher","unstructured":"Jonathan Tennant Ritwik Agarwal David Brassard Tom Crick Daniel J. Dunleavy Thomas Rhys Evans Nicholas Gardner Monica Gonzalez-Marquez Daniel Graziotin Bastian Greshake Tzovaras Daniel Gunnarsson Johanna Havemann Mohammad Hosseini Daniel S. Katz Marcel Kn\u00f6chelmann Christopher R Madan Paolo Manghi Alberto Marocchino Paola Masuzzo Peter Murray-Rust Sanjay Narayanaswamy Gustav Nilsonne Josmel Pacheco-Mendoza Bart Penders Olivier Pourret Michael Rera John Samuel Tobias Steiner Jadranka Stojanovski Alejandro Uribe-Tirado Rutger Vos Simon Worthington and Tal Yarkoni. 2020. A tale of two 'opens': intersections between Free and Open Source Software and Open Scholarship. preprint. SocArXiv. https:\/\/doi.org\/10.31235\/osf.io\/2kxq8","DOI":"10.31235\/osf.io\/2kxq8"},{"key":"e_1_2_1_79_1","doi-asserted-by":"publisher","DOI":"10.1145\/2660398.2660420"},{"key":"e_1_2_1_80_1","doi-asserted-by":"publisher","DOI":"10.1145\/2675133.2675172"},{"key":"e_1_2_1_81_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.infsof.2023.107316"},{"key":"e_1_2_1_82_1","volume-title":"Shaping Science: Organizations, Decisions, and Culture on NASA's Teams","author":"Vertesi Janet","year":"2020","unstructured":"Janet Vertesi. 2020. Shaping Science: Organizations, Decisions, and Culture on NASA's Teams. University of Chicago Press, Chicago, IL. https:\/\/press.uchicago.edu\/ucp\/books\/book\/chicago\/S\/bo49911700.html"},{"key":"e_1_2_1_83_1","doi-asserted-by":"publisher","DOI":"10.1287\/orsc.14.2.209.14992"},{"key":"e_1_2_1_84_1","unstructured":"P. Wagstrom James D. Herbsleb R. E. Kraut and A. Mockus. 2010. The Impact of Commercial Organizations on Volunteer Participation in an Online Community. http:\/\/www.casos.cs.cmu.edu\/publications\/papers\/2010The%20ImpactOfCommericial.pdf"},{"key":"e_1_2_1_85_1","doi-asserted-by":"publisher","DOI":"10.2307\/258556"},{"key":"e_1_2_1_86_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.infoandorg.2014.10.003"},{"key":"e_1_2_1_87_1","doi-asserted-by":"publisher","DOI":"10.2307\/258774"}],"container-title":["Proceedings of the ACM on Human-Computer Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3701208","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3701208","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,8,22]],"date-time":"2025-08-22T14:25:30Z","timestamp":1755872730000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3701208"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,1,10]]},"references-count":87,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2025,1,10]]}},"alternative-id":["10.1145\/3701208"],"URL":"https:\/\/doi.org\/10.1145\/3701208","relation":{},"ISSN":["2573-0142"],"issn-type":[{"type":"electronic","value":"2573-0142"}],"subject":[],"published":{"date-parts":[[2025,1,10]]},"assertion":[{"value":"2025-01-10","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}