{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,9]],"date-time":"2026-07-09T22:41:32Z","timestamp":1783636892301,"version":"3.55.0"},"reference-count":52,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2021,11,2]],"date-time":"2021-11-02T00:00:00Z","timestamp":1635811200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2021,11,2]],"date-time":"2021-11-02T00:00:00Z","timestamp":1635811200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100003329","name":"Ministerio de Econom\u00eda y Competitividad","doi-asserted-by":"publisher","award":["TIN2016-75944-R"],"award-info":[{"award-number":["TIN2016-75944-R"]}],"id":[{"id":"10.13039\/501100003329","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Empir Software Eng"],"published-print":{"date-parts":[[2022,1]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>The role of non-coding contributors in Open Source Software (OSS) is poorly understood. Most of current research around OSS development focuses on the coding aspects of the project (e.g., commits, pull requests or code reviews) while ignoring the potential of other types of contributions. Often, due to the assumption that these other contributions are not significant in number and that, in any case, they are handled by the same people that are also part of the \u201ccoding team\u201d. This paper aims to investigate whether this is actually the case by analyzing the frequency and diversity of non-coding contributions in OSS development. As a sample of projects for our study we have taken the 100 most popular projects in the ecosystem of NPM, a package manager for JavaScript. Our results validate the importance of dedicated non-coding contributors in OSS and the diversity of OSS communities as, typically, a contributor specializes in a specific subset of roles. We foresee that projects adopting explicit policies to attract and onboard them could see a positive impact in their long-term sustainability providing they also put in place the right governance strategies to facilitate the migration and collaboration among the different roles. As part of this work, we also provide a replicability package to facilitate further quantitative role-based analysis by other researchers.<\/jats:p>","DOI":"10.1007\/s10664-021-10061-x","type":"journal-article","created":{"date-parts":[[2021,11,2]],"date-time":"2021-11-02T09:02:46Z","timestamp":1635843766000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":17,"title":["On the analysis of non-coding roles in open source development"],"prefix":"10.1007","volume":"27","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-2326-1700","authenticated-orcid":false,"given":"Javier Luis","family":"C\u00e1novas Izquierdo","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jordi","family":"Cabot","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2021,11,2]]},"reference":[{"issue":"1","key":"10061_CR1","doi-asserted-by":"publisher","first-page":"1936","DOI":"10.1186\/s40064-016-3612-4","volume":"5","author":"A Adewumi","year":"2016","unstructured":"Adewumi A, Misra S, Omoregbe N, Crawford B, Soto R (2016) A systematic literature review of open source software quality assessment models. SpringerPlus 5(1):1936","journal-title":"SpringerPlus"},{"key":"10061_CR2","doi-asserted-by":"crossref","unstructured":"Ashraf U, Mayr-dorn C, Egyed A, Panichella S (2020) A mixed graph-relational dataset of socio-technical interactions in open source systems. In: International conference on mining software repositories, pp 538\u2013542","DOI":"10.1145\/3379597.3387492"},{"issue":"3","key":"10061_CR3","doi-asserted-by":"publisher","first-page":"205","DOI":"10.1080\/07370024.2013.812409","volume":"29","author":"F Barcellini","year":"2014","unstructured":"Barcellini F, D\u00e9tienne F, Burkhardt J (2014) A situated approach of roles and participation in open source software communities. Hum Comput Interact 29(3):205\u2013255","journal-title":"Hum Comput Interact"},{"key":"10061_CR4","doi-asserted-by":"crossref","unstructured":"Barcomb A, Stol K, Riehle D, Fitzgerald B (2019) Why do episodic volunteers stay in FLOSS communities?. In: International conference on software engineering, pp 948\u2013954","DOI":"10.1109\/ICSE.2019.00100"},{"key":"10061_CR5","doi-asserted-by":"crossref","unstructured":"Bhattacharya P, Neamtiu I, Faloutsos M (2014) Determining developers\u2019 expertise and role: a graph hierarchy-based approach. In: International conference on software maintenance and evolution, pp 11\u201320","DOI":"10.1109\/ICSME.2014.23"},{"key":"10061_CR6","doi-asserted-by":"crossref","unstructured":"Blincoe K, Harrison F, Damian DE (2015) Ecosystems in github and a method for ecosystem identification using reference coupling. In: Working conference on mining software repositories, pp 202\u2013211","DOI":"10.1109\/MSR.2015.26"},{"key":"10061_CR7","doi-asserted-by":"crossref","unstructured":"Borges H, Hora AC, Valente MT (2016) Understanding the factors that impact the popularity of github repositories. In: International conference on software maintenance and evolution, pp 334\u2013344","DOI":"10.1109\/ICSME.2016.31"},{"key":"10061_CR8","doi-asserted-by":"crossref","unstructured":"Borges H, Brito R, Valente MT (2019) Beyond textual issues: understanding the usage and impact of github reactions. In: Brazilian symposium on software engineering, pp 397\u2013406","DOI":"10.1145\/3350768.3350788"},{"key":"10061_CR9","doi-asserted-by":"crossref","unstructured":"Capra E, Wasserman AI (2008) A framework for evaluating managerial styles in open source projects. In: Open source development, communities and quality, IFIP 20th world computer congress, working group 2.3 on open source software, IFIP, vol 275, pp 1\u201314","DOI":"10.1007\/978-0-387-09684-1_1"},{"issue":"4","key":"10061_CR10","doi-asserted-by":"publisher","first-page":"322","DOI":"10.1016\/j.jsis.2017.03.001","volume":"26","author":"K Carillo","year":"2017","unstructured":"Carillo K, Huff S, Chawner B (2017) What makes a good contributor? Understanding contributor behavior within large free\/open source software projects\u2014a socialization perspective. J Strateg Inf Syst 26(4):322\u2013359","journal-title":"J Strateg Inf Syst"},{"key":"10061_CR11","doi-asserted-by":"crossref","unstructured":"Casalnuovo C, Vasilescu B, Devanbu P, Filkov V (2015) Developer onboarding in github: the role of prior social links and language experience. In: International symposium on foundations of software engineering, pp 817\u2013828","DOI":"10.1145\/2786805.2786854"},{"key":"10061_CR12","doi-asserted-by":"crossref","unstructured":"Cheng J, Guo JLC (2019) Activity-based analysis of open source software contributors: roles and dynamics. In: International workshop on cooperative and human aspects of software engineering, pp 11\u201318","DOI":"10.1109\/CHASE.2019.00011"},{"key":"10061_CR13","doi-asserted-by":"crossref","unstructured":"Christian J, Vu AN (2020) Task-based structures in open source software: revisiting the onion model. R&D Management","DOI":"10.1111\/radm.12428"},{"key":"10061_CR14","doi-asserted-by":"crossref","unstructured":"Coelho J, Valente MT, Silva LL, Shihab E (2018) Identifying unmaintained projects in github. In: International symposium on empirical software engineering and measurement, pp 15:1\u201315:10","DOI":"10.1145\/3239235.3240501"},{"key":"10061_CR15","doi-asserted-by":"publisher","first-page":"7173","DOI":"10.1109\/ACCESS.2017.2682323","volume":"5","author":"V Cosentino","year":"2017","unstructured":"Cosentino V, C\u00e1novas Izquierdo J, Cabot J (2017) A systematic mapping study of software development with github. IEEE Access 5:7173\u20137192","journal-title":"IEEE Access"},{"issue":"5","key":"10061_CR16","doi-asserted-by":"publisher","first-page":"89","DOI":"10.1109\/MC.2006.152","volume":"39","author":"K Crowston","year":"2006","unstructured":"Crowston K, Howison J (2006) Assessing the health of open source communities. Computer 39(5):89\u201391","journal-title":"Computer"},{"issue":"2","key":"10061_CR17","doi-asserted-by":"publisher","first-page":"7:1","DOI":"10.1145\/2089125.2089127","volume":"44","author":"K Crowston","year":"2012","unstructured":"Crowston K, Wei K, Howison J, Wiggins A (2012) Free\/libre open-source software development: what we know and what we do not know. ACM Comput Surv 44(2):7:1\u20137:35","journal-title":"ACM Comput Surv"},{"key":"10061_CR18","doi-asserted-by":"publisher","first-page":"110573","DOI":"10.1016\/j.jss.2020.110573","volume":"165","author":"A Decan","year":"2020","unstructured":"Decan A, Constantinou E, Mens T, Rocha H (2020) Gap: forecasting commit activity in git projects. J Syst Softw 165:110573","journal-title":"J Syst Softw"},{"key":"10061_CR19","doi-asserted-by":"crossref","unstructured":"Dias E, Meirelles P, Castor F, Steinmacher I, Wiese I (2021) Pinto g what makes a great maintainer of open source projects?. In: International conference on software engineering, pp 982\u2013994","DOI":"10.1109\/ICSE43902.2021.00093"},{"key":"10061_CR20","unstructured":"Eghbal N (2016) Roads and bridges. The unseen labor behind our digital infrastructure"},{"key":"10061_CR21","doi-asserted-by":"crossref","unstructured":"Elazhary O, Storey MD, Ernst NA, Zaidman A (2019) Do as i do, not as i say: do contribution guidelines match the Github contribution process?. In: International conference on software maintenance and evolution, pp 286\u2013290","DOI":"10.1109\/ICSME.2019.00043"},{"key":"10061_CR22","doi-asserted-by":"crossref","unstructured":"Gasparini M, C\u00e1novas Izquierdo J, Claris\u00f3 R, Brambilla M, Cabot J (2019) Analyzing rich-club behavior in open source projects. In: International symposium on open collaboration, pp 6:1\u20136:9","DOI":"10.1145\/3306446.3340825"},{"key":"10061_CR23","doi-asserted-by":"crossref","unstructured":"Gasparini M, Claris\u00f3 R, Brambilla M, Cabot J (2020) Participation inequality and the 90-9-1 principle in open source. In: International symposium on open collaboration, pp 6:1\u20136:7","DOI":"10.1145\/3412569.3412582"},{"key":"10061_CR24","doi-asserted-by":"crossref","unstructured":"Golzadeh M, Legay D, Decan A, Mens T (2020) Bot or not?: detecting bots in Github pull request activity based on comment similarity. In: International conference on software engineering. ACM, pp 31\u201335","DOI":"10.1145\/3387940.3391503"},{"key":"10061_CR25","doi-asserted-by":"crossref","unstructured":"Hata H, Todo T, Onoue S, Matsumoto K (2015) Characteristics of sustainable OSS projects: a theoretical and empirical study. In: International workshop on cooperative and human aspects of software engineering, pp 15\u201321","DOI":"10.1109\/CHASE.2015.9"},{"key":"10061_CR26","doi-asserted-by":"crossref","unstructured":"Jensen C, Scacchi W (2007) Role migration and advancement processes in ossd projects: a comparative case study. In: International conference on software engineering, pp 364\u2013374","DOI":"10.1109\/ICSE.2007.74"},{"key":"10061_CR27","doi-asserted-by":"crossref","unstructured":"Jergensen C, Sarma A, Wagstrom P (2011) The onion patch: migration in open source ecosystems. In: Symposium on the foundations of software engineering, pp 70\u201380","DOI":"10.1145\/2025113.2025127"},{"issue":"5","key":"10061_CR28","doi-asserted-by":"publisher","first-page":"2035","DOI":"10.1007\/s10664-015-9393-5","volume":"21","author":"E Kalliamvakou","year":"2016","unstructured":"Kalliamvakou E, Gousios G, Blincoe K, Singer L, Germ\u00e1n D M, Damian DE (2016) An in-depth study of the promises and perils of mining Github. Empir Softw Eng 21(5):2035\u20132071","journal-title":"Empir Softw Eng"},{"key":"10061_CR29","doi-asserted-by":"crossref","unstructured":"Lee A, Carver JC (2017) Are one-time contributors different? A comparison to core and periphery developers in floss repositories. In: International symposium on empirical software engineering and measurement, pp 1\u201310","DOI":"10.1109\/ESEM.2017.7"},{"issue":"5","key":"10061_CR30","doi-asserted-by":"publisher","first-page":"257","DOI":"10.1016\/j.im.2012.05.005","volume":"49","author":"Y Li","year":"2012","unstructured":"Li Y, Tan CH, Teo HH (2012) Leadership characteristics and developers\u2019 motivation in open source software development. Inf Manag 49(5):257\u2013267","journal-title":"Inf Manag"},{"issue":"2","key":"10061_CR31","doi-asserted-by":"publisher","first-page":"98","DOI":"10.1016\/j.jides.2016.10.006","volume":"3","author":"T Lima","year":"2016","unstructured":"Lima T, dos Santos RP, Oliveira J, Werner C (2016) The importance of socio-technical resources for software ecosystems management. J Innov Digit Ecosyst 3(2):98\u2013113","journal-title":"J Innov Digit Ecosyst"},{"key":"10061_CR32","doi-asserted-by":"crossref","unstructured":"Mockus A, Spinellis D, Kotti Z, Dusing GJ (2020) A complete set of related git repositories identified via community detection approaches based on shared commits. In: International conference on mining software repositories","DOI":"10.1145\/3379597.3387499"},{"key":"10061_CR33","doi-asserted-by":"crossref","unstructured":"Nakamaru T, Matsunaga T, Yamazaki T, Akiyama S, Chiba S (2020) An empirical study of method chaining in java. In: International conference on mining software repositories, pp 93\u2013102","DOI":"10.1145\/3379597.3387441"},{"issue":"5","key":"10061_CR34","doi-asserted-by":"publisher","first-page":"1304","DOI":"10.1587\/transinf.2015EDP7363","volume":"99-D","author":"S Onoue","year":"2016","unstructured":"Onoue S, Hata H, Monden A, Matsumoto K (2016) Investigating and projecting population structures in open source software projects: a case study of projects in github. IEICE Trans Inf Syst 99-D(5):1304\u20131315","journal-title":"IEICE Trans Inf Syst"},{"issue":"1","key":"10061_CR35","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1038\/s41598-019-50463-y","volume":"9","author":"MJ Palazzi","year":"2019","unstructured":"Palazzi MJ, Cabot J, C\u00e1novas Izquierdo J, Sol\u00e9-Ribalta A, Borge-Holthoefer J (2019) Online division of labour: emergent structures in open source software. Sci Rep 9(1):1\u201311","journal-title":"Sci Rep"},{"key":"10061_CR36","doi-asserted-by":"crossref","unstructured":"Pinto G, Steinmacher I, Gerosa MA (2016) More common than you think: an in-depth study of casual contributors. In: International conference on software analysis, evolution, and reengineering, pp 112\u2013123","DOI":"10.1109\/SANER.2016.68"},{"key":"10061_CR37","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3359224","volume":"3","author":"HS Qiu","year":"2019","unstructured":"Qiu HS, Li YL, Padala S, Sarma A, Vasilescu B (2019) The signals that potential contributors look for when choosing open-source projects. ACM Hum-Comput Interact 3:1\u201329","journal-title":"ACM Hum-Comput Interact"},{"key":"10061_CR38","doi-asserted-by":"crossref","unstructured":"Robles G, Arjona Reina L, Serebrenik A, Vasilescu B, Gonz\u00e1lez-Barahona J M (2014) FLOSS 2013: a survey dataset about free software contributors: challenges for curating, sharing, and combining. In: Working conference on mining software repositories, pp 396\u2013399","DOI":"10.1145\/2597073.2597129"},{"key":"10061_CR39","doi-asserted-by":"publisher","first-page":"12","DOI":"10.3389\/fhumd.2021.618207","volume":"3","author":"D Rozas","year":"2021","unstructured":"Rozas D, Gilbert N, Hodkinson P, Hassan S (2021) Talk is silver, code is gold? Beyond traditional notions of contribution in peer production: the case of drupal. Front Hum Dyn 3:12","journal-title":"Front Hum Dyn"},{"issue":"2\u20133","key":"10061_CR40","doi-asserted-by":"publisher","first-page":"229","DOI":"10.1007\/s10606-006-9020-5","volume":"15","author":"W Sack","year":"2006","unstructured":"Sack W, D\u00e9tienne F, Ducheneaut N, Burkhardt JM, Mahendran D, Barcellini F (2006) A methodological framework for socio-cognitive analyses of collaborative design of open source software. Comp Sup Coop Work 15 (2\u20133):229\u2013250","journal-title":"Comp Sup Coop Work"},{"key":"10061_CR41","doi-asserted-by":"crossref","unstructured":"Samoladas I, Gousios G, Spinellis D, Stamelos I (2008) The Sqo-oss quality model: measurement based open source software evaluation. In: Open source development, communities and quality, IFIP 20th world computer congress, working group 2.3 on open source software, vol 275, pp 237\u2013248","DOI":"10.1007\/978-0-387-09684-1_19"},{"key":"10061_CR42","doi-asserted-by":"crossref","unstructured":"Sarker F, Vasilescu B, Blincoe K, Filkov V (2019) Socio-technical work-rate increase associates with changes in work patterns in online projects. In: International conference on software engineering, pp 936\u2013947","DOI":"10.1109\/ICSE.2019.00099"},{"issue":"6","key":"10061_CR43","doi-asserted-by":"publisher","first-page":"3824","DOI":"10.1007\/s10664-019-09713-w","volume":"24","author":"AA Sawant","year":"2019","unstructured":"Sawant AA, Robbes R, Bacchelli A (2019) To react, or not to react: patterns of reaction to Api deprecation. Empir Softw Eng 24(6):3824\u20133870","journal-title":"Empir Softw Eng"},{"key":"10061_CR44","doi-asserted-by":"crossref","unstructured":"Schweik CM, English R (2007) Tragedy of the foss commons? Investigating the institutional designs of free\/libre and open source software projects. First Monday 12(2)","DOI":"10.5210\/fm.v12i2.1619"},{"key":"10061_CR45","doi-asserted-by":"crossref","unstructured":"Soto M, Ciolkowski M (2009) The qualoss open source assessment model measuring the performance of open source communities. In: International symposium on empirical software engineering and measurement, pp 498\u2013501","DOI":"10.1109\/ESEM.2009.5314237"},{"issue":"4","key":"10061_CR46","doi-asserted-by":"publisher","first-page":"41","DOI":"10.1109\/MS.2018.110162131","volume":"36","author":"I Steinmacher","year":"2019","unstructured":"Steinmacher I, Treude C, Gerosa MA (2019) Let me in: guidelines for the successful onboarding of newcomers to open source projects. IEEE Softw 36(4):41\u201349","journal-title":"IEEE Softw"},{"issue":"CSCW2","key":"10061_CR47","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3415251","volume":"4","author":"B Trinkenreich","year":"2020","unstructured":"Trinkenreich B, Guizani M, Wiese I, Sarma A, Steinmacher I (2020) Hidden figures: roles and pathways of successful oss contributors. Proc ACM on Hum-Comput Interact 4(CSCW2):1\u201322","journal-title":"Proc ACM on Hum-Comput Interact"},{"key":"10061_CR48","doi-asserted-by":"crossref","unstructured":"Tsay J, Dabbish L, Herbsleb J (2014a) Influence of social and technical factors for evaluating contribution in github. In: International conference on software engineering, pp 356\u2013366","DOI":"10.1145\/2568225.2568315"},{"key":"10061_CR49","doi-asserted-by":"crossref","unstructured":"Tsay J, Dabbish L, Herbsleb J (2014b) Let\u2019s talk about it: evaluating contributions through discussion in github. In: International symposium on foundations of software engineering, pp 144\u2013154","DOI":"10.1145\/2635868.2635882"},{"key":"10061_CR50","doi-asserted-by":"crossref","unstructured":"Vasilescu B, Filkov V, Serebrenik A (2015) Perceptions of diversity on github: a user survey. In: International workshop on cooperative and human aspects of software engineering, pp 50\u201356","DOI":"10.1109\/CHASE.2015.14"},{"key":"10061_CR51","doi-asserted-by":"crossref","unstructured":"Wang Z, Perry DE (2015) Role distribution and transformation in open source software project teams. In: Asia-pacific software engineering conference, pp 119\u2013126","DOI":"10.1109\/APSEC.2015.12"},{"key":"10061_CR52","doi-asserted-by":"crossref","unstructured":"Yamashita K, McIntosh S, Kamei Y, Hassan AE, Ubayashi N (2015) Revisiting the applicability of the pareto principle to core development teams in open source software projects. In: International workshop on principles of software evolution. ACM, pp 46\u201355","DOI":"10.1145\/2804360.2804366"}],"container-title":["Empirical Software Engineering"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10664-021-10061-x.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10664-021-10061-x\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10664-021-10061-x.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,1,26]],"date-time":"2022-01-26T08:08:59Z","timestamp":1643184539000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10664-021-10061-x"}},"subtitle":["An empirical study of NPM package projects"],"short-title":[],"issued":{"date-parts":[[2021,11,2]]},"references-count":52,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2022,1]]}},"alternative-id":["10061"],"URL":"https:\/\/doi.org\/10.1007\/s10664-021-10061-x","relation":{},"ISSN":["1382-3256","1573-7616"],"issn-type":[{"value":"1382-3256","type":"print"},{"value":"1573-7616","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,11,2]]},"assertion":[{"value":"28 September 2021","order":1,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"2 November 2021","order":2,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}],"article-number":"18"}}