{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,8,12]],"date-time":"2025-08-12T22:17:37Z","timestamp":1755037057466,"version":"3.37.3"},"reference-count":79,"publisher":"Springer Science and Business Media LLC","issue":"4","license":[{"start":{"date-parts":[[2023,7,1]],"date-time":"2023-07-01T00:00:00Z","timestamp":1688169600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,7,15]],"date-time":"2023-07-15T00:00:00Z","timestamp":1689379200000},"content-version":"vor","delay-in-days":14,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100000046","name":"National Research Council Canada","doi-asserted-by":"publisher","award":["RGPIN-2021-04232","DGECR-2021-00283"],"award-info":[{"award-number":["RGPIN-2021-04232","DGECR-2021-00283"]}],"id":[{"id":"10.13039\/501100000046","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Empir Software Eng"],"published-print":{"date-parts":[[2023,7]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Software documentation is often neglected, impacting maintenance and reuse and leading to technical issues. In particular, when working with scientific software, such issues in the documentation pose a risk to producing reliable scientific results as they may cause improper or incorrect use of the software. R is a popular programming language for scientific software with a prolific package-based ecosystem, where users contribute packages (i.e., libraries). R packages are intended to be reused, and their users rely extensively on the available documentation. Thus, understanding what information developers provide in their packages\u2019 documentation (generally, through a system known as Roxygen, based on Javadoc) is essential to contribute to it. This study mined 379 GitHub repositories of R packages and analysed a sample to develop a taxonomy of natural language descriptions used in Roxygen documentation. This was done through hybrid card sorting, which included two experienced R developers. The resulting taxonomy covers parameters, returns, and descriptions, providing a baseline for further studies. Our taxonomy is the first of its kind for R. Based on previous studies in pure object-oriented languages, our taxonomy could be extensible to other dynamically-typed languages used in scientific programming.<\/jats:p>","DOI":"10.1007\/s10664-023-10345-4","type":"journal-article","created":{"date-parts":[[2023,7,15]],"date-time":"2023-07-15T11:01:36Z","timestamp":1689418896000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["Towards a taxonomy of Roxygen documentation in R packages"],"prefix":"10.1007","volume":"28","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-4099-1430","authenticated-orcid":false,"given":"Melina","family":"Vidoni","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Zadia","family":"Codabux","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2023,7,15]]},"reference":[{"key":"10345_CR1","doi-asserted-by":"crossref","unstructured":"Aghajani E, Nagy C, Vega-M\u00e1rquez OL, Linares-V\u00e1squez M, Moreno L, Bavota G, Lanza M (2019) Software Documentation Issues Unveiled. In: IEEE\/ACM 41st International Conference on Software Engineering (ICSE), IEEE, Montreal, Canada, pp 1199\u20131210, 10.1109\/ICSE.2019.00122","DOI":"10.1109\/ICSE.2019.00122"},{"key":"10345_CR2","first-page":"590","volume-title":"42nd International Conference on Software Engineering (ICSE)","author":"E Aghajani","year":"2020","unstructured":"Aghajani E, Nagy C, Linares-V\u00e1squez M, Moreno L, Bavota G, Lanza M, Shepherd DC (2020) Software documentation: The practitioners\u2019 perspective. 42nd International Conference on Software Engineering (ICSE). IEEE\/ACM, South Korea, pp 590\u2013601"},{"issue":"3","key":"10345_CR3","doi-asserted-by":"publisher","first-page":"18","DOI":"10.1109\/MCSE.2014.5","volume":"16","author":"S Ahalt","year":"2014","unstructured":"Ahalt S, Band L, Christopherson L, Idaszak R, Lenhardt C, Minsker B, Palmer M, Shelley M, Tiemann M, Zimmerman A (2014) Water Science Software Institute: Agile and Open Source Scientific Software Development. Computing in Science Engineering 16(3):18\u201326. https:\/\/doi.org\/10.1109\/MCSE.2014.5","journal-title":"Computing in Science Engineering"},{"issue":"2","key":"10345_CR4","doi-asserted-by":"publisher","first-page":"137","DOI":"10.1038\/s41592-019-0654-x","volume":"17","author":"RA Amezquita","year":"2020","unstructured":"Amezquita RA, Lun ATL, Becht E, Carey VJ, Carpp LN, Geistlinger L, Marini F, Rue-Albrecht K, Risso D, Soneson C, Waldron L, Pag\u00e8s H, Smith ML, Huber W, Morgan M, Gottardo R, Hicks SC (2020) Orchestrating single-cell analysis with bioconductor. Nature Methods 17(2):137\u2013145. https:\/\/doi.org\/10.1038\/s41592-019-0654-x","journal-title":"Nature Methods"},{"key":"10345_CR5","doi-asserted-by":"publisher","unstructured":"Ampatzoglou A, Bibi S, Avgeriou P, Verbeek M, Chatzigeorgiou A (2019) Identifying, categorizing and mitigating threats to validity in software engineering secondary studies. Information and Software Technology 106:201\u2013230. https:\/\/doi.org\/10.1016\/j.infsof.2018.10.006, https:\/\/www.sciencedirect.com\/science\/article\/pii\/S0950584918302106","DOI":"10.1016\/j.infsof.2018.10.006"},{"key":"10345_CR6","doi-asserted-by":"crossref","unstructured":"Arnaoudova V, Di\u00a0Penta M, Antoniol G, Gu\u00e9h\u00e9neuc YG (2013) A new family of software anti-patterns: Linguistic anti-patterns. In: 17th European Conference on Software Maintenance and Reengineering, pp 187\u2013196, 10.1109\/CSMR.2013.28","DOI":"10.1109\/CSMR.2013.28"},{"issue":"4","key":"10345_CR7","doi-asserted-by":"publisher","DOI":"10.1002\/ecs2.3060","volume":"11","author":"LA Auker","year":"2020","unstructured":"Auker LA, Barthelmess EL (2020) Teaching r in the undergraduate ecology classroom: approaches, lessons learned, and recommendations. Ecosphere 11(4):e03060. https:\/\/doi.org\/10.1002\/ecs2.3060","journal-title":"Ecosphere"},{"key":"10345_CR8","doi-asserted-by":"publisher","unstructured":"Barbez A, Khomh F, Gu\u00e9h\u00e9neuc YG (2020) A machine-learning based ensemble method for anti-patterns detection. Journal of Systems and Software 161:110486. https:\/\/doi.org\/10.1016\/j.jss.2019.110486, https:\/\/www.sciencedirect.com\/science\/article\/pii\/S0164121219302602","DOI":"10.1016\/j.jss.2019.110486"},{"issue":"1","key":"10345_CR9","doi-asserted-by":"publisher","first-page":"120","DOI":"10.1007\/s41109-019-0193-5","volume":"4","author":"OA Blanthorn","year":"2019","unstructured":"Blanthorn OA, Caine CM, Navarro-L\u00f3pez EM (2019) Evolution of communities of software: using tensor decompositions to compare software ecosystems. Applied Network Science 4(1):120. https:\/\/doi.org\/10.1007\/s41109-019-0193-5","journal-title":"Applied Network Science"},{"key":"10345_CR10","unstructured":"Blasi A, Kuznetsov K, Goffi A, Castellanos SD, Gorla A, Ernst MD, Pezz\u00e8 M (2017) Semantic-based analysis of javadoc comments. In: Proceedings of the Seminar Series on Advanced Techniques and Tools for Software Evolution SATToSE 2017, SATToSE, Madrid, Spain, pp 1\u20135"},{"key":"10345_CR11","doi-asserted-by":"publisher","first-page":"65","DOI":"10.1016\/j.infsof.2018.10.012","volume":"107","author":"H Brabra","year":"2019","unstructured":"Brabra H, Mtibaa A, Petrillo F, Merle P, Sliman L, Moha N, Gaaloul W, Gu\u00e9h\u00e9neuc YG, Benatallah B, Gargouri F (2019) On semantic detection of cloud api (anti)patterns. Information and Software Technology 107:65\u201382. https:\/\/doi.org\/10.1016\/j.infsof.2018.10.012","journal-title":"Information and Software Technology"},{"key":"10345_CR12","first-page":"10","volume-title":"Leveraging Applications of Formal Methods, Verification and Validation","author":"M Broy","year":"2022","unstructured":"Broy M (2022) Software system documentation: Coherent description of software system properties. In: Margaria T, Steffen B (eds) Leveraging Applications of Formal Methods, Verification and Validation. Software Engineering, Springer Nature Switzerland, Cham, pp 10\u201327"},{"issue":"1","key":"10345_CR13","doi-asserted-by":"publisher","first-page":"20","DOI":"10.1080\/00031305.2017.1399928","volume":"72","author":"J Bryan","year":"2018","unstructured":"Bryan J (2018) Excuse me, do you have a moment to talk about version control? The American Statistician 72(1):20\u201327. https:\/\/doi.org\/10.1080\/00031305.2017.1399928","journal-title":"The American Statistician"},{"key":"10345_CR14","unstructured":"Bryan J (2021) Happy Git and GitHub for the useR. RStudio, https:\/\/happygitwithr.com\/index.html"},{"key":"10345_CR15","volume-title":"Software Design","author":"D Budgen","year":"2003","unstructured":"Budgen D (2003) Software Design, 2nd edn. Addison-Wesley Longman Publishing Co., Inc, USA","edition":"2"},{"key":"10345_CR16","doi-asserted-by":"publisher","DOI":"10.1007\/978-0-387-75936-4","volume-title":"Software for Data Analysis: Programming With R","author":"JM Chambers","year":"2008","unstructured":"Chambers JM (2008) Software for Data Analysis: Programming With R, vol 2. Springer, CA, USA"},{"key":"10345_CR17","doi-asserted-by":"crossref","unstructured":"Cho W, Lim Y, Lee H, Varma MK, Lee M, Choi E (2014) Big Data Analysis with Interactive Visualization using R packages. In: Proceedings of the 2014 International Conference on Big Data Science and Computing, Association for Computing Machinery, Beijing, China, BigDataScience \u201914, pp 1\u20136, 10.1145\/2640087.2644168","DOI":"10.1145\/2640087.2644168"},{"key":"10345_CR18","doi-asserted-by":"crossref","unstructured":"Claes M, Mens T, Tabout N, Grosjean P (2015) An empirical study of identical function clones in CRAN. In: 2015 IEEE 9th International Workshop on Software Clones (IWSC), IEEE, Montreal, Canada, pp 19\u201325, 10.1109\/IWSC.2015.7069885","DOI":"10.1109\/IWSC.2015.7069885"},{"key":"10345_CR19","first-page":"195","volume-title":"2021 International Conference on Mining Software Repositories","author":"Z Codabux","year":"2021","unstructured":"Codabux Z, Vidoni M, Fard F (2021) Technical Debt in the Peer-Review Documentation of R Packages: a rOpenSci Case Study. 2021 International Conference on Mining Software Repositories. IEEE, Madrid, Spain, pp 195\u2013206"},{"key":"10345_CR20","doi-asserted-by":"crossref","unstructured":"Datta S, Nagabandi V (2017) Integrating data science and r programming at an early stage. In: 2017 IEEE 4th International Conference on Soft Computing Machine Intelligence (ISCMI), IEEE, Mauritius, pp 1\u20135, 10.1109\/ISCMI.2017.8279587","DOI":"10.1109\/ISCMI.2017.8279587"},{"key":"10345_CR21","doi-asserted-by":"crossref","unstructured":"Decan A, Mens T, Claes M, Grosjean P (2015) On the development and distribution of r packages: An empirical analysis of the r ecosystem. In: Proceedings of the 2015 European Conference on Software Architecture Workshops, Association for Computing Machinery, New York, NY, USA, ECSAW \u201915, pp 1\u20136, 10.1145\/2797433.2797476","DOI":"10.1145\/2797433.2797476"},{"key":"10345_CR22","doi-asserted-by":"crossref","unstructured":"Decan A, Mens T, Claes M, Grosjean P (2016) When github meets cran: An analysis of inter-repository package dependency problems. In: 2016 IEEE 23rd International Conference on Software Analysis, Evolution, and Reengineering (SANER), IEEE, Osaka, Japan, vol\u00a01, pp 493\u2013504, 10.1109\/SANER.2016.12","DOI":"10.1109\/SANER.2016.12"},{"key":"10345_CR23","doi-asserted-by":"crossref","unstructured":"Dekel U, Herbsleb JD (2009) Improving api documentation usability with knowledge pushing. In: Proceedings of the 31st International Conference on Software Engineering, IEEE Computer Society, USA, ICSE \u201909, p 320-330, 10.1109\/ICSE.2009.5070532, https:\/\/doi.org\/10.1109\/ICSE.2009.5070532","DOI":"10.1109\/ICSE.2009.5070532"},{"key":"10345_CR24","doi-asserted-by":"crossref","unstructured":"Fucci D, Mollaalizadehbahnemiri A, Maalej W (2019) On using machine learning to identify knowledge in api reference documentation. In: Proceedings of the 2019 27th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering, Association for Computing Machinery, USA, ESEC\/FSE 2019, p 109-119, 10.1145\/3338906.3338943","DOI":"10.1145\/3338906.3338943"},{"key":"10345_CR25","doi-asserted-by":"crossref","unstructured":"German DM, Adams B, Hassan AE (2013) The Evolution of the R Software Ecosystem. In: 17th European Conference on Software Maintenance and Reengineering, IEEE, Genova, Italy, pp 243\u2013252, 10.1109\/CSMR.2013.33, iSSN: 1534-5351","DOI":"10.1109\/CSMR.2013.33"},{"key":"10345_CR26","doi-asserted-by":"crossref","unstructured":"Groher I, Weinreich R (2017) An interview study on sustainability concerns in software development projects. In: 43rd Euromicro Conference on Software Engineering and Advanced Applications (SEAA), IEEE, Austria, pp 350\u2013358, 10.1109\/SEAA.2017.70","DOI":"10.1109\/SEAA.2017.70"},{"issue":"4","key":"10345_CR27","doi-asserted-by":"publisher","first-page":"86","DOI":"10.1109\/MCSE.2009.129","volume":"11","author":"K Hinsen","year":"2009","unstructured":"Hinsen K (2009) The promises of functional programming. Computing in Science Engineering 11(4):86\u201390. https:\/\/doi.org\/10.1109\/MCSE.2009.129","journal-title":"Computing in Science Engineering"},{"issue":"1","key":"10345_CR28","first-page":"59","volume":"41","author":"K Hornik","year":"2012","unstructured":"Hornik K (2012) Are there too many r packages? Austrian Journal of Statistics 41(1):59\u201366","journal-title":"Austrian Journal of Statistics"},{"issue":"4","key":"10345_CR29","doi-asserted-by":"publisher","first-page":"454","DOI":"10.1093\/reseval\/rvv014","volume":"24","author":"J Howison","year":"2015","unstructured":"Howison J, Deelman E, McLennan MJ, Ferreira da Silva R, Herbsleb JD (2015) Understanding the scientific software ecosystem and its impact: Current and future measures. Research Evaluation 24(4):454\u2013470. https:\/\/doi.org\/10.1093\/reseval\/rvv014","journal-title":"Research Evaluation"},{"issue":"1","key":"10345_CR30","doi-asserted-by":"publisher","first-page":"418","DOI":"10.1007\/s10664-017-9522-4","volume":"23","author":"Q Huang","year":"2018","unstructured":"Huang Q, Shihab E, Xia X, Lo D, Li S (2018) Identifying self-admitted technical debt in open source projects using text mining. Empirical Software Engineering 23(1):418\u2013451","journal-title":"Empirical Software Engineering"},{"key":"10345_CR31","unstructured":"Ihaka R (2017) The r project: A brief history and thoughts about the future. https:\/\/www.stat.auckland.ac.nz\/~ihaka\/downloads\/Massey.pdf"},{"key":"10345_CR32","doi-asserted-by":"crossref","unstructured":"Kalliamvakou E, Gousios G, Blincoe K, Singer L, German DM, Damian D (2014) The promises and perils of mining github. In: Proceedings of the 11th Working Conference on Mining Software Repositories, Association for Computing Machinery, New York, NY, USA, MSR 2014, p 92-101, 10.1145\/2597073.2597074","DOI":"10.1145\/2597073.2597074"},{"issue":"5","key":"10345_CR33","doi-asserted-by":"publisher","first-page":"475","DOI":"10.1108\/DPRG-03-2021-0047","volume":"23","author":"F K\u00f6nigstorfer","year":"2021","unstructured":"K\u00f6nigstorfer F, Thalmann S (2021) Software documentation is not enough! requirements for the documentation of ai. Digital Policy, Regulation and Governance 23(5):475\u2013488. https:\/\/doi.org\/10.1108\/DPRG-03-2021-0047","journal-title":"Digital Policy, Regulation and Governance"},{"key":"10345_CR34","doi-asserted-by":"crossref","unstructured":"Korkmaz G, Kelling C, Robbins C, Keller SA (2018) Modeling the Impact of R Packages Using Dependency and Contributor Networks. In: 2018 IEEE\/ACM International Conference on Advances in Social Networks Analysis and Mining (ASONAM), IEEE\/ACM, Barcelona, Spain, pp 511\u2013514, 10.1109\/ASONAM.2018.8508255, iSSN: 2473-991X","DOI":"10.1109\/ASONAM.2018.8508255"},{"issue":"1","key":"10345_CR35","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1080\/00031305.2019.1668849","volume":"74","author":"S Kross","year":"2020","unstructured":"Kross S, Peng RD, Caffo BS, Gooding I, Leek JT (2020) The democratization of data science education. The American Statistician 74(1):1\u20137. https:\/\/doi.org\/10.1080\/00031305.2019.1668849","journal-title":"The American Statistician"},{"issue":"1","key":"10345_CR36","doi-asserted-by":"publisher","first-page":"449","DOI":"10.1016\/j.joi.2019.02.007","volume":"13","author":"K Li","year":"2019","unstructured":"Li K, Chen PY, Yan E (2019) Challenges of measuring software impact through citations: An examination of the lme4 R package. Journal of Informetrics 13(1):449\u2013461. https:\/\/doi.org\/10.1016\/j.joi.2019.02.007","journal-title":"Journal of Informetrics"},{"key":"10345_CR37","doi-asserted-by":"crossref","unstructured":"Liu J, Huang Q, Xia X, Shihab E, Lo D, Li S (2020) Is using deep learning frameworks free? characterizing technical debt in deep learning frameworks. In: Proceedings of the ACM\/IEEE 42nd International Conference on Software Engineering: Software Engineering in Society, IEEE, Seoul, South Korea, pp 1\u201310","DOI":"10.1145\/3377815.3381377"},{"key":"10345_CR38","doi-asserted-by":"crossref","unstructured":"Liu X, Wang D, Wang A, Hou Y, Wu L (2021) HAConvGNN: Hierarchical attention based convolutional graph neural network for code documentation generation in Jupyter notebooks. In: Findings of the Association for Computational Linguistics: EMNLP 2021, Association for Computational Linguistics, Punta Cana, Dominican Republic, pp 4473\u20134485, 10.18653\/v1\/2021.findings-emnlp.381","DOI":"10.18653\/v1\/2021.findings-emnlp.381"},{"issue":"9","key":"10345_CR39","doi-asserted-by":"publisher","first-page":"1264","DOI":"10.1109\/TSE.2013.12","volume":"39","author":"W Maalej","year":"2013","unstructured":"Maalej W, Robillard MP (2013) Patterns of knowledge in api reference documentation. IEEE Transactions on Software Engineering 39(9):1264\u20131282. https:\/\/doi.org\/10.1109\/TSE.2013.12","journal-title":"IEEE Transactions on Software Engineering"},{"key":"10345_CR40","doi-asserted-by":"crossref","unstructured":"Maddumage C, Dhanushika MP (2018) R programming for Social Network Analysis - A Review. In: 2018 3rd International Conference on Information Technology Research (ICITR), IEEE, Moratuwa, Sri Lanka, pp 1\u20135, 10.1109\/ICITR.2018.8736142","DOI":"10.1109\/ICITR.2018.8736142"},{"issue":"3","key":"10345_CR41","doi-asserted-by":"publisher","first-page":"276","DOI":"10.11613\/BM.2012.031","volume":"22","author":"ML McHugh","year":"2012","unstructured":"McHugh ML (2012) Interrater reliability: the kappa statistic. Biochemia medica: Biochemia medica 22(3):276\u2013282","journal-title":"Biochemia medica: Biochemia medica"},{"issue":"2","key":"10345_CR42","doi-asserted-by":"publisher","first-page":"40","DOI":"10.1145\/3358931.3358937","volume":"7","author":"M Meng","year":"2019","unstructured":"Meng M, Steinhardt S, Schubert A (2019) How developers use api documentation: An observation study. Commun Des Q Rev 7(2):40\u201349. https:\/\/doi.org\/10.1145\/3358931.3358937","journal-title":"Commun Des Q Rev"},{"key":"10345_CR43","unstructured":"Miceli\u00a0Barone AV, Sennrich R (2017) A Parallel Corpus of Python Functions and Documentation Strings for Automated Code Documentation and Code Generation. In: Proceedings of the Eighth International Joint Conference on Natural Language Processing (Volume 2: Short Papers), Asian Federation of Natural Language Processing, Taipei, Taiwan, pp 314\u2013319, https:\/\/aclanthology.org\/I17-2053"},{"key":"10345_CR44","doi-asserted-by":"crossref","unstructured":"Milewicz R, Pinto G, Rodeghero P (2019) Characterizing the Roles of Contributors in Open-Source Scientific Software Projects. In: 16th International Conference on Mining Software Repositories (MSR), IEEE\/ACM, Canada, pp 421\u2013432, 10.1109\/MSR.2019.00069","DOI":"10.1109\/MSR.2019.00069"},{"issue":"6","key":"10345_CR45","doi-asserted-by":"publisher","first-page":"703","DOI":"10.1007\/s10664-011-9186-4","volume":"17","author":"M Monperrus","year":"2012","unstructured":"Monperrus M, Eichberg M, Tekes E, Mezini M (2012) What should developers be aware of? an empirical study on the directives of api documentation. Empirical Software Engineering 17(6):703\u2013737. https:\/\/doi.org\/10.1007\/s10664-011-9186-4","journal-title":"Empirical Software Engineering"},{"key":"10345_CR46","first-page":"104","volume-title":"ECOOP-Object-Oriented Programming","author":"F Morandat","year":"2012","unstructured":"Morandat F, Hill B, Osvald L, Vitek J (2012) Evaluating the Design of the R Language. In: Noble J (ed) ECOOP-Object-Oriented Programming. Springer, Berlin Heidelberg, Berlin, Heidelberg, pp 104\u2013131"},{"key":"10345_CR47","doi-asserted-by":"crossref","unstructured":"Nayebi M, Kuznetsov K, Chen P, Zeller A, Ruhe G (2018) Anatomy of functionality deletion: An exploratory study on mobile apps. In: Proceedings of the 15th International Conference on Mining Software Repositories, Association for Computing Machinery, New York, NY, USA, MSR \u201918, p 243-253, 10.1145\/3196398.3196410","DOI":"10.1145\/3196398.3196410"},{"key":"10345_CR48","doi-asserted-by":"crossref","unstructured":"Nybom K, Ashraf A, Porres I (2018) A systematic mapping study on api documentation generation approaches. In: 44th Euromicro Conference on Software Engineering and Advanced Applications (SEAA), IEEE, Czech Republic, pp 462\u2013469, 10.1109\/SEAA.2018.00081","DOI":"10.1109\/SEAA.2018.00081"},{"key":"10345_CR49","doi-asserted-by":"crossref","unstructured":"Ooms J (2013) Possible Directions for Improving Dependency Versioning in R. The R Journal 5(1):197, 10.32614\/RJ-2013-019, https:\/\/journal.r-project.org\/archive\/2013\/RJ-2013-019\/index.html","DOI":"10.32614\/RJ-2013-019"},{"key":"10345_CR50","doi-asserted-by":"publisher","first-page":"171","DOI":"10.1007\/978-3-662-48616-0_11","volume-title":"Service-Oriented Computing","author":"F Palma","year":"2015","unstructured":"Palma F, Gonzalez-Huerta J, Moha N, Gu\u00e9h\u00e9neuc YG, Tremblay G (2015) Are restful apis well-designed? detection of their linguistic (anti)patterns. In: Barros A, Grigori D, Narendra NC, Dam HK (eds) Service-Oriented Computing. Springer, Berlin Heidelberg, Berlin, Heidelberg, pp 171\u2013187"},{"issue":"1","key":"10345_CR51","doi-asserted-by":"publisher","first-page":"46","DOI":"10.1186\/s12874-019-0666-3","volume":"19","author":"A Perperoglou","year":"2019","unstructured":"Perperoglou A, Sauerbrei W, Abrahamowicz M, Schmid M (2019) A review of spline function procedures in R. BMC Medical Research Methodology 19(1):46. https:\/\/doi.org\/10.1186\/s12874-019-0666-3","journal-title":"BMC Medical Research Methodology"},{"key":"10345_CR52","doi-asserted-by":"crossref","unstructured":"Pinto G, Wiese I, Dias LF (2018) How do scientists develop scientific software? an external replication. In: IEEE 25th International Conference on Software Analysis, Evolution and Reengineering (SANER), IEEE, Campobasso, Italy, pp 582\u2013591, 10.1109\/SANER.2018.8330263","DOI":"10.1109\/SANER.2018.8330263"},{"key":"10345_CR53","doi-asserted-by":"publisher","first-page":"119","DOI":"10.1016\/j.jss.2017.06.095","volume":"132","author":"K Plakidas","year":"2017","unstructured":"Plakidas K, Schall D, Zdun U (2017) Evolution of the R software ecosystem: Metrics, relationships, and their impact on qualities. Journal of Systems and Software 132:119\u2013146. https:\/\/doi.org\/10.1016\/j.jss.2017.06.095","journal-title":"Journal of Systems and Software"},{"issue":"6","key":"10345_CR54","doi-asserted-by":"publisher","first-page":"27","DOI":"10.1109\/MS.2009.193","volume":"26","author":"MP Robillard","year":"2009","unstructured":"Robillard MP (2009) What makes apis hard to learn? answers from developers. IEEE software 26(6):27\u201334","journal-title":"IEEE software"},{"issue":"6","key":"10345_CR55","doi-asserted-by":"publisher","first-page":"703","DOI":"10.1007\/s10664-010-9150-8","volume":"16","author":"MP Robillard","year":"2011","unstructured":"Robillard MP, DeLine R (2011) A field study of api learning obstacles. Empirical Software Engineering 16(6):703\u2013732","journal-title":"Empirical Software Engineering"},{"issue":"3","key":"10345_CR56","first-page":"18","volume":"8","author":"R Shyam","year":"2021","unstructured":"Shyam R, Singh R (2021) A taxonomy of machine learning techniques. Journal of Advancements in Robotics 8(3):18\u201325p","journal-title":"Journal of Advancements in Robotics"},{"key":"10345_CR57","doi-asserted-by":"crossref","unstructured":"Souza R, Oliveira A (2017) Guideautomator: Continuous delivery of end user documentation. In: 39th International Conference on Software Engineering: New Ideas and Emerging Technologies Results Track (ICSE-NIER), pp 31\u201334, 10.1109\/ICSE-NIER.2017.10","DOI":"10.1109\/ICSE-NIER.2017.10"},{"key":"10345_CR58","doi-asserted-by":"crossref","unstructured":"Storer T (2017) Bridging the chasm: A survey of software engineering practice in scientific programming. ACM Comput Surv 50(4), 10.1145\/3084225","DOI":"10.1145\/3084225"},{"key":"10345_CR59","doi-asserted-by":"crossref","unstructured":"Stulova N, Blasi A, Gorla A, Nierstrasz O (2020) Towards detecting inconsistent comments in java source code automatically. In: 2020 IEEE 20th International Working Conference on Source Code Analysis and Manipulation (SCAM), IEEE, Adelaide, Australia, pp 65\u201369, 10.1109\/SCAM51674.2020.00012","DOI":"10.1109\/SCAM51674.2020.00012"},{"key":"10345_CR60","doi-asserted-by":"crossref","unstructured":"Tan L (2015) Chapter 17 - code comment analysis for improving software quality**this chapter contains figures, tables, and text copied from the author\u2019s phd dissertation and the papers that the author of this chapter coauthored [[3], [1], [35], [7 ]]. sections 17.2.3, 17.4.3, 17.5, and 17.6 are new, and the other sections are augmented, reorganized, and improved. In: Bird C, Menzies T, Zimmermann T (eds) The Art and Science of Analyzing Software Data, Morgan Kaufmann, Boston, pp 493 \u2013 517, https:\/\/doi.org\/10.1016\/B978-0-12-411519-4.00017-3","DOI":"10.1016\/B978-0-12-411519-4.00017-3"},{"key":"10345_CR61","doi-asserted-by":"crossref","unstructured":"Tan SH, Marinov D, Tan L, Leavens GT (2012) @tcomment: Testing javadoc comments to detect comment-code inconsistencies. In: 2012 IEEE Fifth International Conference on Software Testing, Verification and Validation, IEEE, Montreal, Canada, pp 260\u2013269, 10.1109\/ICST.2012.106","DOI":"10.1109\/ICST.2012.106"},{"issue":"4","key":"10345_CR62","doi-asserted-by":"publisher","first-page":"14","DOI":"10.1111\/j.1740-9713.2018.01169.x","volume":"15","author":"N Thieme","year":"2018","unstructured":"Thieme N (2018) R generation. Significance 15(4):14\u201319. https:\/\/doi.org\/10.1111\/j.1740-9713.2018.01169.x","journal-title":"Significance"},{"key":"10345_CR63","doi-asserted-by":"crossref","unstructured":"Treude C, Middleton J, Atapattu T (2020) Beyond accuracy: Assessing software documentation quality. In: 28th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering, Association for Computing Machinery, New York, NY, USA, p 1509-1512, https:\/\/doi.org\/10.1145\/3368089.3417045","DOI":"10.1145\/3368089.3417045"},{"key":"10345_CR64","doi-asserted-by":"crossref","unstructured":"Turcotte A, Vitek J (2019) Towards a Type System for R. In: Proceedings of the 14th Workshop on Implementation, Compilation, Optimization of Object-Oriented Languages, Programs and Systems, Association for Computing Machinery, London, United Kingdom, ICOOOLPS \u201919, pp 1\u20135, 10.1145\/3340670.3342426","DOI":"10.1145\/3340670.3342426"},{"issue":"4","key":"10345_CR65","first-page":"68","volume":"32","author":"G Uddin","year":"2015","unstructured":"Uddin G, Robillard MP (2015) How api documentation fails. IEEE software 32(4):68\u201375","journal-title":"How api documentation fails. IEEE software"},{"key":"10345_CR66","doi-asserted-by":"crossref","unstructured":"Vidoni M (2021a) Evaluating unit testing practices in r packages. In: Proceedings of the 43rd International Conference on Software Engineering (ICSE), IEEE, Madrid, Spain, pp 1\u201312","DOI":"10.1109\/ICSE43902.2021.00136"},{"key":"10345_CR67","doi-asserted-by":"crossref","unstructured":"Vidoni M (2021b) Self-Admitted Technical Debt in R Packages: An Exploratory Study. In: International Conference on Mining Software Repositories, IEEE, Madrid, Spain, pp 179\u2013189, https:\/\/doi.ieeecomputersociety.org\/10.1109\/MSR52588.2021.00030","DOI":"10.1109\/MSR52588.2021.00030"},{"key":"10345_CR68","doi-asserted-by":"crossref","unstructured":"Vidoni M (2022a) A Systematic Process for Mining Software Repositories: Results from a Systematic Literature Review. Information and Software Technology p 106791, https:\/\/doi.org\/10.1016\/j.infsof.2021.106791, https:\/\/www.sciencedirect.com\/science\/article\/pii\/S0950584921002317","DOI":"10.1016\/j.infsof.2021.106791"},{"key":"10345_CR69","doi-asserted-by":"publisher","unstructured":"Vidoni M (2022) Understanding Roxygen Package Documentation in R. Journal of Systems and Software 188:111265. https:\/\/doi.org\/10.1016\/j.jss.2022.111265, https:\/\/www.sciencedirect.com\/science\/article\/pii\/S0164121222000310","DOI":"10.1016\/j.jss.2022.111265"},{"key":"10345_CR70","doi-asserted-by":"publisher","first-page":"392","DOI":"10.1007\/978-3-030-16187-3_38","volume-title":"New Knowledge in Information Systems and Technologies","author":"E Villegas","year":"2019","unstructured":"Villegas E, Labrador E, Fonseca D, Fern\u00e1ndez-Guinea S (2019) Validating game mechanics and gamification parameters with card sorting methods. In: Rocha \u00c1, Adeli H, Reis LP, Costanzo S (eds) New Knowledge in Information Systems and Technologies. Springer International Publishing, Cham, pp 392\u2013401"},{"key":"10345_CR71","doi-asserted-by":"crossref","unstructured":"Wang X, Lee M, Pinchbeck A, Fard F (2019) Where does lda sit for github? In: 2019 34th IEEE\/ACM International Conference on Automated Software Engineering Workshop (ASEW), pp 94\u201397, 10.1109\/ASEW.2019.00037","DOI":"10.1109\/ASEW.2019.00037"},{"key":"10345_CR72","volume-title":"Encyclopedia of Human Computer Interaction","author":"B Whitworth","year":"2006","unstructured":"Whitworth B, Ahmad A, Soegaard M, Dam R (2006) Encyclopedia of Human Computer Interaction. IGI Publishing, Hershey, PA, Information Science Reference - Imprint of"},{"key":"10345_CR73","volume-title":"Advanced R","author":"H Wickham","year":"2015","unstructured":"Wickham H (2015) Advanced R. Chapman & Hall, CRC The R Series, CRC Press, Boca Raton, Florida"},{"key":"10345_CR74","unstructured":"Wickham H (2019) roxygen2 7.0.0. https:\/\/www.tidyverse.org\/blog\/2019\/11\/roxygen2-7-0-0\/"},{"key":"10345_CR75","volume-title":"R for Data Science: Import, Tidy, Transform, Visualize, and Model Data","author":"H Wickham","year":"2017","unstructured":"Wickham H, Grolemund G (2017) R for Data Science: Import, Tidy, Transform, Visualize, and Model Data, 1st edn. O\u2019Reilly Media Inc, USA","edition":"1"},{"issue":"2","key":"10345_CR76","doi-asserted-by":"publisher","first-page":"953","DOI":"10.1007\/s10664-017-9536-y","volume":"23","author":"A Zagalsky","year":"2018","unstructured":"Zagalsky A, German DM, Storey MA, Teshima CG, Poo-Caama\u00f1o G (2018) How the r community creates and curates knowledge: an extended study of stack overflow and mailing lists. Empirical Software Engineering 23(2):953\u2013986","journal-title":"Empirical Software Engineering"},{"key":"10345_CR77","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2022.111425","volume":"192","author":"F Zampetti","year":"2022","unstructured":"Zampetti F, Kapur R, Di Penta M, Panichella S (2022) An empirical characterization of software bugs in open-source cyber-physical systems. Journal of Systems and Software 192:111425. https:\/\/doi.org\/10.1016\/j.jss.2022.111425","journal-title":"Journal of Systems and Software"},{"key":"10345_CR78","doi-asserted-by":"crossref","unstructured":"Zanella G, Liu CZ (2020) A Social Network Perspective on the Success of Open Source Software: The Case of R Packages. In: Hawaii International Conference on System Sciences, HICSS, HAwaii, pp 471\u2013480, 10.24251\/HICSS.2020.058","DOI":"10.24251\/HICSS.2020.058"},{"key":"10345_CR79","doi-asserted-by":"crossref","unstructured":"Zhou X, Jin Y, Zhang H, Li S, Huang X (2016) A map of threats to validity of systematic literature reviews in software engineering. In: 2016 23rd Asia-Pacific Software Engineering Conference (APSEC), IEEE, Hamilton, New Zealand, pp 153\u2013160, 10.1109\/APSEC.2016.031","DOI":"10.1109\/APSEC.2016.031"}],"container-title":["Empirical Software Engineering"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10664-023-10345-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10664-023-10345-4\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10664-023-10345-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,10,24]],"date-time":"2024-10-24T06:32:40Z","timestamp":1729751560000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10664-023-10345-4"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,7]]},"references-count":79,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2023,7]]}},"alternative-id":["10345"],"URL":"https:\/\/doi.org\/10.1007\/s10664-023-10345-4","relation":{},"ISSN":["1382-3256","1573-7616"],"issn-type":[{"type":"print","value":"1382-3256"},{"type":"electronic","value":"1573-7616"}],"subject":[],"published":{"date-parts":[[2023,7]]},"assertion":[{"value":"25 May 2023","order":1,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"15 July 2023","order":2,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declared that they have no conflict of interest.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}}],"article-number":"106"}}