{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,15]],"date-time":"2026-08-15T09:27:54Z","timestamp":1786786074200,"version":"build-2736575974"},"reference-count":44,"publisher":"Springer Science and Business Media LLC","issue":"6","license":[{"start":{"date-parts":[[2026,5,30]],"date-time":"2026-05-30T00:00:00Z","timestamp":1780099200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2026,5,30]],"date-time":"2026-05-30T00:00:00Z","timestamp":1780099200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100001782","name":"University of Melbourne","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100001782","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Empir Software Eng"],"published-print":{"date-parts":[[2026,11]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>As the world of technology advances, so do the tools that software developers use to create new programs. In recent years, software development tools have become more popular, allowing developers to work more efficiently and produce higher-quality software. Still, installing such tools can be challenging for novice developers at the early stage of their careers, as they may face issues such as compatibility problems (e.g., with operating systems) and unclear instructions. Therefore, this work aims to investigate the challenges novice developers face when installing software development tools and the strategies they employ to overcome them. To investigate these, we conducted an analysis of 24 live software installation sessions to observe the difficulties developers encounter, the strategies they apply, and the types of information sources they consult when facing obstacles. We also conducted a validation survey with 144 students to support and expand our findings. Our results reveal recurring challenges such as unclear or dysfunctional documentation, complicated installation processes, version incompatibility, and lack of feedback during installation. To address these, participants used strategies such as reformulating search queries, reading instructions more carefully, and searching for alternative sources of documentation. These sources included community platforms (e.g., Stack Overflow), video tutorials, blog posts, and official documentation. Based on these findings, we provide practical recommendations for tool vendors, tool users, and researchers to improve the installation experience for novice developers.<\/jats:p>","DOI":"10.1007\/s10664-026-10885-5","type":"journal-article","created":{"date-parts":[[2026,5,30]],"date-time":"2026-05-30T09:20:52Z","timestamp":1780132852000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Open source software development tool installation"],"prefix":"10.1007","volume":"31","author":[{"ORCID":"https:\/\/orcid.org\/0009-0004-0010-5109","authenticated-orcid":false,"given":"Larissa","family":"Salerno","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Christoph","family":"Treude","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Patanamon","family":"Thongtanunam","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2026,5,30]]},"reference":[{"key":"10885_CR1","doi-asserted-by":"publisher","unstructured":"Aghajani E, Nagy C, Vega-M\u00e1rquez OL, Linares-V\u00e1squez M, Moreno L, Bavota G, Lanza M (2019) Software documentation issues unveiled. In: 2019 IEEE\/ACM 41st International Conference on Software Engineering, IEEE, Piscataway, New Jersey, ICSE \u201919, pp 1199\u20131210. https:\/\/doi.org\/10.1109\/ICSE.2019.00122","DOI":"10.1109\/ICSE.2019.00122"},{"key":"10885_CR2","doi-asserted-by":"publisher","unstructured":"Aghajani E, Nagy C, Linares-V\u00e1squez M, Moreno L, Bavota G, Lanza M, Shepherd DC (2020) Software documentation: the practitioners\u2019 perspective. In: Proceedings of the ACM\/IEEE 42nd International Conference on Software Engineering, ACM, New York, NY, USA, ICSE \u201920, pp 590\u2013601. https:\/\/doi.org\/10.1145\/3377811.3380405","DOI":"10.1145\/3377811.3380405"},{"key":"10885_CR3","doi-asserted-by":"publisher","unstructured":"Chattopadhyay S, Nelson N, Nam T, Calvert M, Sarma A (2018) Context in programming: an investigation of how programmers create context. In: Proceedings of the 11th International Workshop on Cooperative and Human Aspects of Software Engineering, ACM, New York, NY, USA, pp 33\u201336. https:\/\/doi.org\/10.1145\/3195836.3195861","DOI":"10.1145\/3195836.3195861"},{"issue":"6","key":"10885_CR4","doi-asserted-by":"publisher","first-page":"981","DOI":"10.1016\/j.jss.2008.12.036","volume":"82","author":"JC Chen","year":"2009","unstructured":"Chen JC, Huang SJ (2009) An empirical analysis of the impact of software development problem factors on software maintainability. J Syst Softw 82(6):981\u2013992. https:\/\/doi.org\/10.1016\/j.jss.2008.12.036","journal-title":"J Syst Softw"},{"issue":"2","key":"10885_CR5","doi-asserted-by":"publisher","first-page":"101","DOI":"10.1007\/s11334-017-0303-4","volume":"13","author":"E Constantinou","year":"2017","unstructured":"Constantinou E, Mens T (2017) An empirical comparison of developer retention in the RubyGems and npm software ecosystems. Innovations Syst Softw Eng 13(2):101\u2013115. https:\/\/doi.org\/10.1007\/s11334-017-0303-4","journal-title":"Innovations Syst Softw Eng"},{"key":"10885_CR6","doi-asserted-by":"publisher","unstructured":"Fagerholm F, Oza N, M\u00fcnch J (2013) A platform for teaching applied distributed software development: The ongoing journey of the Helsinki software factory. In: International Workshop on Collaborative Teaching of Globally Distributed Software Development (CTGDSD), IEEE, Piscataway, New Jersey, pp 1\u20135. https:\/\/doi.org\/10.1109\/CTGDSD.2013.6635237","DOI":"10.1109\/CTGDSD.2013.6635237"},{"key":"10885_CR7","doi-asserted-by":"publisher","first-page":"452","DOI":"10.1007\/s10664-017-9523-3","volume":"23","author":"D Falessi","year":"2018","unstructured":"Falessi D, Juristo N, Wohlin C, Turhan B, M\u00fcnch J, Jedlitschka A, Oivo M (2018) Empirical software engineering experts on the use of students and professionals in experiments. Empir Softw Eng 23:452\u2013489. https:\/\/doi.org\/10.1007\/s10664-017-9523-3","journal-title":"Empir Softw Eng"},{"key":"10885_CR8","doi-asserted-by":"publisher","unstructured":"Gao H, Treude C, Zahedi M (2023) Evaluating transfer learning for simplifying Github readmes. In: Proceedings of the 31st ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering, Association for Computing Machinery, New York, NY, USA, ESEC\/FSE 2023, pp 1548\u20131560. https:\/\/doi.org\/10.1145\/3611643.3616291","DOI":"10.1145\/3611643.3616291"},{"issue":"01","key":"10885_CR9","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1109\/TSE.2025.3552614","volume":"51","author":"H Gao","year":"2025","unstructured":"Gao H, Treude C, Zahedi M (2025) Adapting installation instructions in rapidly evolving software ecosystems. IEEE Trans Software Eng 51(01):1\u201324. https:\/\/doi.org\/10.1109\/TSE.2025.3552614","journal-title":"IEEE Trans Software Eng"},{"key":"10885_CR10","doi-asserted-by":"publisher","unstructured":"Guo PJ (2013) Online Python tutor: embeddable web-based program visualization for CS education. In: Proceeding of the 44th ACM technical symposium on Computer science education, ACM, New York, NY, USA, pp 579\u2013584. https:\/\/doi.org\/10.1145\/2445196.2445368","DOI":"10.1145\/2445196.2445368"},{"key":"10885_CR11","doi-asserted-by":"publisher","unstructured":"Hassan F, Wang X (2017) Mining readme files to support automatic building of Java projects in software repositories. In: IEEE\/ACM 39th International Conference on Software Engineering Companion, IEEE, Piscataway, New Jersey, ICSE \u201917, pp 277\u2013279. https:\/\/doi.org\/10.1109\/ICSE-C.2017.114","DOI":"10.1109\/ICSE-C.2017.114"},{"key":"10885_CR12","doi-asserted-by":"publisher","unstructured":"Helminen J, Ihantola P, Karavirta V (2013) Recording and analyzing in-browser programming sessions. In: Proceedings of the 13th Koli Calling International Conference on Computing Education Research, ACM, New York, NY, USA, pp 13\u201322. https:\/\/doi.org\/10.1145\/2526968.2526970","DOI":"10.1145\/2526968.2526970"},{"key":"10885_CR13","unstructured":"Initiative OS (2024) The open source definition. https:\/\/opensource.org\/osd"},{"key":"10885_CR14","doi-asserted-by":"publisher","unstructured":"Jenkins J, Brannock E, Cooper T, Dekhane S, Hall M, Nguyen M (2012) Perspectives on active learning and collaboration: Javawide in the classroom. In: Proceedings of the 43rd ACM Technical Symposium on Computer Science Education, ACM, New York, NY, USA, pp 185\u2013190. https:\/\/doi.org\/10.1145\/2157136.2157194","DOI":"10.1145\/2157136.2157194"},{"key":"10885_CR15","doi-asserted-by":"publisher","first-page":"44","DOI":"10.1109\/MS.2006.158","volume":"23","author":"T Kal","year":"2006","unstructured":"Kal T (2006) Experiences with open source software engineering tools. IEEE Softw 23:44\u201352. https:\/\/doi.org\/10.1109\/MS.2006.158","journal-title":"IEEE Softw"},{"key":"10885_CR16","unstructured":"Krosnick R (2015) VideoDoc: Combining videos and lecture notes for a better learning experience. PhD thesis, Massachusetts Institute of Technology"},{"key":"10885_CR17","doi-asserted-by":"publisher","unstructured":"Lafreniere B, Grossman T, Fitzmaurice G (2013) Community enhanced tutorials: improving tutorials with multiple demonstrations. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, ACM, New York, NY, USA, pp 1779\u20131788. https:\/\/doi.org\/10.1145\/2470654.2466235","DOI":"10.1145\/2470654.2466235"},{"key":"10885_CR18","doi-asserted-by":"publisher","DOI":"10.1016\/j.infsof.2022.106924","volume":"148","author":"Y Liu","year":"2022","unstructured":"Liu Y, Noei E, Lyons K (2022) How ReadMe files are structured in open source Java projects. Inf Softw Technol 148:106924. https:\/\/doi.org\/10.1016\/j.infsof.2022.106924","journal-title":"Inf Softw Technol"},{"key":"10885_CR19","doi-asserted-by":"crossref","unstructured":"Mahmoud ASI, Nolte A, Pfahl D (2023) An exploratory study on the evidence of hackathons\u2019 role in solving OSS newcomers\u2019 challenges. arXiv:2305.09546","DOI":"10.5220\/0012091200003538"},{"key":"10885_CR20","doi-asserted-by":"publisher","unstructured":"Mirhosseini S, Parnin C (2020) Docable: Evaluating the executability of software tutorials. In: Proceedings of the 28th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering, ACM, New York, NY, USA, pp 375\u2013385. https:\/\/doi.org\/10.5281\/zenodo.3903727","DOI":"10.5281\/zenodo.3903727"},{"issue":"1","key":"10885_CR21","doi-asserted-by":"publisher","first-page":"6","DOI":"10.4102\/ijmla.v1i1.3","volume":"1","author":"LJ Mselle","year":"2012","unstructured":"Mselle LJ, Twaakyondo H (2012) The impact of memory transfer language (MTL) on reducing misconceptions in teaching programming to novices. Int J Mach Learn Appl 1(1):6. https:\/\/doi.org\/10.4102\/ijmla.v1i1.3","journal-title":"Int J Mach Learn Appl"},{"key":"10885_CR22","doi-asserted-by":"publisher","unstructured":"Mysore A, Guo PJ (2017) Torta: Generating mixed-media GUI and command-line app tutorials using operating-system-wide activity tracing. In: Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology, ACM, New York, NY, USA, pp 703\u2013714. https:\/\/doi.org\/10.1145\/3126594.3126628","DOI":"10.1145\/3126594.3126628"},{"key":"10885_CR23","doi-asserted-by":"publisher","unstructured":"Parnin C, Treude C (2011) Measuring API documentation on the web. In: Proceedings of the 2nd international workshop on Web 2.0 for software engineering, ACM, New York, NY, USA, pp 25\u201330. https:\/\/doi.org\/10.1145\/1984701.1984706","DOI":"10.1145\/1984701.1984706"},{"key":"10885_CR24","doi-asserted-by":"publisher","unstructured":"Pavel A, Reed C, Hartmann B, Agrawala M (2014) Video digests: a browsable, skimmable format for informational lecture videos. In: UIST, ACM, New York, NY, USA, pp 2642918\u20132647400. https:\/\/doi.org\/10.1145\/2642918.2647400","DOI":"10.1145\/2642918.2647400"},{"key":"10885_CR25","doi-asserted-by":"publisher","unstructured":"Pinto G, Ferreira C, Souza C, Steinmacher I, Meirelles P (2019) Training software engineers using open-source software: the students\u2019 perspective. In: 2019 IEEE\/ACM 41st International Conference on Software Engineering: Software Engineering Education and Training (ICSE-SEET), IEEE, Piscataway, New Jersey, pp 147\u2013157. https:\/\/doi.org\/10.1109\/ICSE-SEET.2019.00024","DOI":"10.1109\/ICSE-SEET.2019.00024"},{"key":"10885_CR26","doi-asserted-by":"publisher","first-page":"65","DOI":"10.1016\/j.jss.2020.110663","volume":"168","author":"SL Ram\u00edrez-Mora","year":"2020","unstructured":"Ram\u00edrez-Mora SL, Oktaba H, G\u00f3mez-Adorno H (2020) Descriptions of issues and comments for predicting issue success in software projects. J Syst Softw 168:65. https:\/\/doi.org\/10.1016\/j.jss.2020.110663","journal-title":"J Syst Softw"},{"key":"10885_CR27","volume-title":"Software development tools","author":"W Riddle","year":"2012","unstructured":"Riddle W, Fairley R (2012) Software development tools. Springer Science & Business Media, Berlin, GER"},{"key":"10885_CR28","doi-asserted-by":"publisher","unstructured":"Robillard MP, Treude C (2020) Understanding Wikipedia as a resource for opportunistic learning of computing concepts. In: Proceedings of the 51st ACM Technical Symposium on Computer Science Education, ACM, New York, NY, USA, pp 72\u201378. https:\/\/doi.org\/10.1145\/3328778.3366832","DOI":"10.1145\/3328778.3366832"},{"key":"10885_CR29","doi-asserted-by":"publisher","unstructured":"Robillard MP, Marcus A, Treude C, Bavota G, Chaparro O, Ernst N, Gerosa MA, Godfrey M, Lanza M, Linares-V\u00e1squez M et\u00a0al (2017) On-demand developer documentation. In: 2017 IEEE International conference on software maintenance and evolution (ICSME), IEEE, Piscataway, New Jersey, pp 479\u2013483. https:\/\/doi.org\/10.1109\/ICSME.2017.17","DOI":"10.1109\/ICSME.2017.17"},{"key":"10885_CR30","doi-asserted-by":"publisher","unstructured":"Salerno L, de\u00a0Fran\u00e7a\u00a0Tonh\u00e3o S, Steinmacher I, Treude C (2023) Barriers and self-efficacy: A large-scale study on the impact of OSS courses on student perceptions. In: Proceedings of the 2023 Conference on Innovation and Technology in Computer Science Education V.1, ACM, New York, NY, USA, pp 320\u2013326. https:\/\/doi.org\/10.1145\/3587102.3588789","DOI":"10.1145\/3587102.3588789"},{"key":"10885_CR31","doi-asserted-by":"publisher","unstructured":"Salman I, Misirli AT, Juristo N (2015) Are students representatives of professionals in software engineering experiments? In: IEEE\/ACM 37th IEEE International Conference on Software Engineering, IEEE, Piscataway, New Jersey, pp 666\u2013676. https:\/\/doi.org\/10.1109\/ICSE.2015.82","DOI":"10.1109\/ICSE.2015.82"},{"key":"10885_CR32","doi-asserted-by":"publisher","unstructured":"Steinmacher I, Conte T, Gerosa MA, Redmiles D (2015a) Social barriers faced by newcomers placing their first contribution in open source software projects. In: Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing, ACM, New York, NY, USA, pp 1379\u20131392. https:\/\/doi.org\/10.1145\/2675133.2675215","DOI":"10.1145\/2675133.2675215"},{"key":"10885_CR33","doi-asserted-by":"publisher","unstructured":"Steinmacher I, Silva MAG, Gerosa MA, Redmiles DF (2015b) A systematic literature review on the barriers faced by newcomers to open source software projects. Inf Softw Technol 59:67\u201385. https:\/\/doi.org\/10.1016\/j.infsof.2014.11.001","DOI":"10.1016\/j.infsof.2014.11.001"},{"key":"10885_CR34","doi-asserted-by":"publisher","unstructured":"Steinmacher I, Conte TU, Treude C, Gerosa MA (2016) Overcoming open source project entry barriers with a portal for newcomers. In: Proceedings of the 38th International Conference on Software Engineering, ACM, New York, NY, USA, pp 273\u2013284. https:\/\/doi.org\/10.1145\/2884781.2884806","DOI":"10.1145\/2884781.2884806"},{"key":"10885_CR35","doi-asserted-by":"publisher","unstructured":"Steinmacher I, Treude C, Gerosa MA (2018) Let me in: Guidelines for the successful onboarding of newcomers to open source projects. IEEE Software 36(4):41\u201349. https:\/\/doi.org\/10.1109\/MS.2018.110162131","DOI":"10.1109\/MS.2018.110162131"},{"key":"10885_CR36","first-page":"1","volume-title":"14th International Conference on Evaluation and Assessment in Software Engineering (EASE)","author":"KJ Stol","year":"2010","unstructured":"Stol KJ, Avgeriou P, Babar MA (2010) Identifying architectural patterns used in open source software: approaches and challenges. 14th International Conference on Evaluation and Assessment in Software Engineering (EASE). ACM, New York, NY, USA, pp 1\u201310"},{"key":"10885_CR37","doi-asserted-by":"publisher","unstructured":"Tan X, Long X, Zhu Y, Shi L, Lian X, Zhang L (2025) Revolutionizing newcomers\u2019 onboarding process in OSS communities: the future AI mentor. Proceedings of the ACM on Software Engineering 2(FSE):1091\u20131113. https:\/\/doi.org\/10.1145\/371576","DOI":"10.1145\/371576"},{"key":"10885_CR38","unstructured":"Teague D, Lister R (2014) Longitudinal think aloud study of a novice programmer. In: Conference in Research and Practice in Information Technology Series, ACM, New York, NY, USA, pp 41\u201350. https:\/\/opus.lib.uts.edu.au\/handle\/10453\/33409"},{"key":"10885_CR39","doi-asserted-by":"publisher","unstructured":"Thiselton E, Treude C (2019) Enhancing Python compiler error messages via stack. In: ACM\/IEEE International Symposium on Empirical Software Engineering and Measurement, IEEE, Piscataway, New Jersey, pp 1\u201312. https:\/\/doi.org\/10.1109\/ESEM.2019.8870155","DOI":"10.1109\/ESEM.2019.8870155"},{"key":"10885_CR40","doi-asserted-by":"publisher","unstructured":"Treude C, Aniche M (2018) Where does Google find API documentation? In: Proceedings of the 2nd International Workshop on API Usage and Evolution, ACM, New York, NY, USA, pp 19\u201322. https:\/\/doi.org\/10.1145\/3194793.3194796","DOI":"10.1145\/3194793.3194796"},{"issue":"4","key":"10885_CR41","doi-asserted-by":"publisher","first-page":"68","DOI":"10.1109\/MS.2014.80","volume":"32","author":"G Uddin","year":"2015","unstructured":"Uddin G, Robillard MP (2015) How API documentation fails IEEE software 32(4):68\u201375. https:\/\/doi.org\/10.1109\/MS.2014.80","journal-title":"How API documentation fails IEEE software"},{"key":"10885_CR42","doi-asserted-by":"publisher","unstructured":"Valez M, Yen M, Le M, Su Z, Alipour MA (2020) Student adoption and perceptions of a web integrated development environment: An experience report. In: Proc. 51st ACM Technical Symposium on Computer Science Education, ACM, New York, NY, USA, pp 1172\u20131178. https:\/\/doi.org\/10.1145\/3328778.3366949","DOI":"10.1145\/3328778.3366949"},{"key":"10885_CR43","unstructured":"Walker R (2022) Ossrank. https:\/\/ossrank.com\/"},{"key":"10885_CR44","doi-asserted-by":"crossref","unstructured":"Wickstr\u00f6m G, Bendix T (2000) The \u201chawthorne effect\u201d \u2013 what did the original hawthorne studies actually show? Scandinavian journal of work, environment & health 26:363\u2013367. https:\/\/www.jstor.org\/stable\/40967074","DOI":"10.5271\/sjweh.555"}],"container-title":["Empirical Software Engineering"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10664-026-10885-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10664-026-10885-5","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10664-026-10885-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,8,15]],"date-time":"2026-08-15T09:03:59Z","timestamp":1786784639000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10664-026-10885-5"}},"subtitle":["Challenges and strategies for novice developers"],"short-title":[],"issued":{"date-parts":[[2026,5,30]]},"references-count":44,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2026,11]]}},"alternative-id":["10885"],"URL":"https:\/\/doi.org\/10.1007\/s10664-026-10885-5","relation":{},"ISSN":["1382-3256","1573-7616"],"issn-type":[{"value":"1382-3256","type":"print"},{"value":"1573-7616","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,5,30]]},"assertion":[{"value":"17 July 2024","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"12 May 2026","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"30 May 2026","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"This study was approved by the Ethics Committee at The University of Melbourne (ID 24329).","order":1,"name":"Ethics","label":"Ethics Approval","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"All participants provided informed consent before taking part in this research.","order":2,"name":"Ethics","label":"Consent","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare that they have no relevant employment relationships that could be perceived as influencing the work reported in this manuscript.","order":3,"name":"Ethics","label":"Employment","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare that they have no financial interests that could be perceived as influencing the work reported in this manuscript.","order":4,"name":"Ethics","label":"Financial interests","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare that they have no non-financial interests that could be perceived as influencing the work reported in this manuscript.","order":5,"name":"Ethics","label":"Non-financial interests","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"Not applicable.","order":6,"name":"Ethics","label":"Clinical Trial Number","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare that they have no competing interests. Christoph Treude is a member of the Empirical Software Engineering Editorial Board and had no involvement in the review or decision process for this manuscript. This is disclosed for transparency.","order":7,"name":"Ethics","label":"Conflicts of interests\/Competing interests","group":{"name":"EthicsHeading","label":"Declarations"}}],"article-number":"159"}}