{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,9]],"date-time":"2026-01-09T12:51:27Z","timestamp":1767963087092,"version":"3.49.0"},"reference-count":60,"publisher":"World Scientific Pub Co Pte Lt","issue":"04","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Int. J. Soft. Eng. Knowl. Eng."],"published-print":{"date-parts":[[2013,5]]},"abstract":"<jats:p> Scientific and engineering research is heavily dependent on effective development and use of software artifacts. Many of these artifacts are produced by the scientists themselves, rather than by trained software engineers. To address the challenges in this area, a research community often referred to as \"Development of Scientific Software\" has emerged in the last few decades. As this research area has matured, there has been a sharp increase in the number of papers and results made available, and it has thus become important to summarize and provide an overview about those studies. Through a systematic mapping and bibliometrics study, we have reviewed 130 papers in this area. We present the results of our study in this paper. Also we have made the mapping data available on an online repository which is planned to be updated on a regular basis. The results of our study seem to suggest that many software engineering techniques and activities are being used in the development of scientific software. However, there is still a need for further exploration of the usefulness of specific software engineering techniques (e.g., regarding software maintenance, evolution, refactoring, re(v)-engineering, process and project management) in the scientific context. It is hoped that this article will help (new) researchers get an overview of the research space and help them to understand the trends in the area. <\/jats:p>","DOI":"10.1142\/s0218194013500137","type":"journal-article","created":{"date-parts":[[2013,7,26]],"date-time":"2013-07-26T08:05:56Z","timestamp":1374825956000},"page":"463-506","source":"Crossref","is-referenced-by-count":28,"title":["DEVELOPMENT OF SCIENTIFIC SOFTWARE: A SYSTEMATIC MAPPING, A BIBLIOMETRICS STUDY, AND A PAPER REPOSITORY"],"prefix":"10.1142","volume":"23","author":[{"given":"ROSHANAK","family":"FARHOODI","sequence":"first","affiliation":[{"name":"prairieFyre Software Inc., Ottawa, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"VAHID","family":"GAROUSI","sequence":"additional","affiliation":[{"name":"Department of Electrical and Computer Engineering, University of Calgary, Canada"},{"name":"Informatics Institute, Middle East Technical University, Ankara, Turkey"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"DIETMAR","family":"PFAHL","sequence":"additional","affiliation":[{"name":"Institute of Computer Science, University of Tartu, Estonia and Department of Electrical and Computer Engineering, University of Calgary, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"JONATHAN","family":"SILLITO","sequence":"additional","affiliation":[{"name":"Department of Computer Science, University of Calgary, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"219","published-online":{"date-parts":[[2013,7,25]]},"reference":[{"key":"rf1","doi-asserted-by":"publisher","DOI":"10.1016\/j.advengsoft.2009.05.003"},{"key":"rf3","first-page":"273","volume":"7","author":"Kane D. W.","year":"2006","journal-title":"Bioinformatics"},{"key":"rf6","doi-asserted-by":"publisher","DOI":"10.1109\/MS.2008.84"},{"key":"rf12","doi-asserted-by":"publisher","DOI":"10.1007\/s10664-005-3865-y"},{"key":"rf13","doi-asserted-by":"publisher","DOI":"10.1155\/2008\/486876"},{"key":"rf14","doi-asserted-by":"publisher","DOI":"10.1093\/bioinformatics\/bti234"},{"key":"rf16","doi-asserted-by":"publisher","DOI":"10.1007\/s00024-008-0327-7"},{"key":"rf17","doi-asserted-by":"publisher","DOI":"10.1145\/1163641.1163643"},{"key":"rf19","doi-asserted-by":"publisher","DOI":"10.1186\/gb-2004-5-10-r80"},{"key":"rf23","doi-asserted-by":"publisher","DOI":"10.1145\/1644001.1644004"},{"key":"rf28","doi-asserted-by":"publisher","DOI":"10.1155\/2008\/417946"},{"key":"rf30","author":"Are Magnus Bruaset H. P. L.","year":"1997","journal-title":"ACM Transactions on Mathematical Software"},{"key":"rf31","author":"Urbano Cuadrado M.","year":"2006","journal-title":"Trends in Analytical Chemistry"},{"key":"rf32","volume":"34","author":"Sala M.","year":"2008","journal-title":"ACM Transanctions on Mathematical Software"},{"key":"rf35","doi-asserted-by":"publisher","DOI":"10.1109\/5992.998640"},{"key":"rf37","author":"M\u00f8llegaard Friborg Rune","year":"2011","journal-title":"Journal of Computational Science"},{"key":"rf43","author":"Velde P. V. D.","year":"2007","journal-title":"Advances in Engineering Software"},{"key":"rf47","author":"Rouson D. W. I.","year":"2008","journal-title":"Scientific Programming"},{"key":"rf48","doi-asserted-by":"publisher","DOI":"10.1109\/MS.2009.27"},{"key":"rf50","author":"Hochstein L.","year":"2008","journal-title":"IEEE Computer"},{"key":"rf53","doi-asserted-by":"publisher","DOI":"10.1016\/S0010-4655(97)00043-X"},{"key":"rf57","doi-asserted-by":"publisher","DOI":"10.1109\/MS.2008.86"},{"key":"rf58","author":"Hatlo M.","year":"2005","journal-title":"IEEE Transactions on Nuclear Science"},{"key":"rf59","doi-asserted-by":"publisher","DOI":"10.1109\/MCSE.2009.193"},{"key":"rf61","doi-asserted-by":"publisher","DOI":"10.1109\/MCSE.2009.139"},{"key":"rf68","author":"Marshall J. J.","year":"2010","journal-title":"Earth Science Informatics"},{"key":"rf72","doi-asserted-by":"publisher","DOI":"10.1109\/MS.2008.92"},{"key":"rf73","doi-asserted-by":"publisher","DOI":"10.1109\/MS.2008.93"},{"key":"rf74","author":"Luksch P.","year":"1997","journal-title":"IEEE Concurreny"},{"key":"rf76","doi-asserted-by":"publisher","DOI":"10.1145\/1061254.1061257"},{"key":"rf77","doi-asserted-by":"publisher","DOI":"10.1016\/S0167-739X(02)00126-7"},{"key":"rf82","doi-asserted-by":"publisher","DOI":"10.1016\/S0003-2670(98)00481-4"},{"key":"rf83","author":"Diane Kelly R. G.","year":"2011","journal-title":"Journal of Computational Science"},{"key":"rf91","first-page":"40","volume":"11","author":"Hook D.","year":"2009","journal-title":"IEEE Design & Test"},{"key":"rf92","author":"Kelly D.","year":"2011","journal-title":"IEEE Software"},{"key":"rf94","author":"Post D. E.","year":"2004","journal-title":"International Journal of High Performance Computing Applications"},{"key":"rf100","doi-asserted-by":"publisher","DOI":"10.1109\/99.609829"},{"key":"rf103","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2008.11.846"},{"key":"rf107","doi-asserted-by":"publisher","DOI":"10.1098\/rsta.2008.0096"},{"key":"rf108","doi-asserted-by":"publisher","DOI":"10.1109\/MS.2003.1196317"},{"key":"rf111","doi-asserted-by":"publisher","DOI":"10.1007\/s10606-009-9096-9"},{"key":"rf117","doi-asserted-by":"publisher","DOI":"10.1002\/jcc.20091"},{"key":"rf122","doi-asserted-by":"publisher","DOI":"10.1109\/MS.2008.103"},{"key":"rf123","first-page":"37","volume":"14","author":"Cremer J. F.","year":"1997","journal-title":"Transactions of the Society for Computer Simulation International"},{"key":"rf124","author":"Baxter S. M.","year":"2006","journal-title":"PLoS Computational Biology"},{"key":"rf127","volume":"16","author":"Alexeev Y.","year":"2005","journal-title":"Journal of Physics"},{"key":"rf131","doi-asserted-by":"publisher","DOI":"10.1109\/MS.2007.155"},{"key":"rf132","doi-asserted-by":"publisher","DOI":"10.1109\/MCSE.2007.89"},{"key":"rf133","doi-asserted-by":"publisher","DOI":"10.1016\/S0164-1212(03)00232-2"},{"key":"rf134","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2004.08.018"},{"key":"rf135","first-page":"19","volume":"3","author":"Garousi V.","year":"2010","journal-title":"Canadian Journal on Computer and Information Science"},{"key":"rf136","first-page":"1","volume":"5","author":"Garousi V.","year":"2012","journal-title":"Canadian Journal on Computer and Information Science"},{"key":"rf140","author":"Kitchenham B.","year":"2007","journal-title":"Evidence-Based Software Engineering"},{"key":"rf142","doi-asserted-by":"publisher","DOI":"10.1016\/j.infsof.2011.06.003"},{"key":"rf143","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2009.52"},{"key":"rf146","doi-asserted-by":"publisher","DOI":"10.1002\/9781118181034"},{"key":"rf147","volume-title":"Bibliometrics and Citation Analysis: From the Science Citation Index to Cybermetrics","author":"Nicola B. D.","year":"2009"},{"key":"rf148","volume-title":"R Programming for Bioinformatics","author":"Gentleman R.","year":"2009"},{"key":"rf150","doi-asserted-by":"publisher","DOI":"10.1109\/MS.2008.86"},{"key":"rf151","volume-title":"Quasi-Experimentation \u2014 Design and Analysis Issues for Field Settings","author":"Cook T. D.","year":"1979"}],"container-title":["International Journal of Software Engineering and Knowledge Engineering"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.worldscientific.com\/doi\/pdf\/10.1142\/S0218194013500137","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2019,8,6]],"date-time":"2019-08-06T11:19:30Z","timestamp":1565090370000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.worldscientific.com\/doi\/abs\/10.1142\/S0218194013500137"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2013,5]]},"references-count":60,"journal-issue":{"issue":"04","published-online":{"date-parts":[[2013,7,25]]},"published-print":{"date-parts":[[2013,5]]}},"alternative-id":["10.1142\/S0218194013500137"],"URL":"https:\/\/doi.org\/10.1142\/s0218194013500137","relation":{},"ISSN":["0218-1940","1793-6403"],"issn-type":[{"value":"0218-1940","type":"print"},{"value":"1793-6403","type":"electronic"}],"subject":[],"published":{"date-parts":[[2013,5]]}}}