{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,10]],"date-time":"2026-06-10T15:30:45Z","timestamp":1781105445629,"version":"3.54.1"},"reference-count":39,"publisher":"IGI Global Scientific Publishing","issue":"2","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2011,4,1]]},"abstract":"<p>Open Source Software (OSS) products do not usually follow traditional software engineering development paradigms. Specifically, testing activities in OSS development may be quite different from those carried out in Closed Source Software (CSS) development. As testing and verification require a good deal of resources in OSS, it is necessary to have ways to assess and improve OSS testing processes. This paper provides a set of testing guidelines and issues that OSS developers can use to decide which testing techniques make most sense for their OSS products. This paper 1) provides a checklist that helps OSS developers identify the most useful testing techniques according to the main characteristics of their products, and 2) outlines a proposal for a method that helps assess the maturity of OSS testing processes. The method is a proposal of a Maturity Model for testing processes (called OSS-TMM). To show its usefulness, the authors apply the method to seven real-life projects. Specifically, the authors apply the method to BusyBox, Apache Httpd, and Eclipse Test &amp; Performance Tools Platform to show how the checklist supports and guides the testing process of these OSS products.<\/p>","DOI":"10.4018\/jossp.2011040101","type":"journal-article","created":{"date-parts":[[2012,1,13]],"date-time":"2012-01-13T10:56:53Z","timestamp":1326452213000},"page":"1-22","source":"Crossref","is-referenced-by-count":7,"title":["OSS-TMM"],"prefix":"10.4018","volume":"3","author":[{"given":"Sandro","family":"Morasca","sequence":"first","affiliation":[{"name":"Universit\u00e0 degli Studi dell\u2019Insubria, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Davide","family":"Taibi","sequence":"additional","affiliation":[{"name":"Universit\u00e0 degli Studi dell\u2019Insubria, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Davide","family":"Tosi","sequence":"additional","affiliation":[{"name":"Universit\u00e0 degli Studi dell\u2019Insubria, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"2432","reference":[{"key":"jossp.2011040101-0","doi-asserted-by":"publisher","DOI":"10.1109\/MS.2007.2"},{"key":"jossp.2011040101-1","unstructured":"Agruss, C. (2000). Software installation testing - how to automate tests for smooth system installation. Software Testing & Quality Engineering, 32-37."},{"key":"jossp.2011040101-2","doi-asserted-by":"publisher","DOI":"10.1109\/MSP.2005.23"},{"key":"jossp.2011040101-3","doi-asserted-by":"publisher","DOI":"10.1145\/196092.196088"},{"key":"jossp.2011040101-4","doi-asserted-by":"crossref","unstructured":"Burnstein, I., Suwanassart, T., & Carlson, R. (1996). Developing a Testing Maturity Model for software test process evaluation and improvement. In Proceedings of the IEEE International Test Conference (pp. 581-589).","DOI":"10.1109\/TEST.1996.557106"},{"key":"jossp.2011040101-5","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.1982.234773"},{"key":"jossp.2011040101-6","unstructured":"Duijnhouwer, F. W., & Widdows, C. (2010). Open Source Maturity Model. Retrieved from http:\/\/www.osspartner.com"},{"key":"jossp.2011040101-7","author":"K.El Emam","year":"1997","journal-title":"Spice: The Theory and Practice of Software Process Improvement and Capability determination"},{"key":"jossp.2011040101-8","doi-asserted-by":"publisher","DOI":"10.1002\/(SICI)1099-1689(199712)7:4<229::AID-STVR149>3.0.CO;2-M"},{"key":"jossp.2011040101-9","doi-asserted-by":"publisher","DOI":"10.1109\/32.908957"},{"issue":"7","key":"jossp.2011040101-10","doi-asserted-by":"crossref","first-page":"744","DOI":"10.1109\/TSE.1986.6312976","article-title":"Advances in Software Inspections.","volume":"12","author":"M. E.Fagan","year":"1986","journal-title":"IEEE Transactions on Software Engineering"},{"key":"jossp.2011040101-11","author":"D.Garmus","year":"2001","journal-title":"Function point analysis: measurement practices for successful software projects"},{"key":"jossp.2011040101-12","doi-asserted-by":"publisher","DOI":"10.1145\/255656.255692"},{"key":"jossp.2011040101-13","doi-asserted-by":"publisher","DOI":"10.1109\/MSP.2006.84"},{"key":"jossp.2011040101-14","year":"1986","journal-title":"Std 1008-1987: IEEE standard for Software Unit Testing"},{"key":"jossp.2011040101-15","year":"2008","journal-title":"Std 829-2008: IEEE Standard for Software and System Test Documentation"},{"key":"jossp.2011040101-16","year":"2004","journal-title":"ISO\/IEC 15504-1 Information technology process assessment. Part 1: Concepts and vocabulary"},{"key":"jossp.2011040101-17","year":"2001","journal-title":"ISO\/IEC 14598-1 Information technology - software product evaluation. Part 1: General overview"},{"key":"jossp.2011040101-18","year":"2001","journal-title":"ISO\/IEC 9126-1 Software engineering - product quality. Part 1: Quality model"},{"key":"jossp.2011040101-19","author":"T.Koomen","year":"1999","journal-title":"Test Process Improvement: a practical step-by-step guide to structured testing"},{"key":"jossp.2011040101-20","doi-asserted-by":"crossref","unstructured":"Leung, H. K. N., & White, L. (1990). A study of integration testing and software regression at the integration level. In Proceedings of the Conference on Software Maintenance (pp. 290-301).","DOI":"10.1109\/ICSM.1990.131377"},{"key":"jossp.2011040101-21","doi-asserted-by":"crossref","unstructured":"Mao, C., Lu, Y., & Zhang, J. (2007). Regression testing for component-based software via built-in test design. In Proceedings of the ACM Symposium on Applied Computing (pp. 1416-1421).","DOI":"10.1145\/1244002.1244307"},{"key":"jossp.2011040101-22","doi-asserted-by":"crossref","unstructured":"Morasca, S., Taibi, D., & Tosi, D. (2010). T-DOC: a Tool for the Automatic Generation of Testing Documentation for OSS Products. In Proceedings of the IFIP International Conference on Open Source Software.","DOI":"10.1007\/978-3-642-13244-5_16"},{"key":"jossp.2011040101-23","doi-asserted-by":"crossref","unstructured":"Morasca, S., Taibi, T., & Tosi, D. (2009). Certifying the testing process of open source software: New challenges or old methodologies? In Proceedings of the IEEE International Workshop on Free\/Libre\/Open Source Software Research and Development (pp. 25-30).","DOI":"10.1109\/FLOSS.2009.5071356"},{"key":"jossp.2011040101-24","doi-asserted-by":"publisher","DOI":"10.1109\/32.57623"},{"key":"jossp.2011040101-25","doi-asserted-by":"publisher","DOI":"10.1145\/291469.291470"},{"key":"jossp.2011040101-26","unstructured":"Oksanen, V., & Kupsu, M. (2008). OSLC Open Source License Checker V3. Retrieved from http:\/\/forge.ow2.org\/projects\/oslcv3\/"},{"key":"jossp.2011040101-27","doi-asserted-by":"crossref","unstructured":"Orso, A. (2010). Monitoring, analysis, and testing of deployed software. In Proceedings of the FSE\/SDP Workshop on Future of Software Engineering Research (pp. 263-268).","DOI":"10.1145\/1882362.1882417"},{"key":"jossp.2011040101-28","doi-asserted-by":"publisher","DOI":"10.1145\/62959.62964"},{"key":"jossp.2011040101-29","doi-asserted-by":"crossref","unstructured":"Petrinja, E., Nambakam, R., & Sillitti, A. (2009). Introducing the OpenSource Maturity Model. In Proceedings of the IEEE International Workshop on Free\/Libre\/Open Source Software Research and Development.","DOI":"10.1109\/FLOSS.2009.5071358"},{"key":"jossp.2011040101-30","author":"M.Pezz\u00e8","year":"2007","journal-title":"Software Testing and Analysis. Process, Principles, and Techniques"},{"key":"jossp.2011040101-31","doi-asserted-by":"crossref","unstructured":"Pretschner, A., Prenninger, W., Wagner, S., Kuhnel, C., Baumgartner, M., Sostawa, B., & Zolch, R. (2005). One evaluation of model-based testing and its automation. In Proceedings of the 27th International Conference on Software Engineering (pp. 392-401).","DOI":"10.1145\/1062455.1062529"},{"key":"jossp.2011040101-32","doi-asserted-by":"crossref","unstructured":"Santelices, R. A., Chittimalli, P. K., Apiwattanapong, T., Orso, A., & Harrold, M. J. (2008). Test-suite augmentation for evolving software. In Proceedings of the IEEE International Conference on Automated Software Engineering (pp. 218-227).","DOI":"10.1109\/ASE.2008.32"},{"key":"jossp.2011040101-33","doi-asserted-by":"crossref","unstructured":"Taibi, D., Lavazza, L., & Morasca, S. (2007). OpenBQR: a framework for the assessment of OSS. International Journal on Open Source Development, Adoption and Innovation, 173-186.","DOI":"10.1007\/978-0-387-72486-7_14"},{"key":"jossp.2011040101-34","unstructured":"The Qualipso Project 1. (2010). How European software industry perceives OSS trustworthiness and what are the specific criteria to establish trust in OSS. Retrieved from http:\/\/www.qualipso.eu\/node\/45"},{"key":"jossp.2011040101-35","unstructured":"Tosi, D., & Tahir, A. (2010). How developers test their Open Source Software Products. A survey of well-known OSS projects. In Proceedings of the 5th International Conference on Software and Data Technologies."},{"key":"jossp.2011040101-36","doi-asserted-by":"publisher","DOI":"10.1007\/s10515-009-0054-z"},{"key":"jossp.2011040101-37","doi-asserted-by":"publisher","DOI":"10.1109\/32.888628"},{"issue":"1","key":"jossp.2011040101-38","doi-asserted-by":"crossref","first-page":"65","DOI":"10.1016\/S0164-1212(02)00064-X","article-title":"Quality assurance under the open source development model.","volume":"66","author":"L.Zhao","year":"2003","journal-title":"International Journal of Systems and Software"}],"container-title":["International Journal of Open Source Software and Processes"],"original-title":[],"language":"ng","link":[{"URL":"https:\/\/www.igi-global.com\/viewtitle.aspx?TitleId=62097","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,6,1]],"date-time":"2022-06-01T17:01:18Z","timestamp":1654102878000},"score":1,"resource":{"primary":{"URL":"https:\/\/services.igi-global.com\/resolvedoi\/resolve.aspx?doi=10.4018\/jossp.2011040101"}},"subtitle":["Guidelines for Improving the Testing Process of Open Source Software"],"short-title":[],"issued":{"date-parts":[[2011,4,1]]},"references-count":39,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2011,4]]}},"URL":"https:\/\/doi.org\/10.4018\/jossp.2011040101","relation":{},"ISSN":["1942-3926","1942-3934"],"issn-type":[{"value":"1942-3926","type":"print"},{"value":"1942-3934","type":"electronic"}],"subject":[],"published":{"date-parts":[[2011,4,1]]}}}