{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,10]],"date-time":"2026-06-10T14:51:28Z","timestamp":1781103088460,"version":"3.54.1"},"reference-count":75,"publisher":"IGI Global Scientific Publishing","issue":"3","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2011,7,1]]},"abstract":"<p>There is an ample debate over the quality of Free\/Libre Open Source Software (FLOSS) with mixed research results. The authors show that a reason for these mixed results is that quality is being defined, measured, and evaluated differently. They report the most popular approaches including software structure measures, process measures, and maturity assessment models. The way researchers have built their samples has also contributed to the mixed results with different project properties being considered and ignored. Because FLOSS projects evolve with each release, their quality does too, and it must be measured using metrics that take into account their communities\u2019 commitment to quality rather than just the structure of the resulting code. Challenges exist in defining what constitutes a defect or bug, and the role of modularity in affecting FLOSS quality. The authors suggest three considerations for future research on FLOSS quality models: (1) defect resolution rate, (2) kind of software product, and (3) modularity\u2014both technical and organizational.<\/p>","DOI":"10.4018\/jossp.2011070104","type":"journal-article","created":{"date-parts":[[2013,1,9]],"date-time":"2013-01-09T15:56:53Z","timestamp":1357747013000},"page":"48-65","source":"Crossref","is-referenced-by-count":5,"title":["Measuring Open Source Quality"],"prefix":"10.4018","volume":"3","author":[{"given":"Claudia","family":"Ruiz","sequence":"first","affiliation":[{"name":"Georgia State University, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"William N.","family":"Robinson","sequence":"additional","affiliation":[{"name":"Georgia State University, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"2432","reference":[{"key":"jossp.2011070104-0","doi-asserted-by":"publisher","DOI":"10.1109\/MS.2007.2"},{"key":"jossp.2011070104-1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2007.01.011"},{"key":"jossp.2011070104-2","doi-asserted-by":"crossref","first-page":"576","DOI":"10.17705\/1jais.00245","article-title":"A comprehensive review and synthesis of open source research.","volume":"11","author":"A.Aksulu","year":"2010","journal-title":"Journal of the Association for Information Systems"},{"key":"jossp.2011070104-3","unstructured":"Association for Information Systems. (2011). Senor scholars\u2019 basket of journals. Retrieved from http:\/\/home.aisnet.org\/displaycommon.cfm?an=1&subarticlenbr=346"},{"key":"jossp.2011070104-4","doi-asserted-by":"publisher","DOI":"10.1016\/j.im.2008.09.004"},{"key":"jossp.2011070104-5","unstructured":"Barbagallo, D., Francalenei, C., & Merlo, F. (2008). The impact of social networking on software design quality and development effort in open source projects. In Proceedings of the International Conference on Information Systems."},{"key":"jossp.2011070104-6","unstructured":"Boehm, B. W., Brown, J. R., & Lipow, M. (1976). Quantitative evaluation of software quality. In Proceedings of the 2nd International Conference on Software Engineering (pp. 592-605)."},{"key":"jossp.2011070104-7","doi-asserted-by":"publisher","DOI":"10.1007\/s12130-006-1003-9"},{"key":"jossp.2011070104-8","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2008.68"},{"key":"jossp.2011070104-9","doi-asserted-by":"crossref","unstructured":"Cavano, J. P., & McCall, J. A. (1978). A framework for the measurement of software quality. In Proceedings of the ACM Software Quality Workshop (pp. 133-139).","DOI":"10.1145\/953579.811113"},{"key":"jossp.2011070104-10","author":"C. A.Conley","year":"2008","journal-title":"Design for quality: The case of open source software development"},{"key":"jossp.2011070104-11","author":"P. B.Crosby","year":"1979","journal-title":"Quality is free: The art of making quality certain"},{"key":"jossp.2011070104-12","doi-asserted-by":"publisher","DOI":"10.1002\/spip.259"},{"key":"jossp.2011070104-13","doi-asserted-by":"publisher","DOI":"10.4018\/jdm.2008040101"},{"key":"jossp.2011070104-14","doi-asserted-by":"publisher","DOI":"10.1145\/2089125.2089127"},{"key":"jossp.2011070104-15","doi-asserted-by":"crossref","unstructured":"del Bianco, V., Lavazza, L., Morasca, S., Taibi, D., & Tosi, D. (2010). The QualiSPo approach to OSS product quality evaluation. In Proceedings of the 3rd International Workshop on Emerging Trends in Free\/Libre\/Open Source Software Research and Development (pp. 23-28).","DOI":"10.1145\/1833272.1833277"},{"key":"jossp.2011070104-16","author":"W. E.Deming","year":"1982","journal-title":"Quality, productivity, and competitive position"},{"key":"jossp.2011070104-17","author":"W. E.Deming","year":"1986","journal-title":"Out of the crisis"},{"key":"jossp.2011070104-18","doi-asserted-by":"crossref","unstructured":"Deprez, J.-C., & Alexandre, S. (2008). Comparing assessment methodologies for free\/open source software: OpenBRR and QSOS. In Proceedings of the 9th International Conference on Product-Focused Software Process Improvement (pp. 189-203).","DOI":"10.1007\/978-3-540-69566-0_17"},{"key":"jossp.2011070104-19","doi-asserted-by":"crossref","unstructured":"Deprez, J.-C., Monfils, F. F., Ciolkowski, M., & Soto, M. (2007). Defining software evolvability from a free\/open-source software perspective. In Proceedings of the Third International IEEE Workshop on Software Evolvability (pp. 29-35).","DOI":"10.1109\/SE.2007.15"},{"key":"jossp.2011070104-20","author":"A.Feigenbaum","year":"1961","journal-title":"Total quality control: Engineering and management: The technical and managerial field for improving product quality, including its reliability, and for reducing operating costs and losses"},{"key":"jossp.2011070104-21","first-page":"25","article-title":"What does 'product quality' really mean?","volume":"1","author":"D. A.Garvin","year":"1984","journal-title":"Sloan Management Review"},{"key":"jossp.2011070104-22","doi-asserted-by":"crossref","unstructured":"Ghapanchi, A. H., & Aurum, A. (2011). Measuring the effectiveness of the defect-fixing process in open source software projects. In Proceedings of the 44th Hawaii International Conference on System Sciences (pp. 1-11).","DOI":"10.1109\/HICSS.2011.305"},{"issue":"4","key":"jossp.2011070104-23","doi-asserted-by":"crossref","DOI":"10.5210\/fm.v9i4.1136","article-title":"Release criteria for the Linux Kernel.","volume":"9","author":"D. G.Glance","year":"2004","journal-title":"First Monday"},{"key":"jossp.2011070104-24","doi-asserted-by":"crossref","unstructured":"Glinz, M. (2007). On non-functional requirements. In Proceedings of the 15th IEEE International Requirements Engineering Conference.","DOI":"10.1109\/RE.2007.45"},{"key":"jossp.2011070104-25","doi-asserted-by":"crossref","unstructured":"Glott, R., Groven, A.-K., Haaland, K., & Tannenberg, A. (2010). Quality models for free\/libre open source software\u2011Towards the \u201csilver bullet\u201d? In Proceedings of the 36th EUROMICRO Conference on Software Engineering and Advanced Applications (pp. 439-446).","DOI":"10.1109\/SEAA.2010.23"},{"key":"jossp.2011070104-26","doi-asserted-by":"crossref","unstructured":"Groven, A.-K., Haaland, K., Glott, R., & Tannenberg, A. (2010). Security measurements within the framework of quality assessment models for free\/libre open source software. In Proceedings of the Fourth European Conference on Software Architecture: Companion Volume (pp. 229-235).","DOI":"10.1145\/1842752.1842796"},{"key":"jossp.2011070104-27","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2005.112"},{"key":"jossp.2011070104-28","unstructured":"Hales, P. (2006, December 8). Firefox use continues to rise in Europe. The Inquirer."},{"key":"jossp.2011070104-29","unstructured":"Halloran, T. J., & Scherlis, W. L. (2002). High quality and open source software practices. In Proceedings of the 2nd Workshop on Open Source Software Engineering."},{"key":"jossp.2011070104-30","doi-asserted-by":"publisher","DOI":"10.1109\/TEM.2003.820136"},{"key":"jossp.2011070104-31","year":"2001","journal-title":"ISO 9126-1:2001, Software engineering - Product quality, Part 1: Quality model"},{"key":"jossp.2011070104-32","author":"K.Ishikawa","year":"1985","journal-title":"What is total quality control? The Japanese way"},{"key":"jossp.2011070104-33","author":"J. M.Juran","year":"1988","journal-title":"Planning for quality"},{"key":"jossp.2011070104-34","doi-asserted-by":"publisher","DOI":"10.1002\/(SICI)1098-240X(199804)21:2<179::AID-NUR8>3.0.CO;2-G"},{"key":"jossp.2011070104-35","doi-asserted-by":"publisher","DOI":"10.1002\/nur.1029"},{"key":"jossp.2011070104-36","doi-asserted-by":"publisher","DOI":"10.1007\/s10588-006-9006-3"},{"key":"jossp.2011070104-37","unstructured":"Kitchenham, B., & Charters, S. (2007). Guidelines for performing systematic literature reviews in software engineering. Engineering, 2."},{"key":"jossp.2011070104-38","doi-asserted-by":"publisher","DOI":"10.4018\/jdm.2008040102"},{"key":"jossp.2011070104-39","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2006.05.017"},{"key":"jossp.2011070104-40","doi-asserted-by":"publisher","DOI":"10.1109\/MS.2004.12"},{"key":"jossp.2011070104-41","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2005.89"},{"key":"jossp.2011070104-42","unstructured":"Kuan, J. (2003). Open source software as lead-user's make or buy decision: A study of open and closed source quality. In Proceedings of the Second Conference on the Economics of the Software and Internet Industries."},{"key":"jossp.2011070104-43","unstructured":"McCall, J. A., Richards, P. K., & Walters, G. F. (1977). Factors in software quality. National Technology Information Service, 1-3."},{"key":"jossp.2011070104-44","unstructured":"Michlmayr, M. (2005). Software process maturity and the success of free software projects. In Proceeding of the Conference on Software Engineering: Evolution and Emerging Technologies (pp. 3-14)."},{"key":"jossp.2011070104-45","unstructured":"Michlmayr, M., Hunt, F., & Probert, D. (2005). Quality practices and problems in free software projects. In Proceedings of the First International Conference on Open Source Systems."},{"key":"jossp.2011070104-46","doi-asserted-by":"crossref","unstructured":"Mockus, A., Fielding, R. T., & Herbsleb, J. (2000). A case study of open source software development: The apache server. In Proceedings of the 22nd International Conference on Software Engineering (pp. 263-272).","DOI":"10.1145\/337180.337209"},{"key":"jossp.2011070104-47","doi-asserted-by":"publisher","DOI":"10.1145\/567793.567795"},{"key":"jossp.2011070104-48","unstructured":"OSI. (2006). The open source definition, version 1.9. Retrieved August 4, 2009, from http:\/\/www.opensource.org\/docs\/osd"},{"key":"jossp.2011070104-49","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2004.1274044"},{"issue":"6","key":"jossp.2011070104-50","first-page":"903","article-title":"Open source versus closed source: software quality in monopoly and competitive markets. IEEE Transactions on Systems, Man and Cybernetics","volume":"35","author":"S.Raghunathan","year":"2005","journal-title":"Part A"},{"key":"jossp.2011070104-51","doi-asserted-by":"publisher","DOI":"10.1007\/s12130-999-1026-0"},{"key":"jossp.2011070104-52","doi-asserted-by":"crossref","unstructured":"Rigby, P. C., German, D. M., & Storey, M.-A. (2008). Open source software peer review practices: a case study of the apache server. In Proceedings of the International Conference on Software Engineering (pp. 541-550).","DOI":"10.1145\/1368088.1368162"},{"key":"jossp.2011070104-53","doi-asserted-by":"crossref","unstructured":"Samoladas, I., Gousios, G., Spinellis, D., & Stamelos, I. (2008). The SQO-OSS quality model: Measurement based open source software evaluation. In Proceedings of the 4th International Conference on Open Source Systems (pp. 237-248).","DOI":"10.1007\/978-0-387-09684-1_19"},{"key":"jossp.2011070104-54","doi-asserted-by":"publisher","DOI":"10.1145\/1022594.1022598"},{"key":"jossp.2011070104-55","article-title":"Understanding requirements for open source software","author":"W.Scacchi","year":"2009","journal-title":"Design requirements engineering - A multi-disciplinary perspective for the next decade"},{"key":"jossp.2011070104-56","author":"K.Schwaber","year":"2004","journal-title":"Agile project management with scrum"},{"key":"jossp.2011070104-57","unstructured":"Schweik, C. M., English, R. C., Kitsing, M., & Haire, S. (2008). Brooks' versus Linus' Law: An empirical test of open source projects. In Proceedings of the International Conference on Digital Government Research (pp. 423-424)."},{"key":"jossp.2011070104-58","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2007.08.034"},{"key":"jossp.2011070104-59","doi-asserted-by":"crossref","unstructured":"Soto, M., & Ciolkowski, M. (2009). The QualOSS open source assessment model measuring the performance of open source communities. In Proceedings of the 3rd International Symposium on Empirical Software Engineering and Measurement (pp. 498-501).","DOI":"10.1109\/ESEM.2009.5314237"},{"key":"jossp.2011070104-60","doi-asserted-by":"crossref","unstructured":"Spinellis, D. (2008). A tale of four kernels. In Proceedings of the 30th International Conference on Software Engineering (pp. 381-390).","DOI":"10.1145\/1368088.1368140"},{"key":"jossp.2011070104-61","doi-asserted-by":"publisher","DOI":"10.1046\/j.1365-2575.2002.00117.x"},{"issue":"2","key":"jossp.2011070104-62","doi-asserted-by":"crossref","first-page":"291","DOI":"10.2307\/25148732","article-title":"The impact of ideology on effectiveness in open source software development teams.","volume":"30","author":"K. J.Stewart","year":"2006","journal-title":"Management Information Systems Quarterly"},{"key":"jossp.2011070104-63","first-page":"273","article-title":"Grounded theory methodology - An overview","author":"A.Strauss","year":"1994","journal-title":"Handbook of qualitative research"},{"key":"jossp.2011070104-64","author":"A. L.Strauss","year":"1990","journal-title":"Basics of qualitative research: Grounded theory procedures and techniques"},{"key":"jossp.2011070104-65","author":"G.Tennant","year":"2001","journal-title":"Six sigma: SPC and TQM in manufacturing and services"},{"key":"jossp.2011070104-66","author":"A.Tiwana","year":"2010","journal-title":"The influence of software platform modularity on platform abandonment: An empirical study of Firefox extension developers. Unpublished Presentation"},{"key":"jossp.2011070104-67","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2009.1"},{"key":"jossp.2011070104-68","doi-asserted-by":"publisher","DOI":"10.1287\/orsc.14.2.209.14992"},{"key":"jossp.2011070104-69","doi-asserted-by":"publisher","DOI":"10.1287\/isre.6.4.376"},{"key":"jossp.2011070104-70","doi-asserted-by":"publisher","DOI":"10.1108\/09685220810920530"},{"key":"jossp.2011070104-71","unstructured":"Ye, Y., & Kishida, K. (2003). Toward an understanding of the motivation of open source software developers. In Proceedings of the 25th International Conference on Software Engineering (pp. 419-429)."},{"key":"jossp.2011070104-72","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2005.08.014"},{"key":"jossp.2011070104-73","doi-asserted-by":"publisher","DOI":"10.1016\/S0164-1212(02)00064-X"},{"key":"jossp.2011070104-74","doi-asserted-by":"crossref","unstructured":"Zhou, Y., & Davis, J. (2005). Open source software reliability model: An empirical approach. In Proceedings of the Fifth Workshop on Open Source Software Engineering.","DOI":"10.1145\/1083258.1083273"}],"container-title":["International Journal of Open Source Software and Processes"],"original-title":[],"language":"ng","link":[{"URL":"https:\/\/www.igi-global.com\/viewtitle.aspx?TitleId=68150","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,6,2]],"date-time":"2022-06-02T01:09:35Z","timestamp":1654132175000},"score":1,"resource":{"primary":{"URL":"https:\/\/services.igi-global.com\/resolvedoi\/resolve.aspx?doi=10.4018\/jossp.2011070104"}},"subtitle":["A Literature Review"],"short-title":[],"issued":{"date-parts":[[2011,7,1]]},"references-count":75,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2011,7]]}},"URL":"https:\/\/doi.org\/10.4018\/jossp.2011070104","relation":{},"ISSN":["1942-3926","1942-3934"],"issn-type":[{"value":"1942-3926","type":"print"},{"value":"1942-3934","type":"electronic"}],"subject":[],"published":{"date-parts":[[2011,7,1]]}}}