{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,21]],"date-time":"2026-02-21T18:11:02Z","timestamp":1771697462001,"version":"3.50.1"},"reference-count":31,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2005,5,17]],"date-time":"2005-05-17T00:00:00Z","timestamp":1116288000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["SIGSOFT Softw. Eng. Notes"],"published-print":{"date-parts":[[2005,7]]},"abstract":"<jats:p>In industrial practice, information on post-release field quality of a product tends to become available too late in the software development process to affordably guide corrective actions. An important step towards remediation of this problem of late information lies in the ability to provide an early estimation of software post-release field quality. This paper presents the use of a suite of in-process metrics that leverages the software testing effort to provide (1) an estimation of potential software field quality in early software development phases, and (2) the identification of low quality software programs. A controlled case study conducted at North Carolina State University provides initial indication that our approach is effective for making an early assessment of post-release field quality.<\/jats:p>","DOI":"10.1145\/1082983.1083304","type":"journal-article","created":{"date-parts":[[2005,11,7]],"date-time":"2005-11-07T19:28:32Z","timestamp":1131391712000},"page":"1-7","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":16,"title":["Early estimation of software quality using in-process testing metrics"],"prefix":"10.1145","volume":"30","author":[{"given":"Nachiappan","family":"Nagappan","sequence":"first","affiliation":[{"name":"Microsoft Research, Redmond, WA"}]},{"given":"Laurie","family":"Williams","sequence":"additional","affiliation":[{"name":"North Carolina State University, Raleigh, NC"}]},{"given":"Mladen","family":"Vouk","sequence":"additional","affiliation":[{"name":"North Carolina State University, Raleigh, NC"}]},{"given":"Jason","family":"Osborne","sequence":"additional","affiliation":[{"name":"North Carolina State University, Raleigh, NC"}]}],"member":"320","published-online":{"date-parts":[[2005,5,17]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1109\/32.544352"},{"key":"e_1_2_1_2_1","volume-title":"Extreme Programming Explained: Embrace Change","author":"Beck K.","year":"2000","unstructured":"Beck , K. , Extreme Programming Explained: Embrace Change . Reading, Massachusetts : Addison-Wesley , 2000 . Beck, K., Extreme Programming Explained: Embrace Change. Reading, Massachusetts: Addison-Wesley, 2000."},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.5555\/539425"},{"key":"e_1_2_1_4_1","volume-title":"SPSS for Psychologists: Palgrave Macmillan","author":"Brace N.","year":"2003","unstructured":"Brace , N. , Kemp , R. , Snelgar , R. , SPSS for Psychologists: Palgrave Macmillan , 2003 . Brace, N., Kemp, R., Snelgar, R., SPSS for Psychologists: Palgrave Macmillan, 2003."},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0164-1212(99)00102-8"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/302405.302654"},{"key":"e_1_2_1_7_1","volume-title":"Proceedings of ECOOP '95 Workshop on Metrics","author":"Brito","year":"1995","unstructured":"Brito e Abreu, F., \" The MOOD Metrics Set ,\" Proceedings of ECOOP '95 Workshop on Metrics , 1995 , pp. Brito e Abreu, F., \"The MOOD Metrics Set,\" Proceedings of ECOOP '95 Workshop on Metrics, 1995, pp."},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1109\/32.707698"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1109\/32.295895"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1109\/32.372153"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1109\/32.935855"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1109\/32.689404"},{"key":"e_1_2_1_13_1","unstructured":"ISO\/IEC \"DIS 14598-1 Information Technology - Software Product Evaluation \" 1996.  ISO\/IEC \"DIS 14598-1 Information Technology - Software Product Evaluation \" 1996."},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1002\/0471725331"},{"key":"e_1_2_1_15_1","volume-title":"Metrics and Models in Software Quality Engineering","author":"Kan S. H.","year":"1995","unstructured":"Kan , S. H. , Metrics and Models in Software Quality Engineering . Reading, MA : Addison-Wesley , 1995 . Kan, S. H., Metrics and Models in Software Quality Engineering. Reading, MA: Addison-Wesley, 1995."},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1109\/49.46879"},{"key":"e_1_2_1_17_1","first-page":"72","volume-title":"Proceedings of International Conference on Software Maintenance","author":"Khoshgoftaar T. M.","year":"1993","unstructured":"Khoshgoftaar , T. M. , Munson , J. C. , Lanning , D. L. , \"A Comparative Study of Predictive Models for Program Changes During System Testing and Maintenance,\" Proceedings of International Conference on Software Maintenance , 1993 , pp. 72 -- 79 . Khoshgoftaar, T. M., Munson, J. C., Lanning, D. L., \"A Comparative Study of Predictive Models for Program Changes During System Testing and Maintenance,\" Proceedings of International Conference on Software Maintenance, 1993, pp. 72--79."},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1024424811345"},{"key":"e_1_2_1_19_1","volume-title":"Applied Regression Analysis and Other Multivariable Methods","author":"Kleinbaum D. G.","year":"1987","unstructured":"Kleinbaum , D. G. , Kupper , L. L. , Muller , K. E. , Applied Regression Analysis and Other Multivariable Methods . Boston : PWS-KENT Publishing Company , 1987 . Kleinbaum, D. G., Kupper, L. L., Muller, K. E., Applied Regression Analysis and Other Multivariable Methods. Boston: PWS-KENT Publishing Company, 1987."},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.1976.233837"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.5555\/81449.81451"},{"key":"e_1_2_1_22_1","volume-title":"Department of Computer Science","author":"Nagappan N.","year":"2005","unstructured":"Nagappan , N. , \"A Software Testing and Reliability Early Warning (STREW) Metric Suite\" , Department of Computer Science , North Carolina State University , 2005 . Nagappan, N., \"A Software Testing and Reliability Early Warning (STREW) Metric Suite\", Department of Computer Science, North Carolina State University, 2005."},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/965660.965667"},{"key":"e_1_2_1_24_1","first-page":"238","volume-title":"Proceedings of International Symposium on Software Reliability Engineering, FastAbstract","author":"Nagappan N.","year":"2003","unstructured":"Nagappan , N. , Williams , L. , Vouk M. A. , \" Towards a Metric Suite for Early Software Reliability Assessment,\" Proceedings of International Symposium on Software Reliability Engineering, FastAbstract , Denver, CO , 2003 , pp. 238 -- 239 . Nagappan, N., Williams, L., Vouk M. A., \"Towards a Metric Suite for Early Software Reliability Assessment,\" Proceedings of International Symposium on Software Reliability Engineering, FastAbstract, Denver, CO, 2003, pp. 238--239."},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.5555\/1337691.1338388"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1109\/32.341844"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2003.1191795"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.5555\/520792.823979"},{"key":"e_1_2_1_29_1","volume-title":"North York, Ontario","author":"Troster J.","year":"1992","unstructured":"Troster , J. , \" Assessing Design-Quality Metrics on Legacy Software,\" Software Engineering Process Group , IBM Canada Ltd. Laboratory , North York, Ontario 1992 . Troster, J., \"Assessing Design-Quality Metrics on Legacy Software,\" Software Engineering Process Group, IBM Canada Ltd. Laboratory, North York, Ontario 1992."},{"key":"e_1_2_1_30_1","first-page":"513","volume-title":"Proceedings of CASCON'93","author":"Vouk M. A.","year":"1993","unstructured":"Vouk , M. A. , Tai , K. C. , \" Multi-Phase Coverage - and Risk-Based Software Reliability Modeling,\" Proceedings of CASCON'93 , 1993 , pp. 513 -- 523 . Vouk, M. A., Tai, K. C., \"Multi-Phase Coverage- and Risk-Based Software Reliability Modeling,\" Proceedings of CASCON'93, 1993, pp. 513--523."},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1142\/1390"}],"container-title":["ACM SIGSOFT Software Engineering Notes"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1082983.1083304","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/1082983.1083304","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T16:08:14Z","timestamp":1750262894000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1082983.1083304"}},"subtitle":["a controlled case study"],"short-title":[],"issued":{"date-parts":[[2005,5,17]]},"references-count":31,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2005,7]]}},"alternative-id":["10.1145\/1082983.1083304"],"URL":"https:\/\/doi.org\/10.1145\/1082983.1083304","relation":{"is-identical-to":[{"id-type":"doi","id":"10.1145\/1083292.1083304","asserted-by":"subject"}]},"ISSN":["0163-5948"],"issn-type":[{"value":"0163-5948","type":"print"}],"subject":[],"published":{"date-parts":[[2005,5,17]]},"assertion":[{"value":"2005-05-17","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}