{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T04:56:36Z","timestamp":1750308996822,"version":"3.41.0"},"reference-count":11,"publisher":"Association for Computing Machinery (ACM)","issue":"5","license":[{"start":{"date-parts":[[2004,9,1]],"date-time":"2004-09-01T00:00:00Z","timestamp":1093996800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["SIGSOFT Softw. Eng. Notes"],"published-print":{"date-parts":[[2004,9]]},"abstract":"<jats:p>Many factors influence quality data obtained from industrial case studies making comparisons difficult. In this paper, two longitudinal industrial case study experiences are shared which illustrate the complications that can arise. The first is a case study of an IBM team that transitioned to the use of test-driven development. The primary quality measure was functional verification test defects normalized by lines of code. The second case study was performed with an Extreme Programming team at Sabre Airline Solutions. Both test defects and field defects were compared. In both case studies, differences existed which made the comparisons indicative but not absolute.<\/jats:p>","DOI":"10.1145\/1022494.1022546","type":"journal-article","created":{"date-parts":[[2004,10,7]],"date-time":"2004-10-07T17:39:09Z","timestamp":1097170749000},"page":"1-4","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":1,"title":["On the need for a process for making reliable quality comparisons with industrial data"],"prefix":"10.1145","volume":"29","author":[{"given":"Laurie","family":"Williams","sequence":"first","affiliation":[{"name":"North Carolina State University"}]}],"member":"320","published-online":{"date-parts":[[2004,9]]},"reference":[{"key":"e_1_2_1_1_1","volume-title":"Extreme Programming Explained: Embrace Change","author":"Beck K.","year":"2000","unstructured":"K. Beck , Extreme Programming Explained: Embrace Change . Reading, Massachusetts : Addison-Wesley , 2000 . K. Beck, Extreme Programming Explained: Embrace Change. Reading, Massachusetts: Addison-Wesley, 2000."},{"key":"e_1_2_1_2_1","volume-title":"Test Driven Development: By Example: Addison Wesley","author":"Beck K.","year":"2002","unstructured":"K. Beck , Test Driven Development: By Example: Addison Wesley , 2002 . K. Beck, Test Driven Development: By Example: Addison Wesley, 2002."},{"key":"e_1_2_1_3_1","volume-title":"Agile Software Development","author":"Cockburn A.","year":"2001","unstructured":"A. Cockburn , Agile Software Development . Reading, Massachusetts : Addison Wesley Longman , 2001 . A. Cockburn, Agile Software Development. Reading, Massachusetts: Addison Wesley Longman, 2001."},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/74587.74643"},{"key":"e_1_2_1_5_1","volume-title":"Boston","author":"Jones C.","year":"2000","unstructured":"C. Jones , Software Assessments , Benchmarks, and Best Practices . Boston , MA : Addison Wesley , 2000 . C. Jones, Software Assessments, Benchmarks, and Best Practices. Boston, MA: Addison Wesley, 2000."},{"key":"e_1_2_1_6_1","volume-title":"Exploring Extreme Programming in Context: An Industrial Case Study,\" to appear Agile Development Conference","author":"Layman L.","year":"2004","unstructured":"L. Layman , L. Williams , and L. Cunningham , \" Exploring Extreme Programming in Context: An Industrial Case Study,\" to appear Agile Development Conference , Salt Lake City, UT , 2004 . L. Layman, L. Williams, and L. Cunningham, \"Exploring Extreme Programming in Context: An Industrial Case Study,\" to appear Agile Development Conference, Salt Lake City, UT, 2004."},{"key":"e_1_2_1_7_1","volume-title":"Assessing Test-driven Development at IBM,\" International Conference of Software Engineering","author":"Maximilien E. M.","year":"2003","unstructured":"E. M. Maximilien and L. Williams , \" Assessing Test-driven Development at IBM,\" International Conference of Software Engineering , Portland, OR , 2003 . E. M. Maximilien and L. Williams, \"Assessing Test-driven Development at IBM,\" International Conference of Software Engineering, Portland, OR, 2003."},{"key":"e_1_2_1_8_1","volume-title":"Within Budget.","author":"Putnam L. H.","year":"1992","unstructured":"L. H. Putnam and W. Myers , Measures for Excellence: Reliable Software on Time , Within Budget. Englewood Cliffs, NJ : Yourdon Press , 1992 . L. H. Putnam and W. Myers, Measures for Excellence: Reliable Software on Time, Within Budget. Englewood Cliffs, NJ: Yourdon Press, 1992."},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.1978.231521"},{"key":"e_1_2_1_10_1","volume-title":"Test-Driven Development as a Defect-Reduction Practice,\" IEEE International Symposium on Software Reliability Engineering","author":"Williams L.","year":"2003","unstructured":"L. Williams , E. M. Maximilien , and M. Vouk , \" Test-Driven Development as a Defect-Reduction Practice,\" IEEE International Symposium on Software Reliability Engineering , Denver, CO , 2003 . L. Williams, E. M. Maximilien, and M. Vouk, \"Test-Driven Development as a Defect-Reduction Practice,\" IEEE International Symposium on Software Reliability Engineering, Denver, CO, 2003."},{"key":"e_1_2_1_11_1","volume-title":"Case Study Research: Design and Methods","author":"Yin R. K.","year":"2003","unstructured":"R. K. Yin , Case Study Research: Design and Methods , vol. 5 , Third ed. Thousand Oaks, CA : Sage Publications , 2003 . R. K. Yin, Case Study Research: Design and Methods, vol. 5, Third ed. Thousand Oaks, CA: Sage Publications, 2003."}],"container-title":["ACM SIGSOFT Software Engineering Notes"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1022494.1022546","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/1022494.1022546","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T21:41:25Z","timestamp":1750282885000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1022494.1022546"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2004,9]]},"references-count":11,"journal-issue":{"issue":"5","published-print":{"date-parts":[[2004,9]]}},"alternative-id":["10.1145\/1022494.1022546"],"URL":"https:\/\/doi.org\/10.1145\/1022494.1022546","relation":{},"ISSN":["0163-5948"],"issn-type":[{"type":"print","value":"0163-5948"}],"subject":[],"published":{"date-parts":[[2004,9]]},"assertion":[{"value":"2004-09-01","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}