{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,9]],"date-time":"2026-03-09T10:54:09Z","timestamp":1773053649761,"version":"3.50.1"},"reference-count":18,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2008,6,1]],"date-time":"2008-06-01T00:00:00Z","timestamp":1212278400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Softw. Eng. Methodol."],"published-print":{"date-parts":[[2008,6]]},"abstract":"<jats:p>Failure patterns describe typical ways in which inputs revealing program failure are distributed across the input domain\u2014in many cases, clustered together in contiguous regions. Based on these observations several debug testing methods have been developed. We examine the upper bound of debug testing effectiveness improvements possible through making assumptions about the shape, size and orientation of failure patterns. We consider the bounds for testing strategies with respect to minimizing the F-measure, maximizing the P-measure, and maximizing the E-measure. Surprisingly, we find that the empirically measured effectiveness of some existing methods that are not based on these assumptions is close to the theoretical upper bound of these strategies. The assumptions made to obtain the upper bound, and its further implications, are also examined.<\/jats:p>","DOI":"10.1145\/1363102.1363107","type":"journal-article","created":{"date-parts":[[2008,7,2]],"date-time":"2008-07-02T12:09:19Z","timestamp":1215000559000},"page":"1-27","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":82,"title":["An upper bound on software testing effectiveness"],"prefix":"10.1145","volume":"17","author":[{"given":"Tsong Yueh","family":"Chen","sequence":"first","affiliation":[{"name":"Swinburne University of Technology, Hawthorn Victoria, Australia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Robert","family":"Merkel","sequence":"additional","affiliation":[{"name":"Swinburne University of Technology, Hawthorn Victoria, Australia"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2008,6,27]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1109\/12.2185"},{"key":"e_1_2_1_2_1","volume-title":"FTSC-23. Digest of Papers, the Twenty-Third International Symposium on Fault-Tolerant Computing","author":"Bishop P. G."},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1016\/0950-5849(96)01103-2"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2005.05.029"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.infsof.2004.07.004"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-30502-6_23"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1109\/32.485221"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/1145735.1145744"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/503209.503243"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.1984.5010257"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1109\/32.707695"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1109\/32.221133"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1109\/32.62448"},{"key":"e_1_2_1_14_1","unstructured":"Kuo F.-C. 2006. On adaptive random testing. Ph.D. thesis Swinburne University of Technology Hawthorn Australia.  Kuo F.-C. 2006. On adaptive random testing. Ph.D. thesis Swinburne University of Technology Hawthorn Australia."},{"key":"e_1_2_1_15_1","unstructured":"Merkel R. 2005. Analysis and enhancements of adaptive random testing. Ph.D. thesis Swinburne University of Technology Hawthorn Australia.  Merkel R. 2005. Analysis and enhancements of adaptive random testing. Ph.D. thesis Swinburne University of Technology Hawthorn Australia."},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/1007512.1007533"},{"key":"e_1_2_1_17_1","unstructured":"Weisstein E. W. 2004. Tessellation. From Mathworld\u2014a Wolfram Web Resource http:\/\/mathworld.wolfram.com\/Tessellation.html.  Weisstein E. W. 2004. Tessellation. From Mathworld\u2014a Wolfram Web Resource http:\/\/mathworld.wolfram.com\/Tessellation.html."},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.1980.234486"}],"container-title":["ACM Transactions on Software Engineering and Methodology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1363102.1363107","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/1363102.1363107","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T15:13:48Z","timestamp":1750259628000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1363102.1363107"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2008,6]]},"references-count":18,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2008,6]]}},"alternative-id":["10.1145\/1363102.1363107"],"URL":"https:\/\/doi.org\/10.1145\/1363102.1363107","relation":{},"ISSN":["1049-331X","1557-7392"],"issn-type":[{"value":"1049-331X","type":"print"},{"value":"1557-7392","type":"electronic"}],"subject":[],"published":{"date-parts":[[2008,6]]},"assertion":[{"value":"2006-06-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2007-04-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2008-06-27","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}