{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,9,28]],"date-time":"2025-09-28T04:13:07Z","timestamp":1759032787993,"version":"3.41.0"},"reference-count":50,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2005,7,1]],"date-time":"2005-07-01T00:00:00Z","timestamp":1120176000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Softw. Eng. Methodol."],"published-print":{"date-parts":[[2005,7]]},"abstract":"<jats:p>Kuhn, followed by Tsuchiya and Kikuno, have developed a hierarchy of relationships among several common types of faults (such as variable and expression faults) for specification-based testing by studying the corresponding fault detection conditions. Their analytical results can help explain the relative effectiveness of various fault-based testing techniques previously proposed in the literature. This article extends and complements their studies by analyzing the relationships between variable and literal faults, and among literal, operator, term, and expression faults. Our analysis is more comprehensive and produces a richer set of findings that interpret previous empirical results, can be applied to the design and evaluation of test methods, and inform the way that test cases should be prioritized for earlier detection of faults. Although this work originated from the detection of faults related to specifications, our results are equally applicable to program-based predicate testing that involves logic expressions.<\/jats:p>","DOI":"10.1145\/1072997.1072998","type":"journal-article","created":{"date-parts":[[2005,8,3]],"date-time":"2005-08-03T08:30:55Z","timestamp":1123057855000},"page":"247-276","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":85,"title":["An extended fault class hierarchy for specification-based testing"],"prefix":"10.1145","volume":"14","author":[{"given":"Man F.","family":"Lau","sequence":"first","affiliation":[{"name":"Swinburne University of Technology, Hawthorn, Australia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yuen T.","family":"Yu","sequence":"additional","affiliation":[{"name":"City University of Hong Kong, Kowloon Tong, Hong Kong"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2005,7]]},"reference":[{"volume-title":"Proceedings of the 7th Annual International Conference on Eng. of Complex Computer Systems (ICECCS '01)","author":"Ammann P.","key":"e_1_2_1_1_1","unstructured":"Ammann , P. , Ding , W. , and Xu , D . 2001. Using a model checker to test safety properties . In Proceedings of the 7th Annual International Conference on Eng. of Complex Computer Systems (ICECCS '01) . 212--221. Ammann, P., Ding, W., and Xu, D. 2001. Using a model checker to test safety properties. In Proceedings of the 7th Annual International Conference on Eng. of Complex Computer Systems (ICECCS '01). 212--221."},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1142\/S0218539301000530"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/229000.226326"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1109\/32.210305"},{"key":"e_1_2_1_5_1","volume-title":"Proceedings of Mutation","author":"Black P. E.","year":"2000","unstructured":"Black , P. E. , Okun , V. , and Yesha , Y . 2000a. Mutation of model checker specifications for test generation and evaluation . In Proceedings of Mutation 2000 . 14--20. Black, P. E., Okun, V., and Yesha, Y. 2000a. Mutation of model checker specifications for test generation and evaluation. In Proceedings of Mutation 2000. 14--20."},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.5555\/786768.786981"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1109\/32.708566"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/229000.226302"},{"volume-title":"Proceedings of the 21st International Computer Software and Application Conference (COMPSAC '97)","author":"Chen T. Y.","key":"e_1_2_1_9_1","unstructured":"Chen , T. Y. and Lau , M. F . 1997. Two test data selection strategies towards testing of Boolean specifications . In Proceedings of the 21st International Computer Software and Application Conference (COMPSAC '97) . 608--611. Chen, T. Y. and Lau, M. F. 1997. Two test data selection strategies towards testing of Boolean specifications. In Proceedings of the 21st International Computer Software and Application Conference (COMPSAC '97). 608--611."},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1002\/stvr.221"},{"volume-title":"Proceedings of Asia-Pacific Software Engineering Conference (APSEC '99)","author":"Chen T. Y.","key":"e_1_2_1_11_1","unstructured":"Chen , T. Y. , Lau , M. F. , and Yu , Y. T . 1999. MUMCUT: A fault-based strategy for testing Boolean specifications . In Proceedings of Asia-Pacific Software Engineering Conference (APSEC '99) . 606--613. Chen, T. Y., Lau, M. F., and Yu, Y. T. 1999. MUMCUT: A fault-based strategy for testing Boolean specifications. In Proceedings of Asia-Pacific Software Engineering Conference (APSEC '99). 606--613."},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1109\/32.368132"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1109\/32.485221"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1049\/sej.1994.0025"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/229000.226313"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1109\/C-M.1978.218136"},{"key":"e_1_2_1_17_1","volume-title":"Proceedings of the First International Symposium of Formal Methods Europe (FME","volume":"670","author":"Dick J.","year":"1993","unstructured":"Dick , J. and Faivre , A . 1993. Automating the generation and sequencing of test cases from model-based specifications . In Proceedings of the First International Symposium of Formal Methods Europe (FME 1993 ). Lecture Notes in Computer Science , vol. 670 . Springer, Berlin, Germany, 19--23. Dick, J. and Faivre, A. 1993. Automating the generation and sequencing of test cases from model-based specifications. In Proceedings of the First International Symposium of Formal Methods Europe (FME 1993). Lecture Notes in Computer Science, vol. 670. Springer, Berlin, Germany, 19--23."},{"key":"e_1_2_1_18_1","volume-title":"Proceedings of Digital Aviation Systems Conference (DASC","author":"Dupuy A.","year":"2000","unstructured":"Dupuy , A. and Leveson , N . 2000. An empirical evaluation of the MC\/DC coverage criterion on the HETE-2 satellite software . In Proceedings of Digital Aviation Systems Conference (DASC 2000 ). Dupuy, A. and Leveson, N. 2000. An empirical evaluation of the MC\/DC coverage criterion on the HETE-2 satellite software. In Proceedings of Digital Aviation Systems Conference (DASC 2000)."},{"key":"e_1_2_1_19_1","first-page":"4","article-title":"An evaluation of random testing","volume":"10","author":"Duran J. W.","year":"1984","unstructured":"Duran , J. W. and Ntafos , S. C. 1984 . An evaluation of random testing . IEEE Trans. Softw. Eng. 10 , 4 (July), 438--444. Duran, J. W. and Ntafos, S. C. 1984. An evaluation of random testing. IEEE Trans. Softw. Eng. 10, 4 (July), 438--444.","journal-title":"IEEE Trans. Softw. Eng."},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1109\/32.988497"},{"key":"e_1_2_1_21_1","first-page":"2","article-title":"Error sensitive test cases analysis (ESTCA)","volume":"6","author":"Foster K. A.","year":"1980","unstructured":"Foster , K. A. 1980 . Error sensitive test cases analysis (ESTCA) . IEEE Trans. Softw. Eng. 6 , 2 (May), 258--264. Foster, K. A. 1980. Error sensitive test cases analysis (ESTCA). IEEE Trans. Softw. Eng. 6, 2 (May), 258--264.","journal-title":"IEEE Trans. Softw. Eng."},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/1010925.1010935"},{"key":"e_1_2_1_23_1","volume-title":"Proceedings of the 7th European Software Engineering Conference and the 7th ACM SIGSOFT Symposium on the Foundations of Software Engineering. Lecture Notes in Computer Science","volume":"1687","author":"Gargantini A.","unstructured":"Gargantini , A. and Heitmeyer , C . 1999. Using model checking to generate tests from requirements specifications . In Proceedings of the 7th European Software Engineering Conference and the 7th ACM SIGSOFT Symposium on the Foundations of Software Engineering. Lecture Notes in Computer Science , vol. 1687 . Springer, Berlin, Germany, 146--162. Gargantini, A. and Heitmeyer, C. 1999. Using model checking to generate tests from requirements specifications. In Proceedings of the 7th European Software Engineering Conference and the 7th ACM SIGSOFT Symposium on the Foundations of Software Engineering. Lecture Notes in Computer Science, vol. 1687. Springer, Berlin, Germany, 146--162."},{"key":"e_1_2_1_24_1","first-page":"11","article-title":"ASM-based testing: Coverage criteria and automatic test sequence generation","volume":"7","author":"Gargantini A.","year":"2001","unstructured":"Gargantini , A. and Riccobene , E. 2001 . ASM-based testing: Coverage criteria and automatic test sequence generation . J. Univers. Comput. Sci. 7 , 11 (Nov.), 1050--1167. Gargantini, A. and Riccobene, E. 2001. ASM-based testing: Coverage criteria and automatic test sequence generation. J. Univers. Comput. Sci. 7, 11 (Nov.), 1050--1167.","journal-title":"J. Univers. Comput. Sci."},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.5555\/1762980.1763009"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1109\/32.508311"},{"key":"e_1_2_1_27_1","first-page":"7","article-title":"Applying the SCR requirements method to the light control case study","volume":"6","author":"Heitmeyer C.","year":"2000","unstructured":"Heitmeyer , C. and Bharadwaj , R. 2000 . Applying the SCR requirements method to the light control case study . J. Univers. Comput. Sci. 6 , 7 (Aug.), 650--678. Heitmeyer, C. and Bharadwaj, R. 2000. Applying the SCR requirements method to the light control case study. J. Univers. Comput. Sci. 6, 7 (Aug.), 650--678.","journal-title":"J. Univers. Comput. Sci."},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1002\/(SICI)1099-1689(199703)7:1<19::AID-STVR124>3.0.CO;2-N"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/606612.606615"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2003.1183927"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0950-5849(01)00222-1"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/322993.322996"},{"key":"e_1_2_1_33_1","volume-title":"Proceedings of Australian Software Engineering Conference (ASWEC","author":"Lau M. F.","year":"2001","unstructured":"Lau , M. F. and Yu , Y. T . 2001. On the relationships of faults for Boolean specification based testing . In Proceedings of Australian Software Engineering Conference (ASWEC 2001 ). 21--28. Lau, M. F. and Yu, Y. T. 2001. On the relationships of faults for Boolean specification based testing. In Proceedings of Australian Software Engineering Conference (ASWEC 2001). 21--28."},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1109\/52.300036"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1109\/32.317428"},{"key":"e_1_2_1_36_1","volume-title":"Proceedings of International Conference on Dependable Systems and Networks (DSN","author":"Madeira H.","year":"2000","unstructured":"Madeira , H. , Costa , D. , and Vieira , M . 2000. On the emulation of software faults by software fault injection . In Proceedings of International Conference on Dependable Systems and Networks (DSN 2000 ). 417--426. Madeira, H., Costa, D., and Vieira, M. 2000. On the emulation of software faults by software fault injection. In Proceedings of International Conference on Dependable Systems and Networks (DSN 2000). 417--426."},{"key":"e_1_2_1_37_1","volume-title":"The Art of Software Testing","author":"Myers G. J.","unstructured":"Myers , G. J. 1979. The Art of Software Testing , 2 nd ed. John Wiley , New York, NY . Myers, G. J. 1979. The Art of Software Testing, 2nd ed. John Wiley, New York, NY.","edition":"2"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/227607.227610"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1002\/stvr.264"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.5555\/590565.590596"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1109\/32.232020"},{"volume-title":"Software Considerations in Airborne Systems and Equipment Certification. RTCA","key":"e_1_2_1_42_1","unstructured":"RTCA\/DO-178B. 1992. Software Considerations in Airborne Systems and Equipment Certification. RTCA , Inc., Washington, DC. RTCA\/DO-178B. 1992. Software Considerations in Airborne Systems and Equipment Certification. RTCA, Inc., Washington, DC."},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1109\/32.553698"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1109\/32.536956"},{"volume-title":"Proceedings of the 11th International Computer Software and Application Conference (COMPSAC '87)","author":"Tai K. C.","key":"e_1_2_1_45_1","unstructured":"Tai , K. C. and Su , H. K . 1987. Test generation for Boolean expressions . In Proceedings of the 11th International Computer Software and Application Conference (COMPSAC '87) . 278--284. Tai, K. C. and Su, H. K. 1987. Test generation for Boolean expressions. In Proceedings of the 11th International Computer Software and Application Conference (COMPSAC '87). 278--284."},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1145\/504087.504089"},{"volume-title":"Proceedings of International Symposium on Software Reliability Engineering. 55--64","author":"Vouk M. A.","key":"e_1_2_1_47_1","unstructured":"Vouk , M. A. , Tai , K. C. , and Paradkar , A . 1994. Empirical studies of predicate-based software testing . In Proceedings of International Symposium on Software Reliability Engineering. 55--64 . Vouk, M. A., Tai, K. C., and Paradkar, A. 1994. Empirical studies of predicate-based software testing. In Proceedings of International Symposium on Software Reliability Engineering. 55--64."},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1109\/32.286420"},{"key":"e_1_2_1_49_1","volume-title":"Proceedings of the 7th International Conference on Reliable Software Technologies---Ada-Europe","volume":"2361","author":"Yu Y. T.","year":"2002","unstructured":"Yu , Y. T. and Lau , M. F . 2002. Prioritization of test cases in MUMCUT test sets: An empirical study . In Proceedings of the 7th International Conference on Reliable Software Technologies---Ada-Europe 2002 . Lecture Notes in Computer Science , vol. 2361 . Springer, Berlin, Germany, 245--256. Yu, Y. T. and Lau, M. F. 2002. Prioritization of test cases in MUMCUT test sets: An empirical study. In Proceedings of the 7th International Conference on Reliable Software Technologies---Ada-Europe 2002. Lecture Notes in Computer Science, vol. 2361. Springer, Berlin, Germany, 245--256."},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2005.08.016"}],"container-title":["ACM Transactions on Software Engineering and Methodology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1072997.1072998","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/1072997.1072998","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T16:07:45Z","timestamp":1750262865000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1072997.1072998"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2005,7]]},"references-count":50,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2005,7]]}},"alternative-id":["10.1145\/1072997.1072998"],"URL":"https:\/\/doi.org\/10.1145\/1072997.1072998","relation":{},"ISSN":["1049-331X","1557-7392"],"issn-type":[{"type":"print","value":"1049-331X"},{"type":"electronic","value":"1557-7392"}],"subject":[],"published":{"date-parts":[[2005,7]]},"assertion":[{"value":"2005-07-01","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}