{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,30]],"date-time":"2026-01-30T01:51:55Z","timestamp":1769737915781,"version":"3.49.0"},"reference-count":37,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2009,5,1]],"date-time":"2009-05-01T00:00:00Z","timestamp":1241136000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["CCR-0305330"],"award-info":[{"award-number":["CCR-0305330"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100000266","name":"Engineering and Physical Sciences Research Council","doi-asserted-by":"publisher","award":["EP\/G009600\/1EP\/F065825\/1EP\/F010443EP\/F059442EP\/D050863"],"award-info":[{"award-number":["EP\/G009600\/1EP\/F065825\/1EP\/F010443EP\/F059442EP\/D050863"]}],"id":[{"id":"10.13039\/501100000266","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Softw. Eng. Methodol."],"published-print":{"date-parts":[[2009,5]]},"abstract":"<jats:p>Evolutionary testing is an approach to automating test data generation that uses an evolutionary algorithm to search a test object's input domain for test data. Nested predicates can cause problems for evolutionary testing, because information needed for guiding the search only becomes available as each nested conditional is satisfied. This means that the search process can overfit to early information, making it harder, and sometimes near impossible, to satisfy constraints that only become apparent later in the search. The article presents a testability transformation that allows the evaluation of all nested conditionals at once. Two empirical studies are presented. The first study shows that the form of nesting handled is prevalent in practice. The second study shows how the approach improves evolutionary test data generation.<\/jats:p>","DOI":"10.1145\/1525880.1525884","type":"journal-article","created":{"date-parts":[[2009,6,2]],"date-time":"2009-06-02T14:51:08Z","timestamp":1243954268000},"page":"1-27","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":40,"title":["Empirical evaluation of a nesting testability transformation for evolutionary testing"],"prefix":"10.1145","volume":"18","author":[{"given":"Phil","family":"McMinn","sequence":"first","affiliation":[{"name":"University of Sheffield, Sheffield, UK"}]},{"given":"David","family":"Binkley","sequence":"additional","affiliation":[{"name":"Loyola College Maryland, Baltimore, MD"}]},{"given":"Mark","family":"Harman","sequence":"additional","affiliation":[{"name":"King's College London, London, UK"}]}],"member":"320","published-online":{"date-parts":[[2009,6,4]]},"reference":[{"key":"e_1_2_1_1_1","volume-title":"Automatisierung von strukturtests mit evolutionren algorithmen. Diploma Thesis","author":"Baresel A.","unstructured":"Baresel , A. 2000. Automatisierung von strukturtests mit evolutionren algorithmen. Diploma Thesis , Humboldt University , Berlin, Germany . Baresel, A. 2000. Automatisierung von strukturtests mit evolutionren algorithmen. Diploma Thesis, Humboldt University, Berlin, Germany."},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/1007512.1007527"},{"key":"e_1_2_1_3_1","volume-title":"Proceedings of the Genetic and Evolutionary Computation Conference (GECCO'03)","volume":"2724","author":"Baresel A.","unstructured":"Baresel , A. and Sthamer , H . 2003. Evolutionary testing of flag conditions . In Proceedings of the Genetic and Evolutionary Computation Conference (GECCO'03) . Lecture Notes in Computer Science vol. 2724 . Springer-Verlag, 2442--2454. Baresel, A. and Sthamer, H. 2003. Evolutionary testing of flag conditions. In Proceedings of the Genetic and Evolutionary Computation Conference (GECCO'03). Lecture Notes in Computer Science vol. 2724. Springer-Verlag, 2442--2454."},{"key":"e_1_2_1_4_1","volume-title":"Proceedings of the Genetic and Evolutionary Computation Conference (GECCO'02)","author":"Baresel A.","unstructured":"Baresel , A. , Sthamer , H. , and Schmidt , M . 2002. Fitness function design to improve evolutionary structural testing . In Proceedings of the Genetic and Evolutionary Computation Conference (GECCO'02) . Morgan Kaufmann, New York, 1329--1336. Baresel, A., Sthamer, H., and Schmidt, M. 2002. Fitness function design to improve evolutionary structural testing. In Proceedings of the Genetic and Evolutionary Computation Conference (GECCO'02). Morgan Kaufmann, New York, 1329--1336."},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/800027.808445"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.1976.233817"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1109\/32.92910"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10664-005-3861-2"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/226155.226158"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/1287624.1287647"},{"key":"e_1_2_1_11_1","volume-title":"Proceedings of the Genetic and Evolutionary Computation Conference (GECCO'02)","author":"Harman M.","unstructured":"Harman , M. , Hu , L. , Hierons , R. , Baresel , A. , and Sthamer , H . 2002. Improving evolutionary testing by flag removal . In Proceedings of the Genetic and Evolutionary Computation Conference (GECCO'02) . Morgan Kaufmann, New York, 1359--1366. Harman, M., Hu, L., Hierons, R., Baresel, A., and Sthamer, H. 2002. Improving evolutionary testing by flag removal. In Proceedings of the Genetic and Evolutionary Computation Conference (GECCO'02). Morgan Kaufmann, New York, 1359--1366."},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2004.1265732"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2009.71"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1093\/comjnl\/bxh093"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1049\/sej.1996.0040"},{"key":"e_1_2_1_16_1","volume-title":"Proceedings of the 3rd International Conference on Software Quality Management, 435--444","author":"Jones B.","unstructured":"Jones , B. , Sthamer , H. , Yang , X. , and Eyres , D . 1995. The automatic generation of software test data sets using adaptive search techniques . In Proceedings of the 3rd International Conference on Software Quality Management, 435--444 . Jones, B., Sthamer, H., Yang, X., and Eyres, D. 1995. The automatic generation of software test data sets using adaptive search techniques. In Proceedings of the 3rd International Conference on Software Quality Management, 435--444."},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/360248.360252"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1109\/32.57624"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1002\/stvr.4370020405"},{"key":"e_1_2_1_20_1","volume-title":"Proceedings of the 18th International Conference on Software Engineering (ICSE), 71--80","author":"Korel B.","unstructured":"Korel , B. and Al-Yami , A. M . 1996. Assertion-Oriented automated test data generation . In Proceedings of the 18th International Conference on Software Engineering (ICSE), 71--80 . Korel, B. and Al-Yami, A. M. 1996. Assertion-Oriented automated test data generation. In Proceedings of the 18th International Conference on Software Engineering (ICSE), 71--80."},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1109\/ISSRE.2005.16"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1002\/stvr.v14:2"},{"key":"e_1_2_1_23_1","volume-title":"Proceedings of the UK Software Testing Workshop (UKTest'05)","author":"McMinn P.","unstructured":"McMinn , P. , Binkley , D. , and Harman , M . 2005. Testability transformation for efficient automated test data search in the presence of nesting . In Proceedings of the UK Software Testing Workshop (UKTest'05) . University of Sheffield Computer Science tech. rep. CS-05-07, 165--182. McMinn, P., Binkley, D., and Harman, M. 2005. Testability transformation for efficient automated test data search in the presence of nesting. In Proceedings of the UK Software Testing Workshop (UKTest'05). University of Sheffield Computer Science tech. rep. CS-05-07, 165--182."},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1162\/106365606776022742"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.1976.233818"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1162\/evco.1993.1.1.25"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1002\/(SICI)1099-1689(199912)9:4<263::AID-STVR190>3.0.CO;2-Y"},{"key":"e_1_2_1_28_1","volume-title":"Proceedings of the 19th IEEE Real-Time Systems Symposium. IEEE Computer Society Press, 134--143","author":"Puschner P.","unstructured":"Puschner , P. and Nossal , R . 1998. Testing the results of static worst-case execution-time analysis . In Proceedings of the 19th IEEE Real-Time Systems Symposium. IEEE Computer Society Press, 134--143 . Puschner, P. and Nossal, R. 1998. Testing the results of static worst-case execution-time analysis. In Proceedings of the 19th IEEE Real-Time Systems Symposium. IEEE Computer Society Press, 134--143."},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/271775.271792"},{"key":"e_1_2_1_31_1","volume-title":"Proceedings of the International Workshop on Dependable Computing and Its Applications. 169--180","author":"Tracey N.","unstructured":"Tracey , N. , Clark , J. , and Mander , K . 1998b. The way forward for unifying dynamic test-case generation: The optimisation-based approach . In Proceedings of the International Workshop on Dependable Computing and Its Applications. 169--180 . Tracey, N., Clark, J., and Mander, K. 1998b. The way forward for unifying dynamic test-case generation: The optimisation-based approach. In Proceedings of the International Workshop on Dependable Computing and Its Applications. 169--180."},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.5555\/521138.786846"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1002\/(SICI)1097-024X(200001)30:1%3C61::AID-SPE292%3E3.0.CO;2-9"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0950-5849(01)00190-2"},{"key":"e_1_2_1_35_1","volume-title":"Proceedings of the 4th European Conference on Software Testing, Analysis and Review (EuroSTAR'96)","author":"Wegener J.","unstructured":"Wegener , J. , Grimm , K. , Grochtmann , M. , Sthamer , H. , and Jones , B . 1996. Systematic testing of real-time systems . In Proceedings of the 4th European Conference on Software Testing, Analysis and Review (EuroSTAR'96) . Wegener, J., Grimm, K., Grochtmann, M., Sthamer, H., and Jones, B. 1996. Systematic testing of real-time systems. In Proceedings of the 4th European Conference on Software Testing, Analysis and Review (EuroSTAR'96)."},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1008096431840"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0950-5849(01)00188-4"},{"key":"e_1_2_1_38_1","volume-title":"Proceedings of the 5th International Conference on Software Engineering and its Applications, 625--636","author":"Xanthakis S.","unstructured":"Xanthakis , S. , Ellis , C. , Skourlas , C. , Le Gall , A. , Katsikas , S. , and Karapoulios , K . 1992. Application of genetic algorithms to software testing (Application des algorithmes g\u00e9n\u00e9tiques au test des logiciels) . In Proceedings of the 5th International Conference on Software Engineering and its Applications, 625--636 . Xanthakis, S., Ellis, C., Skourlas, C., Le Gall, A., Katsikas, S., and Karapoulios, K. 1992. Application of genetic algorithms to software testing (Application des algorithmes g\u00e9n\u00e9tiques au test des logiciels). In Proceedings of the 5th International Conference on Software Engineering and its Applications, 625--636."}],"container-title":["ACM Transactions on Software Engineering and Methodology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1525880.1525884","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/1525880.1525884","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T13:30:28Z","timestamp":1750253428000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1525880.1525884"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2009,5]]},"references-count":37,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2009,5]]}},"alternative-id":["10.1145\/1525880.1525884"],"URL":"https:\/\/doi.org\/10.1145\/1525880.1525884","relation":{},"ISSN":["1049-331X","1557-7392"],"issn-type":[{"value":"1049-331X","type":"print"},{"value":"1557-7392","type":"electronic"}],"subject":[],"published":{"date-parts":[[2009,5]]},"assertion":[{"value":"2006-05-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2007-11-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2009-06-04","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}