{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,17]],"date-time":"2026-07-17T15:01:49Z","timestamp":1784300509896,"version":"3.55.0"},"reference-count":97,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2021,1,3]],"date-time":"2021-01-03T00:00:00Z","timestamp":1609632000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"CONICET PIP","award":["2014\/16, 2015\/17"],"award-info":[{"award-number":["2014\/16, 2015\/17"]}]},{"DOI":"10.13039\/501100010253","name":"UBACYT","doi-asserted-by":"crossref","award":["2018-20020170200297BA, 20020170100419BA, and 20020170200249BA"],"award-info":[{"award-number":["2018-20020170200297BA, 20020170100419BA, and 20020170200249BA"]}],"id":[{"id":"10.13039\/501100010253","id-type":"DOI","asserted-by":"crossref"}]},{"name":"ANPCYT PICT","award":["2015-3638, 2015-1718, 2015-2741, 2018-3835"],"award-info":[{"award-number":["2015-3638, 2015-1718, 2015-2741, 2018-3835"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Softw. Eng. Methodol."],"published-print":{"date-parts":[[2021,4,30]]},"abstract":"<jats:p>A significant proportion of classes in modern software introduce or use object protocols, prescriptions on the temporal orderings of method calls on objects. This article studies search-based test generation techniques that aim to exploit a particular abstraction of object protocols (enabledness preserving abstractions (EPAs)) to find failures. We define coverage criteria over an extension of EPAs that includes abnormal method termination and define a search-based test case generation technique aimed at achieving high coverage. Results suggest that the proposed case generation technique with a fitness function that aims at combined structural and extended EPA coverage can provide better failure-detection capabilities not only for protocol failures but also for general failures when compared to random testing and search-based test generation for standard structural coverage.<\/jats:p>","DOI":"10.1145\/3415153","type":"journal-article","created":{"date-parts":[[2021,1,3]],"date-time":"2021-01-03T11:09:08Z","timestamp":1609672148000},"page":"1-36","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":6,"title":["Enabledness-based Testing of Object Protocols"],"prefix":"10.1145","volume":"30","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-4880-4070","authenticated-orcid":false,"given":"Javier","family":"Godoy","sequence":"first","affiliation":[{"name":"Universidad Nacional de General Sarmiento and Departamento de Computaci\u00f3n, FCEyN-UBA, Argentina"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Juan Pablo","family":"Galeotti","sequence":"additional","affiliation":[{"name":"Departamento de Computaci\u00f3n, FCEyN-UBA and ICC CONICET, Argentina"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Diego","family":"Garbervetsky","sequence":"additional","affiliation":[{"name":"Departamento de Computaci\u00f3n, FCEyN-UBA and ICC CONICET, Argentina"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sebasti\u00e1n","family":"Uchitel","sequence":"additional","affiliation":[{"name":"Departamento de Computaci\u00f3n, FCEyN-UBA and ICC CONICET, Argentina and Department of Computing, Imperial College London, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2021,1,3]]},"reference":[{"key":"e_1_2_1_1_1","unstructured":"[n.d.]. Oracle. Retrieved from https:\/\/docs.oracle.com\/javase\/8\/docs\/api\/java\/util\/ListIterator.html and https:\/\/docs.oracle.com\/javase\/8\/docs\/api\/java\/util\/ListIterator..html  [n.d.]. Oracle. Retrieved from https:\/\/docs.oracle.com\/javase\/8\/docs\/api\/java\/util\/ListIterator.html and https:\/\/docs.oracle.com\/javase\/8\/docs\/api\/java\/util\/ListIterator..html"},{"key":"e_1_2_1_2_1","unstructured":"[n.d.]. Tcases: A Model-Based Test Case Generator. Retrieved from https:\/\/github.com\/Cornutum\/tcases and https:\/\/github.com\/Cornutum\/tcasesl.  [n.d.]. Tcases: A Model-Based Test Case Generator. Retrieved from https:\/\/github.com\/Cornutum\/tcases and https:\/\/github.com\/Cornutum\/tcasesl."},{"key":"e_1_2_1_3_1","unstructured":"[n.d.]. Apache. Retrieved from https:\/\/xalan.apache.org and https:\/\/xalan.apache.org.  [n.d.]. Apache. Retrieved from https:\/\/xalan.apache.org and https:\/\/xalan.apache.org."},{"key":"e_1_2_1_4_1","unstructured":"[n.d.]. Retrieved from https:\/\/bugs.openjdk.java.net\/browse\/JDK-4308549 and https:\/\/bugs.openjdk.java.net\/browse\/JDK-4308549.  [n.d.]. Retrieved from https:\/\/bugs.openjdk.java.net\/browse\/JDK-4308549 and https:\/\/bugs.openjdk.java.net\/browse\/JDK-4308549."},{"key":"e_1_2_1_5_1","unstructured":"[n.d.]. Retrieved from http:\/\/bugs.sun.com\/bugdatabase\/view_bug.do?bug_id=6529795 and http:\/\/bugs.sun.com\/bugdatabase\/view_bug.do?bug_id=6529795.  [n.d.]. Retrieved from http:\/\/bugs.sun.com\/bugdatabase\/view_bug.do?bug_id=6529795 and http:\/\/bugs.sun.com\/bugdatabase\/view_bug.do?bug_id=6529795."},{"key":"e_1_2_1_6_1","unstructured":"[n.d.]. Apache. Retrieved from https:\/\/issues.apache.org\/jira\/browse\/COLLECTIONS-360 and https:\/\/issues.apache.org\/jira\/browse\/COLLECTIONS-360.  [n.d.]. Apache. Retrieved from https:\/\/issues.apache.org\/jira\/browse\/COLLECTIONS-360 and https:\/\/issues.apache.org\/jira\/browse\/COLLECTIONS-360."},{"key":"e_1_2_1_7_1","unstructured":"[n.d.]. Retrieved from http:\/\/hg.openjdk.java.net\/openjfx\/10-dev\/rt\/rev\/572a70fabb47 and http:\/\/hg.openjdk.java.net\/openjfx\/10-dev\/rt\/rev\/572a70fabb47.  [n.d.]. Retrieved from http:\/\/hg.openjdk.java.net\/openjfx\/10-dev\/rt\/rev\/572a70fabb47 and http:\/\/hg.openjdk.java.net\/openjfx\/10-dev\/rt\/rev\/572a70fabb47."},{"key":"e_1_2_1_8_1","unstructured":"[n.d.]. Retrieved from https:\/\/bugs.openjdk.java.net\/browse\/JDK-4238266 and https:\/\/bugs.openjdk.java.net\/browse\/JDK-4238266.  [n.d.]. Retrieved from https:\/\/bugs.openjdk.java.net\/browse\/JDK-4238266 and https:\/\/bugs.openjdk.java.net\/browse\/JDK-4238266."},{"key":"e_1_2_1_9_1","unstructured":"[n.d.]. Retrieved from https:\/\/bugs.java.com\/bugdatabase\/view_bug.do?bug_id=4135670 and https:\/\/bugs.java.com\/bugdatabase\/view_bug.do?bug_id=4135670.  [n.d.]. Retrieved from https:\/\/bugs.java.com\/bugdatabase\/view_bug.do?bug_id=4135670 and https:\/\/bugs.java.com\/bugdatabase\/view_bug.do?bug_id=4135670."},{"key":"e_1_2_1_10_1","unstructured":"[n.d.]. Retrieved from https:\/\/issues.apache.org\/jira\/browse\/COLLECTIONS-61 and https:\/\/issues.apache.org\/jira\/browse\/COLLECTIONS-61.  [n.d.]. Retrieved from https:\/\/issues.apache.org\/jira\/browse\/COLLECTIONS-61 and https:\/\/issues.apache.org\/jira\/browse\/COLLECTIONS-61."},{"key":"e_1_2_1_11_1","unstructured":"[n.d.]. Retrieved from https:\/\/bugs.openjdk.java.net\/ and https:\/\/bugs.openjdk.java.net\/.  [n.d.]. Retrieved from https:\/\/bugs.openjdk.java.net\/ and https:\/\/bugs.openjdk.java.net\/."},{"key":"e_1_2_1_12_1","unstructured":"[n.d.]. Retrieved from http:\/\/bugs.sun.com and http:\/\/bugs.sun.com.  [n.d.]. Retrieved from http:\/\/bugs.sun.com and http:\/\/bugs.sun.com."},{"key":"e_1_2_1_13_1","unstructured":"[n.d.]. Retrieved from https:\/\/issues.apache.org and https:\/\/issues.apache.org.  [n.d.]. Retrieved from https:\/\/issues.apache.org and https:\/\/issues.apache.org."},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1109\/MS.2014.55"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2006.83"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2010.46"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/1985793.1985795"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1002\/stvr.1486"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/2642937.2642986"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/2786805.2786828"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICST.2017.19"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-03077-7_8"},{"key":"e_1_2_1_23_1","volume-title":"Proceedings of the 8th International SPIN Workshop on Model Checking of Software (SPIN\u201901)","author":"Ball Thomas","unstructured":"Thomas Ball and Sriram K. Rajamani . 2001. Automatically validating temporal safety properties of interfaces . In Proceedings of the 8th International SPIN Workshop on Model Checking of Software (SPIN\u201901) . Springer-Verlag, Berlin, 103--122. Thomas Ball and Sriram K. Rajamani. 2001. Automatically validating temporal safety properties of interfaces. In Proceedings of the 8th International SPIN Workshop on Model Checking of Software (SPIN\u201901). Springer-Verlag, Berlin, 103--122."},{"key":"e_1_2_1_24_1","volume-title":"Proceedings of the European Conference on Object-Oriented Programming (ECOOP\u201911)","author":"Beckman N.","unstructured":"N. Beckman , D. Kim , and J. Aldrich . [n.d.]. An empirical study of object protocols in the wild . In Proceedings of the European Conference on Object-Oriented Programming (ECOOP\u201911) . 2--26. N. Beckman, D. Kim, and J. Aldrich. [n.d.]. An empirical study of object protocols in the wild. In Proceedings of the European Conference on Object-Oriented Programming (ECOOP\u201911). 2--26."},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/1297105.1297050"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.infsof.2018.08.010"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/2931037.2948707"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1002\/stvr.1593"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2011.105"},{"key":"e_1_2_1_30_1","volume-title":"Proceedings of the International Conference on Software Engineering (ICSE\u201911)","author":"de Caso G.","unstructured":"G. de Caso , V. Braberman , D. Garbervetsky , and S. Uchitel . [n.d.]. Program abstractions for behaviour validation . In Proceedings of the International Conference on Software Engineering (ICSE\u201911) . 381--390. G. de Caso, V. Braberman, D. Garbervetsky, and S. Uchitel. [n.d.]. Program abstractions for behaviour validation. In Proceedings of the International Conference on Software Engineering (ICSE\u201911). 381--390."},{"key":"e_1_2_1_31_1","volume-title":"Proceedings of the International Conference on Software Engineering (ICSE\u201909)","author":"de Caso G.","unstructured":"G. de Caso , V. Braberman , D. Garbervetsky , and S. Uchitel . [n.d.]. Validation of contracts using enabledness preserving finite state abstractions . In Proceedings of the International Conference on Software Engineering (ICSE\u201909) . 452--462. G. de Caso, V. Braberman, D. Garbervetsky, and S. Uchitel. [n.d.]. Validation of contracts using enabledness preserving finite state abstractions. In Proceedings of the International Conference on Software Engineering (ICSE\u201909). 452--462."},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2010.98"},{"key":"e_1_2_1_33_1","article-title":"Enabledness-based program abstractions for behavior validation","volume":"22","author":"de Caso G.","year":"2013","unstructured":"G. de Caso , V. Braberman , D. Garbervetsky , and S. Uchitel . 2013 . Enabledness-based program abstractions for behavior validation . ACM Trans. Softw. Eng. Methodol. 22 , 3 (2013). G. de Caso, V. Braberman, D. Garbervetsky, and S. Uchitel. 2013. Enabledness-based program abstractions for behavior validation. ACM Trans. Softw. Eng. Methodol. 22, 3 (2013).","journal-title":"ACM Trans. Softw. Eng. Methodol."},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1109\/4235.996017"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-24851-4_21"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1007\/11785477_20"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1007\/3-540-44898-5_25"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/1348250.1348255"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2012.14"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/2685612"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.5555\/2780084.2780170"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICST.2011.53"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2011.93"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/566172.566190"},{"key":"e_1_2_1_45_1","first-page":"55","article-title":"Model-based quality assurance of protocol documentation: Tools and methodology","volume":"21","author":"Grieskamp W.","year":"2011","unstructured":"W. Grieskamp , N. Kicillof , K. Stobie , and V. Braberman . 2011 . Model-based quality assurance of protocol documentation: Tools and methodology . STVR 21 , 1 (2011), 55 -- 71 . DOI:https:\/\/doi.org\/10.1002\/stvr.427 W. Grieskamp, N. Kicillof, K. Stobie, and V. Braberman. 2011. Model-based quality assurance of protocol documentation: Tools and methodology. STVR 21, 1 (2011), 55--71. DOI:https:\/\/doi.org\/10.1002\/stvr.427","journal-title":"STVR"},{"key":"e_1_2_1_46_1","volume-title":"Proceedings of the International Symposium on Software Testing and Analysis (ISSTA\u201912)","author":"Groce A.","unstructured":"A. Groce , C. Zhang , E. Eide , Y. Chen , and J. Regehr . [n.d.]. Swarm testing . In Proceedings of the International Symposium on Software Testing and Analysis (ISSTA\u201912) . 78--88. A. Groce, C. Zhang, E. Eide, Y. Chen, and J. Regehr. [n.d.]. Swarm testing. In Proceedings of the International Symposium on Software Testing and Analysis (ISSTA\u201912). 78--88."},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.5555\/1890580.1890598"},{"key":"e_1_2_1_48_1","volume-title":"Article 9","author":"Hierons Robert M.","year":"2009","unstructured":"Robert M. Hierons , Kirill Bogdanov , Jonathan P. Bowen , Rance Cleaveland , John Derrick , Jeremy Dick , Marian Gheorghe , Mark Harman , Kalpesh Kapoor , Paul Krause , Gerald L\u00fcttgen , Anthony J. H. Simons , Sergiy Vilkomir , Martin R. Woodward , and Hussein Zedan . 2009. Using formal specifications to support testing. Comput. Surveys 41, 2 , Article 9 ( 2009 ), 9:1--9:76 pages. Robert M. Hierons, Kirill Bogdanov, Jonathan P. Bowen, Rance Cleaveland, John Derrick, Jeremy Dick, Marian Gheorghe, Mark Harman, Kalpesh Kapoor, Paul Krause, Gerald L\u00fcttgen, Anthony J. H. Simons, Sergiy Vilkomir, Martin R. Woodward, and Hussein Zedan. 2009. Using formal specifications to support testing. Comput. Surveys 41, 2, Article 9 (2009), 9:1--9:76 pages."},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1109\/ASE.2008.40"},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0169-7552(96)00017-7"},{"key":"e_1_2_1_51_1","volume-title":"Proceedings of the International Symposium on Software Testing and Analysis, (ISSTA\u201914)","author":"Just Ren\u00e9","unstructured":"Ren\u00e9 Just , Darioush Jalali , and Michael D. Ernst . 2014. Defects4J: A database of existing faults to enable controlled testing studies for Java programs . In Proceedings of the International Symposium on Software Testing and Analysis, (ISSTA\u201914) , Corina S. Pasareanu and Darko Marinov (Eds.). ACM, 437--440. DOI:https:\/\/doi.org\/10.1145\/2610384.2628055 Ren\u00e9 Just, Darioush Jalali, and Michael D. Ernst. 2014. Defects4J: A database of existing faults to enable controlled testing studies for Java programs. In Proceedings of the International Symposium on Software Testing and Analysis, (ISSTA\u201914), Corina S. Pasareanu and Darko Marinov (Eds.). ACM, 437--440. DOI:https:\/\/doi.org\/10.1145\/2610384.2628055"},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1145\/2635868.2635929"},{"key":"e_1_2_1_53_1","volume-title":"Using built-in domain-specific modeling support to guide model-based test generation. Model-Driven Engineering of Information Systems: Principles, Techniques, and Practice","author":"Kanstr\u00e9n Teemu","year":"2012","unstructured":"Teemu Kanstr\u00e9n and Olli-Pekka Puolitaival . 2012. Using built-in domain-specific modeling support to guide model-based test generation. Model-Driven Engineering of Information Systems: Principles, Techniques, and Practice ( 2012 ), 295--319. Teemu Kanstr\u00e9n and Olli-Pekka Puolitaival. 2012. Using built-in domain-specific modeling support to guide model-based test generation. Model-Driven Engineering of Information Systems: Principles, Techniques, and Practice (2012), 295--319."},{"key":"e_1_2_1_54_1","volume-title":"Proceedings of the Symposium on the Foundations of Software Engineering (FSE\u201914)","author":"Krka I.","unstructured":"I. Krka , Y. Brun , and N. Medvidovic . [n.d.]. Automatic mining of specifications from invocation traces and method invariants . In Proceedings of the Symposium on the Foundations of Software Engineering (FSE\u201914) . 178--189. I. Krka, Y. Brun, and N. Medvidovic. [n.d.]. Automatic mining of specifications from invocation traces and method invariants. In Proceedings of the Symposium on the Foundations of Software Engineering (FSE\u201914). 178--189."},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2010.07.026"},{"key":"e_1_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.1109\/ASE.2015.83"},{"key":"e_1_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.1109\/5.533956"},{"key":"e_1_2_1_58_1","volume-title":"Proceedings of the International Conference on Tools and Methods for Program Analysis. Springer, 77--89","author":"Li Wenbin","year":"2017","unstructured":"Wenbin Li , Franck Le Gall , and Naum Spaseski . 2017 . A survey on model-based testing tools for test case generation . In Proceedings of the International Conference on Tools and Methods for Program Analysis. Springer, 77--89 . Wenbin Li, Franck Le Gall, and Naum Spaseski. 2017. A survey on model-based testing tools for test case generation. In Proceedings of the International Conference on Tools and Methods for Program Analysis. Springer, 77--89."},{"key":"e_1_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.5555\/1776119.1776126"},{"key":"e_1_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2013.44"},{"key":"e_1_2_1_61_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICST.2008.22"},{"key":"e_1_2_1_62_1","doi-asserted-by":"publisher","DOI":"10.1145\/1985793.1985979"},{"key":"e_1_2_1_63_1","doi-asserted-by":"publisher","DOI":"10.1016\/bs.adcom.2015.03.003"},{"key":"e_1_2_1_64_1","doi-asserted-by":"publisher","DOI":"10.5555\/1077276.1077279"},{"key":"e_1_2_1_65_1","volume-title":"Proceedings of the 8th European Software Engineering Conference Held Jointly with 9th ACM SIGSOFT International Symposium on Foundations of Software Engineering (ESEC\/FSE-9). ACM","author":"Memon Atif M.","unstructured":"Atif M. Memon , Mary Lou Soffa , and Martha E. Pollack . 2001. Coverage criteria for GUI testing . In Proceedings of the 8th European Software Engineering Conference Held Jointly with 9th ACM SIGSOFT International Symposium on Foundations of Software Engineering (ESEC\/FSE-9). ACM , New York, NY, 256--267. DOI:https:\/\/doi.org\/10.1145\/503209.503244 Atif M. Memon, Mary Lou Soffa, and Martha E. Pollack. 2001. Coverage criteria for GUI testing. In Proceedings of the 8th European Software Engineering Conference Held Jointly with 9th ACM SIGSOFT International Symposium on Foundations of Software Engineering (ESEC\/FSE-9). ACM, New York, NY, 256--267. DOI:https:\/\/doi.org\/10.1145\/503209.503244"},{"key":"e_1_2_1_66_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICWE.2008.24"},{"key":"e_1_2_1_67_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2010.32"},{"key":"e_1_2_1_68_1","volume-title":"A farewell to Bonferroni: The problems of low statistical power and publication bias. Behav. Ecol. 15, 6 (11","author":"Nakagawa Shinichi","year":"2004","unstructured":"Shinichi Nakagawa . 2004. A farewell to Bonferroni: The problems of low statistical power and publication bias. Behav. Ecol. 15, 6 (11 2004 ), 1044--1045. DOI:https:\/\/doi.org\/10.1093\/beheco\/arh107 Shinichi Nakagawa. 2004. A farewell to Bonferroni: The problems of low statistical power and publication bias. Behav. Ecol. 15, 6 (11 2004), 1044--1045. DOI:https:\/\/doi.org\/10.1093\/beheco\/arh107"},{"key":"e_1_2_1_69_1","doi-asserted-by":"publisher","DOI":"10.1145\/2593882.2593885"},{"key":"e_1_2_1_70_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE.2007.37"},{"key":"e_1_2_1_71_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICST.2015.7102604"},{"key":"e_1_2_1_72_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2017.2663435"},{"key":"e_1_2_1_73_1","doi-asserted-by":"publisher","DOI":"10.1136\/bmj.316.7139.1236"},{"key":"e_1_2_1_74_1","volume-title":"Proceedings of the 26th IEEE International Conference on Software Maintenance (ICSM\u201910)","author":"Pradel Michael","year":"2010","unstructured":"Michael Pradel , Philipp Bichsel , and Thomas R. Gross . 2010. A framework for the evaluation of specification miners based on finite state machines . In Proceedings of the 26th IEEE International Conference on Software Maintenance (ICSM\u201910) . IEEE Computer Society, 1--10. DOI:https:\/\/doi.org\/10.1109\/ICSM. 2010 .5609576 Michael Pradel, Philipp Bichsel, and Thomas R. Gross. 2010. A framework for the evaluation of specification miners based on finite state machines. In Proceedings of the 26th IEEE International Conference on Software Maintenance (ICSM\u201910). IEEE Computer Society, 1--10. DOI:https:\/\/doi.org\/10.1109\/ICSM.2010.5609576"},{"key":"e_1_2_1_75_1","volume-title":"Proceedings of the International Conference on Software Engineering (ICSE\u201905)","author":"Pretschner A.","unstructured":"A. Pretschner , W. Prenninger , S. Wagner , C. K\u00fchnel , M. Baumgartner , B. Sostawa , R. Z\u00f6lch , and T. Stauner . 2005. One evaluation of model-based testing and its automation . In Proceedings of the International Conference on Software Engineering (ICSE\u201905) . 392--401. A. Pretschner, W. Prenninger, S. Wagner, C. K\u00fchnel, M. Baumgartner, B. Sostawa, R. Z\u00f6lch, and T. Stauner. 2005. One evaluation of model-based testing and its automation. In Proceedings of the International Conference on Software Engineering (ICSE\u201905). 392--401."},{"key":"e_1_2_1_76_1","volume-title":"Proceedings of the 27th International Conference on Software Engineering (ICSE\u201905)","author":"Pretschner A.","unstructured":"A. Pretschner , W. Prenninger , S. Wagner , C. K\u00fchnel , M. Baumgartner , B. Sostawa , R. Z\u00f6lch , and T. Stauner . 2005. One evaluation of model-based testing and its automation . In Proceedings of the 27th International Conference on Software Engineering (ICSE\u201905) . ACM, New York, NY, 392--401. DOI:https:\/\/doi.org\/10.1145\/1062455.1062529 A. Pretschner, W. Prenninger, S. Wagner, C. K\u00fchnel, M. Baumgartner, B. Sostawa, R. Z\u00f6lch, and T. Stauner. 2005. One evaluation of model-based testing and its automation. In Proceedings of the 27th International Conference on Software Engineering (ICSE\u201905). ACM, New York, NY, 392--401. DOI:https:\/\/doi.org\/10.1145\/1062455.1062529"},{"key":"e_1_2_1_77_1","volume-title":"Proceedings of the Symposium on Search Based Software Engineering (SSBSE\u201915)","author":"Rojas J.","unstructured":"J. Rojas , J. Campos , M. Vivanti , G. Fraser , and A. Arcuri . [n.d.]. Combining multiple coverage criteria in search-based unit test generation . In Proceedings of the Symposium on Search Based Software Engineering (SSBSE\u201915) . 93--108. J. Rojas, J. Campos, M. Vivanti, G. Fraser, and A. Arcuri. [n.d.]. Combining multiple coverage criteria in search-based unit test generation. In Proceedings of the Symposium on Search Based Software Engineering (SSBSE\u201915). 93--108."},{"key":"e_1_2_1_78_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10664-015-9424-2"},{"key":"e_1_2_1_79_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSM.1998.738487"},{"key":"e_1_2_1_80_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2008.33"},{"key":"e_1_2_1_81_1","volume-title":"Proceedings of the 30th Annual International Computer Software and Applications Conference (COMPSAC\u201906)","volume":"2","author":"Santiago V.","year":"2006","unstructured":"V. Santiago , A. S. Martins Do Amaral, N. L. Vijaykumar, M. D. Fatima Mattiello-francisco, E. Martins, and O. C. Lopes. 2006. A practical approach for automated test case generation using statecharts . In Proceedings of the 30th Annual International Computer Software and Applications Conference (COMPSAC\u201906) , Vol. 2 . 183--188. DOI:https:\/\/doi.org\/10.1109\/COMPSAC. 2006 .100 V. Santiago, A. S. Martins Do Amaral, N. L. Vijaykumar, M. D. Fatima Mattiello-francisco, E. Martins, and O. C. Lopes. 2006. A practical approach for automated test case generation using statecharts. In Proceedings of the 30th Annual International Computer Software and Applications Conference (COMPSAC\u201906), Vol. 2. 183--188. DOI:https:\/\/doi.org\/10.1109\/COMPSAC.2006.100"},{"key":"e_1_2_1_82_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10009-013-0291-0"},{"key":"e_1_2_1_83_1","doi-asserted-by":"publisher","DOI":"10.1109\/ASE.2015.86"},{"key":"e_1_2_1_84_1","doi-asserted-by":"publisher","DOI":"10.1002\/stvr.1660"},{"key":"e_1_2_1_85_1","volume-title":"Proceedings of the International Conference on Fundamental Approaches to Software Engineering (FASE\u201911)","author":"Sharma R.","unstructured":"R. Sharma , M. Gligoric , A. Arcuri , G. Fraser , and D. Marinov . 2011. Testing container classes: Random or systematic? In Proceedings of the International Conference on Fundamental Approaches to Software Engineering (FASE\u201911) . 262--277. R. Sharma, M. Gligoric, A. Arcuri, G. Fraser, and D. Marinov. 2011. Testing container classes: Random or systematic? In Proceedings of the International Conference on Fundamental Approaches to Software Engineering (FASE\u201911). 262--277."},{"key":"e_1_2_1_86_1","doi-asserted-by":"publisher","DOI":"10.1109\/2.294849"},{"key":"e_1_2_1_87_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.1986.6312929"},{"key":"e_1_2_1_88_1","doi-asserted-by":"publisher","DOI":"10.1145\/2048066.2048083"},{"key":"e_1_2_1_89_1","doi-asserted-by":"publisher","DOI":"10.1145\/1013886.1007528"},{"key":"e_1_2_1_90_1","volume-title":"ACM SIGSOFT Software Engineering Notes","author":"Untch Roland H.","unstructured":"Roland H. Untch , A. Jefferson Offutt , and Mary Jean Harrold . 1993. Mutation analysis using mutant schemata . In ACM SIGSOFT Software Engineering Notes , Vol. 18 . ACM , 139--148. Roland H. Untch, A. Jefferson Offutt, and Mary Jean Harrold. 1993. Mutation analysis using mutant schemata. In ACM SIGSOFT Software Engineering Notes, Vol. 18. ACM, 139--148."},{"key":"e_1_2_1_91_1","volume-title":"Practical Model-based Testing: A Tools Approach","author":"Utting Mark","unstructured":"Mark Utting and Bruno Legeard . 2010. Practical Model-based Testing: A Tools Approach . Elsevier . Mark Utting and Bruno Legeard. 2010. Practical Model-based Testing: A Tools Approach. Elsevier."},{"key":"e_1_2_1_92_1","unstructured":"M. Utting G. Perrone J. Winchester S. Thompson R. Yang and P. Douangsavanh. 2009. Model junit. Department of Computer Science University of Waikato Waikato New Zealand (2009).  M. Utting G. Perrone J. Winchester S. Thompson R. Yang and P. Douangsavanh. 2009. Model junit. Department of Computer Science University of Waikato Waikato New Zealand (2009)."},{"key":"e_1_2_1_93_1","doi-asserted-by":"publisher","DOI":"10.1002\/stvr.456"},{"key":"e_1_2_1_94_1","volume-title":"Proceedings of the 3rd International Workshop on Formal Approaches to Testing of Software (FATES\u201903)","volume":"2931","author":"van der Bijl Machiel","year":"2003","unstructured":"Machiel van der Bijl , Arend Rensink , and Jan Tretmans . 2003 . Compositional testing with ioco. In Formal Approaches to Software Testing , Proceedings of the 3rd International Workshop on Formal Approaches to Testing of Software (FATES\u201903) , Alexandre Petrenko and Andreas Ulrich (Eds.), Lecture Notes in Computer Science , Vol. 2931 . Springer, 86--100. DOI:https:\/\/doi.org\/10.1007\/978-3-540-24617-6_7 Machiel van der Bijl, Arend Rensink, and Jan Tretmans. 2003. Compositional testing with ioco. In Formal Approaches to Software Testing, Proceedings of the 3rd International Workshop on Formal Approaches to Testing of Software (FATES\u201903), Alexandre Petrenko and Andreas Ulrich (Eds.), Lecture Notes in Computer Science, Vol. 2931. Springer, 86--100. DOI:https:\/\/doi.org\/10.1007\/978-3-540-24617-6_7"},{"key":"e_1_2_1_95_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICST.2010.28"},{"key":"e_1_2_1_96_1","volume-title":"Proceedings of the International Conference on Software Engineering (ICSE\u201911)","author":"Xiao X.","unstructured":"X. Xiao , T. Xie , N. Tillmann , and J. de Halleux . [n.d.]. Precise identification of problems for structural test generation . In Proceedings of the International Conference on Software Engineering (ICSE\u201911) . 611--620. X. Xiao, T. Xie, N. Tillmann, and J. de Halleux. [n.d.]. Precise identification of problems for structural test generation. In Proceedings of the International Conference on Software Engineering (ICSE\u201911). 611--620."},{"key":"e_1_2_1_97_1","doi-asserted-by":"publisher","DOI":"10.1109\/TR.2014.2354172"}],"container-title":["ACM Transactions on Software Engineering and Methodology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3415153","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3415153","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T22:03:10Z","timestamp":1750197790000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3415153"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,1,3]]},"references-count":97,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2021,4,30]]}},"alternative-id":["10.1145\/3415153"],"URL":"https:\/\/doi.org\/10.1145\/3415153","relation":{},"ISSN":["1049-331X","1557-7392"],"issn-type":[{"value":"1049-331X","type":"print"},{"value":"1557-7392","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,1,3]]},"assertion":[{"value":"2019-06-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2020-07-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-01-03","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}