{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,2]],"date-time":"2026-07-02T11:49:22Z","timestamp":1782992962000,"version":"3.54.5"},"reference-count":85,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2020,4,29]],"date-time":"2020-04-29T00:00:00Z","timestamp":1588118400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"European Union's Horizon 2020 Research and Innovation Program","award":["694277"],"award-info":[{"award-number":["694277"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Softw. Eng. Methodol."],"published-print":{"date-parts":[[2020,4,30]]},"abstract":"<jats:p>The ability to generate test data is often a necessary prerequisite for automated software testing. For the generated data to be fit for their intended purpose, the data usually have to satisfy various logical constraints. When testing is performed at a system level, these constraints tend to be complex and are typically captured in expressive formalisms based on first-order logic. Motivated by improving the feasibility and scalability of data generation for system testing, we present a novel approach, whereby we employ a combination of metaheuristic search and Satisfiability Modulo Theories (SMT) for constraint solving. Our approach delegates constraint solving tasks to metaheuristic search and SMT in such a way as to take advantage of the complementary strengths of the two techniques. We ground our work on test data models specified in UML, with OCL used as the constraint language. We present tool support and an evaluation of our approach over three industrial case studies. The results indicate that, for complex system test data generation problems, our approach presents substantial benefits over the state-of-the-art in terms of applicability and scalability.<\/jats:p>","DOI":"10.1145\/3381032","type":"journal-article","created":{"date-parts":[[2020,5,4]],"date-time":"2020-05-04T17:00:53Z","timestamp":1588611653000},"page":"1-48","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":32,"title":["Practical Constraint Solving for Generating System Test Data"],"prefix":"10.1145","volume":"29","author":[{"given":"Ghanem","family":"Soltana","sequence":"first","affiliation":[{"name":"SnT, University of Luxembourg, Luxembourg"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4711-8319","authenticated-orcid":false,"given":"Mehrdad","family":"Sabetzadeh","sequence":"additional","affiliation":[{"name":"School of EECS, University of Ottawa 8 SnT, University of Luxembourg, Luxembourg"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lionel C.","family":"Briand","sequence":"additional","affiliation":[{"name":"School of EECS, University of Ottawa 8 SnT, University of Luxembourg, Luxembourg"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2020,4,29]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2009.52"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2013.17"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10664-015-9392-6"},{"key":"e_1_2_1_4_1","volume-title":"Introduction to Software Testing","author":"Ammann Paul","unstructured":"Paul Ammann and Jeff Offutt . 2016. Introduction to Software Testing ( 2 nd ed.). Cambridge University Press . Paul Ammann and Jeff Offutt. 2016. Introduction to Software Testing (2nd ed.). Cambridge University Press.","edition":"2"},{"key":"e_1_2_1_5_1","unstructured":"Kyriakos Anastasakis. 2009. UML2Alloy (Version 0.52). Retrieved from http:\/\/www.cs.bham.ac.uk\/\u223cbxb\/UML2Alloy\/.  Kyriakos Anastasakis. 2009. UML2Alloy (Version 0.52). Retrieved from http:\/\/www.cs.bham.ac.uk\/\u223cbxb\/UML2Alloy\/."},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-75209-7_30"},{"key":"e_1_2_1_7_1","unstructured":"Apache Foundation. 2006. Apache OpenJPA. Retrieved from http:\/\/openjpa.apache.org\/.  Apache Foundation. 2006. Apache OpenJPA. Retrieved from http:\/\/openjpa.apache.org\/."},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.5555\/2032305.2032319"},{"key":"e_1_2_1_10_1","volume-title":"Barrett and Cesare Tinelli","author":"Clark","year":"2018","unstructured":"Clark W. Barrett and Cesare Tinelli . 2018 . Satisfiability modulo theories. In Handbook of Model Checking. Springer , 305--343. Clark W. Barrett and Cesare Tinelli. 2018. Satisfiability modulo theories. In Handbook of Model Checking. Springer, 305--343."},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.3233\/SAT190075"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/566172.566191"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/3092703.3092715"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/3183440.3183472"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.5555\/2932433.2932497"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/1321631.1321737"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-00255-7_4"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1002\/stvr.1537"},{"key":"e_1_2_1_19_1","unstructured":"Felix Chang Emina Torlak Julie Pelaez and Daniel Jackson. 2018. Alloy Analyzer (Version 5). Retrieved from http:\/\/alloytools.org\/.  Felix Chang Emina Torlak Julie Pelaez and Daniel Jackson. 2018. Alloy Analyzer (Version 5). Retrieved from http:\/\/alloytools.org\/."},{"key":"e_1_2_1_20_1","unstructured":"Robert Claris\u00f3 Carlos A. Gonz\u00e1lez and Jordi Cabot. 2009. UMLtoCSP. Retrieved from http:\/\/gres.uoc.edu\/UMLtoCSP\/.  Robert Claris\u00f3 Carlos A. Gonz\u00e1lez and Jordi Cabot. 2009. UMLtoCSP. Retrieved from http:\/\/gres.uoc.edu\/UMLtoCSP\/."},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2017.2777830"},{"key":"e_1_2_1_22_1","unstructured":"Coninfer Ltd. 2006. The ECLiPSe Constraint Programming System (Version 5.0). Retrieved from http:\/\/eclipseclp.org\/.  Coninfer Ltd. 2006. The ECLiPSe Constraint Programming System (Version 5.0). Retrieved from http:\/\/eclipseclp.org\/."},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/2976767.2976774"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.5555\/1792734.1792766"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/1995376.1995394"},{"key":"e_1_2_1_26_1","unstructured":"Leonardo Mendon\u00e7a de Moura and Nikolaj Bj\u00f8rner (Microsoft Research). 2012. Z3 Solver. Retrieved from https:\/\/github.com\/Z3Prover\/z3.  Leonardo Mendon\u00e7a de Moura and Nikolaj Bj\u00f8rner (Microsoft Research). 2012. Z3 Solver. Retrieved from https:\/\/github.com\/Z3Prover\/z3."},{"key":"e_1_2_1_27_1","unstructured":"Rina Dechter and David Cohen. 2003. Constraint Processing. Morgan Kaufmann.  Rina Dechter and David Cohen. 2003. Constraint Processing. Morgan Kaufmann."},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/3053430"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0304-3975(01)00182-7"},{"key":"e_1_2_1_30_1","unstructured":"Eclipse Foundation. 2006. Acceleo\u2014Transforming Models into Code. Retrieved from http:\/\/www.eclipse.org\/acceleo\/.  Eclipse Foundation. 2006. Acceleo\u2014Transforming Models into Code. Retrieved from http:\/\/www.eclipse.org\/acceleo\/."},{"key":"e_1_2_1_31_1","unstructured":"Eclipse Foundation. 2007. ATL\u2014A model transformation technology. Retrieved from https:\/\/www.eclipse.org\/atl\/.  Eclipse Foundation. 2007. ATL\u2014A model transformation technology. Retrieved from https:\/\/www.eclipse.org\/atl\/."},{"key":"e_1_2_1_32_1","unstructured":"Eclipse Foundation. 2009. Xpand. Retrieved from https:\/\/www.eclipse.org\/modeling\/m2t\/?project=xpand.  Eclipse Foundation. 2009. Xpand. Retrieved from https:\/\/www.eclipse.org\/modeling\/m2t\/?project=xpand."},{"key":"e_1_2_1_33_1","unstructured":"Eclipse Foundation. 2018. Eclipse OCL (Version 6.4.0). Retrieved from http:\/\/www.eclipse.org\/ocl.  Eclipse Foundation. 2018. Eclipse OCL (Version 6.4.0). Retrieved from http:\/\/www.eclipse.org\/ocl."},{"key":"e_1_2_1_34_1","volume-title":"Proceedings of the 6th International Conference on Theory and Applications of Satisfiability Testing (SAT\u201903)","author":"E\u00e9n Niklas","year":"2003","unstructured":"Niklas E\u00e9n and Niklas S\u00f6rensson . 2003 . An extensible SAT-solver . In Proceedings of the 6th International Conference on Theory and Applications of Satisfiability Testing (SAT\u201903) . 502--518. Niklas E\u00e9n and Niklas S\u00f6rensson. 2003. An extensible SAT-solver. In Proceedings of the 6th International Conference on Theory and Applications of Satisfiability Testing (SAT\u201903). 502--518."},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.infsof.2014.03.003"},{"key":"e_1_2_1_36_1","volume-title":"Search-based software engineering: Trends, techniques, and applications. Comput. Surv. 45, 1","author":"Harman Mark","year":"2012","unstructured":"Mark Harman , S. Afshin Mansouri , and Yuanyuan Zhang . 2012. Search-based software engineering: Trends, techniques, and applications. Comput. Surv. 45, 1 ( 2012 ), 11:1--11:61. Mark Harman, S. Afshin Mansouri, and Yuanyuan Zhang. 2012. Search-based software engineering: Trends, techniques, and applications. Comput. Surv. 45, 1 (2012), 11:1--11:61."},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2009.71"},{"key":"e_1_2_1_38_1","doi-asserted-by":"crossref","unstructured":"John Henry Holland etal 1992. Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology Control and Artificial Intelligence. The MIT Press.  John Henry Holland et al. 1992. Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology Control and Artificial Intelligence. The MIT Press.","DOI":"10.7551\/mitpress\/1090.001.0001"},{"key":"e_1_2_1_39_1","volume-title":"A Concise Introduction to Logic","author":"Hurley Patrick","unstructured":"Patrick Hurley . 2014. A Concise Introduction to Logic . Nelson Education . Patrick Hurley. 2014. A Concise Introduction to Logic. Nelson Education."},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1109\/ASE.2008.40"},{"key":"e_1_2_1_41_1","volume-title":"Proceedings of the 4th International Symposium on Search-based Software Engineering (SSBSE\u201902)","author":"Iqbal Muhammad Zohaib Z.","unstructured":"Muhammad Zohaib Z. Iqbal , Andrea Arcuri , and Lionel C. Briand . 2012. Combining search-based and adaptive random testing strategies for environment model-based testing of real-time embedded systems . In Proceedings of the 4th International Symposium on Search-based Software Engineering (SSBSE\u201902) . 136--151. Muhammad Zohaib Z. Iqbal, Andrea Arcuri, and Lionel C. Briand. 2012. Combining search-based and adaptive random testing strategies for environment model-based testing of real-time embedded systems. In Proceedings of the 4th International Symposium on Search-based Software Engineering (SSBSE\u201902). 136--151."},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10270-013-0328-6"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10009-013-0272-3"},{"key":"e_1_2_1_44_1","volume-title":"Software Abstractions: Logic, Language, and Analysis","author":"Jackson Daniel","year":"2012","unstructured":"Daniel Jackson . 2012 . Software Abstractions: Logic, Language, and Analysis . The MIT Press . Daniel Jackson. 2012. Software Abstractions: Logic, Language, and Analysis. The MIT Press."},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1109\/FMCAD.2016.7886666"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.tcs.2014.12.009"},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10515-010-0079-3"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1109\/32.57624"},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-31491-9_5"},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1109\/CIS.2007.150"},{"key":"e_1_2_1_51_1","volume-title":"Elements of Finite Model Theory (Texts in Theoretical Computer Science. An EATCS Series)","author":"Libkin Leonid","unstructured":"Leonid Libkin . 2004. Elements of Finite Model Theory (Texts in Theoretical Computer Science. An EATCS Series) . Springer Verlag . Leonid Libkin. 2004. Elements of Finite Model Theory (Texts in Theoretical Computer Science. An EATCS Series). Springer Verlag."},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.5555\/1077276.1077279"},{"key":"e_1_2_1_53_1","volume-title":"Proceedings of the 8th International Symposium on Search-based Software Engineering (SSBSE\u201916)","author":"McMinn Phil","unstructured":"Phil McMinn and Gregory M. Kapfhammer . 2016. AVMf: An open-source framework and implementation of the alternating variable method . In Proceedings of the 8th International Symposium on Search-based Software Engineering (SSBSE\u201916) . 259--266. Phil McMinn and Gregory M. Kapfhammer. 2016. AVMf: An open-source framework and implementation of the alternating variable method. In Proceedings of the 8th International Symposium on Search-based Software Engineering (SSBSE\u201916). 259--266."},{"key":"e_1_2_1_54_1","volume-title":"The Art of Software Testing","author":"Myers Glenford J.","unstructured":"Glenford J. Myers , Corey Sandler , and Tom Badgett . 2011. The Art of Software Testing ( 3 rd ed.). Wiley Publishing . Glenford J. Myers, Corey Sandler, and Tom Badgett. 2011. The Art of Software Testing (3rd ed.). Wiley Publishing.","edition":"3"},{"key":"e_1_2_1_55_1","unstructured":"Object Management Group. 2004. Object Constraint Language 2.4 Specification. Retrieved from http:\/\/www.omg.org\/spec\/OCL\/2.4\/.  Object Management Group. 2004. Object Constraint Language 2.4 Specification. Retrieved from http:\/\/www.omg.org\/spec\/OCL\/2.4\/."},{"key":"e_1_2_1_56_1","unstructured":"Object Management Group. 2015. OMG Unified Modeling Language (UML). Retrieved from http:\/\/www.omg.org\/spec\/UML\/2.5.  Object Management Group. 2015. OMG Unified Modeling Language (UML). Retrieved from http:\/\/www.omg.org\/spec\/UML\/2.5."},{"key":"e_1_2_1_57_1","volume-title":"Proceedings of the 36th International Conference on Conceptual Modeling (ER\u201917)","author":"Oriol Xavier","year":"2017","unstructured":"Xavier Oriol and Ernest Teniente . 2017 . OCL: Expressive UML\/OCL conceptual schemas for finite reasoning . In Proceedings of the 36th International Conference on Conceptual Modeling (ER\u201917) . 354--369. Xavier Oriol and Ernest Teniente. 2017. OCL: Expressive UML\/OCL conceptual schemas for finite reasoning. In Proceedings of the 36th International Conference on Conceptual Modeling (ER\u201917). 354--369."},{"key":"e_1_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2017.03.015"},{"key":"e_1_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2017.2663435"},{"key":"e_1_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.1002\/(SICI)1099-1689(199912)9:4<263::AID-STVR190>3.0.CO;2-Y"},{"key":"e_1_2_1_61_1","doi-asserted-by":"publisher","DOI":"10.1049\/iet-cps.2016.0022"},{"key":"e_1_2_1_62_1","doi-asserted-by":"publisher","DOI":"10.1145\/2976767.2976780"},{"key":"e_1_2_1_63_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.datak.2011.09.004"},{"key":"e_1_2_1_64_1","unstructured":"Red Hat. 2001. Hibernate. Everything data. Retrieved from http:\/\/hibernate.org\/.  Red Hat. 2001. Hibernate. Everything data. Retrieved from http:\/\/hibernate.org\/."},{"key":"e_1_2_1_65_1","volume-title":"Handbook of Automated Reasoning","author":"Robinson Alan","unstructured":"Alan Robinson and Andrei Voronkov . 2001. Handbook of Automated Reasoning . Elsevier . Alan Robinson and Andrei Voronkov. 2001. Handbook of Automated Reasoning. Elsevier."},{"key":"e_1_2_1_66_1","volume-title":"Proceedings of the International Conference on 2nd Abstract State Machines, Alloy, B and Z (ABZ\u201910)","author":"Rosner Nicol\u00e1s","unstructured":"Nicol\u00e1s Rosner , Juan P. Galeotti , Carlos L\u00f3pez Pombo , and Marcelo F. Frias . 2010. ParAlloy: Towards a framework for efficient parallel analysis of Alloy models . In Proceedings of the International Conference on 2nd Abstract State Machines, Alloy, B and Z (ABZ\u201910) . 396--397. Nicol\u00e1s Rosner, Juan P. Galeotti, Carlos L\u00f3pez Pombo, and Marcelo F. Frias. 2010. ParAlloy: Towards a framework for efficient parallel analysis of Alloy models. In Proceedings of the International Conference on 2nd Abstract State Machines, Alloy, B and Z (ABZ\u201910). 396--397."},{"key":"e_1_2_1_67_1","volume-title":"Proceedings of the 28th IEEE\/ACM International Conference on Automated Software Engineering (ASE\u201913)","author":"Rosner Nicol\u00e1s","unstructured":"Nicol\u00e1s Rosner , Junaid Haroon Siddiqui , Nazareno Aguirre , Sarfraz Khurshid , and Marcelo F. Frias . 2013. Ranger: Parallel analysis of Alloy models by range partitioning . In Proceedings of the 28th IEEE\/ACM International Conference on Automated Software Engineering (ASE\u201913) . 147--157. Nicol\u00e1s Rosner, Junaid Haroon Siddiqui, Nazareno Aguirre, Sarfraz Khurshid, and Marcelo F. Frias. 2013. Ranger: Parallel analysis of Alloy models by range partitioning. In Proceedings of the 28th IEEE\/ACM International Conference on Automated Software Engineering (ASE\u201913). 147--157."},{"key":"e_1_2_1_68_1","first-page":"195","article-title":"Statistical usage testing for software reliability control","volume":"19","author":"Runeson Per","year":"1995","unstructured":"Per Runeson and Claes Wohlin . 1995 . Statistical usage testing for software reliability control . Informatica 19 , 2 (1995), 195 -- 207 . Per Runeson and Claes Wohlin. 1995. Statistical usage testing for software reliability control. Informatica 19, 2 (1995), 195--207.","journal-title":"Informatica"},{"key":"e_1_2_1_69_1","volume-title":"Russell and Peter Norvig","author":"Stuart","year":"1995","unstructured":"Stuart J. Russell and Peter Norvig . 1995 . Artificial Intelligence : A Modern Approach. Prentice-Hall , Inc. Stuart J. Russell and Peter Norvig. 1995. Artificial Intelligence: A Modern Approach. Prentice-Hall, Inc."},{"key":"e_1_2_1_70_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-27455-9_8"},{"key":"e_1_2_1_71_1","doi-asserted-by":"publisher","DOI":"10.5555\/2485288.2485574"},{"key":"e_1_2_1_72_1","doi-asserted-by":"publisher","DOI":"10.1145\/3180155.3180186"},{"key":"e_1_2_1_73_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-02408-5_11"},{"key":"e_1_2_1_74_1","doi-asserted-by":"publisher","DOI":"10.1145\/1858996.1859038"},{"key":"e_1_2_1_75_1","doi-asserted-by":"publisher","DOI":"10.5555\/2025936.2025948"},{"key":"e_1_2_1_76_1","volume-title":"Briand","author":"Soltana Ghanem","year":"2017","unstructured":"Ghanem Soltana , Mehrdad Sabetzadeh , and Lionel C . Briand . 2017 . Search-based Synthetic Data Generator. Retrieved from http:\/\/people.svv.lu\/tools\/SDG\/. Ghanem Soltana, Mehrdad Sabetzadeh, and Lionel C. Briand. 2017. Search-based Synthetic Data Generator. Retrieved from http:\/\/people.svv.lu\/tools\/SDG\/."},{"key":"e_1_2_1_77_1","volume-title":"Proceedings of the 32nd IEEE\/ACM International Conference on Automated Software Engineering (ASE\u201917)","author":"Soltana Ghanem","unstructured":"Ghanem Soltana , Mehrdad Sabetzadeh , and Lionel C. Briand . 2017. Synthetic data generation for statistical testing . In Proceedings of the 32nd IEEE\/ACM International Conference on Automated Software Engineering (ASE\u201917) . 872--882. Ghanem Soltana, Mehrdad Sabetzadeh, and Lionel C. Briand. 2017. Synthetic data generation for statistical testing. In Proceedings of the 32nd IEEE\/ACM International Conference on Automated Software Engineering (ASE\u201917). 872--882."},{"key":"e_1_2_1_78_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE.2015.81"},{"key":"e_1_2_1_79_1","doi-asserted-by":"publisher","DOI":"10.1145\/2393596.2393637"},{"key":"e_1_2_1_80_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.infsof.2016.09.009"},{"key":"e_1_2_1_81_1","volume-title":"Practical Model-based Testing: A Tools Approach","author":"Utting Mark","unstructured":"Mark Utting and Bruno Legeard . 2010. Practical Model-based Testing: A Tools Approach . Elsevier . Mark Utting and Bruno Legeard. 2010. Practical Model-based Testing: A Tools Approach. Elsevier."},{"key":"e_1_2_1_82_1","doi-asserted-by":"publisher","DOI":"10.1145\/2771783.2771812"},{"key":"e_1_2_1_83_1","volume-title":"Proceedings of the 33rd IEEE\/ACM International Conference on Automated Software Engineering (ASE\u201918)","author":"Wang Jianghao","unstructured":"Jianghao Wang , Hamid Bagheri , and Myra B. Cohen . 2018. An evolutionary approach for analyzing Alloy specifications . In Proceedings of the 33rd IEEE\/ACM International Conference on Automated Software Engineering (ASE\u201918) . 820--825. Jianghao Wang, Hamid Bagheri, and Myra B. Cohen. 2018. An evolutionary approach for analyzing Alloy specifications. In Proceedings of the 33rd IEEE\/ACM International Conference on Automated Software Engineering (ASE\u201918). 820--825."},{"key":"e_1_2_1_84_1","volume-title":"Kleppe","author":"Warmer Jos B.","year":"2003","unstructured":"Jos B. Warmer and Anneke G . Kleppe . 2003 . The Object Constraint Language: Getting Your Models Ready for MDA. Addison-Wesley Professional . Jos B. Warmer and Anneke G. Kleppe. 2003. The Object Constraint Language: Getting Your Models Ready for MDA. Addison-Wesley Professional."},{"key":"e_1_2_1_85_1","volume-title":"Mutation Testing for the New Century","author":"Wong W. Eric","unstructured":"W. Eric Wong . 2001. Mutation Testing for the New Century . Kluwer Academic Publishers , Norwell, MA . W. Eric Wong. 2001. Mutation Testing for the New Century. Kluwer Academic Publishers, Norwell, MA."},{"key":"e_1_2_1_86_1","volume-title":"Proceedings of the 26th IEEE\/ACM International Conference on Automated Software Engineering (ASE\u201911)","author":"Zhang Pingyu","unstructured":"Pingyu Zhang , Sebastian G. Elbaum , and Matthew B. Dwyer . 2011. Automatic generation of load tests . In Proceedings of the 26th IEEE\/ACM International Conference on Automated Software Engineering (ASE\u201911) . 43--52. Pingyu Zhang, Sebastian G. Elbaum, and Matthew B. Dwyer. 2011. Automatic generation of load tests. In Proceedings of the 26th IEEE\/ACM International Conference on Automated Software Engineering (ASE\u201911). 43--52."}],"container-title":["ACM Transactions on Software Engineering and Methodology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3381032","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3381032","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T23:44:58Z","timestamp":1750203898000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3381032"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,4,29]]},"references-count":85,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2020,4,30]]}},"alternative-id":["10.1145\/3381032"],"URL":"https:\/\/doi.org\/10.1145\/3381032","relation":{},"ISSN":["1049-331X","1557-7392"],"issn-type":[{"value":"1049-331X","type":"print"},{"value":"1557-7392","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,4,29]]},"assertion":[{"value":"2019-01-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2020-01-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2020-04-29","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}