{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,9]],"date-time":"2026-01-09T15:39:56Z","timestamp":1767973196015,"version":"3.49.0"},"publisher-location":"New York, NY, USA","reference-count":49,"publisher":"ACM","license":[{"start":{"date-parts":[[2022,5,17]],"date-time":"2022-05-17T00:00:00Z","timestamp":1652745600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"European Union?s Horizon 2020","award":["871319, 957212"],"award-info":[{"award-number":["871319, 957212"]}]},{"name":"Swedish Innovation Agency (Vinnova)","award":["XIVT project"],"award-info":[{"award-number":["XIVT project"]}]},{"name":"ECSEL Joint Undertaking (JU)","award":["101007350"],"award-info":[{"award-number":["101007350"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2022,5,17]]},"DOI":"10.1145\/3524481.3527235","type":"proceedings-article","created":{"date-parts":[[2022,7,19]],"date-time":"2022-07-19T16:51:53Z","timestamp":1658249513000},"page":"148-159","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":5,"title":["Evaluating system-level test generation for industrial software"],"prefix":"10.1145","author":[{"given":"Muhammad Nouman","family":"Zafar","sequence":"first","affiliation":[{"name":"M\u00e4lardalen University, Sweden"}]},{"given":"Wasif","family":"Afzal","sequence":"additional","affiliation":[{"name":"M\u00e4lardalen University, Sweden"}]},{"given":"Eduard","family":"Enoiu","sequence":"additional","affiliation":[{"name":"M\u00e4lardalen University, Sweden"}]}],"member":"320","published-online":{"date-parts":[[2022,7,19]]},"reference":[{"key":"e_1_3_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10664-014-9301-4"},{"key":"e_1_3_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2013.02.061"},{"key":"e_1_3_2_1_3_1","doi-asserted-by":"crossref","unstructured":"Andrea Bombarda and Angelo Gargantini. 2020. An Automata-Based Generation Method for Combinatorial Sequence Testing of Finite State Machines. In 2020 IEEE International Conference on Software Testing Verification and Validation Workshops (ICSTW). IEEE 157--166.  Andrea Bombarda and Angelo Gargantini. 2020. An Automata-Based Generation Method for Combinatorial Sequence Testing of Finite State Machines. In 2020 IEEE International Conference on Software Testing Verification and Validation Workshops (ICSTW) . IEEE 157--166.","DOI":"10.1109\/ICSTW50294.2020.00036"},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1109\/QRS.2015.38"},{"key":"e_1_3_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-34691-0_3"},{"key":"e_1_3_2_1_6_1","first-page":"209","article-title":"Klee: unassisted and automatic generation of high-coverage tests for complex systems programs","volume":"8","author":"Cadar Cristian","year":"2008","unstructured":"Cristian Cadar , Daniel Dunbar , Dawson R Engler , 2008 . Klee: unassisted and automatic generation of high-coverage tests for complex systems programs . In OSDI , Vol. 8. 209 -- 224 . Cristian Cadar, Daniel Dunbar, Dawson R Engler, et al. 2008. Klee: unassisted and automatic generation of high-coverage tests for complex systems programs. In OSDI, Vol. 8. 209--224.","journal-title":"OSDI"},{"key":"e_1_3_2_1_7_1","volume-title":"An Approach of Creating Component Design Specification for Safety-Related Software in Railway. In 2019 Annual Reliability and Maintainability Symposium (RAMS). IEEE, 1--4.","author":"Chen Yin","year":"2019","unstructured":"Yin Chen , Sven Linder , and Jonas Wigstein . 2019 . An Approach of Creating Component Design Specification for Safety-Related Software in Railway. In 2019 Annual Reliability and Maintainability Symposium (RAMS). IEEE, 1--4. Yin Chen, Sven Linder, and Jonas Wigstein. 2019. An Approach of Creating Component Design Specification for Safety-Related Software in Railway. In 2019 Annual Reliability and Maintainability Symposium (RAMS). IEEE, 1--4."},{"key":"e_1_3_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1049\/sej.1994.0025"},{"key":"e_1_3_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE.2003.1201186"},{"key":"e_1_3_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/302405.302640"},{"key":"e_1_3_2_1_11_1","volume-title":"Travassos","author":"Dias-Neto Arilo C.","year":"2010","unstructured":"Arilo C. Dias-Neto and Guilherme H . Travassos . 2010 . A Picture from the Model-Based Testing Area: Concepts, Techniques, and Challenges. In Advances in Computers, Marvin V. Zelkowitz (Ed.). Advances in Computers, Vol. 80 . Elsevier , 45--120. Arilo C. Dias-Neto and Guilherme H. Travassos. 2010. A Picture from the Model-Based Testing Area: Concepts, Techniques, and Challenges. In Advances in Computers, Marvin V. Zelkowitz (Ed.). Advances in Computers, Vol. 80. Elsevier, 45--120."},{"key":"e_1_3_2_1_12_1","volume-title":"Proceedings (Cat. No. 00CH37126)","volume":"1","author":"Dupuy Arnaud","year":"2000","unstructured":"Arnaud Dupuy and Nancy Leveson . 2000 . An empirical evaluation of the MC\/DC coverage criterion on the HETE-2 satellite software. In 19th DASC. 19th Digital Avionics Systems Conference . Proceedings (Cat. No. 00CH37126) , Vol. 1 . IEEE, 1B6--1. Arnaud Dupuy and Nancy Leveson. 2000. An empirical evaluation of the MC\/DC coverage criterion on the HETE-2 satellite software. In 19th DASC. 19th Digital Avionics Systems Conference. Proceedings (Cat. No. 00CH37126), Vol. 1. IEEE, 1B6--1."},{"key":"e_1_3_2_1_13_1","volume-title":"Proceedings of the 13th International Conference on Intelligent Systems: Theories and Applications. 1--6.","author":"Mounia El","year":"2020","unstructured":"Mounia El qortobi, Amine Rahj , Jamal Bentahar , and Rachida Dssouli . 2020 . Test Generation Tool for Modified Condition\/Decision Coverage: Model Based Testing . In Proceedings of the 13th International Conference on Intelligent Systems: Theories and Applications. 1--6. Mounia El qortobi, Amine Rahj, Jamal Bentahar, and Rachida Dssouli. 2020. Test Generation Tool for Modified Condition\/Decision Coverage: Model Based Testing. In Proceedings of the 13th International Conference on Intelligent Systems: Theories and Applications. 1--6."},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICST.2017.44"},{"key":"e_1_3_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSTW.2019.00062"},{"key":"e_1_3_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/1370042.1370050"},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/2934672"},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSTW.2014.70"},{"key":"e_1_3_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSTW.2014.70"},{"key":"e_1_3_2_1_20_1","volume-title":"A practical tutorial on modified condition\/decision coverage","author":"Hayhurst Kelly J","unstructured":"Kelly J Hayhurst . 2001. A practical tutorial on modified condition\/decision coverage . DIANE Publishing . Kelly J Hayhurst. 2001. A practical tutorial on modified condition\/decision coverage. DIANE Publishing."},{"key":"e_1_3_2_1_21_1","volume-title":"2018 IEEE\/ACM 40th International Conference on Software Engineering: Software Engineering in Practice Track (ICSE-SEIP). IEEE, 256--265","author":"Hemmati Hadi","year":"2018","unstructured":"Hadi Hemmati , Syed S Arefin , and Howard W Loewen . 2018 . Evaluating specification-level MC\/DC criterion in model-based testing of safety critical systems . In 2018 IEEE\/ACM 40th International Conference on Software Engineering: Software Engineering in Practice Track (ICSE-SEIP). IEEE, 256--265 . Hadi Hemmati, Syed S Arefin, and Howard W Loewen. 2018. Evaluating specification-level MC\/DC criterion in model-based testing of safety critical systems. In 2018 IEEE\/ACM 40th International Conference on Software Engineering: Software Engineering in Practice Track (ICSE-SEIP). IEEE, 256--265."},{"key":"e_1_3_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10664-019-09799-2"},{"key":"e_1_3_2_1_23_1","volume-title":"Model-based testing essentials-guide to the ISTQB certified model-based tester: foundation level","author":"Kramer Anne","unstructured":"Anne Kramer and Bruno Legeard . 2016. Model-based testing essentials-guide to the ISTQB certified model-based tester: foundation level . John Wiley & Sons . Anne Kramer and Bruno Legeard. 2016. Model-based testing essentials-guide to the ISTQB certified model-based tester: foundation level. John Wiley & Sons."},{"key":"e_1_3_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1109\/ESEM.2013.49"},{"key":"e_1_3_2_1_25_1","first-page":"19","article-title":"Combinatorial coverage as an aspect of test quality","volume":"28","author":"Kuhn D Richard","year":"2015","unstructured":"D Richard Kuhn , Raghu N Kacker , Yu Lei , 2015 . Combinatorial coverage as an aspect of test quality . CrossTalk 28 , 2 (2015), 19 -- 23 . D Richard Kuhn, Raghu N Kacker, Yu Lei, et al. 2015. Combinatorial coverage as an aspect of test quality. CrossTalk 28, 2 (2015), 19--23.","journal-title":"CrossTalk"},{"key":"e_1_3_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSM.2011.6080840"},{"key":"e_1_3_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1109\/TAICPART.2009.15"},{"key":"e_1_3_2_1_28_1","first-page":"201","article-title":"A cost model to compare regression test strategies","volume":"91","author":"Leung Hareton KN","year":"1991","unstructured":"Hareton KN Leung and Lee J White . 1991 . A cost model to compare regression test strategies . In ICSM , Vol. 91. 201 -- 208 . Hareton KN Leung and Lee J White. 1991. A cost model to compare regression test strategies. In ICSM, Vol. 91. 201--208.","journal-title":"ICSM"},{"key":"e_1_3_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1109\/QRS-C.2017.131"},{"key":"e_1_3_2_1_30_1","volume-title":"International Conference on Tools and Methods for Program Analysis. Springer.","author":"Li W.","unstructured":"W. Li , F. Le Gall , and N. Spaseski . 2017. A survey on model-based testing tools for test case generation . In International Conference on Tools and Methods for Program Analysis. Springer. W. Li, F. Le Gall, and N. Spaseski. 2017. A survey on model-based testing tools for test case generation. In International Conference on Tools and Methods for Program Analysis. Springer."},{"key":"e_1_3_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSTW.2014.29"},{"key":"e_1_3_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/3330089.3330121"},{"key":"e_1_3_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1109\/SEAA.2015.18"},{"key":"e_1_3_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/2338965.2336765"},{"key":"e_1_3_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/1944892.1944901"},{"key":"e_1_3_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1109\/ISSRE.2010.38"},{"key":"e_1_3_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICST.2012.142"},{"key":"e_1_3_2_1_38_1","unstructured":"Sanjai Rayadurgam and Mats Heimdahl. 2003. Generating MC\/DC adequate test sequences through model checking. (2003).  Sanjai Rayadurgam and Mats Heimdahl. 2003. Generating MC\/DC adequate test sequences through model checking. (2003)."},{"key":"e_1_3_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/3387940.3392238"},{"key":"e_1_3_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/2591062.2591180"},{"key":"e_1_3_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1007\/s13198-011-0065-6"},{"key":"e_1_3_2_1_42_1","unstructured":"M. Utting and B. Legeard. 2010. Practical model-based testing: a tools approach. Elsevier.  M. Utting and B. Legeard. 2010. Practical model-based testing: a tools approach . Elsevier."},{"key":"e_1_3_2_1_43_1","volume-title":"ISTQB Certification. Cengage Learning EMEA","author":"Veenendaal Erik Van","year":"2008","unstructured":"Erik Van Veenendaal , Dorothy Graham , and Rex Black . 2008. \" Foundations of Software Testing : ISTQB Certification. Cengage Learning EMEA ( 2008 ), 30. Erik Van Veenendaal, Dorothy Graham, and Rex Black. 2008. \"Foundations of Software Testing: ISTQB Certification. Cengage Learning EMEA (2008), 30."},{"key":"e_1_3_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1109\/QRS-C.2017.19"},{"key":"e_1_3_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSTW50294.2020.00041"},{"key":"e_1_3_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1109\/AERO.2001.931302"},{"key":"e_1_3_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1145\/3472672.3473956"},{"key":"e_1_3_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1145\/3452383.3452388"},{"key":"e_1_3_2_1_49_1","volume-title":"The 17th Workshop on Advances in Model Based Testing. http:\/\/www.es.mdh.se\/publications\/6172-","author":"Zafar Muhammad Nouman","year":"2021","unstructured":"Muhammad Nouman Zafar , Wasif Afzal , Eduard Paul Enoiu , Athanasios Stratis , and Ola Sellin . 2021 . A Model-Based Test Script Generation Framework for Embedded Software . In The 17th Workshop on Advances in Model Based Testing. http:\/\/www.es.mdh.se\/publications\/6172- Muhammad Nouman Zafar, Wasif Afzal, Eduard Paul Enoiu, Athanasios Stratis, and Ola Sellin. 2021. A Model-Based Test Script Generation Framework for Embedded Software. In The 17th Workshop on Advances in Model Based Testing. http:\/\/www.es.mdh.se\/publications\/6172-"}],"event":{"name":"AST '22: IEEE\/ACM 3rd International Conference on Automation of Software Test","location":"Pittsburgh Pennsylvania","acronym":"AST '22","sponsor":["SIGSOFT ACM Special Interest Group on Software Engineering","IEEE TCSC IEEE Technical Committee on Scalable Computing"]},"container-title":["Proceedings of the 3rd ACM\/IEEE International Conference on Automation of Software Test"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3524481.3527235","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3524481.3527235","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T17:50:59Z","timestamp":1750182659000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3524481.3527235"}},"subtitle":["a comparison between manual, combinatorial and model-based testing"],"short-title":[],"issued":{"date-parts":[[2022,5,17]]},"references-count":49,"alternative-id":["10.1145\/3524481.3527235","10.1145\/3524481"],"URL":"https:\/\/doi.org\/10.1145\/3524481.3527235","relation":{},"subject":[],"published":{"date-parts":[[2022,5,17]]},"assertion":[{"value":"2022-07-19","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}