{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,1]],"date-time":"2025-10-01T16:22:09Z","timestamp":1759335729136,"version":"3.41.0"},"reference-count":34,"publisher":"Association for Computing Machinery (ACM)","issue":"FSE","funder":[{"name":"National Natural Science Foundation of China","award":["62372227"],"award-info":[{"award-number":["62372227"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Proc. ACM Softw. Eng."],"published-print":{"date-parts":[[2025,6,19]]},"abstract":"<jats:p>Model-based testing (MBT) has been an important methodology in software engineering, attracting extensive research attention for over four decades. However, despite its academic acclaim, studies examining the impact of MBT in industrial environments\u2014particularly regarding its extended effects\u2014remain limited and yield unclear results. This gap may contribute to the challenges in establishing a study environment for implementing and applying MBT in production settings to evaluate its impact over time. To bridge this gap, we collaborated with an industrial partner to undertake a comprehensive, longitudinal empirical study employing mixed methods. Over two months, we implemented our MBT tool within the corporation, assessing the immediate and extended effectiveness and efficiency of MBT compared to script-writing-based testing. Through a mix of quantitative and qualitative methods\u2014spanning controlled experiments, questionnaire surveys, and interviews\u2014our study uncovers several insightful findings. These include differences in effectiveness and maintainability between immediate and extended MBT application, the evolving perceptions and expectations of engineers regarding MBT, and more. Leveraging these insights, we propose actionable implications for both the academic and industrial communities, aimed at bolstering confidence in MBT adoption and investment for software testing purposes.<\/jats:p>","DOI":"10.1145\/3715789","type":"journal-article","created":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T15:15:34Z","timestamp":1750346134000},"page":"1545-1566","source":"Crossref","is-referenced-by-count":1,"title":["A Mixed-Methods Study of Model-Based GUI Testing in Real-World Industrial Settings"],"prefix":"10.1145","volume":"2","author":[{"ORCID":"https:\/\/orcid.org\/0009-0000-6929-1027","authenticated-orcid":false,"given":"Shaoheng","family":"Cao","sequence":"first","affiliation":[{"name":"Nanjing University, Nanjing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0006-4367-1228","authenticated-orcid":false,"given":"Renyi","family":"Chen","sequence":"additional","affiliation":[{"name":"Samsung Electronics (China) R&amp;D Centre, Nanjing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1213-6733","authenticated-orcid":false,"given":"Wenhua","family":"Yang","sequence":"additional","affiliation":[{"name":"Nanjing University of Aeronautics and Astronautics, Nanjing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4011-5350","authenticated-orcid":false,"given":"Minxue","family":"Pan","sequence":"additional","affiliation":[{"name":"Nanjing University, Nanjing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3090-9568","authenticated-orcid":false,"given":"Xuandong","family":"Li","sequence":"additional","affiliation":[{"name":"Nanjing University, Nanjing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2025,6,19]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10664-022-10145-2"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10664-017-9570-9"},{"key":"e_1_2_1_3_1","volume-title":"Extending the Interaction Flow Modeling Language (IFML) for Model Driven Development of Mobile Applications Front End","author":"Brambilla Marco","unstructured":"Marco Brambilla, Andrea Mauri, and Eric Umuhoza. 2014. Extending the Interaction Flow Modeling Language (IFML) for Model Driven Development of Mobile Applications Front End. In Mobile Web Information Systems, Irfan Awan, Muhammad Younas, Xavier Franch, and Carme Quer (Eds.). Springer International Publishing, Cham. 176\u2013191. isbn:978-3-319-10359-4"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/3691620.3695032"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/2904354.2904369"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/302405.302640"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.entcs.2015.05.002"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","unstructured":"Vladimir Entin Mathias Winder Bo Zhang and Stephan Christmann. 2011. Combining Model-Based and Capture-Replay Testing Techniques of Graphical User Interfaces: An Industrial Approach. In 2011 IEEE Fourth International Conference on Software Testing Verification and Validation Workshops. 572\u2013577. https:\/\/doi.org\/10.1109\/ICSTW.2011.13 10.1109\/ICSTW.2011.13","DOI":"10.1109\/ICSTW.2011.13"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1109\/IWAST.2012.6228989"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.scico.2023.102942"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10664-020-09803-0"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2021.111032"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","unstructured":"Robert Grissom and John Kim. 2005. Effect Sizes for Research: A Broad Practical Approach. isbn:0805850147 https:\/\/doi.org\/10.4324\/9781410612915 10.4324\/9781410612915","DOI":"10.4324\/9781410612915"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICST53961.2022.00047"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSTW52544.2021.00033"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.csi.2017.08.002"},{"key":"e_1_2_1_17_1","volume-title":"Model-Based Testing Essentials - Guide to the ISTQB Certified Model-Based Tester: Foundation Level","author":"Kramer Anne","year":"1913","unstructured":"Anne Kramer and Bruno Legeard. 2016. Model-Based Testing Essentials - Guide to the ISTQB Certified Model-Based Tester: Foundation Level (1st ed.). Wiley Publishing. isbn:1119130018","edition":"1"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/3597503.3623344"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1002\/casp.2450040506"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.scico.2023.103005"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/3510003.3510133"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSTW.2014.29"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11219-021-09575-w"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1038\/134201b0"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10270-021-00924-8"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2019.110433"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/3544902.3546233"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/1808266.1808279"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/2591062.2591180"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11219-016-9321-y"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICST.2011.11"},{"key":"e_1_2_1_32_1","volume-title":"Practical Model-Based Testing: A Tools Approach","author":"Utting Mark","unstructured":"Mark Utting and Bruno Legeard. 2006. Practical Model-Based Testing: A Tools Approach. Morgan Kaufmann Publishers Inc., San Francisco, CA, USA. isbn:0123725011"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/3597926.3598033"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/3452383.3452388"}],"container-title":["Proceedings of the ACM on Software Engineering"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3715789","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T15:19:34Z","timestamp":1750346374000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3715789"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,6,19]]},"references-count":34,"journal-issue":{"issue":"FSE","published-print":{"date-parts":[[2025,6,19]]}},"alternative-id":["10.1145\/3715789"],"URL":"https:\/\/doi.org\/10.1145\/3715789","relation":{},"ISSN":["2994-970X"],"issn-type":[{"value":"2994-970X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,6,19]]}}}