{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,19]],"date-time":"2026-03-19T11:56:01Z","timestamp":1773921361336,"version":"3.50.1"},"reference-count":53,"publisher":"Association for Computing Machinery (ACM)","issue":"EICS","license":[{"start":{"date-parts":[[2021,5,27]],"date-time":"2021-05-27T00:00:00Z","timestamp":1622073600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Hum.-Comput. Interact."],"published-print":{"date-parts":[[2021,5,27]]},"abstract":"<jats:p>The goal of software testing is to detect defects with the objective of removing them at a later stage in the development process. Interactive software development follows the User Centered Design approach that promotes continuous involvement of users both at design and evaluation phases. This process is meant to produce usable interactive software by gathering functional and non-functional requirements related to both user needs and context of use. However, taking into account these potentially very-complex-to-implement requirements increases the complexity of the software that is likely, without appropriate methods and tools, to encompass a large number of defects. One of the limitations of UCD approaches is that it provides no guidance on the engineering of the interactive application, which thus usually embeds numerous defects resulting in failures at the origin of user frustrations and performance drops. Even though a classification of interactive application defects has been proposed, interactive application testers remain only superficially supported in detecting them. This paper defines a model-based approach to engineer the testing activity for interactive applications. It proposes a process that bridges the gap between UCD artefacts and interactive software implementation by the production of a dedicated formal model exploited for testing purposes only. The application of the process is demonstrated on an interactive cockpit WIMP application. Finally, threats to validity (capability of the approach to detect defects and to ensure an acceptable coverage testing of the interactive application) are addressed by a longitudinal study on 61 variants of a simple application developed by 61 different developers. ?<\/jats:p>","DOI":"10.1145\/3461729","type":"journal-article","created":{"date-parts":[[2021,5,30]],"date-time":"2021-05-30T01:31:19Z","timestamp":1622338279000},"page":"1-30","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":6,"title":["Engineering Model-Based Software Testing of WIMP Interactive Applications"],"prefix":"10.1145","volume":"5","author":[{"given":"Alexandre","family":"Canny","sequence":"first","affiliation":[{"name":"University Toulouse III - Paul Sabatier, Toulouse, France"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"C\u00e9lia","family":"Martinie","sequence":"additional","affiliation":[{"name":"University Toulouse III - Paul Sabatier, Toulouse, France"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"David","family":"Navarre","sequence":"additional","affiliation":[{"name":"University of Toulouse I - Capitole, Toulouse, France"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Philippe","family":"Palanque","sequence":"additional","affiliation":[{"name":"University Toulouse III - Paul Sabatier, Toulouse, France"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Eric","family":"Barboni","sequence":"additional","affiliation":[{"name":"University Toulouse III - Paul Sabatier, Toulouse, France"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Christine","family":"Gris","sequence":"additional","affiliation":[{"name":"Airbus Group, Toulouse, France"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2021,5,29]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1109\/TDSC.2004.2"},{"key":"e_1_2_1_2_1","volume-title":"Prepared by Airlines Electronic Engineering Committee. Cockpit Display System Interfaces to User Systems. Arinc Specification 661--7","author":"ARINC","year":"2020","unstructured":"ARINC 661--7 , Prepared by Airlines Electronic Engineering Committee. Cockpit Display System Interfaces to User Systems. Arinc Specification 661--7 ; 2020 ARINC 661--7, Prepared by Airlines Electronic Engineering Committee. Cockpit Display System Interfaces to User Systems. Arinc Specification 661--7; 2020"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.infsof.2013.03.004"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.5555\/1756428.1756434"},{"key":"e_1_2_1_5_1","doi-asserted-by":"crossref","unstructured":"Eric Barboni C\u00e9lia Martinie David Navarre Philippe A. Palanque Marco Winckler: Bridging the gap between a behavioral formal description technique and a user interface description language: Enhancing ICO with a graphical user interface markup language. Sci. Comput. Program. 86: 3--29 (2014)  Eric Barboni C\u00e9lia Martinie David Navarre Philippe A. Palanque Marco Winckler: Bridging the gap between a behavioral formal description technique and a user interface description language: Enhancing ICO with a graphical user interface markup language. Sci. Comput. Program. 86: 3--29 (2014)","DOI":"10.1016\/j.scico.2013.04.001"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/1996461.1996516"},{"key":"e_1_2_1_7_1","volume-title":"Duc-Hoa Le","author":"Bastide R\u00e9mi","year":"1998","unstructured":"R\u00e9mi Bastide , Philippe A. Palanque , Duc-Hoa Le , Jaime Munoz : Integrating Rendering Specifications into a Formalism for the Design of Interactive Systems. DSV-IS 1998 : 171--190 R\u00e9mi Bastide, Philippe A. Palanque, Duc-Hoa Le, Jaime Munoz: Integrating Rendering Specifications into a Formalism for the Design of Interactive Systems. DSV-IS 1998: 171--190"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/1027933.1027974"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.5555\/772072.772136"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/1134285.1134288"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.5555\/2616205"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/3095807"},{"key":"e_1_2_1_13_1","volume-title":"Human-Computer Interaction -- INTERACT 2013 (Lecture Notes in Computer Science)","author":"Cajander \u00c5sa","unstructured":"\u00c5sa Cajander , Marta Larusdottir , and Jan Gulliksen . 2013. Existing but Not Explicit - The User Perspective in Scrum Projects in Practice . In Human-Computer Interaction -- INTERACT 2013 (Lecture Notes in Computer Science) , Springer , Berlin, Heidelberg , 762--779. DOI:https:\/\/doi.org\/10.1007\/978--3--642--40477--1_52 10.1007\/978--3--642--40477--1_52 \u00c5sa Cajander, Marta Larusdottir, and Jan Gulliksen. 2013. Existing but Not Explicit - The User Perspective in Scrum Projects in Practice. In Human-Computer Interaction -- INTERACT 2013 (Lecture Notes in Computer Science), Springer, Berlin, Heidelberg, 762--779. DOI:https:\/\/doi.org\/10.1007\/978--3--642--40477--1_52"},{"key":"e_1_2_1_14_1","volume-title":"Human-Centered Software Engineering (Lecture Notes in Computer Science)","author":"Canny Alexandre","unstructured":"Alexandre Canny , Elodie Bouzekri , C\u00e9lia Martinie , and Philippe Palanque . 2019. Rationalizing the Need of Architecture-Driven Testing of Interactive Systems . In Human-Centered Software Engineering (Lecture Notes in Computer Science) , Springer International Publishing , Cham , 164--186. DOI:https:\/\/doi.org\/10.1007\/978--3-030-05909--5_10. 10.1007\/978--3-030-05909--5_10 Alexandre Canny, Elodie Bouzekri, C\u00e9lia Martinie, and Philippe Palanque. 2019. Rationalizing the Need of Architecture-Driven Testing of Interactive Systems. In Human-Centered Software Engineering (Lecture Notes in Computer Science), Springer International Publishing, Cham, 164--186. DOI:https:\/\/doi.org\/10.1007\/978--3-030-05909--5_10."},{"key":"e_1_2_1_15_1","volume-title":"Jos\u00e9 Creissac Campos, and Philippe Palanque","author":"Canny Alexandre","year":"2020","unstructured":"Alexandre Canny , David Navarre , Jos\u00e9 Creissac Campos, and Philippe Palanque . 2020 . Model-Based Testing of Post-WIMP Interactions Using Object Oriented Petri-Nets. In Formal Methods. FM 2019 International Workshops (Lecture Notes in Computer Science), Springer International Publishing , Cham, 486--502. DOI:https:\/\/doi.org\/10.1007\/978--3-030--54994--7_35 10.1007\/978--3-030--54994--7_35 Alexandre Canny, David Navarre, Jos\u00e9 Creissac Campos, and Philippe Palanque. 2020. Model-Based Testing of Post-WIMP Interactions Using Object Oriented Petri-Nets. In Formal Methods. FM 2019 International Workshops (Lecture Notes in Computer Science), Springer International Publishing, Cham, 486--502. DOI:https:\/\/doi.org\/10.1007\/978--3-030--54994--7_35"},{"key":"e_1_2_1_16_1","volume-title":"Model-Based Testing of GUI Applications Featuring Dynamic Instanciation of Widgets. In 2020 IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW), 95--104","author":"Canny Alexandre","year":"2020","unstructured":"Alexandre Canny , Philippe Palanque , and David Navarre . 2020 . Model-Based Testing of GUI Applications Featuring Dynamic Instanciation of Widgets. In 2020 IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW), 95--104 . DOI:https:\/\/doi.org\/10.1109\/ICSTW50294.2020.00029 10.1109\/ICSTW50294.2020.00029 Alexandre Canny, Philippe Palanque, and David Navarre. 2020. Model-Based Testing of GUI Applications Featuring Dynamic Instanciation of Widgets. In 2020 IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW), 95--104. DOI:https:\/\/doi.org\/10.1109\/ICSTW50294.2020.00029"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1109\/ASE.2015.89"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/2933242.2948735"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/3095811"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/3404199"},{"key":"e_1_2_1_21_1","volume-title":"MIODMIT: A Generic Architecture for Dynamic Multimodal Interactive Systems. In Human-Centered Software Engineering (Lecture Notes in Computer Science)","author":"Cronel Martin","year":"2019","unstructured":"Martin Cronel , Bruno Dumas , Philippe Palanque , and Alexandre Canny . 2019 . MIODMIT: A Generic Architecture for Dynamic Multimodal Interactive Systems. In Human-Centered Software Engineering (Lecture Notes in Computer Science) , Springer International Publishing , Cham , 109--129. DOI:https:\/\/doi.org\/10.1007\/978--3-030-05909--5_7 10.1007\/978--3-030-05909--5_7 Martin Cronel, Bruno Dumas, Philippe Palanque, and Alexandre Canny. 2019. MIODMIT: A Generic Architecture for Dynamic Multimodal Interactive Systems. In Human-Centered Software Engineering (Lecture Notes in Computer Science), Springer International Publishing, Cham, 109--129. DOI:https:\/\/doi.org\/10.1007\/978--3-030-05909--5_7"},{"key":"e_1_2_1_22_1","unstructured":"European Aviation Safety Agency. 2017. CS-25 -- Certification Specifications and Acceptable Means of Compliance for Large Aeroplanes. (2017).  European Aviation Safety Agency. 2017. CS-25 -- Certification Specifications and Acceptable Means of Compliance for Large Aeroplanes. (2017)."},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/2933242.2933258"},{"key":"e_1_2_1_24_1","volume-title":"Agile Processes in Software Engineering and Extreme Programming (Lecture Notes in Business Information Processing)","author":"Ferreira Jennifer","unstructured":"Jennifer Ferreira , Helen Sharp , and Hugh Robinson . 2010. Values and Assumptions Shaping Agile Development and User Experience Design in Practice . In Agile Processes in Software Engineering and Extreme Programming (Lecture Notes in Business Information Processing) , Springer , Berlin, Heidelberg , 178--183. DOI:https:\/\/doi.org\/10.1007\/978--3--642--13054-0_15 10.1007\/978--3--642--13054-0_15 Jennifer Ferreira, Helen Sharp, and Hugh Robinson. 2010. Values and Assumptions Shaping Agile Development and User Experience Design in Practice. In Agile Processes in Software Engineering and Extreme Programming (Lecture Notes in Business Information Processing), Springer, Berlin, Heidelberg, 178--183. DOI:https:\/\/doi.org\/10.1007\/978--3--642--13054-0_15"},{"key":"e_1_2_1_25_1","volume-title":"UI\/Application Exercise Monkey, https:\/\/developer.android.com\/studio\/test\/monkey , last accessed","year":"2021","unstructured":"Google. Monkey : UI\/Application Exercise Monkey, https:\/\/developer.android.com\/studio\/test\/monkey , last accessed February 2021 . Google. Monkey : UI\/Application Exercise Monkey, https:\/\/developer.android.com\/studio\/test\/monkey , last accessed February 2021."},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/2494603.2480311"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/2607023.2610286"},{"key":"e_1_2_1_28_1","volume-title":"ISTQB Glossary: https:\/\/glossary.istqb.org\/, last accessed","author":"Testing Qualification Board International Software","year":"2021","unstructured":"International Software Testing Qualification Board . ISTQB Glossary: https:\/\/glossary.istqb.org\/, last accessed February 2021 . International Software Testing Qualification Board. ISTQB Glossary: https:\/\/glossary.istqb.org\/, last accessed February 2021."},{"key":"e_1_2_1_29_1","volume-title":"Human-centred design for interactive systems. Retrieved","author":"ISO","year":"2018","unstructured":"ISO 9241--210:2010 - Ergonomics of human-system interaction -- Part 210 : Human-centred design for interactive systems. Retrieved June 7, 2018 from https:\/\/www.iso.org\/standard\/52075.html ISO 9241--210:2010 - Ergonomics of human-system interaction -- Part 210: Human-centred design for interactive systems. Retrieved June 7, 2018 from https:\/\/www.iso.org\/standard\/52075.html"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1109\/MC.2005.314"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-22698-9_3"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.5555\/1841406"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2016.01.024"},{"key":"#cr-split#-e_1_2_1_34_1.1","doi-asserted-by":"crossref","unstructured":"Val\u00e9ria Lelli Arnaud Blouin and Benoit Baudry. 2015. Classifying and Qualifying GUI Defects. 1--10. DOI:https:\/\/doi.org\/10.1109\/ICST.2015.7102582 10.1109\/ICST.2015.7102582","DOI":"10.1109\/ICST.2015.7102582"},{"key":"#cr-split#-e_1_2_1_34_1.2","doi-asserted-by":"crossref","unstructured":"Val\u00e9ria Lelli Arnaud Blouin and Benoit Baudry. 2015. Classifying and Qualifying GUI Defects. 1--10. DOI:https:\/\/doi.org\/10.1109\/ICST.2015.7102582","DOI":"10.1109\/ICST.2015.7102582"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSTW.2015.7107403"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/2501907.2501954"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/503271.503244"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.5555\/577677"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.5555\/1732323.1732462"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/1614390.1614393"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/1996461.1996490"},{"key":"e_1_2_1_42_1","volume-title":"Brace Touch: A Dependable, Turbulence-Tolerant, Multi-touch Interaction Technique for Interactive Cockpits. In Computer Safety, Reliability, and Security (Lecture Notes in Computer Science)","author":"Palanque Philippe","year":"2019","unstructured":"Philippe Palanque , Andy Cockburn , L\u00e9opold D\u00e9sert-Legendre , Carl Gutwin , and Yannick Deleris . 2019 . Brace Touch: A Dependable, Turbulence-Tolerant, Multi-touch Interaction Technique for Interactive Cockpits. In Computer Safety, Reliability, and Security (Lecture Notes in Computer Science) , Springer International Publishing , Cham , 53--68. DOI:https:\/\/doi.org\/10.1007\/978--3-030--26601--1_4 10.1007\/978--3-030--26601--1_4 Philippe Palanque, Andy Cockburn, L\u00e9opold D\u00e9sert-Legendre, Carl Gutwin, and Yannick Deleris. 2019. Brace Touch: A Dependable, Turbulence-Tolerant, Multi-touch Interaction Technique for Interactive Cockpits. In Computer Safety, Reliability, and Security (Lecture Notes in Computer Science), Springer International Publishing, Cham, 53--68. DOI:https:\/\/doi.org\/10.1007\/978--3-030--26601--1_4"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/3236454.3236489"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/175276.175288"},{"key":"e_1_2_1_45_1","first-page":"1","volume-title":"Managing the Development of Large Software Systems","author":"Royce Winston W.","year":"1970","unstructured":"Winston W. Royce . Managing the Development of Large Software Systems . IEEE Wescon , pp 1 -- 9 , 1970 Winston W. Royce. Managing the Development of Large Software Systems. IEEE Wescon, pp 1--9, 1970"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.5555\/559553"},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.5555\/2835547.2835549"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1145\/1570433.1570474"},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1145\/3397873"},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1002\/stvr.456"},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.5555\/2011166.2011168"},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1145\/503112.503114"}],"container-title":["Proceedings of the ACM on Human-Computer Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3461729","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3461729","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T20:17:06Z","timestamp":1750191426000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3461729"}},"subtitle":["A Process based on Formal Models and the SQUAMATA Tool"],"short-title":[],"issued":{"date-parts":[[2021,5,27]]},"references-count":53,"journal-issue":{"issue":"EICS","published-print":{"date-parts":[[2021,5,27]]}},"alternative-id":["10.1145\/3461729"],"URL":"https:\/\/doi.org\/10.1145\/3461729","relation":{},"ISSN":["2573-0142"],"issn-type":[{"value":"2573-0142","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,5,27]]},"assertion":[{"value":"2021-05-29","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}