{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,7]],"date-time":"2026-05-07T15:52:37Z","timestamp":1778169157382,"version":"3.51.4"},"reference-count":64,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2021,11,17]],"date-time":"2021-11-17T00:00:00Z","timestamp":1637107200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Softw. Eng. Methodol."],"published-print":{"date-parts":[[2022,4,30]]},"abstract":"<jats:p>In automated Visual GUI Testing (VGT) for Android devices, the available tools often suffer from low robustness to mobile fragmentation, leading to incorrect results when running the same tests on different devices.<\/jats:p>\n          <jats:p>\n            To soften these issues, we evaluate two feature matching-based approaches for widget detection in VGT scripts, which use, respectively, the complete full-screen snapshot of the application (\n            <jats:italic>Fullscreen<\/jats:italic>\n            ) and the cropped images of its widgets (\n            <jats:italic>Cropped<\/jats:italic>\n            ) as\n            <jats:italic>visual locators<\/jats:italic>\n            to match on emulated devices.\n          <\/jats:p>\n          <jats:p>Our analysis includes validating the portability of different feature-based visual locators over various apps and devices and evaluating their robustness in terms of cross-device portability and correctly executed interactions. We assessed our results through a comparison with two state-of-the-art tools, EyeAutomate and Sikuli.<\/jats:p>\n          <jats:p>Despite a limited increase in the computational burden, our Fullscreen approach outperformed state-of-the-art tools in terms of correctly identified locators across a wide range of devices and led to a 30% increase in passing tests.<\/jats:p>\n          <jats:p>Our work shows that VGT tools\u2019 dependability can be improved by bridging the testing and computer vision communities. This connection enables the design of algorithms targeted to domain-specific needs and thus inherently more usable and robust.<\/jats:p>","DOI":"10.1145\/3477427","type":"journal-article","created":{"date-parts":[[2021,11,17]],"date-time":"2021-11-17T21:57:08Z","timestamp":1637186228000},"page":"1-32","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":10,"title":["Feature Matching-based Approaches to Improve the Robustness of Android Visual GUI Testing"],"prefix":"10.1145","volume":"31","author":[{"given":"Luca","family":"Ardito","sequence":"first","affiliation":[{"name":"Politecnico di Torino, Torino, Italy"}]},{"given":"Andrea","family":"Bottino","sequence":"additional","affiliation":[{"name":"Politecnico di Torino, Torino, Italy"}]},{"given":"Riccardo","family":"Coppola","sequence":"additional","affiliation":[{"name":"Politecnico di Torino, Torino, Italy"}]},{"given":"Fabrizio","family":"Lamberti","sequence":"additional","affiliation":[{"name":"Politecnico di Torino, Torino, Italy"}]},{"given":"Francesco","family":"Manigrasso","sequence":"additional","affiliation":[{"name":"Politecnico di Torino, Torino, Italy"}]},{"given":"Lia","family":"Morra","sequence":"additional","affiliation":[{"name":"Politecnico di Torino, Torino, Italy"}]},{"given":"Marco","family":"Torchiano","sequence":"additional","affiliation":[{"name":"Politecnico di Torino, Torino, Italy"}]}],"member":"320","published-online":{"date-parts":[[2021,11,17]]},"reference":[{"key":"e_1_3_2_2_2","article-title":"EyeAutomate Documentation","author":"AB Synteda","year":"2018","unstructured":"Synteda AB. 2018. EyeAutomate Documentation. Retrieved from https:\/\/eyeautomate.com\/wp-content\/themes\/EyeAutomateTheme\/resources\/EyeAutomateCertifiedTesterCourse.pdf.","journal-title":"https:\/\/eyeautomate.com\/wp-content\/themes\/EyeAutomateTheme\/resources\/EyeAutomateCertifiedTesterCourse.pdf"},{"key":"e_1_3_2_3_2","volume-title":"Visual GUI Testing: Automating High-level Software Testing in Industrial Practice","author":"Al\u00e9groth Emil","year":"2015","unstructured":"Emil Al\u00e9groth. 2015. Visual GUI Testing: Automating High-level Software Testing in Industrial Practice. Chalmers University of Technology, G\u00f6teborg."},{"key":"e_1_3_2_4_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10664-016-9497-6"},{"key":"e_1_3_2_5_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.infsof.2016.01.012"},{"key":"e_1_3_2_6_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICST.2015.7102584"},{"key":"e_1_3_2_7_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICST.2013.61"},{"key":"e_1_3_2_8_2","doi-asserted-by":"publisher","DOI":"10.1109\/MS.2014.55"},{"key":"e_1_3_2_9_2","doi-asserted-by":"publisher","DOI":"10.1002\/stvr.1654"},{"key":"e_1_3_2_10_2","first-page":"1","article-title":"Permutational multivariate analysis of variance (PERMANOVA)","volume":"1","author":"Anderson Marti J.","year":"2014","unstructured":"Marti J. Anderson. 2014. Permutational multivariate analysis of variance (PERMANOVA). Wiley Statsref: Stat. Ref. Online 1 (2014), 1\u201315.","journal-title":"Wiley Statsref: Stat. Ref. Online"},{"key":"e_1_3_2_11_2","doi-asserted-by":"publisher","DOI":"10.1145\/3319008.3319022"},{"key":"e_1_3_2_12_2","doi-asserted-by":"publisher","DOI":"10.1145\/3236454.3236488"},{"key":"e_1_3_2_13_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.infsof.2013.03.004"},{"key":"e_1_3_2_14_2","first-page":"6733","volume-title":"Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition","author":"Barath Daniel","year":"2017","unstructured":"Daniel Barath and Jiri Matas. 2017. Graph-Cut RANSAC. In Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition. IEEE, 6733\u20136741."},{"key":"e_1_3_2_15_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.cviu.2007.09.014"},{"key":"e_1_3_2_16_2","doi-asserted-by":"publisher","DOI":"10.1145\/3197231.3197243"},{"key":"e_1_3_2_17_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICST.2012.115"},{"key":"e_1_3_2_18_2","article-title":"The OpenCV library","volume":"1","author":"Bradski G.","year":"2000","unstructured":"G. Bradski. 2000. The OpenCV library. Dr. Dobb\u2019s J. Softw. Tools 1 (2000).","journal-title":"Dr. Dobb\u2019s J. Softw. Tools"},{"key":"e_1_3_2_19_2","first-page":"528","article-title":"Goal question metric paradigm","volume":"1","author":"Caldiera Victor R. Basili-Gianluigi","year":"1994","unstructured":"Victor R. Basili-Gianluigi Caldiera and H. Dieter Rombach. 1994. Goal question metric paradigm. Encyclopedia Softw. Eng. 1 (1994), 528\u2013532.","journal-title":"Encyclopedia Softw. Eng."},{"key":"e_1_3_2_20_2","doi-asserted-by":"publisher","DOI":"10.1145\/1753326.1753555"},{"key":"e_1_3_2_21_2","doi-asserted-by":"publisher","DOI":"10.1145\/3368089.3409691"},{"key":"e_1_3_2_22_2","doi-asserted-by":"publisher","DOI":"10.1145\/3340433.3342824"},{"key":"e_1_3_2_23_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICSTW50294.2020.00027"},{"key":"e_1_3_2_24_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2020.110845"},{"key":"e_1_3_2_25_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10664-019-09722-9"},{"key":"e_1_3_2_26_2","doi-asserted-by":"publisher","DOI":"10.1145\/1348246.1348248"},{"key":"e_1_3_2_27_2","doi-asserted-by":"publisher","DOI":"10.1145\/3126594.3126651"},{"key":"e_1_3_2_28_2","unstructured":"A. Developers. 2012. Ui\/application exerciser monkey."},{"key":"e_1_3_2_29_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICST.2017.21"},{"key":"e_1_3_2_30_2","doi-asserted-by":"publisher","DOI":"10.5244\/C.27.13"},{"key":"e_1_3_2_31_2","doi-asserted-by":"publisher","DOI":"10.1109\/TIT.1975.1055330"},{"key":"e_1_3_2_32_2","doi-asserted-by":"publisher","DOI":"10.1109\/WCRE.2012.18"},{"key":"e_1_3_2_33_2","doi-asserted-by":"publisher","DOI":"10.1109\/APSEC.2017.87"},{"key":"e_1_3_2_34_2","doi-asserted-by":"publisher","DOI":"10.1145\/3238147.3238180"},{"key":"e_1_3_2_35_2","doi-asserted-by":"publisher","DOI":"10.1145\/2406367.2406402"},{"key":"e_1_3_2_36_2","doi-asserted-by":"publisher","DOI":"10.1145\/3243218.3243219"},{"key":"e_1_3_2_37_2","doi-asserted-by":"publisher","DOI":"10.1002\/stvr.1665"},{"key":"e_1_3_2_38_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2014.2331982"},{"key":"e_1_3_2_39_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICSME.2017.27"},{"key":"e_1_3_2_40_2","doi-asserted-by":"publisher","DOI":"10.1023\/B:VISI.0000029664.99615.94"},{"key":"e_1_3_2_41_2","doi-asserted-by":"publisher","DOI":"10.1109\/CONISOFT.2018.8645883"},{"key":"e_1_3_2_42_2","unstructured":"S. S. Mangiafico. 2015. An R Companion for the Handbook of Biological Statistics Version 1.09c 274 pp."},{"key":"e_1_3_2_43_2","doi-asserted-by":"publisher","DOI":"10.1145\/2931037.2931054"},{"key":"e_1_3_2_44_2","unstructured":"Matias Martinez and Bruno Gois Mateus. 2020. How and Why did developers migrate Android Applications from Java to Kotlin? A study based on code analysis and interviews with developers. arXiv:2003.12730v1 [cs.SE]."},{"key":"e_1_3_2_45_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-58469-0_36"},{"key":"e_1_3_2_46_2","doi-asserted-by":"publisher","DOI":"10.1109\/MALWARE.2016.7888731"},{"key":"e_1_3_2_47_2","doi-asserted-by":"publisher","DOI":"10.1109\/MOBILESoft.2017.36"},{"key":"e_1_3_2_48_2","first-page":"25","volume-title":"Proceedings of the the 11th International Conference on Mobile Ubiquitous Computing, Systems, Services and Technologies","author":"Mozgovoy Maxim","year":"2017","unstructured":"Maxim Mozgovoy and Evgeny Pyshkin. 2017. Using image recognition for testing hand-drawn graphic user interfaces. In Proceedings of the the 11th International Conference on Mobile Ubiquitous Computing, Systems, Services and Technologies. IARIA, Barcelona, 25\u201328."},{"key":"e_1_3_2_49_2","first-page":"239","volume-title":"International Journal on Advances in Software","author":"Mozgovoy Maxim","year":"2018","unstructured":"Maxim Mozgovoy and Evgeny Pyshkin. 2018. Pragmatic approach to automated testing of mobile applications with non-native graphic user interface. In International Journal on Advances in Software. IARIA, Wilmington, UK, 239\u2013246."},{"key":"e_1_3_2_50_2","first-page":"139","volume-title":"Unity Application Testing Automation with Appium and Image Recognition","author":"Mozgovoy Maxim","year":"2018","unstructured":"Maxim Mozgovoy and Evgeny Pyshkin. 2018. Unity Application Testing Automation with Appium and Image Recognition. Springer, Cham, 139\u2013150. https:\/\/doi.org\/10.1007\/978-3-319-71734-0_12"},{"key":"e_1_3_2_51_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE-SEIP.2019.00029"},{"key":"e_1_3_2_52_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICISA.2013.6579465"},{"key":"e_1_3_2_53_2","doi-asserted-by":"publisher","DOI":"10.1145\/2494603.2480308"},{"key":"e_1_3_2_54_2","article-title":"Global Google Play app downloads 2016-2019","year":"2021","unstructured":"Statista. 2021. Global Google Play app downloads 2016-2019. Retrieved from https:\/\/www.statista.com\/statistics\/734332\/google-play-app-installs-per-year\/.","journal-title":"https:\/\/www.statista.com\/statistics\/734332\/google-play-app-installs-per-year\/"},{"key":"e_1_3_2_55_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICOMET.2018.8346440"},{"key":"e_1_3_2_56_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICOMET.2018.8346440"},{"key":"e_1_3_2_57_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICSME.2018.00062"},{"key":"e_1_3_2_58_2","volume-title":"effsize: Efficient Effect Size Computation","author":"Torchiano Marco","year":"2020","unstructured":"Marco Torchiano. 2020. effsize: Efficient Effect Size Computation. Politecnico di Torino. https:\/\/doi.org\/10.5281\/zenodo.1480624"},{"key":"e_1_3_2_59_2","doi-asserted-by":"publisher","DOI":"10.1007\/s40869-019-00087-z"},{"key":"e_1_3_2_60_2","doi-asserted-by":"publisher","DOI":"10.5555\/1481563"},{"key":"e_1_3_2_61_2","volume-title":"Visual Regression Testing for Web Applications; Selainpohjaisten ohjelmistojen visuaalinen regressiotestaus","author":"Vesikkala Mikko","unstructured":"Mikko Vesikkala. 2014-05-05. Visual Regression Testing for Web Applications; Selainpohjaisten ohjelmistojen visuaalinen regressiotestaus. G2 Pro gradu, diplomity\u00f6; masterThesis. Aalto University. Retrieved from http:\/\/urn.fi\/URN:NBN:fi:aalto-201405131809."},{"key":"e_1_3_2_62_2","doi-asserted-by":"publisher","DOI":"10.1145\/3377811.3380347"},{"key":"e_1_3_2_63_2","doi-asserted-by":"publisher","DOI":"10.1145\/1622176.1622213"},{"key":"e_1_3_2_64_2","doi-asserted-by":"publisher","DOI":"10.5555\/2601851"},{"key":"e_1_3_2_65_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4842-4315-2_8"}],"container-title":["ACM Transactions on Software Engineering and Methodology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3477427","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3477427","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T19:30:32Z","timestamp":1750188632000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3477427"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,11,17]]},"references-count":64,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2022,4,30]]}},"alternative-id":["10.1145\/3477427"],"URL":"https:\/\/doi.org\/10.1145\/3477427","relation":{},"ISSN":["1049-331X","1557-7392"],"issn-type":[{"value":"1049-331X","type":"print"},{"value":"1557-7392","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,11,17]]},"assertion":[{"value":"2020-09-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-07-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-11-17","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}