{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,22]],"date-time":"2026-04-22T03:17:14Z","timestamp":1776827834720,"version":"3.51.2"},"publisher-location":"New York, NY, USA","reference-count":39,"publisher":"ACM","license":[{"start":{"date-parts":[[2021,9,27]],"date-time":"2021-09-27T00:00:00Z","timestamp":1632700800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2021,9,27]]},"DOI":"10.1145\/3474624.3474634","type":"proceedings-article","created":{"date-parts":[[2021,10,5]],"date-time":"2021-10-05T19:47:46Z","timestamp":1633463266000},"page":"186-194","source":"Crossref","is-referenced-by-count":28,"title":["Deep Reinforcement Learning based Android Application GUI Testing"],"prefix":"10.1145","author":[{"given":"Eliane","family":"Collins","sequence":"first","affiliation":[{"name":"University of Sao Paulo, Brazil"}]},{"given":"Arilo","family":"Neto","sequence":"additional","affiliation":[{"name":"UFAM, Brazil"}]},{"given":"Auri","family":"Vincenzi","sequence":"additional","affiliation":[{"name":"Universidade Federal de S\u00e3o Carlos, Brazil"}]},{"given":"Jos\u00e9","family":"Maldonado","sequence":"additional","affiliation":[{"name":"SSC\/ICMC-USP\/ S\u00e3o Carlos, Brazil"}]}],"member":"320","published-online":{"date-parts":[[2021,10,5]]},"reference":[{"key":"e_1_3_2_1_1_1","unstructured":"[n.d.]. Appium: Mobile App Automation Made Awesome.http:\/\/appium.io\/  [n.d.]. Appium: Mobile App Automation Made Awesome.http:\/\/appium.io\/"},{"key":"e_1_3_2_1_2_1","unstructured":"2020. F-Droid - Free and Open Source Android App Repository. https:\/\/f-droid.org\/pt_BR\/packages\/  2020. F-Droid - Free and Open Source Android App Repository. https:\/\/f-droid.org\/pt_BR\/packages\/"},{"key":"e_1_3_2_1_3_1","unstructured":"2020. GitHub - honeynet\/droidbot: A lightweight test input generator for Android. Similar to Monkey but with more intelligence and cool features!https:\/\/github.com\/honeynet\/droidbot  2020. GitHub - honeynet\/droidbot: A lightweight test input generator for Android. Similar to Monkey but with more intelligence and cool features!https:\/\/github.com\/honeynet\/droidbot"},{"key":"e_1_3_2_1_4_1","unstructured":"2020. Gym. https:\/\/gym.openai.com\/  2020. Gym. https:\/\/gym.openai.com\/"},{"key":"e_1_3_2_1_5_1","unstructured":"2020. Logcat. https:\/\/developer.android.com\/studio\/command-line\/logcat  2020. Logcat. https:\/\/developer.android.com\/studio\/command-line\/logcat"},{"key":"e_1_3_2_1_6_1","unstructured":"2020. Mobile Operating System Market Share Worldwide | StatCounter Global Stats. https:\/\/gs.statcounter.com\/os-market-share\/mobile\/worldwide  2020. Mobile Operating System Market Share Worldwide | StatCounter Global Stats. https:\/\/gs.statcounter.com\/os-market-share\/mobile\/worldwide"},{"key":"e_1_3_2_1_7_1","unstructured":"2020. Monkey tests for IU\/apps. https:\/\/developer.android.com\/studio\/test\/monkey  2020. Monkey tests for IU\/apps. https:\/\/developer.android.com\/studio\/test\/monkey"},{"key":"e_1_3_2_1_8_1","unstructured":"2020. Welcome to Python.org. https:\/\/www.python.org\/  2020. Welcome to Python.org. https:\/\/www.python.org\/"},{"key":"e_1_3_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/3278186.3278187"},{"key":"e_1_3_2_1_10_1","doi-asserted-by":"crossref","unstructured":"Domenico Amalfitano Anna\u00a0Rita Fasolino Porfirio Tramontana and Bryan Robbins. 2013. Chapter 1 - Testing Android Mobile Applications: Challenges Strategies and Approaches. Advances in Computers Vol.\u00a089. Elsevier 1 \u2013 52. https:\/\/doi.org\/10.1016\/B978-0-12-408094-2.00001-1  Domenico Amalfitano Anna\u00a0Rita Fasolino Porfirio Tramontana and Bryan Robbins. 2013. Chapter 1 - Testing Android Mobile Applications: Challenges Strategies and Approaches. Advances in Computers Vol.\u00a089. Elsevier 1 \u2013 52. https:\/\/doi.org\/10.1016\/B978-0-12-408094-2.00001-1","DOI":"10.1016\/B978-0-12-408094-2.00001-1"},{"key":"e_1_3_2_1_11_1","volume-title":"2015 30th IEEE\/ACM International Conference on Automated Software Engineering (ASE). 429\u2013440","author":"Choudhary R."},{"key":"e_1_3_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.5555\/3221317.3221618"},{"key":"e_1_3_2_1_13_1","unstructured":"Android Developers. 2020. Android Debug Bridge (adb). https:\/\/developer.android.com\/studio\/command-line\/adb  Android Developers. 2020. Android Debug Bridge (adb). https:\/\/developer.android.com\/studio\/command-line\/adb"},{"key":"e_1_3_2_1_14_1","unstructured":"Android Developers. 2020. UI Automator. https:\/\/developer.android.com\/training\/testing\/ui-automator  Android Developers. 2020. UI Automator. https:\/\/developer.android.com\/training\/testing\/ui-automator"},{"key":"e_1_3_2_1_15_1","unstructured":"Jianqing Fan Zhaoran Wang Yuchen Xie and Zhuoran Yang. 2020. A theoretical analysis of deep Q-learning. In Learning for Dynamics and Control. PMLR 486\u2013489.  Jianqing Fan Zhaoran Wang Yuchen Xie and Zhuoran Yang. 2020. A theoretical analysis of deep Q-learning. In Learning for Dynamics and Control. PMLR 486\u2013489."},{"key":"e_1_3_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1109\/MC.2013.445"},{"key":"e_1_3_2_1_17_1","volume-title":"AimDroid: Activity-Insulated Multi-level Automated Testing for Android Applications. In 2017 IEEE International Conference on Software Maintenance and Evolution (ICSME). 103\u2013114","author":"Gu T."},{"key":"e_1_3_2_1_18_1","volume-title":"Robust Estimation of a Location Parameter. Ann. Math. Statist. 35, 1 (03","author":"Huber J.","year":"1964"},{"key":"e_1_3_2_1_19_1","unstructured":"Jonathan Hui. 2018. RL - DQN Deep Q-network. Can computers play video games like a. https:\/\/medium.com\/@jonathan_hui\/rl-dqn-deep-q-network-e207751f7ae4  Jonathan Hui. 2018. RL - DQN Deep Q-network. Can computers play video games like a. https:\/\/medium.com\/@jonathan_hui\/rl-dqn-deep-q-network-e207751f7ae4"},{"key":"e_1_3_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10664-013-9266-8"},{"key":"e_1_3_2_1_21_1","volume-title":"Real Challenges in Mobile App Development. In 2013 ACM \/ IEEE International Symposium on Empirical Software Engineering and Measurement. 15\u201324","author":"Joorabchi E."},{"key":"e_1_3_2_1_22_1","unstructured":"Suparna Khamaru. 2017. Code Coverage for Android using Jacoco - QA Learning Guide. http:\/\/www.qalearningguide.com\/2017\/10\/code-coverage-for-android-using-jacoco.html  Suparna Khamaru. 2017. Code Coverage for Android using Jacoco - QA Learning Guide. http:\/\/www.qalearningguide.com\/2017\/10\/code-coverage-for-android-using-jacoco.html"},{"key":"e_1_3_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICPRIME.2013.6496451"},{"key":"e_1_3_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1109\/TR.2018.2865733"},{"key":"e_1_3_2_1_25_1","unstructured":"Yavuz Koroglu and Alper Sen. [n.d.]. Functional test generation from UI test scenarios using reinforcement learning for android applications. Software Testing Verification and Reliability n\/a n\/a([n.\u00a0d.]) e1752. https:\/\/doi.org\/10.1002\/stvr.1752 arXiv:https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/stvr.1752e1752 stvr.1752.  Yavuz Koroglu and Alper Sen. [n.d.]. Functional test generation from UI test scenarios using reinforcement learning for android applications. Software Testing Verification and Reliability n\/a n\/a([n.\u00a0d.]) e1752. https:\/\/doi.org\/10.1002\/stvr.1752 arXiv:https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/stvr.1752e1752 stvr.1752."},{"key":"e_1_3_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICST.2018.00020"},{"key":"e_1_3_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/2931037.2931054"},{"key":"e_1_3_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1109\/MS.2017.49"},{"key":"e_1_3_2_1_29_1","doi-asserted-by":"crossref","unstructured":"Patrick\u00a0E McKnight and Julius Najab. 2010. Mann-Whitney U Test. The Corsini encyclopedia of psychology(2010) 1\u20131.  Patrick\u00a0E McKnight and Julius Najab. 2010. Mann-Whitney U Test. The Corsini encyclopedia of psychology(2010) 1\u20131.","DOI":"10.1002\/9780470479216.corpsy0524"},{"key":"e_1_3_2_1_30_1","volume-title":"Convergence of Q-learning: A simple proof","author":"Melo S","year":"2001"},{"key":"e_1_3_2_1_31_1","doi-asserted-by":"crossref","volume-title":"Machine Learning","author":"Mitchell M.","DOI":"10.1007\/978-1-4613-2279-5"},{"key":"e_1_3_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/3395363.3397354"},{"key":"e_1_3_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/3395363.3397354"},{"key":"e_1_3_2_1_34_1","unstructured":"Adam Paszke. 2017. Reinforcement Learning (DQN) tutorial \u2014 PyTorch Tutorials 0.2.0_4 documentation. http:\/\/seba1511.net\/tutorials\/intermediate\/reinforcement_q_learning.html  Adam Paszke. 2017. Reinforcement Learning (DQN) tutorial \u2014 PyTorch Tutorials 0.2.0_4 documentation. http:\/\/seba1511.net\/tutorials\/intermediate\/reinforcement_q_learning.html"},{"key":"e_1_3_2_1_35_1","doi-asserted-by":"crossref","unstructured":"Martin\u00a0L. Puterman. 1990. Chapter 8 Markov decision processes. In Stochastic Models. Handbooks in Operations Research and Management Science Vol.\u00a02. Elsevier 331 \u2013 434. https:\/\/doi.org\/10.1016\/S0927-0507(05)80172-0  Martin\u00a0L. Puterman. 1990. Chapter 8 Markov decision processes. In Stochastic Models. Handbooks in Operations Research and Management Science Vol.\u00a02. Elsevier 331 \u2013 434. https:\/\/doi.org\/10.1016\/S0927-0507(05)80172-0","DOI":"10.1016\/S0927-0507(05)80172-0"},{"key":"e_1_3_2_1_36_1","doi-asserted-by":"crossref","volume-title":"Reinforcement learning: An introduction","author":"Sutton S","DOI":"10.1007\/978-1-4615-3618-5"},{"key":"e_1_3_2_1_37_1","doi-asserted-by":"crossref","volume-title":"Introduction to reinforcement learning","author":"Sutton S","DOI":"10.1109\/TNN.1998.712192"},{"key":"e_1_3_2_1_38_1","doi-asserted-by":"crossref","unstructured":"Thi Vuong and Shingo Takada. 2019. Semantic Analysis for Deep Q-Network in Android GUI Testing. 123\u2013128. https:\/\/doi.org\/10.18293\/SEKE2019-080  Thi Vuong and Shingo Takada. 2019. Semantic Analysis for Deep Q-Network in Android GUI Testing. 123\u2013128. https:\/\/doi.org\/10.18293\/SEKE2019-080","DOI":"10.18293\/SEKE2019-080"},{"key":"e_1_3_2_1_39_1","volume-title":"Machine learning 8, 3-4","author":"Watkins JCH","year":"1992"}],"event":{"name":"SBES '21: Brazilian Symposium on Software Engineering","location":"Joinville Brazil","acronym":"SBES '21"},"container-title":["Brazilian Symposium on Software Engineering"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3474624.3474634","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3474624.3474634","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T20:18:50Z","timestamp":1750191530000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3474624.3474634"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,9,27]]},"references-count":39,"alternative-id":["10.1145\/3474624.3474634","10.1145\/3474624"],"URL":"https:\/\/doi.org\/10.1145\/3474624.3474634","relation":{},"subject":[],"published":{"date-parts":[[2021,9,27]]}}}