{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,19]],"date-time":"2026-02-19T16:28:38Z","timestamp":1771518518040,"version":"3.50.1"},"reference-count":92,"publisher":"Association for Computing Machinery (ACM)","issue":"10s","license":[{"start":{"date-parts":[[2022,1,31]],"date-time":"2022-01-31T00:00:00Z","timestamp":1643587200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"Coordena\u00e7\u00e3o de Aperfei\u00e7oamento de Pessoal de N\u00edvel Superior \u2014 Brasil (CAPES) \u2014 Finance","award":["001"],"award-info":[{"award-number":["001"]}]},{"name":"Funda\u00e7\u00e3o de Amparo a Pesquisa do Estado de S\u00e3o Paulo - FAPESP","award":["2017\/19492-1"],"award-info":[{"award-number":["2017\/19492-1"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Comput. Surv."],"published-print":{"date-parts":[[2022,1,31]]},"abstract":"<jats:p>\n            <jats:bold>Context:<\/jats:bold>\n            The mobile app market is continually growing offering solutions to almost all aspects of people\u2019s lives, e.g., healthcare, business, entertainment, as well as the stakeholders\u2019 demand for apps that are more secure, portable, easy to use, among other non-functional requirements (NFRs). Therefore, manufacturers should guarantee that their mobile apps achieve high-quality levels. A good strategy is to include software testing and quality assurance activities during the whole life cycle of such solutions.\n          <\/jats:p>\n          <jats:p>\n            <jats:bold>Problem:<\/jats:bold>\n            Systematically warranting NFRs is not an easy task for any software product. Software engineers must take important decisions before adopting testing techniques and automation tools to support such endeavors.\n          <\/jats:p>\n          <jats:p>\n            <jats:bold>Proposal:<\/jats:bold>\n            To provide to the software engineers with a broad overview of existing dynamic techniques and automation tools for testing mobile apps regarding NFRs.\n          <\/jats:p>\n          <jats:p>\n            <jats:bold>Methods:<\/jats:bold>\n            We planned and conducted a Systematic Mapping Study (SMS) following well-established guidelines for executing secondary studies in software engineering.\n          <\/jats:p>\n          <jats:p>\n            <jats:bold>Results:<\/jats:bold>\n            We found 56 primary studies and characterized their contributions based on testing strategies, testing approaches, explored mobile platforms, and the proposed tools.\n          <\/jats:p>\n          <jats:p>\n            <jats:bold>Conclusions:<\/jats:bold>\n            The characterization allowed us to identify and discuss important trends and opportunities that can benefit both academics and practitioners.\n          <\/jats:p>","DOI":"10.1145\/3507903","type":"journal-article","created":{"date-parts":[[2022,1,12]],"date-time":"2022-01-12T15:49:51Z","timestamp":1642002591000},"page":"1-38","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":14,"title":["Dynamic Testing Techniques of Non-functional Requirements in Mobile Apps: A Systematic Mapping Study"],"prefix":"10.1145","volume":"54","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-9176-9314","authenticated-orcid":false,"given":"Misael C.","family":"J\u00fanior","sequence":"first","affiliation":[{"name":"Instituto de Ci\u00eancias Matem\u00e1ticas e de Computa\u00e7\u00e3o, Universidade de S\u00e3o Paulo,ICMC-USP, S\u00e3o Carlos, SP, Brazil"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4761-4443","authenticated-orcid":false,"given":"Domenico","family":"Amalfitano","sequence":"additional","affiliation":[{"name":"Department of Electrical Engineering and Information Technology,University of Naples Federico II, DIETI-UNINA, Napoli, Campania, Italy"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4990-6562","authenticated-orcid":false,"given":"Lina","family":"Garc\u00e9s","sequence":"additional","affiliation":[{"name":"Instituto de Ci\u00eancias Matem\u00e1ticas e de Computa\u00e7\u00e3o, Universidade de S\u00e3o Paulo,ICMC-USP, S\u00e3o Carlos, SP, Pinheirinho, Itajub\u00e1, MG, Brazil6"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7116-019X","authenticated-orcid":false,"given":"Anna Rita","family":"Fasolino","sequence":"additional","affiliation":[{"name":"Department of Electrical Engineering and Information Technology,University of Naples Federico II, DIETI-UNINA, Napoli, Campania, Italy"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1559-6789","authenticated-orcid":false,"given":"Stev\u00e3o A.","family":"Andrade","sequence":"additional","affiliation":[{"name":"Instituto de Ci\u00eancias Matem\u00e1ticas e deComputa\u00e7\u00e3o, Universidade de S\u00e3o Paulo, ICMC-USP, Brazil"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7535-5891","authenticated-orcid":false,"given":"M\u00e1rcio","family":"Delamaro","sequence":"additional","affiliation":[{"name":"Instituto de Ci\u00eancias Matem\u00e1ticas e deComputa\u00e7\u00e3o, Universidade de S\u00e3o Paulo, ICMC-USP, Brazil"}]}],"member":"320","published-online":{"date-parts":[[2022,9,13]]},"reference":[{"key":"e_1_3_3_2_2","doi-asserted-by":"publisher","DOI":"10.1145\/10.1109\/access.2018.2877395"},{"key":"e_1_3_3_3_2","doi-asserted-by":"publisher","DOI":"10.1145\/10.1007\/978-3-319-18344-2"},{"key":"e_1_3_3_4_2","doi-asserted-by":"publisher","DOI":"10.1145\/10.1109\/ACCESS.2019.2956770"},{"key":"e_1_3_3_5_2","doi-asserted-by":"publisher","DOI":"10.1145\/10.1186\/s13173-019-0093-7"},{"key":"e_1_3_3_6_2","doi-asserted-by":"publisher","DOI":"10.1145\/10.1109\/ICSME46990.2020.00109"},{"key":"e_1_3_3_7_2","doi-asserted-by":"publisher","DOI":"10.1145\/10.1109\/access.2020.2966522"},{"key":"e_1_3_3_8_2","doi-asserted-by":"publisher","DOI":"10.1145\/10.3390\/info10100326"},{"key":"e_1_3_3_9_2","doi-asserted-by":"publisher","DOI":"10.1145\/10.1016\/j.infsof.2018.10.006"},{"key":"e_1_3_3_10_2","doi-asserted-by":"publisher","DOI":"10.1145\/10.1109\/iwast.2013.6595792"},{"key":"e_1_3_3_11_2","doi-asserted-by":"publisher","DOI":"10.1145\/10.1109\/tse.2017.2689012"},{"key":"e_1_3_3_12_2","doi-asserted-by":"publisher","DOI":"10.1145\/10.1007\/978-3-030-19223-5_10"},{"key":"e_1_3_3_13_2","doi-asserted-by":"publisher","DOI":"10.1145\/10.1007\/978-3-030-03712-3_3"},{"key":"e_1_3_3_14_2","doi-asserted-by":"publisher","DOI":"10.1145\/10.1109\/hsi.2015.7170698"},{"key":"e_1_3_3_15_2","doi-asserted-by":"publisher","DOI":"10.5555\/2616205"},{"key":"e_1_3_3_16_2","doi-asserted-by":"publisher","DOI":"10.1145\/10.1145\/3293882.3330564"},{"key":"e_1_3_3_17_2","first-page":"528","article-title":"The goal question metric approach","volume":"2","author":"Caldiera Victor R. Basili, Gianluigi","year":"1994","unstructured":"Victor R. Basili, Gianluigi Caldiera, and H. Dieter Rombach. 1994. The goal question metric approach. Encyc. Softw. Eng.ineering 2 (1994), 528\u2013532.","journal-title":"Encyc. Softw. Eng.ineering"},{"key":"e_1_3_3_18_2","unstructured":"Melissa Chau and Ryan Reith. 2020. Smartphone Market Share. Retrieved from https:\/\/www.idc.com\/promo\/smartphone-market-share\/os."},{"key":"e_1_3_3_19_2","doi-asserted-by":"publisher","DOI":"10.1145\/10.1145\/2898459.2898460"},{"key":"e_1_3_3_20_2","doi-asserted-by":"publisher","DOI":"10.1145\/10.1145\/2901739.2901763"},{"key":"e_1_3_3_21_2","doi-asserted-by":"publisher","DOI":"10.1145\/10.1007\/978-3-319-58634-2_27"},{"key":"e_1_3_3_22_2","doi-asserted-by":"publisher","DOI":"10.1145\/10.1145\/3126594.3126647"},{"key":"e_1_3_3_23_2","volume-title":"Introduction to Software Testing (2nd ed.)","author":"Delamaro Marcio","year":"2016","unstructured":"Marcio Delamaro, Mario Jino, and Jose Maldonado. 2016. Introduction to Software Testing (2nd ed.). Elsevier Brasil."},{"key":"e_1_3_3_24_2","doi-asserted-by":"publisher","DOI":"10.1145\/10.1109\/ESEM.2007.59"},{"key":"e_1_3_3_25_2","doi-asserted-by":"publisher","DOI":"10.1145\/10.1155\/2017\/2012696"},{"key":"e_1_3_3_26_2","doi-asserted-by":"publisher","DOI":"10.1145\/10.1007\/978-3-319-67687-6_9"},{"key":"e_1_3_3_27_2","doi-asserted-by":"publisher","DOI":"10.1145\/10.1145\/2786567.2792902"},{"key":"e_1_3_3_28_2","unstructured":"International Organization for Standardization. 2013. ISO\/IEC\/IEEE International Standard\u2014Software and systems engineering \u2013 Software testing - -Part 2:Test processes. https:\/\/ieeexplore.ieee.org\/document\/6588543."},{"key":"e_1_3_3_29_2","doi-asserted-by":"publisher","DOI":"10.1145\/10.1145\/3106237.3106244"},{"key":"e_1_3_3_30_2","doi-asserted-by":"publisher","DOI":"10.1145\/10.1145\/2771783.2771800"},{"key":"e_1_3_3_31_2","doi-asserted-by":"publisher","DOI":"10.1145\/10.1109\/MS.2020.3042424"},{"key":"e_1_3_3_32_2","volume-title":"ISO\/IEC 9126-1, Software Engineering \u2013 Product Quality","year":"2001","unstructured":"ISO. 2001. ISO\/IEC 9126-1, Software Engineering \u2013 Product Quality. ISO, Geneva, Switzerland. https:\/\/www.iso.org\/standard\/22749.html."},{"key":"e_1_3_3_33_2","volume-title":"ISO\/IEC 25010:2011, Systems and software engineering \u2013 Systems and software Quality Requirements and Evaluation (SQuaRE) \u2013 System and software quality models","year":"2011","unstructured":"ISO. 2011. ISO\/IEC 25010:2011, Systems and software engineering \u2013 Systems and software Quality Requirements and Evaluation (SQuaRE) \u2013 System and software quality models. ISO, Geneva, Switzerland. https:\/\/www.semanticscholar.org\/paper\/ISO-%2F-IEC-25010-%3A-2011-Systems-and-software-%E2%80%94-and-%28\/ad7102b6bd0842fe1b46ce6a9246b1.f00f51948f."},{"key":"e_1_3_3_34_2","unstructured":"ISO. 2013. ISO\/IEC\/IEEE 29119-1: Software and systems engineering-Software testing-Part 1: Concepts and definitions. https:\/\/ieeexplore.ieee.org\/document\/6588537."},{"key":"e_1_3_3_35_2","doi-asserted-by":"publisher","DOI":"10.1145\/10.1109\/icse.2019.00115"},{"key":"e_1_3_3_36_2","doi-asserted-by":"publisher","DOI":"10.1145\/10.1145\/3106237.3106244"},{"key":"e_1_3_3_37_2","doi-asserted-by":"publisher","DOI":"10.1145\/10.1145\/3368089.3409677"},{"key":"e_1_3_3_38_2","doi-asserted-by":"publisher","DOI":"10.1145\/10.1002\/stvr.460"},{"key":"e_1_3_3_39_2","doi-asserted-by":"publisher","DOI":"10.1145\/10.1016\/j.ijhcs.2019.10.001"},{"key":"e_1_3_3_40_2","unstructured":"Misael Junior Domenico Amalfitano Lina Garc\u00e9s Stev\u00e3o Andrade and M\u00e1rcio Delamaro. 2021. Dataset on Dynamic Testing Techniques of Non-Functional Requirements on Mobile Applications. Retrieved from https:\/\/data.mendeley.com\/datasets\/gswvb2s2ht\/3."},{"key":"e_1_3_3_41_2","doi-asserted-by":"publisher","DOI":"10.1145\/10.1016\/j.jksuci.2018.11.002"},{"key":"e_1_3_3_42_2","doi-asserted-by":"publisher","DOI":"10.1145\/10.1145\/2896921.2896930"},{"key":"e_1_3_3_43_2","doi-asserted-by":"publisher","DOI":"10.1145\/10.1109\/icse.2019.00040"},{"key":"e_1_3_3_44_2","doi-asserted-by":"publisher","DOI":"10.1145\/10.1109\/ssiri.2009.28"},{"key":"e_1_3_3_45_2","doi-asserted-by":"publisher","DOI":"10.1145\/10.14236\/ewic\/EASE2010.4"},{"key":"e_1_3_3_46_2","unstructured":"B. Kitchenham and S. Charters. 2007. Guidelines for performing Systematic Literature Reviews in Software Engineering. https:\/\/www.bibsonomy.org\/bibtex\/23f4b30c0fe1435b642467af4cca120ef\/jpmor."},{"key":"e_1_3_3_47_2","doi-asserted-by":"publisher","DOI":"10.1145\/10.5220\/0004985101490156"},{"key":"e_1_3_3_48_2","doi-asserted-by":"publisher","DOI":"10.1145\/10.1109\/icstw.2015.7107459"},{"key":"e_1_3_3_49_2","doi-asserted-by":"publisher","DOI":"10.1109\/TR.2018.2865733"},{"key":"e_1_3_3_50_2","doi-asserted-by":"publisher","DOI":"10.1145\/10.1007\/978-3-642-34347-6_9"},{"key":"e_1_3_3_51_2","doi-asserted-by":"publisher","DOI":"10.1145\/10.1109\/apsec48747.2019.00030"},{"key":"e_1_3_3_52_2","doi-asserted-by":"publisher","DOI":"10.1145\/10.1155\/2016\/1740129"},{"key":"e_1_3_3_53_2","doi-asserted-by":"publisher","DOI":"10.1145\/10.1145\/2428955.2428983"},{"key":"e_1_3_3_54_2","doi-asserted-by":"publisher","DOI":"10.1145\/10.1145\/3395363.3397350"},{"key":"e_1_3_3_55_2","doi-asserted-by":"publisher","DOI":"10.1145\/10.1007\/978-3-030-03638-6_4"},{"key":"e_1_3_3_56_2","doi-asserted-by":"publisher","DOI":"10.1145\/10.1109\/ICEI.2019.00072"},{"key":"e_1_3_3_57_2","doi-asserted-by":"publisher","DOI":"10.1145\/10.1007\/s11042-018-6268-y"},{"key":"e_1_3_3_58_2","doi-asserted-by":"publisher","DOI":"10.1145\/10.1007\/s11432-017-9400-y"},{"key":"e_1_3_3_59_2","doi-asserted-by":"publisher","DOI":"10.1145\/10.1007\/s11280-017-0458-9"},{"key":"e_1_3_3_60_2","doi-asserted-by":"publisher","DOI":"10.1145\/10.1145\/3372788"},{"key":"e_1_3_3_61_2","doi-asserted-by":"publisher","DOI":"10.1145\/10.1007\/s11036-012-0421-z"},{"key":"e_1_3_3_62_2","doi-asserted-by":"publisher","DOI":"10.1145\/10.18489\/sacj.v30i1.511"},{"key":"e_1_3_3_63_2","first-page":"1","volume-title":"Proceedings of the 28th Ibero-American Conference on Software Engineering (CIBSE\u201915)","author":"Porras Abel M\u00e9ndez","year":"2015","unstructured":"Abel M\u00e9ndez Porras, Christian Ulises Quesada L\u00f3pez, and Marcelo Jenkins Coronas. 2015. Automated testing of mobile applications: A systematic map and review. In Proceedings of the 28th Ibero-American Conference on Software Engineering (CIBSE\u201915). 1\u201314."},{"key":"e_1_3_3_64_2","doi-asserted-by":"publisher","DOI":"10.1109\/IWAST.2012.6228987"},{"key":"e_1_3_3_65_2","volume-title":"The Art of Software Testing (3rd ed.)","author":"Myers Glenford J.","year":"2011","unstructured":"Glenford J. Myers, Corey Sandler, and Tom Badgett. 2011. The Art of Software Testing (3rd ed.). Wiley Publishing, New York, NY."},{"key":"e_1_3_3_66_2","doi-asserted-by":"publisher","DOI":"10.1145\/10.1145\/2593501.2593504"},{"key":"e_1_3_3_67_2","unstructured":"Simon O\u2019Dea. 2020. Smartphone users worldwide 2016\u20132021. Retrieved from https:\/\/www.statista.com\/statistics\/330695\/number-of-smartphone-users-worldwide\/."},{"key":"e_1_3_3_68_2","doi-asserted-by":"publisher","DOI":"10.1145\/10.1016\/j.infsof.2015.03.007"},{"key":"e_1_3_3_69_2","volume-title":"Software Engineering: A Practitioner\u2019s Approach (9th ed.)","author":"Pressman Roger","year":"2016","unstructured":"Roger Pressman. 2016. Software Engineering: A Practitioner\u2019s Approach (9th ed.). McGraw-Hill, Inc., USA."},{"key":"e_1_3_3_70_2","doi-asserted-by":"publisher","DOI":"10.1145\/10.1109\/siet.2017.8304131"},{"key":"e_1_3_3_71_2","doi-asserted-by":"publisher","DOI":"10.1145\/10.1145\/2435349.2435379"},{"key":"e_1_3_3_72_2","doi-asserted-by":"publisher","DOI":"10.1145\/10.1007\/978-3-319-21413-9_11"},{"key":"e_1_3_3_73_2","doi-asserted-by":"publisher","DOI":"10.1145\/10.1007\/s10009-014-0303-8"},{"key":"e_1_3_3_74_2","doi-asserted-by":"publisher","DOI":"10.1145\/10.1145\/3376123"},{"key":"e_1_3_3_75_2","doi-asserted-by":"publisher","DOI":"10.1145\/10.1109\/hase.2014.32"},{"key":"e_1_3_3_76_2","doi-asserted-by":"publisher","DOI":"10.1145\/10.1145\/3321705.3329801"},{"key":"e_1_3_3_77_2","doi-asserted-by":"publisher","DOI":"10.1145\/10.1109\/seeda-cecnsm49515.2020.9221828"},{"key":"e_1_3_3_78_2","volume-title":"Software Engineering (9th ed.)","author":"Sommerville Ian","year":"2011","unstructured":"Ian Sommerville. 2011. Software Engineering (9th ed.). Addison-Wesley Publishing Company, USA."},{"key":"e_1_3_3_79_2","doi-asserted-by":"publisher","DOI":"10.1145\/10.1007\/978-3-319-08964-5_4"},{"key":"e_1_3_3_80_2","doi-asserted-by":"publisher","DOI":"10.1145\/10.1109\/qomex.2018.8463419"},{"key":"e_1_3_3_81_2","doi-asserted-by":"publisher","DOI":"10.1145\/10.1007\/s11219-018-9418-6"},{"key":"e_1_3_3_82_2","doi-asserted-by":"publisher","DOI":"10.1145\/10.1002\/smr.2215"},{"key":"e_1_3_3_83_2","doi-asserted-by":"publisher","DOI":"10.1145\/10.1109\/eurospw.2018.00008"},{"key":"e_1_3_3_84_2","doi-asserted-by":"publisher","DOI":"10.1145\/10.1109\/ICST.2015.7102585"},{"key":"e_1_3_3_85_2","doi-asserted-by":"publisher","DOI":"10.1145\/10.1016\/j.jss.2020.110609"},{"key":"e_1_3_3_86_2","doi-asserted-by":"publisher","DOI":"10.1145\/10.1145\/2590296.2590316"},{"key":"e_1_3_3_87_2","doi-asserted-by":"publisher","DOI":"10.1145\/10.32890\/jict2019.18.4.5"},{"key":"e_1_3_3_88_2","doi-asserted-by":"publisher","DOI":"10.1145\/10.1109\/ICSE43902.2021.00139"},{"key":"e_1_3_3_89_2","doi-asserted-by":"publisher","DOI":"10.1145\/10.1007\/978-981-10-3256-1_7"},{"key":"e_1_3_3_90_2","doi-asserted-by":"publisher","DOI":"10.1145\/10.1016\/j.jss.2016.03.065"},{"key":"e_1_3_3_91_2","doi-asserted-by":"publisher","DOI":"10.1145\/10.1145\/2896921.2896932"},{"key":"e_1_3_3_92_2","doi-asserted-by":"publisher","DOI":"10.1145\/10.1109\/sose.2015.35"},{"key":"e_1_3_3_93_2","doi-asserted-by":"publisher","DOI":"10.1145\/10.1109\/access.2019.2925350"}],"container-title":["ACM Computing Surveys"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3507903","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3507903","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T18:10:16Z","timestamp":1750183816000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3507903"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,1,31]]},"references-count":92,"journal-issue":{"issue":"10s","published-print":{"date-parts":[[2022,1,31]]}},"alternative-id":["10.1145\/3507903"],"URL":"https:\/\/doi.org\/10.1145\/3507903","relation":{},"ISSN":["0360-0300","1557-7341"],"issn-type":[{"value":"0360-0300","type":"print"},{"value":"1557-7341","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,1,31]]},"assertion":[{"value":"2021-01-28","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-12-20","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2022-09-13","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}