{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,9,10]],"date-time":"2025-09-10T22:26:19Z","timestamp":1757543179117,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":33,"publisher":"ACM","license":[{"start":{"date-parts":[[2021,6,21]],"date-time":"2021-06-21T00:00:00Z","timestamp":1624233600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2021,6,21]]},"DOI":"10.1145\/3463274.3463318","type":"proceedings-article","created":{"date-parts":[[2021,6,18]],"date-time":"2021-06-18T23:43:11Z","timestamp":1624059791000},"page":"191-200","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":2,"title":["Measurement-based Experiments on the Mobile Web: A Systematic Mapping Study"],"prefix":"10.1145","author":[{"given":"Omar","family":"De Munk","sequence":"first","affiliation":[{"name":"Vrije Universiteit Amsterdam, Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ivano","family":"Malavolta","sequence":"additional","affiliation":[{"name":"Vrije Universiteit Amsterdam, Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2021,6,21]]},"reference":[{"key":"e_1_3_2_2_1_1","volume-title":"An energy efficiency study of web-based communication in android phones. Scientific Programming 2019","author":"Ayala Inmaculada","year":"2019","unstructured":"Inmaculada Ayala , Mercedes Amor , and Lidia Fuentes . 2019. An energy efficiency study of web-based communication in android phones. Scientific Programming 2019 ( 2019 ). Inmaculada Ayala, Mercedes Amor, and Lidia Fuentes. 2019. An energy efficiency study of web-based communication in android phones. Scientific Programming 2019 (2019)."},{"volume-title":"3rd Intl Conf on Big Data Intelligence and Computing and Cyber Science and Technology Congress (DASC\/PiCom\/DataCom\/CyberSciTech)","author":"Ayala Inmaculada","key":"e_1_3_2_2_2_1","unstructured":"Inmaculada Ayala , Mercedes Amor , Lidia Fuentes , and Daniel Munoz . 2017. An empirical study of power consumption of web-based communications in mobile phones. In 2017 IEEE 15th Intl Conf on Dependable, Autonomic and Secure Computing, 15th Intl Conf on Pervasive Intelligence and Computing , 3rd Intl Conf on Big Data Intelligence and Computing and Cyber Science and Technology Congress (DASC\/PiCom\/DataCom\/CyberSciTech) . IEEE , 861\u2013866. Inmaculada Ayala, Mercedes Amor, Lidia Fuentes, and Daniel Munoz. 2017. An empirical study of power consumption of web-based communications in mobile phones. In 2017 IEEE 15th Intl Conf on Dependable, Autonomic and Secure Computing, 15th Intl Conf on Pervasive Intelligence and Computing, 3rd Intl Conf on Big Data Intelligence and Computing and Cyber Science and Technology Congress (DASC\/PiCom\/DataCom\/CyberSciTech). IEEE, 861\u2013866."},{"key":"e_1_3_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.1109\/MS.2020.2994306"},{"key":"e_1_3_2_2_4_1","doi-asserted-by":"publisher","DOI":"10.1093\/imaman\/dpw003"},{"key":"e_1_3_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.1098\/rsos.140216"},{"key":"e_1_3_2_2_6_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.infsof.2011.01.004"},{"volume-title":"Primer on Client-Side Web Security","author":"De\u00a0Ryck Philippe","key":"e_1_3_2_2_7_1","unstructured":"Philippe De\u00a0Ryck , Lieven Desmet , Frank Piessens , and Martin Johns . 2014. The Browser as a Platform . In Primer on Client-Side Web Security . Springer , 25\u201332. Philippe De\u00a0Ryck, Lieven Desmet, Frank Piessens, and Martin Johns. 2014. The Browser as a Platform. In Primer on Client-Side Web Security. Springer, 25\u201332."},{"key":"e_1_3_2_2_8_1","volume-title":"English as the universal language of science: opportunities and challenges. Molecular biology of the cell 23, 8","author":"Drubin G","year":"2012","unstructured":"David\u00a0 G Drubin and Douglas\u00a0 R Kellogg . 2012. English as the universal language of science: opportunities and challenges. Molecular biology of the cell 23, 8 ( 2012 ), 1399\u20131399. David\u00a0G Drubin and Douglas\u00a0R Kellogg. 2012. English as the universal language of science: opportunities and challenges. Molecular biology of the cell 23, 8 (2012), 1399\u20131399."},{"key":"e_1_3_2_2_9_1","volume-title":"How one second could cost amazon $1.6 billion in sales","author":"Eaton Kit","year":"2012","unstructured":"Kit Eaton . 2012. How one second could cost amazon $1.6 billion in sales . Fast Company 14( 2012 ). Kit Eaton. 2012. How one second could cost amazon $1.6 billion in sales. Fast Company 14(2012)."},{"key":"e_1_3_2_2_10_1","doi-asserted-by":"publisher","DOI":"10.5195\/jmla.2017.88"},{"key":"e_1_3_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11192-018-2958-5"},{"key":"e_1_3_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1109\/GLOCOMW.2013.6825149"},{"key":"e_1_3_2_2_13_1","doi-asserted-by":"crossref","unstructured":"B Kitchenham and P Brereton. 2013. A systematic review of systematic review process research in software engineering. (2013).  B Kitchenham and P Brereton. 2013. A systematic review of systematic review process research in software engineering. (2013).","DOI":"10.1016\/j.infsof.2013.07.010"},{"key":"e_1_3_2_2_14_1","volume-title":"A systematic review of systematic review process research in software engineering. Information and software technology 55, 12","author":"Kitchenham Barbara","year":"2013","unstructured":"Barbara Kitchenham and Pearl Brereton . 2013. A systematic review of systematic review process research in software engineering. Information and software technology 55, 12 ( 2013 ), 2049\u20132075. Barbara Kitchenham and Pearl Brereton. 2013. A systematic review of systematic review process research in software engineering. Information and software technology 55, 12 (2013), 2049\u20132075."},{"key":"e_1_3_2_2_16_1","doi-asserted-by":"publisher","DOI":"10.1109\/TMC.2015.2489202"},{"key":"e_1_3_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/2736277.2741114"},{"key":"e_1_3_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/2677832.2677843"},{"volume-title":"35th IEEE\/ACM International Conference on Automated Software Engineering Workshops (ASEW-20)","author":"Malavolta Ivano","key":"e_1_3_2_2_19_1","unstructured":"Ivano Malavolta , Eoin\u00a0Martino Grua , Cheng-Yu Lam , Randy de Vries , Franky Tan , Eric Zielinski , Michael Peters , and Luuk Kaandorp . [n.d.]. A Framework for the Automatic Execution of Measurement-based Experiments on Android Devices . In 35th IEEE\/ACM International Conference on Automated Software Engineering Workshops (ASEW-20) . 61\u201366. Ivano Malavolta, Eoin\u00a0Martino Grua, Cheng-Yu Lam, Randy de Vries, Franky Tan, Eric Zielinski, Michael Peters, and Luuk Kaandorp. [n.d.]. A Framework for the Automatic Execution of Measurement-based Experiments on Android Devices. In 35th IEEE\/ACM International Conference on Automated Software Engineering Workshops (ASEW-20). 61\u201366."},{"key":"e_1_3_2_2_20_1","volume-title":"Abandon statistical significance. The American Statistician 73, sup1","author":"McShane B","year":"2019","unstructured":"Blakeley\u00a0 B McShane , David Gal , Andrew Gelman , Christian Robert , and Jennifer\u00a0 L Tackett . 2019. Abandon statistical significance. The American Statistician 73, sup1 ( 2019 ), 235\u2013245. Blakeley\u00a0B McShane, David Gal, Andrew Gelman, Christian Robert, and Jennifer\u00a0L Tackett. 2019. Abandon statistical significance. The American Statistician 73, sup1 (2019), 235\u2013245."},{"key":"e_1_3_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.infsof.2015.03.007"},{"key":"e_1_3_2_2_22_1","doi-asserted-by":"crossref","unstructured":"K Peterson S Vakkalanka and L Kuzniarz. 2015. Guidelines for conducting systematic mapping studies in software engineering: An update. (2015).  K Peterson S Vakkalanka and L Kuzniarz. 2015. Guidelines for conducting systematic mapping studies in software engineering: An update. (2015).","DOI":"10.1016\/j.infsof.2015.03.007"},{"key":"e_1_3_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/3154384"},{"key":"e_1_3_2_2_24_1","unstructured":"Victor\u00a0Le Pochat Tom van Goethem and Wouter Joosen. 2018. Rigging Research Results by Manipulating Top Websites Rankings. CoRR abs\/1806.01156(2018). arxiv:1806.01156http:\/\/arxiv.org\/abs\/1806.01156  Victor\u00a0Le Pochat Tom van Goethem and Wouter Joosen. 2018. Rigging Research Results by Manipulating Top Websites Rankings. CoRR abs\/1806.01156(2018). arxiv:1806.01156http:\/\/arxiv.org\/abs\/1806.01156"},{"key":"e_1_3_2_2_25_1","volume-title":"Tranco: A research-oriented top sites ranking hardened against manipulation. arXiv preprint arXiv:1806.01156(2018).","author":"Pochat Victor\u00a0Le","year":"2018","unstructured":"Victor\u00a0Le Pochat , Tom Van\u00a0Goethem , Samaneh Tajalizadehkhoob , Maciej Korczy\u0144ski , and Wouter Joosen . 2018 . Tranco: A research-oriented top sites ranking hardened against manipulation. arXiv preprint arXiv:1806.01156(2018). Victor\u00a0Le Pochat, Tom Van\u00a0Goethem, Samaneh Tajalizadehkhoob, Maciej Korczy\u0144ski, and Wouter Joosen. 2018. Tranco: A research-oriented top sites ranking hardened against manipulation. arXiv preprint arXiv:1806.01156(2018)."},{"key":"e_1_3_2_2_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/3431832.3431837"},{"key":"e_1_3_2_2_27_1","volume-title":"Reproducibility and research integrity. Accountability in research 24, 2","author":"Resnik B","year":"2017","unstructured":"David\u00a0 B Resnik and Adil\u00a0 E Shamoo . 2017. Reproducibility and research integrity. Accountability in research 24, 2 ( 2017 ), 116\u2013123. David\u00a0B Resnik and Adil\u00a0E Shamoo. 2017. Reproducibility and research integrity. Accountability in research 24, 2 (2017), 116\u2013123."},{"volume-title":"Desktop vs Mobile vs Tablet Market Share Worldwide","year":"2015","key":"e_1_3_2_2_29_1","unstructured":"StatCounter. [n.d.]. Desktop vs Mobile vs Tablet Market Share Worldwide Nov 2015 - Nov 2020. https:\/\/gs.statcounter.com\/platform-market-share\/desktop-mobile-tablet\/worldwide\/monthly-201511-202011 Accessed: 2020-12-15. StatCounter. [n.d.]. Desktop vs Mobile vs Tablet Market Share Worldwide Nov 2015 - Nov 2020. https:\/\/gs.statcounter.com\/platform-market-share\/desktop-mobile-tablet\/worldwide\/monthly-201511-202011 Accessed: 2020-12-15."},{"volume-title":"Mobile Operating System Market Share Worldwide","year":"2020","key":"e_1_3_2_2_30_1","unstructured":"StatCounter. [n.d.]. Mobile Operating System Market Share Worldwide Nov 2020 . https:\/\/gs.statcounter.com\/os-market-share\/mobile\/worldwide. Accessed : 2020-12-18. StatCounter. [n.d.]. Mobile Operating System Market Share Worldwide Nov 2020. https:\/\/gs.statcounter.com\/os-market-share\/mobile\/worldwide. Accessed: 2020-12-18."},{"key":"e_1_3_2_2_31_1","doi-asserted-by":"crossref","unstructured":"Victoria Stodden. 2010. The scientific method in practice: Reproducibility in the computational sciences. (2010).  Victoria Stodden. 2010. The scientific method in practice: Reproducibility in the computational sciences. (2010).","DOI":"10.2139\/ssrn.1550193"},{"key":"e_1_3_2_2_32_1","doi-asserted-by":"publisher","DOI":"10.4300\/JGME-D-12-00156.1"},{"key":"e_1_3_2_2_33_1","volume-title":"2016 USENIX Annual Technical Conference (USENIX ATC 16)","author":"Vesuna Jamshed","year":"2016","unstructured":"Jamshed Vesuna , Colin Scott , Michael Buettner , Michael Piatek , Arvind Krishnamurthy , and Scott Shenker . 2016 . Caching doesn\u2019t improve mobile web performance (much) . In 2016 USENIX Annual Technical Conference (USENIX ATC 16) . 159\u2013165. Jamshed Vesuna, Colin Scott, Michael Buettner, Michael Piatek, Arvind Krishnamurthy, and Scott Shenker. 2016. Caching doesn\u2019t improve mobile web performance (much). In 2016 USENIX Annual Technical Conference (USENIX ATC 16). 159\u2013165."},{"key":"e_1_3_2_2_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/2601248.2601268"},{"key":"e_1_3_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4615-4625-2"}],"event":{"name":"EASE 2021: Evaluation and Assessment in Software Engineering","acronym":"EASE 2021","location":"Trondheim Norway"},"container-title":["Evaluation and Assessment in Software Engineering"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3463274.3463318","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3463274.3463318","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T21:31:27Z","timestamp":1750195887000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3463274.3463318"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,6,21]]},"references-count":33,"alternative-id":["10.1145\/3463274.3463318","10.1145\/3463274"],"URL":"https:\/\/doi.org\/10.1145\/3463274.3463318","relation":{},"subject":[],"published":{"date-parts":[[2021,6,21]]},"assertion":[{"value":"2021-06-21","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}