{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T04:28:16Z","timestamp":1750220896381,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":90,"publisher":"ACM","license":[{"start":{"date-parts":[[2019,10,22]],"date-time":"2019-10-22T00:00:00Z","timestamp":1571702400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2019,10,22]]},"DOI":"10.1145\/3357155.3358449","type":"proceedings-article","created":{"date-parts":[[2019,10,7]],"date-time":"2019-10-07T12:21:06Z","timestamp":1570450866000},"page":"1-13","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":5,"title":["What are we talking about when we talk about location-based games evaluation?"],"prefix":"10.1145","author":[{"given":"Nayana","family":"Carneiro","sequence":"first","affiliation":[{"name":"Universidade Federal do Cear\u00e1, Fortaleza, Cear\u00e1, Brasil"}]},{"given":"Ticianne","family":"Darin","sequence":"additional","affiliation":[{"name":"Universidade Federal do Cear\u00e1, Fortaleza, Brazil"}]},{"given":"Windson","family":"Viana","sequence":"additional","affiliation":[{"name":"Universidade Federal do Cear\u00e1, Fortaleza, Cear\u00e1, Brazil"}]}],"member":"320","published-online":{"date-parts":[[2019,10,22]]},"reference":[{"key":"e_1_3_2_1_1_1","doi-asserted-by":"crossref","unstructured":"Ola Ahlqvist. 2018. Location-Based Games. International Encyclopedia of Geography: People the Earth Environment and Technology (2018) 1--6.  Ola Ahlqvist. 2018. Location-Based Games. International Encyclopedia of Geography: People the Earth Environment and Technology (2018) 1--6.","DOI":"10.1002\/9781118786352.wbieg0298.pub2"},{"key":"e_1_3_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/2836041.2836047"},{"key":"e_1_3_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/3116595.3116614"},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/2914920.2915011"},{"key":"e_1_3_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-58637-3_27"},{"key":"e_1_3_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.5555\/1151758.1151759"},{"volume-title":"Proceedings of the 7th Annual International Workshop on PRESENCE. 1864--1105","year":"2004","author":"Bailenson Jeremy N","key":"e_1_3_2_1_7_1"},{"key":"e_1_3_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1007\/s12193-010-0039-z"},{"key":"e_1_3_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-79576-6_15"},{"key":"e_1_3_2_1_10_1","volume-title":"European Conference on Games Based Learning","volume":"1","author":"Beg Imran","year":"2014"},{"key":"e_1_3_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/1143518.1143522"},{"key":"e_1_3_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/1823818.1823822"},{"key":"e_1_3_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/2317956.2318064"},{"key":"e_1_3_2_1_14_1","unstructured":"John Brooke et al. 1996. SUS-A quick and dirty usability scale. Usability evaluation in industry 189 194 (1996) 4--7.  John Brooke et al. 1996. SUS-A quick and dirty usability scale. Usability evaluation in industry 189 194 (1996) 4--7."},{"key":"e_1_3_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/2071423.2071483"},{"key":"e_1_3_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.chb.2015.01.066"},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/1868914.1868929"},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/1389908.1389942"},{"key":"e_1_3_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1109\/MELCON.2016.7495414"},{"key":"e_1_3_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-31037-9_4"},{"key":"e_1_3_2_1_21_1","unstructured":"John W Creswell and J David Creswell. 2017. Research design: Qualitative quantitative and mixed methods approaches. Sage publications.  John W Creswell and J David Creswell. 2017. Research design: Qualitative quantitative and mixed methods approaches. Sage publications."},{"volume-title":"Supporting Decision-Making About the Evaluation of User Experience. In International Conference on Human-Computer Interaction. Springer, 49--67","year":"2019","author":"Darin Ticianne","key":"e_1_3_2_1_22_1"},{"key":"e_1_3_2_1_23_1","unstructured":"Adriana De Souza e Silva and Daniel M Sutko. 2009. Digital cityscapes: Merging digital and urban playspaces.  Adriana De Souza e Silva and Daniel M Sutko. 2009. Digital cityscapes: Merging digital and urban playspaces."},{"key":"e_1_3_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1468-2885.2010.01374.x"},{"key":"e_1_3_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00779-010-0304-x"},{"key":"e_1_3_2_1_26_1","doi-asserted-by":"crossref","unstructured":"Anders Drachen Pejman Mirza-Babaei and Lennart E Nacke. 2018. Games user research. Oxford University Press.  Anders Drachen Pejman Mirza-Babaei and Lennart E Nacke. 2018. Games user research. Oxford University Press.","DOI":"10.1145\/3270316.3271548"},{"volume-title":"Proceedings of the 2nd audio mostly conference. 148--153","year":"2007","author":"Ekman Inger","key":"e_1_3_2_1_27_1"},{"key":"e_1_3_2_1_28_1","unstructured":"Sandra Fabbri Elis Montoro Hernandes Andr\u00e9 Di Thommazo Anderson Belgamo Augusto Zamboni and Cleiton Silva. 2012. Managing Literature Reviews Information through Visualization.. In ICEIS (2). 36--45.  Sandra Fabbri Elis Montoro Hernandes Andr\u00e9 Di Thommazo Anderson Belgamo Augusto Zamboni and Cleiton Silva. 2012. Managing Literature Reviews Information through Visualization.. In ICEIS (2). 36--45."},{"key":"e_1_3_2_1_29_1","doi-asserted-by":"crossref","unstructured":"Marsha E Fonteyn Benjamin Kuipers and Susan J Grobe. 1993. A description of think aloud method and protocol analysis. Qualitative health research 3 4 (1993) 430--441.  Marsha E Fonteyn Benjamin Kuipers and Susan J Grobe. 1993. A description of think aloud method and protocol analysis. Qualitative health research 3 4 (1993) 430--441.","DOI":"10.1177\/104973239300300403"},{"key":"e_1_3_2_1_30_1","first-page":"56","article-title":"O-Mopsi: Mobile orienteering game for sightseeing, exercising, and education","volume":"13","author":"Fr\u00e4nti Pasi","year":"2017","journal-title":"ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM)"},{"key":"e_1_3_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/2967934.2968087"},{"key":"e_1_3_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290688.3290747"},{"key":"e_1_3_2_1_33_1","unstructured":"WA IJsselsteijn YAW De Kort and Karolien Poels. 2013. The game experience questionnaire. Eindhoven: Technische Universiteit Eindhoven (2013).  WA IJsselsteijn YAW De Kort and Karolien Poels. 2013. The game experience questionnaire. Eindhoven: Technische Universiteit Eindhoven (2013)."},{"key":"e_1_3_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICIW.2008.54"},{"key":"e_1_3_2_1_35_1","first-page":"3","article-title":"User-Generated Content in Pervasive Games","volume":"16","author":"Kasapakis Vlasios","year":"2017","journal-title":"Computers in Entertainment (CIE)"},{"key":"e_1_3_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10055-017-0328-x"},{"volume-title":"4th International Conference on Pervasive Computing. 183--190","year":"2006","author":"Kiefer Peter","key":"e_1_3_2_1_37_1"},{"key":"e_1_3_2_1_38_1","unstructured":"Sung Lae Kim Hae Jung Suk Jeong Hwa Kang Jun Mo Jung Teemu H Laine and Joonas Westlin. 2014. Using Unity 3D to facilitate mobile augmented reality game development. In 2014 IEEE World Forum on Internet of Things (WF-IoT). IEEE 21--26.  Sung Lae Kim Hae Jung Suk Jeong Hwa Kang Jun Mo Jung Teemu H Laine and Joonas Westlin. 2014. Using Unity 3D to facilitate mobile augmented reality game development. In 2014 IEEE World Forum on Internet of Things (WF-IoT). IEEE 21--26."},{"key":"e_1_3_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00779-011-0423-z"},{"key":"e_1_3_2_1_40_1","doi-asserted-by":"crossref","unstructured":"Barbara Kitchenham O Pearl Brereton David Budgen Mark Turner John Bailey and Stephen Linkman. 2009. Systematic literature reviews in software engineering-a systematic literature review. Information and software technology 51 1 (2009) 7--15.  Barbara Kitchenham O Pearl Brereton David Budgen Mark Turner John Bailey and Stephen Linkman. 2009. Systematic literature reviews in software engineering-a systematic literature review. Information and software technology 51 1 (2009) 7--15.","DOI":"10.1016\/j.infsof.2008.09.009"},{"key":"e_1_3_2_1_41_1","first-page":"25","article-title":"The value of mapping studies-A participant-observer case study","volume":"10","author":"Kitchenham Barbara A","year":"2010","journal-title":"EASE"},{"key":"e_1_3_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1117\/12.596686"},{"key":"e_1_3_2_1_43_1","unstructured":"Madison W Klarkowski. 2017. The psychophysiological evaluation of the player experience. Ph.D. Dissertation. Queensland University of Technology.  Madison W Klarkowski. 2017. The psychophysiological evaluation of the player experience. Ph.D. Dissertation. Queensland University of Technology."},{"key":"e_1_3_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/2071423.2071463"},{"key":"e_1_3_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1145\/3121283.3121288"},{"volume-title":"Evaluating user experience in games","author":"Lankes Michael","key":"e_1_3_2_1_46_1"},{"key":"e_1_3_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-40621-3_28"},{"key":"e_1_3_2_1_48_1","unstructured":"Jonathan Lazar Jinjuan Heidi Feng and Harry Hochheiser. 2017. Research methods in human-computer interaction. Morgan Kaufmann.  Jonathan Lazar Jinjuan Heidi Feng and Harry Hochheiser. 2017. Research methods in human-computer interaction. Morgan Kaufmann."},{"key":"e_1_3_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00779-015-0843-2"},{"key":"e_1_3_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1145\/2371456.2371460"},{"key":"e_1_3_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1145\/1236224.1236237"},{"key":"e_1_3_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-03161-3_9"},{"key":"e_1_3_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1145\/2018556.2018558"},{"volume-title":"LAGARTO: A LocAtion based Games AuthoRing TOol enhanced with augmented reality features. Entertainment computing 22","year":"2017","author":"Maia Lu\u00eds Fernando","key":"e_1_3_2_1_54_1"},{"key":"e_1_3_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1109\/CIG.2017.8080438"},{"key":"e_1_3_2_1_56_1","first-page":"157","article-title":"Experiences of evaluating presence in augmented realities","volume":"6","author":"McCall Roderick","year":"2008","journal-title":"Psychnology"},{"key":"e_1_3_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00779-010-0306-8"},{"key":"e_1_3_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.1145\/3116595.3116598"},{"key":"e_1_3_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.1145\/1690388.1690402"},{"key":"e_1_3_2_1_60_1","doi-asserted-by":"crossref","unstructured":"Peter Mozelius Jimmy Jaldemark Sofia Eriksson Bergstr\u00f6m and Marcus Sundgren. 2019. Augmented Education: Location-Based Games for Real-World Teaching and Learning Sessions. In Augmented Reality Games I. Springer 217--235.  Peter Mozelius Jimmy Jaldemark Sofia Eriksson Bergstr\u00f6m and Marcus Sundgren. 2019. Augmented Education: Location-Based Games for Real-World Teaching and Learning Sessions. In Augmented Reality Games I. Springer 217--235.","DOI":"10.1007\/978-3-030-15616-9_14"},{"volume-title":"Proceedings of digra 2009: Breaking new ground: Innovation in games, play, practice and theory. DiGRA.","year":"2009","author":"Nacke Lennart","key":"e_1_3_2_1_61_1"},{"volume-title":"Proceedings of the Entertainment Interfaces Track 2010 Interaktive Kulturen, 12--15","year":"2010","author":"Nacke Lennart","key":"e_1_3_2_1_62_1"},{"key":"e_1_3_2_1_63_1","first-page":"56","article-title":"Applying seamful design in location-based mobile museum applications","volume":"12","author":"Nilsson Tommy","year":"2016","journal-title":"ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM)"},{"volume-title":"Eat-A Toolbox for Educational Location-Based Games. In International Conference on Advances in Computer Entertainment. Springer, 774--794","year":"2017","author":"Oppermann Leif","key":"e_1_3_2_1_64_1"},{"key":"e_1_3_2_1_65_1","doi-asserted-by":"publisher","DOI":"10.1145\/3025453.3025871"},{"volume-title":"40th AES Conference: Spatial Audio","year":"2010","author":"Paterson N","key":"e_1_3_2_1_66_1"},{"key":"e_1_3_2_1_67_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.infsof.2015.03.007"},{"key":"e_1_3_2_1_68_1","doi-asserted-by":"crossref","unstructured":"Giani Petri and Christiane Gresse von Wangenheim. 2017. How games for computing education are evaluated? A systematic literature review. Computers & education 107 (2017) 68--90.  Giani Petri and Christiane Gresse von Wangenheim. 2017. How games for computing education are evaluated? A systematic literature review. Computers & education 107 (2017) 68--90.","DOI":"10.1016\/j.compedu.2017.01.004"},{"key":"e_1_3_2_1_69_1","doi-asserted-by":"crossref","unstructured":"Yen Lina Prasetio Rendy Wijaya Michael Pratama Sjah Michael Ryan Christian and Andry Chowanda. 2017. Location-based game to enhance player's experience in survival horror game. Procedia computer science 116 (2017) 206--213.  Yen Lina Prasetio Rendy Wijaya Michael Pratama Sjah Michael Ryan Christian and Andry Chowanda. 2017. Location-based game to enhance player's experience in survival horror game. Procedia computer science 116 (2017) 206--213.","DOI":"10.1016\/j.procs.2017.10.037"},{"key":"e_1_3_2_1_70_1","doi-asserted-by":"crossref","unstructured":"Aung Pyae Luimula Mika and Jouni Smed. 2017. Understanding Players' Experiences in Location-based Augmented Reality Mobile Games: A Case of Pok\u00e9mon Go. In Extended Abstracts Publication of the Annual Symposium on Computer-Human Interaction in Play. ACM 535--541.  Aung Pyae Luimula Mika and Jouni Smed. 2017. Understanding Players' Experiences in Location-based Augmented Reality Mobile Games: A Case of Pok\u00e9mon Go. In Extended Abstracts Publication of the Annual Symposium on Computer-Human Interaction in Play. ACM 535--541.","DOI":"10.1145\/3130859.3131322"},{"key":"e_1_3_2_1_71_1","doi-asserted-by":"publisher","DOI":"10.1109\/GAMEPEC.2015.7331850"},{"key":"e_1_3_2_1_72_1","unstructured":"Yvonne Rogers Jenny Preece and Helen Sharp. 2011. Interaction design: beyond human-computer interaction. (2011).  Yvonne Rogers Jenny Preece and Helen Sharp. 2011. Interaction design: beyond human-computer interaction. (2011)."},{"key":"e_1_3_2_1_73_1","doi-asserted-by":"publisher","DOI":"10.1080\/0144929X.2012.710648"},{"key":"e_1_3_2_1_74_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-21741-8_48"},{"key":"e_1_3_2_1_75_1","doi-asserted-by":"publisher","DOI":"10.1109\/VS-GAMES.2017.8056574"},{"key":"e_1_3_2_1_76_1","doi-asserted-by":"publisher","DOI":"10.1155\/2016\/7690754"},{"key":"e_1_3_2_1_77_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00779-015-0845-0"},{"key":"e_1_3_2_1_78_1","unstructured":"Steven F. Stemler. 2004. A comparison of consensus consistency and measurement approaches to estimating interrater reliability. Practical assessment research & evaluation 9 4 (2004) 1--19.  Steven F. Stemler. 2004. A comparison of consensus consistency and measurement approaches to estimating interrater reliability. Practical assessment research & evaluation 9 4 (2004) 1--19."},{"key":"e_1_3_2_1_79_1","unstructured":"James Stewart Lizzy Bleumers Jan Van Looy Ilse Mari\u00ebn Anissa All Dana Schurmans Koen Willaert Frederik De Grove An Jacobs and Gianluca Misuraca. 2013. The potential of digital games for empowerment and social inclusion of groups at risk of social and economic exclusion: evidence and opportunity for policy. Joint Research Centre European Commission (2013).  James Stewart Lizzy Bleumers Jan Van Looy Ilse Mari\u00ebn Anissa All Dana Schurmans Koen Willaert Frederik De Grove An Jacobs and Gianluca Misuraca. 2013. The potential of digital games for empowerment and social inclusion of groups at risk of social and economic exclusion: evidence and opportunity for policy. Joint Research Centre European Commission (2013)."},{"key":"e_1_3_2_1_80_1","doi-asserted-by":"publisher","DOI":"10.1145\/1823818.1823836"},{"key":"e_1_3_2_1_81_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00779-017-1107-0"},{"key":"e_1_3_2_1_82_1","doi-asserted-by":"crossref","unstructured":"Adri\u00e1n Juan Verdejo Katrien De Moor Istvan Ketyko Karen Torben Nielsen Jeroen Vanattenhoven Toon De Pessemier Wout Joseph Luc Martens and Lieven De Marez. 2010. QoE estimation of a location-based mobile game using on-body sensors and QoS-related data. In 2010 IFIP Wireless Days. IEEE 1--5.  Adri\u00e1n Juan Verdejo Katrien De Moor Istvan Ketyko Karen Torben Nielsen Jeroen Vanattenhoven Toon De Pessemier Wout Joseph Luc Martens and Lieven De Marez. 2010. QoE estimation of a location-based mobile game using on-body sensors and QoS-related data. In 2010 IFIP Wireless Days. IEEE 1--5.","DOI":"10.1109\/WD.2010.5657756"},{"key":"e_1_3_2_1_83_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00779-006-0068-5"},{"key":"e_1_3_2_1_84_1","first-page":"2015","article-title":"MEC Spatial Presence Questionnaire","volume":"18","author":"Vorderer Peter","year":"2004","journal-title":"Retrieved Sept"},{"volume-title":"European Conference on Game Based Learning (ECGBL","year":"2016","author":"Wang Alf Inge","key":"e_1_3_2_1_85_1"},{"key":"e_1_3_2_1_86_1","doi-asserted-by":"publisher","DOI":"10.1145\/3027063.3053069"},{"key":"e_1_3_2_1_87_1","doi-asserted-by":"crossref","unstructured":"Josef Wiemeyer Lennart Nacke Christiane Moser etal 2016. Player experience. In Serious Games. Springer 243--271.  Josef Wiemeyer Lennart Nacke Christiane Moser et al. 2016. Player experience. In Serious Games. Springer 243--271.","DOI":"10.1007\/978-3-319-40612-1_9"},{"key":"e_1_3_2_1_88_1","doi-asserted-by":"publisher","DOI":"10.1108\/JRIM-06-2017-0041"},{"key":"e_1_3_2_1_89_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11042-016-3845-9"},{"key":"e_1_3_2_1_90_1","doi-asserted-by":"crossref","unstructured":"Raphael Zender Richard Metzler and Ulrike Lucke. 2014. FreshUP---A pervasive educational game for freshmen. Pervasive and mobile computing 14 (2014) 47--56.  Raphael Zender Richard Metzler and Ulrike Lucke. 2014. FreshUP---A pervasive educational game for freshmen. Pervasive and mobile computing 14 (2014) 47--56.","DOI":"10.1016\/j.pmcj.2013.09.003"}],"event":{"name":"IHC '19: XVIII Brazilian Symposium on Human Factors in Computing Systems","sponsor":["SBC Brazilian Computer Society"],"location":"Vit\u00f3ria Esp\u00edrito Santo Brazil","acronym":"IHC '19"},"container-title":["Proceedings of the 18th Brazilian Symposium on Human Factors in Computing Systems"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3357155.3358449","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3357155.3358449","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T23:44:38Z","timestamp":1750203878000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3357155.3358449"}},"subtitle":["a systematic mapping study"],"short-title":[],"issued":{"date-parts":[[2019,10,22]]},"references-count":90,"alternative-id":["10.1145\/3357155.3358449","10.1145\/3357155"],"URL":"https:\/\/doi.org\/10.1145\/3357155.3358449","relation":{},"subject":[],"published":{"date-parts":[[2019,10,22]]},"assertion":[{"value":"2019-10-22","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}