{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T03:30:22Z","timestamp":1760239822287,"version":"build-2065373602"},"reference-count":64,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2020,12,28]],"date-time":"2020-12-28T00:00:00Z","timestamp":1609113600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Location-based applications (LBAs) capture the user\u2019s physical location via satellite navigation sensors and integrate it as part of the digital application. Because of this connection, the real-world environment needs to be accounted for in LBA design. In this work, we focused on creating a database of geographically distributed points of interest (PoIs) that is optimal for learning local history. First, we conducted a requirements elicitation study at three outdoor archaeological sites and identified issues in existing solutions. Second, we designed a multi-layered prototype solution. Third, we evaluated the solution with nine experts who had prior experience with LBAs or similar systems. We incorporated their feedback to our design to iteratively improve it. As a whole, our work contributes to the LBA design literature by proposing a solution that is optimized for the learning of local history.<\/jats:p>","DOI":"10.3390\/s21010129","type":"journal-article","created":{"date-parts":[[2020,12,28]],"date-time":"2020-12-28T10:33:56Z","timestamp":1609151636000},"page":"129","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["Learning History with Location-Based Applications: An Architecture for Points of Interest in Multiple Layers"],"prefix":"10.3390","volume":"21","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-4285-0073","authenticated-orcid":false,"given":"Samuli","family":"Laato","sequence":"first","affiliation":[{"name":"Department of Computing, University of Turku, 20540 Turku, Finland"},{"name":"Department of Teacher Education, University of Turku, 20540 Turku, Finland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1891-2353","authenticated-orcid":false,"given":"Sampsa","family":"Rauti","sequence":"additional","affiliation":[{"name":"Department of Computing, University of Turku, 20540 Turku, Finland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0823-009X","authenticated-orcid":false,"given":"Antti","family":"Laato","sequence":"additional","affiliation":[{"name":"Department of Theology, \u00c5bo Akademi University, 20540 Turku, Finland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5966-992X","authenticated-orcid":false,"given":"Teemu","family":"Laine","sequence":"additional","affiliation":[{"name":"Department of Digital Media, Ajou University, Suwon 16499, Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1020-3325","authenticated-orcid":false,"given":"Erkki","family":"Sutinen","sequence":"additional","affiliation":[{"name":"Department of Computing, University of Turku, 20540 Turku, Finland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6188-862X","authenticated-orcid":false,"given":"Erno","family":"Lehtinen","sequence":"additional","affiliation":[{"name":"Department of Teacher Education, University of Turku, 20540 Turku, Finland"},{"name":"Department of Education, Vytautas Magnus University, 44248 Kaunas, Lithuania"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2020,12,28]]},"reference":[{"key":"ref_1","first-page":"1","article-title":"Hedonic and utilitarian benefits as determinants of the application continuance intention in location-based applications: The mediating role of satisfaction","volume":"2","author":"Akel","year":"2020","journal-title":"Multimed. Tools Appl."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Jensen, L.J., Valentine, K.D., and Case, J.P. (2019). Accessing the pok\u00e9layer: Augmented reality and fantastical play in Pok\u00e9mon Go. Educational Media and Technology Yearbook, Springer.","DOI":"10.1007\/978-3-030-27986-8_9"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Liberati, N. (2019). Mediation Theory Between Pok\u00e9mon GO and the Everyday World. Augmented Reality Games I, Springer.","DOI":"10.1007\/978-3-030-15616-9_4"},{"key":"ref_4","unstructured":"Mozelius, P., Jaldemark, J., and Hellerstedt, A. (2020, January 15). Aristotle, Comenius, Dewey, Plato and Pok\u00e9mon GO: Walking with Location-based Games in the Footsteps of Didactic Giants. Proceedings of the Fifteenth European Conference on Technology Enhanced Learning (EC-TEL 2020), Heidelberg, Germany."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"79","DOI":"10.17083\/ijsg.v7i1.337","article-title":"Location-based Games as Exergames-from Pok\u00e9mon to the Wizarding World","volume":"7","author":"Laato","year":"2020","journal-title":"Int. J. Serious Games"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1016\/j.chb.2017.06.008","article-title":"Catch them all and increase your place attachment! The role of location-based augmented reality games in changing people-place relations","volume":"76","author":"Oleksy","year":"2017","journal-title":"Comput. Hum. Behav."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"332","DOI":"10.1111\/j.1365-2729.2009.00316.x","article-title":"Mobile game-based learning in secondary education: Engagement, motivation and learning in a mobile city game","volume":"25","author":"Huizenga","year":"2009","journal-title":"J. Comput. Assist. Learn."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Laato, S., and Laato, A. (2020, January 7\u201310). Augmented Reality to Enhance Visitors\u2019 Experience at Archaeological Sites. Proceedings of the World Conference on Information Systems and Technologies, Budva, Montenegro.","DOI":"10.1007\/978-3-030-45691-7_32"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Laato, S., Hyrynsalmi, S.M., and Paloheimo, M. (2019, January 18\u201320). Online Multiplayer Games for Crowdsourcing the Development of Digital Assets. Proceedings of the International Conference on Software Business, Jyv\u00e4skyl\u00e4, Finland.","DOI":"10.1007\/978-3-030-33742-1_31"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Viinikkala, L., Yli-Sepp\u00e4l\u00e4, L., Heimo, O.I., Helle, S., H\u00e4rk\u00e4nen, L., Jokela, S., J\u00e4rvenp\u00e4\u00e4, L., Korkalainen, T., Latvala, J., and P\u00e4\u00e4kyl\u00e4, J. (2016, January 17\u201321). Reforming the representation of the reformation: Mixed reality narratives in communicating tangible and intangible heritage of the protestant reformation in Finland. Proceedings of the 2016 22nd International Conference on Virtual System & Multimedia (VSMM), Kuala Lumpur, Malaysia.","DOI":"10.1109\/VSMM.2016.7863203"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Brabham, D.C. (2013). Crowdsourcing, MIT Press.","DOI":"10.7551\/mitpress\/9693.001.0001"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"12","DOI":"10.1109\/MPRV.2008.80","article-title":"Openstreetmap: User-generated street maps","volume":"7","author":"Haklay","year":"2008","journal-title":"IEEE Pervasive Comput."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Laato, S., Pietarinen, T., Rauti, S., and Laine, T.H. (2019, January 21\u201322). Analysis of the Quality of Points of Interest in the Most Popular Location-based Games. Proceedings of the 20th International Conference on Computer Systems and Technologies, Ruse, Bulgaria.","DOI":"10.1145\/3345252.3345286"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Tregel, T., Raymann, L., G\u00f6bel, S., and Steinmetz, R. (2017, January 23\u201324). Geodata Classification for Automatic Content Creation in Location-based Games. Proceedings of the Joint International Conference on Serious Games, Valencia, Spain.","DOI":"10.1007\/978-3-319-70111-0_20"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"241","DOI":"10.1080\/10095020.2017.1368200","article-title":"Where to catch \u2018em all?\u2013a geographic analysis of Pok\u00e9mon Go locations","volume":"20","author":"Hochmair","year":"2017","journal-title":"Geo-SPatial Inf. Sci."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"7","DOI":"10.1016\/j.ijhcs.2018.10.001","article-title":"Cooperation or competition\u2013When do people contribute more? A field experiment on gamification of crowdsourcing","volume":"127","author":"Morschheuser","year":"2019","journal-title":"Int. J. Hum. Comput. Stud."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Juh\u00e1sz, L., Novack, T., Hochmair, H.H., and Qiao, S. (2020). Cartographic Vandalism in the Era of Location-Based Games\u2014The Case of OpenStreetMap and Pok\u00e9mon GO. ISPRS Int. J. Geo-Inf., 9.","DOI":"10.3390\/ijgi9040197"},{"key":"ref_18","first-page":"133","article-title":"Augmented Reality Trends in Education: A Systematic Review of Research and Applications","volume":"17","author":"Bacca","year":"2014","journal-title":"J. Educ. Technol. Soc."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"505","DOI":"10.1002\/spip.293","article-title":"Framework for matching requirements elicitation techniques to project characteristics","volume":"11","author":"Tsumaki","year":"2006","journal-title":"Softw. Process. Improv. Pract."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Hyrynsalmi, S., Rauti, S., and Kaila, E. (2019, January 20\u201324). Bridging the gap between software architecture and business model development: A literature study. Proceedings of the 2019 42nd International Convention on Information and Communication Technology, Electronics and Microelectronics (MIPRO), Opatija, Croatia.","DOI":"10.23919\/MIPRO.2019.8756974"},{"key":"ref_21","unstructured":"Nature, I., and Authority, P. (2019, October 10). National Parks and Nature Reserves. Available online: https:\/\/www.parks.org.il\/en\/about\/."},{"key":"ref_22","unstructured":"Stern, E., and Aviram, J. (1993). The New Encyclopedia of Archaeological Excavations in the Holy Land, Eisenbrauns."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"221","DOI":"10.2458\/56.16899","article-title":"Absolute chronology of Megiddo, Israel, in the late Bronze and Iron Ages: High-resolution radiocarbon dating","volume":"56","author":"Toffolo","year":"2014","journal-title":"Radiocarbon"},{"key":"ref_24","unstructured":"Niantic (2019, October 22). Ingress Intel Map. Available online: https:\/\/intel.ingress.com\/intel."},{"key":"ref_25","first-page":"4","article-title":"A three cycle view of design science research","volume":"19","author":"Hevner","year":"2007","journal-title":"Scand. J. Inf. Syst."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"42","DOI":"10.1109\/52.469759","article-title":"The 4+1 View Model of Architecture","volume":"12","author":"Kruchten","year":"1995","journal-title":"IEEE Softw."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"118","DOI":"10.5615\/neareastarch.76.2.0118","article-title":"Conservation and Restoration at Hazor","volume":"76","author":"Cohen","year":"2013","journal-title":"East. Archaeol."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Keil, J., Pujol, L., Roussou, M., Engelke, T., Schmitt, M., Bockholt, U., and Eleftheratou, S. (November, January 28). A digital look at physical museum exhibits: Designing personalized stories with handheld Augmented Reality in museums. Proceedings of the 2013 Digital Heritage International Congress (DigitalHeritage), Marseille, France.","DOI":"10.1109\/DigitalHeritage.2013.6744836"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Laine, T.H., Sedano, C.I., Sutinen, E., and Joy, M. (2010, January 1\u20133). Viable and portable architecture for pervasive learning spaces. Proceedings of the 9th International Conference on Mobile and Ubiquitous Multimedia, Limassol, Cyprus.","DOI":"10.1145\/1899475.1899476"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"73","DOI":"10.5615\/neareastarch.76.2.0073","article-title":"Tel Hazor: A key site of the Intermediate Bronze Age","volume":"76","author":"Bechar","year":"2013","journal-title":"East. Archaeol."},{"key":"ref_31","first-page":"148","article-title":"The Iron Age I at Tel Hazor in light of the renewed excavations","volume":"51","year":"2001","journal-title":"Isr. Explor. J."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"274","DOI":"10.1179\/tav.1992.1992.2.274","article-title":"Notes on the Middle Bronze Age fortifications of Hazor","volume":"19","author":"Ussishkin","year":"1992","journal-title":"Tel Aviv"},{"key":"ref_33","first-page":"80","article-title":"Solomon\u2019s city wall and gate at Gezer","volume":"8","author":"Yadin","year":"1958","journal-title":"Isr. Explor. J."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"1","DOI":"10.2307\/1356752","article-title":"Was the \u201cSolomonic\u201d City Gate at Megiddo Built by King Solomon?","volume":"239","author":"Ussishkin","year":"1980","journal-title":"Bull. Am. Sch. Orient. Res."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"3035","DOI":"10.1016\/j.jas.2008.06.024","article-title":"Hydrogeological insights in antiquity as indicated by Canaanite and Israelite water systems","volume":"35","author":"Weinberger","year":"2008","journal-title":"J. Archaeol. Sci."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"179","DOI":"10.1179\/lev.1999.31.1.179","article-title":"Socioeconomic stratification in an Israelite city: Hazor VI as a test case","volume":"31","author":"Faust","year":"1999","journal-title":"Levant"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"22","DOI":"10.2307\/3210929","article-title":"The four room house: Embodying Iron Age Israelite society","volume":"66","author":"Faust","year":"2003","journal-title":"East. Archaeol."},{"key":"ref_38","first-page":"180","article-title":"The Four-Room House Its Situation and Function in the Israelite City","volume":"20","author":"Shiloh","year":"1970","journal-title":"Isr. Explor. J."},{"key":"ref_39","unstructured":"Cline, E.H. (2002). The Battles of Armageddon: Megiddo and the Jezreel Valley from the Bronze Age to the Nuclear Age, University of Michigan Press."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Lamon, R.S. (1935). The Megiddo Water System, University of Chicago Press.","DOI":"10.1515\/9783112615645-011"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"285","DOI":"10.3764\/aja.118.2.0285","article-title":"The Great Temple of Early Bronze One Megiddo","volume":"118","author":"Adams","year":"2014","journal-title":"Am. J. Archaeol."},{"key":"ref_42","first-page":"217","article-title":"Solomonic and Assyrian Period\u2019Palaces\u2019 at Gezer","volume":"35","author":"Dever","year":"1985","journal-title":"Isr. Explor. J."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"47","DOI":"10.2307\/3210954","article-title":"Excavations at Gezer","volume":"30","author":"Dever","year":"1967","journal-title":"Biblic. Archaeol."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"4","DOI":"10.5615\/neareastarch.75.1.0004","article-title":"Guarding the Border to Jerusalem: The Iron Age City of Gezer","volume":"75","author":"Ortiz","year":"2012","journal-title":"East. Archaeol."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"213","DOI":"10.1179\/tav.1995.1995.2.213","article-title":"The Date of the Settlement of the Philistines in Canaan","volume":"22","author":"Finkelstein","year":"1995","journal-title":"Tel Aviv"},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"177","DOI":"10.1179\/lev.1996.28.1.177","article-title":"The archaeology of the United Monarchy: An alternative view","volume":"28","author":"Finkelstein","year":"1996","journal-title":"Levant"},{"key":"ref_47","first-page":"143","article-title":"The spade and the text: The interaction between archaeology and Israelite history relating to the tenth-ninth centuries BCE","volume":"Volume 1","author":"Mazar","year":"2007","journal-title":"Proceedings-British Academy"},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"50","DOI":"10.5615\/neareastarch.74.1.0050","article-title":"The Iron Age chronology debate: Is the gap narrowing?","volume":"74","author":"Finkelstein","year":"2011","journal-title":"East. Archaeol."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"9","DOI":"10.2307\/1357481","article-title":"Hazor and the chronology of northern Israel: A reply to Israel Finkelstein","volume":"317","year":"2000","journal-title":"Bull. Am. Sch. Orient. Res."},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"66","DOI":"10.5615\/neareastarch.76.2.0066","article-title":"The Renewed Hazor Excavations","volume":"76","year":"2013","journal-title":"East. Archaeol."},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"105","DOI":"10.5615\/neareastarch.76.2.0105","article-title":"Hazor in the Tenth Century bce","volume":"76","year":"2013","journal-title":"East. Archaeol."},{"key":"ref_52","first-page":"e00123","article-title":"Making virtual reconstructions part of the visit: An exploratory study","volume":"15","author":"Petrelli","year":"2019","journal-title":"Digit. Appl. Archaeol. Cult. Herit."},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"14","DOI":"10.1016\/j.technovation.2016.05.002","article-title":"Crowdsourcing not all sourced by the crowd: An observation on the behavior of Wikipedia participants","volume":"55","author":"Lee","year":"2016","journal-title":"Technovation"},{"key":"ref_54","doi-asserted-by":"crossref","unstructured":"Mazar, A. (2010). Archaeology and the Biblical Narrative: The Case of the United Monarchy, de Gruyter. BZAW 405.","DOI":"10.1515\/9783110223583.29"},{"key":"ref_55","unstructured":"Harari, Y.N. (2014). Sapiens: A Brief History of Humankind, Random House."},{"key":"ref_56","doi-asserted-by":"crossref","unstructured":"Laato, S., Inaba, N., and Paloheimo, M. (2020, January 7\u201310). The Effect of Team Choice in Ingress and Pok\u00e9mon GO for Players\u2019 Social Circles and Attitudes Towards Game Slang. Proceedings of the 53rd Hawaii International Conference on System Sciences, Maui, HI, USA.","DOI":"10.24251\/HICSS.2020.324"},{"key":"ref_57","first-page":"26","article-title":"Teaching for transformative experiences in history: Experiencing controversial history ideas","volume":"15","author":"Alongi","year":"2016","journal-title":"J. Soc. Sci. Educ."},{"key":"ref_58","doi-asserted-by":"crossref","unstructured":"Rauti, S., and Laato, S. (2020, January 7\u201310). Location-Based Games as Interfaces for Collecting User Data. Proceedings of the World Conference on Information Systems and Technologies, Budva, Montenegro.","DOI":"10.1007\/978-3-030-45691-7_59"},{"key":"ref_59","doi-asserted-by":"crossref","unstructured":"Guo, S., Xiong, H., Zheng, X., and Zhou, Y. (2017). Activity recognition and semantic description for indoor mobile localization. Sensors, 17.","DOI":"10.3390\/s17030649"},{"key":"ref_60","doi-asserted-by":"crossref","unstructured":"Liu, Q., Yang, X., and Deng, L. (2018). An IBeacon-based location system for smart home control. Sensors, 18.","DOI":"10.3390\/s18061897"},{"key":"ref_61","unstructured":"Bergstrom, K. (2020). Who is playing Pok\u00e9mon GO? An observational activity. Commun. Teach., 1\u20135."},{"key":"ref_62","doi-asserted-by":"crossref","unstructured":"Laato, S., Pietarinen, T., Rauti, S., and Sutinen, E. (2019, January 2\u20134). Potential Benefits of Playing Location-Based Games: An Analysis of Game Mechanics. Proceedings of the International Conference on Computer Supported Education, Crete, Greece.","DOI":"10.1007\/978-3-030-58459-7_27"},{"key":"ref_63","doi-asserted-by":"crossref","first-page":"245","DOI":"10.1016\/j.ijer.2019.09.001","article-title":"Historians and conceptual change in history itself: The domain as a unit of analysis","volume":"98","author":"Kainulainen","year":"2019","journal-title":"Int. J. Educ. Res."},{"key":"ref_64","unstructured":"CBS News (2020, October 28). Auschwitz Museum Says No to \u201cPokemon Go\u201d. ONLINE. Available online: https:\/\/www.cbsnews.com\/news\/auschwitz-museum-no-pokemon-go\/."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/1\/129\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T10:46:50Z","timestamp":1760179610000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/1\/129"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,12,28]]},"references-count":64,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2021,1]]}},"alternative-id":["s21010129"],"URL":"https:\/\/doi.org\/10.3390\/s21010129","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2020,12,28]]}}}