{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,25]],"date-time":"2026-06-25T11:35:36Z","timestamp":1782387336415,"version":"3.54.5"},"reference-count":56,"publisher":"MDPI AG","issue":"6","license":[{"start":{"date-parts":[[2020,6,22]],"date-time":"2020-06-22T00:00:00Z","timestamp":1592784000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["NSF SBE - 1659735"],"award-info":[{"award-number":["NSF SBE - 1659735"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["IJGI"],"abstract":"<jats:p>The need for improvement of societal disaster resilience and response efforts was evident after the destruction caused by the 2017 Atlantic hurricane season. We present a novel conceptual framework for improving disaster resilience through the combination of serious games, geographic information systems (GIS), spatial thinking, and disaster resilience. Our framework is implemented via Project Lily Pad, a serious geogame based on our conceptual framework, serious game case studies, interviews and real-life experiences from 2017 Hurricane Harvey survivors in Dickinson, TX, and an immersive hurricane-induced flooding scenario. The game teaches a four-fold set of skills relevant to spatial thinking and disaster resilience, including reading a map, navigating an environment, coding verbal instructions, and determining best practices in a disaster situation. Results of evaluation of the four skills via Project Lily Pad through a \u201cthink aloud\u201d study conducted by both emergency management novices and professionals revealed that the game encouraged players to think spatially, can help build awareness for disaster response scenarios, and has potential for real-life use by emergency management professionals. It can be concluded from our results that the combination of serious games, geographic information systems (GIS), spatial thinking, and disaster resilience, as implemented via Project Lily Pad and our evaluation results, demonstrated the wide range of possibilities for using serious geogames to improve disaster resilience spatial thinking and potentially save lives when disasters occur.<\/jats:p>","DOI":"10.3390\/ijgi9060405","type":"journal-article","created":{"date-parts":[[2020,6,23]],"date-time":"2020-06-23T04:51:16Z","timestamp":1592887876000},"page":"405","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":22,"title":["Supporting Disaster Resilience Spatial Thinking with Serious GeoGames: Project Lily Pad"],"prefix":"10.3390","volume":"9","author":[{"given":"Brian","family":"Tomaszewski","sequence":"first","affiliation":[{"name":"Center for Geographic Information Science and Technology, Rochester Institute of Technology, Rochester, NY 14623, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Amy","family":"Walker","sequence":"additional","affiliation":[{"name":"Center for Geographic Information Science and Technology, Rochester Institute of Technology, Rochester, NY 14623, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Emily","family":"Gawlik","sequence":"additional","affiliation":[{"name":"Center for Geographic Information Science and Technology, Rochester Institute of Technology, Rochester, NY 14623, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Casey","family":"Lane","sequence":"additional","affiliation":[{"name":"Center for Geographic Information Science and Technology, Rochester Institute of Technology, Rochester, NY 14623, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Scott","family":"Williams","sequence":"additional","affiliation":[{"name":"Center for Geographic Information Science and Technology, Rochester Institute of Technology, Rochester, NY 14623, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Deborah","family":"Orieta","sequence":"additional","affiliation":[{"name":"Center for Geographic Information Science and Technology, Rochester Institute of Technology, Rochester, NY 14623, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Claudia","family":"McDaniel","sequence":"additional","affiliation":[{"name":"Center for Geographic Information Science and Technology, Rochester Institute of Technology, Rochester, NY 14623, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Matthew","family":"Plummer","sequence":"additional","affiliation":[{"name":"Center for Geographic Information Science and Technology, Rochester Institute of Technology, Rochester, NY 14623, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Anushka","family":"Nair","sequence":"additional","affiliation":[{"name":"School of Interactive Games &amp; Media, Rochester Institute of Technology, Rochester, NY 14623, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Nicolas","family":"San Jose","sequence":"additional","affiliation":[{"name":"School of Interactive Games &amp; Media, Rochester Institute of Technology, Rochester, NY 14623, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Nathan","family":"Terrell","sequence":"additional","affiliation":[{"name":"School of Interactive Games &amp; Media, Rochester Institute of Technology, Rochester, NY 14623, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kyle","family":"Pecsok","sequence":"additional","affiliation":[{"name":"Center for Geographic Information Science and Technology, Rochester Institute of Technology, Rochester, NY 14623, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Emma","family":"Thomley","sequence":"additional","affiliation":[{"name":"Center for Geographic Information Science and Technology, Rochester Institute of Technology, Rochester, NY 14623, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Erin","family":"Mahoney","sequence":"additional","affiliation":[{"name":"Center for Geographic Information Science and Technology, Rochester Institute of Technology, Rochester, NY 14623, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Emily","family":"Haberlack","sequence":"additional","affiliation":[{"name":"Center for Geographic Information Science and Technology, Rochester Institute of Technology, Rochester, NY 14623, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"David","family":"Schwartz","sequence":"additional","affiliation":[{"name":"School of Interactive Games &amp; Media, Rochester Institute of Technology, Rochester, NY 14623, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2020,6,22]]},"reference":[{"key":"ref_1","unstructured":"Linsay, B.R. (2014). FEMA\u2019s Disaster Relief Fund: Overview and Selected Issues, Congressional Research Service."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Liu, W., Dugar, S., McCallum, I., Thapa, G., See, L., Khadka, P., Budhathoki, N., Brown, S., Mechler, R., and Fritz, S. (2018). Integrated Participatory and Collaborative Risk Mapping for Enhancing Disaster Resilience. ISPRS Int. J. Geo-Inf., 7.","DOI":"10.3390\/ijgi7020068"},{"key":"ref_3","unstructured":"World Economic Forum (2017). The Global Risks Report 2017, World Economic Forum."},{"key":"ref_4","unstructured":"Cova, T.J., and Tsou, M.-H. (2018). GIS and Serious Games. Comprehensive Geographic Information Systems, Elsevier."},{"key":"ref_5","unstructured":"Tomaszewski, B., and Schwartz, D.I. (2017, January 9\u201312). Critical Spatial Thinking and Serious Geogames: A Position. Proceedings of the AGILE 2017 Workshop on Geogames and Geoplay, Wageningen, The Netherlands."},{"key":"ref_6","unstructured":"Dewey, A., and Drahota, A. (2020, June 17). Introduction to Systematic Reviews: Online Learning Module Cochrane Training. Available online: https:\/\/training.cochrane.org\/interactivelearning\/module-1-introduction-conducting-systematic-reviews."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Cacchione, P.Z. (2016). The Evolving Methodology of Scoping Reviews, SAGE Publications.","DOI":"10.1177\/1054773816637493"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"571","DOI":"10.1007\/s10726-011-9227-9","article-title":"Using games in community disaster prevention exercises","volume":"21","author":"Yamori","year":"2012","journal-title":"Group Decis. Negot."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"1013","DOI":"10.1016\/j.ijdrr.2018.09.001","article-title":"An overview of serious games for disaster risk management\u2013Prospects and limitations for informing actions to arrest increasing risk","volume":"31","author":"Magnuszewski","year":"2018","journal-title":"Int. J. Disaster Risk Reduct."},{"key":"ref_10","unstructured":"(2020, January 20). Office for Coastal Management: National Oceanic and Atmospheric Administration. Fast Facts: Hurricane Costs, Available online: https:\/\/coast.noaa.gov\/states\/fast-facts\/hurricane-costs.html."},{"key":"ref_11","unstructured":"Combaz, E. (2014). Diasaster Resilience: Topic Guide, GSDRC."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.gloenvcha.2014.10.010","article-title":"Resilience for disaster risk management in a changing climate: Practitioners\u2019 frames and practices","volume":"30","author":"Aldunce","year":"2015","journal-title":"Glob. Environ. Chang."},{"key":"ref_13","unstructured":"National Research Council (2012). Disaster Resilience: A National Imperative, The National Academies Press."},{"key":"ref_14","unstructured":"National Research Council (2006). Learning to Think Spatially: GIS as a Support System in the K-12 Curriculum, The National Academies Press."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1007\/s10708-010-9340-3","article-title":"Toward critical spatial thinking in the social sciences and humanities","volume":"75","author":"Goodchild","year":"2010","journal-title":"GeoJournal"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"183","DOI":"10.1080\/03098260802276714","article-title":"Effect of GIS Learning on Spatial Thinking","volume":"33","author":"Lee","year":"2009","journal-title":"J. Geogr. High. Educ."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Ahlqvist, O., and Schlieder, C. (2018). Introducing Geogames and Geoplay: Characterizing an Emerging Research Field. Geogames and Geoplay: Game-Based Approaches to the Analysis of Geo-Information, Springer International Publishing.","DOI":"10.1007\/978-3-319-22774-0"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Sui, D.Z. (2008). The Importance of Spatial Thinking in an Uncertain World. Geospatial Technologies and Homeland Security: Research Frontiers and Future Challenges, Springer.","DOI":"10.1007\/978-1-4020-8507-9"},{"key":"ref_19","unstructured":"Ahlqvist, O., and Schlieder, C. (2018). OriGami: A Mobile Geogame for Spatial Literacy. Geogames and Geoplay: Game-Based Approaches to the Analysis of Geo-Information, Springer International Publishing."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"352","DOI":"10.1037\/a0028446","article-title":"The malleability of spatial skills: A meta-analysis of training studies","volume":"139","author":"Uttal","year":"2013","journal-title":"Psychol Bull."},{"key":"ref_21","unstructured":"Council, N.R. (2006). Learning to Think Spatially, The National Academies Press."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"73","DOI":"10.1016\/j.sbspro.2011.07.037","article-title":"Beyond geo-spatial technologies: Promoting spatial thinking through local disaster risk management planning","volume":"21","author":"Berse","year":"2011","journal-title":"Procedia Soc. Behav. Sci."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"350","DOI":"10.1080\/03098265.2013.769091","article-title":"Development of critical spatial thinking through GIS learning","volume":"37","author":"Kim","year":"2013","journal-title":"J. Geogr. High. Educ."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"315","DOI":"10.1353\/hpu.2007.0029","article-title":"Katrina and vulnerability: The geography of stress","volume":"18","author":"Curtis","year":"2007","journal-title":"J. Health Care Poor Underserved"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Buchroithner, M. (2014). Geospatial Data Collection\/Use in Disaster Response: A United States Nationwide Survey of State Agencies. Cartography from Pole to Pole, Springer.","DOI":"10.1007\/978-3-642-32618-9"},{"key":"ref_26","first-page":"571","article-title":"Geographic Information Systems for Disaster Response: A Review","volume":"12","author":"Tomaszewski","year":"2015","journal-title":"J. Homel. Secur. Emerg. Manag."},{"key":"ref_27","unstructured":"Taylor, J.L. (1985). Guide on Simulation and Gaming for Environmental Education, UNESCO."},{"key":"ref_28","unstructured":"Cutter, S., Richardson, D., and Wilbanks, T. (2003). The Geographical Dimensions of Terrorism, Routledge."},{"key":"ref_29","first-page":"15","article-title":"Components of spatial thinking: Evidence from a spatial thinking ability test","volume":"111","author":"Lee","year":"2012","journal-title":"J. Geogr."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"289","DOI":"10.1080\/136588199241210","article-title":"Four barriers to the development of effective exploratory visualisation tools for the geosciences","volume":"13","author":"Gahegan","year":"1999","journal-title":"Int. J. Geogr. Inf. Sci."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"177","DOI":"10.1177\/1555412009354727","article-title":"From Edutainment to Serious Games: A Change in the Use of Game Characteristics","volume":"5","author":"Charsky","year":"2010","journal-title":"Games Cult."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"69","DOI":"10.1016\/j.entcom.2010.12.002","article-title":"The role of psychology in understanding the impact of computer games","volume":"2","author":"Boyle","year":"2011","journal-title":"Entertain. Comput."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Ashfield, S., Jarvis, C., and Kaduk, J. (2010, January 25\u201326). Serious Games for Geographical Field Skills: An Exploration. Proceedings of the 2010 Second International Conference on Games and Virtual Worlds for Serious Applications, Braga, Portugal.","DOI":"10.1109\/VS-GAMES.2010.18"},{"key":"ref_34","unstructured":"Ahlqvist, O., and Schlieder, C. (2018). Spatial Game for Negotiations and Consensus Building in Urban Planning: YouPlaceIt!. Geogames and Geoplay: Game-Based Approaches to the Analysis of Geo-Information, Springer International Publishing."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"135","DOI":"10.5194\/nhess-16-135-2016","article-title":"Hazagora: Will you survive the next disaster?\u2014A serious game to raise awareness about geohazards and disaster risk reduction","volume":"16","author":"Mossoux","year":"2016","journal-title":"Nat. Hazards Earth Syst. Sci."},{"key":"ref_36","first-page":"441","article-title":"Code Red: Triage Or COgnition-based DEsign Rules Enhancing Decisionmaking TRaining In A Game Environment","volume":"42","author":"Wouters","year":"2010","journal-title":"Br. J. Educ. Technol."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"77","DOI":"10.1016\/j.chb.2016.06.043","article-title":"How do presence, flow, and character identification affect players\u2019 empathy and interest in learning from a serious computer game?","volume":"64","author":"Bachen","year":"2016","journal-title":"Comput. Hum. Behav."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"22","DOI":"10.3991\/ijet.v5s3.1500","article-title":"Designing Effective Serious Games: Opportunities and Challenges for Research","volume":"5","author":"Bellotti","year":"2010","journal-title":"Int. J. Emerg. Technol. Learn."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Kapp, K.M. (2012). The Gamification of Learning and Instruction Game-Based Methods and Strategies for Training and Education, Pfeiffer.","DOI":"10.1145\/2207270.2211316"},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Ahlqvist, O., and Schlieder, C. (2018). Defining a Geogame Genre Using Core Concepts of Games, Play, and Geographic Information and Thinking. Geogames and Geoplay: Game-Based Approaches to the Analysis of Geo-Information, Springer International Publishing.","DOI":"10.1007\/978-3-319-22774-0_2"},{"key":"ref_41","unstructured":"Tomaszewski, B., Schwartz, D.I., and Szarzynski, J. (2016, January 22\u201325). Crisis Response Serious Spatial Thinking Games: Spatial Think Aloud Study Results. Proceedings of the 13th International Conference of the International Association For The Study Of Information Systems For Crisis Response And Management (ISCRAM), Rio de Janeiro, Brazil."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Biddulph, M., Lambert, D., and Balderstone, D. (2015). Learning to Teach Geography in the Secondary School: A Companion to School Experience, Routledge. [3rd ed.].","DOI":"10.4324\/9781315771274"},{"key":"ref_43","unstructured":"IJsselsteijn, W., De Kort, Y., and Poels, K. (2020, June 17). The Game Experience Questionnaire. Available online: https:\/\/pure.tue.nl\/ws\/files\/21666907\/Game_Experience_Questionnaire_English.pdf."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"339","DOI":"10.1177\/1473871612456122","article-title":"Geovisual Analytics to Support Crisis Management: Information Foraging for Geo-Historical Context","volume":"11","author":"Tomaszewski","year":"2012","journal-title":"Inf. Vis."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"1213","DOI":"10.1002\/acp.1045","article-title":"Language and spatial cognition: Comparing the roles of landmarks and street names in route instructions","volume":"18","author":"Tom","year":"2004","journal-title":"Appl. Cognit. Psychol."},{"key":"ref_46","first-page":"36","article-title":"Wayfinding Behavior: Cognitive Mapping and Other Spatial Processes","volume":"10","author":"Golledge","year":"1999","journal-title":"Psycoloquy"},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"516","DOI":"10.1111\/0033-0124.00189","article-title":"Three Spaces of Spatial Cognition","volume":"51","author":"Tversky","year":"1999","journal-title":"Prof. Geogr."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"483","DOI":"10.3758\/BF03199581","article-title":"Descriptions and depictions of environments","volume":"20","author":"Taylor","year":"1992","journal-title":"Mem. Cognit."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"s82","DOI":"10.1017\/S1049023X19001729","article-title":"The Use of Simulation Games and Tabletop Exercises in Disaster Preparedness Training of Emergency Medicine Residents","volume":"34","author":"Rivera","year":"2019","journal-title":"Prehospital Disaster Med."},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"176","DOI":"10.1061\/(ASCE)1527-6988(2003)4:4(176)","article-title":"Assessing Community Impacts of Natural Disasters","volume":"4","author":"Lindell","year":"2003","journal-title":"Nat. Hazards Rev."},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"242","DOI":"10.1111\/1540-6237.8402002","article-title":"Social Vulnerability to Environmental Hazards","volume":"84","author":"Cutter","year":"2003","journal-title":"Soc. Sci. Q."},{"key":"ref_52","doi-asserted-by":"crossref","unstructured":"Tomaszewski, B. (2020). Geographic Information Systems for Disaster Management, Routledge. [2nd ed.].","DOI":"10.4324\/9781351034869"},{"key":"ref_53","unstructured":"U.S. Department of Homeland Security (2006). National Planning Scenarios, National Incident Management System."},{"key":"ref_54","unstructured":"Federal Emergency Management Agency (FEMA) (2020, June 17). The Whole Community: Planning for the Unthinkable, Available online: https:\/\/www.fema.gov\/emergency-planning-exercises."},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"87","DOI":"10.1007\/s11024-011-9166-2","article-title":"Prediction as an Impediment to Preparedness: Lessons from the US Hurricane and Earthquake Research Enterprises","volume":"49","author":"Maricle","year":"2011","journal-title":"Minerva"},{"key":"ref_56","unstructured":"Philipps, D. (2020, March 25). Seven Hard Lessons Federal Responders to Harvey Learned From Katrina. Available online: https:\/\/www.nytimes.com\/2017\/09\/07\/us\/hurricane-harvey-katrina-federal-responders.html."}],"container-title":["ISPRS International Journal of Geo-Information"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2220-9964\/9\/6\/405\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T09:41:15Z","timestamp":1760175675000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2220-9964\/9\/6\/405"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,6,22]]},"references-count":56,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2020,6]]}},"alternative-id":["ijgi9060405"],"URL":"https:\/\/doi.org\/10.3390\/ijgi9060405","relation":{},"ISSN":["2220-9964"],"issn-type":[{"value":"2220-9964","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,6,22]]}}}