{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,13]],"date-time":"2026-04-13T22:23:58Z","timestamp":1776119038182,"version":"3.50.1"},"reference-count":45,"publisher":"MDPI AG","issue":"2","license":[{"start":{"date-parts":[[2018,6,11]],"date-time":"2018-06-11T00:00:00Z","timestamp":1528675200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Seventh Framework Programme","award":["270198"],"award-info":[{"award-number":["270198"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["MTI"],"abstract":"<jats:p>A multitude of challenges comes into play when attempting to design (and evaluate) an interactive digital storytelling experience for use by visitors in a museum. This paper reports on the evaluation of the prototype mobile-based storytelling \u201cguides\u201d designed, developed and deployed as part of a research project at the Acropolis Museum in Athens, Greece. Experiences designed for different visitor profiles were evaluated several times throughout the iterative design process, in a number of on-site studies, and with more than 180 museum visitors of all ages (with this paper reporting on two studies conducted with a total of 53 users visiting individually or in pairs). The evaluation methods included ethnography (i.e., observation of visitors in the Museum\u2019s galleries), pre- and post-experience in-depth interviews and questionnaires to measure the Users\u2019 Experience (UX), as well as data logging. The analysis of the data focused on themes representing components of the experiences, such as interactive story plot and narration, staging and way-finding in the physical space, personalization and social interaction. Our findings confirmed that understanding UX and what makes it effective or not in the rich context of a cultural setting is a complex endeavor. The paper discusses our findings and proposes relevant recommendations for the design of digital experiences for cultural, educational, and recreational purposes.<\/jats:p>","DOI":"10.3390\/mti2020032","type":"journal-article","created":{"date-parts":[[2018,6,11]],"date-time":"2018-06-11T11:01:01Z","timestamp":1528714861000},"page":"32","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":83,"title":["Flow, Staging, Wayfinding, Personalization: Evaluating User Experience with Mobile Museum Narratives"],"prefix":"10.3390","volume":"2","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-2826-162X","authenticated-orcid":false,"given":"Maria","family":"Roussou","sequence":"first","affiliation":[{"name":"Department of Informatics and Telecommunications, National and Kapodistrian University of Athens, 157 84 Athens, Greece"}]},{"given":"Akrivi","family":"Katifori","sequence":"additional","affiliation":[{"name":"Department of Informatics and Telecommunications, National and Kapodistrian University of Athens, 157 84 Athens, Greece"},{"name":"Athena Research and Innovation Center, 15125 Maroussi, Greece"}]}],"member":"1968","published-online":{"date-parts":[[2018,6,11]]},"reference":[{"key":"ref_1","unstructured":"Pine, B.J., and Gilmore, J.H. (1999). The Experience Economy: Work Is Theater & Every Business a Stage, Harvard Business School Press."},{"key":"ref_2","unstructured":"Hassenzahl, M. (2012). User Experience and Experience Design. Encyclopedia of Interaction Design, Interaction Design Foundation. [2nd ed.]."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Law, E.L.-C. (2011, January 13\u201316). The Measurability and Predictability of User Experience. Proceedings of the 3rd ACM SIGCHI Symposium on Engineering Interactive Computing Systems (EICS), Pisa, Italy.","DOI":"10.1145\/1996461.1996485"},{"key":"ref_4","unstructured":"Wright, A. (2017). Storytelling and Interpretation: Examining Best Practice at Heritage Sites, University of York."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Perry, S., Roussou, M., Economou, M., Young, H., and Pujol, L. (2017, January 31). Moving Beyond the Virtual Museum: Engaging Visitors Emotionally. Proceedings of the 23rd International Conference on Virtual Systems and Multimedia-VSMM, Dublin, Ireland.","DOI":"10.1109\/VSMM.2017.8346276"},{"key":"ref_6","unstructured":"Adler, C. (2006). Telling Tales. A Guide to Developing Effective Storytelling Programmes for Museums, London Museums Hub, Museum of London."},{"key":"ref_7","unstructured":"Tallon, L., and Walker, K. (2008). Digital Technologies and the Museum Experience: Handheld Guides and Other Media, AltaMira Press."},{"key":"ref_8","unstructured":"American Alliance of Museums, Museums Association, and Fusion Research + Analytics (2012). Mobile in Museums Study\u20142012: A Survey of American Alliance of Museums (US) and Museums Association (UK) Members, AAM Press."},{"key":"ref_9","unstructured":"Victoria & Albert Museum, Fusion Research & Analytics LLC, and Frankly, Green + Webb Ltd. (2012). Understanding the Mobile V&A Visitor: Autumn 2012, V & A."},{"key":"ref_10","unstructured":"Natural History Museum and Fusion Research & Analytics LLC (2013). Natural History Museum: Understanding the Mobile Visitor, NHM. Available online: http:\/\/www.nhm.ac.uk\/resources-rx\/files\/nhm-mobile-report-july-2013-127910.pdf."},{"key":"ref_11","unstructured":"Proctor, N. (2011). Mobile Apps for Museums: The AAM Guide to Planning and Strategy, AAM Press. [2nd ed.]."},{"key":"ref_12","unstructured":"Othman, M.K. (2012). Measuring Visitors\u2019 Experiences with Mobile Guide Technology in Cultural Spaces, The University of York."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"77","DOI":"10.1037\/aca0000049","article-title":"Time spent viewing art and reading labels","volume":"11","author":"Smith","year":"2017","journal-title":"Psychol. Aesthet. Creat. Arts"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/1921614.1921618","article-title":"A visitor\u2019s guide in an active museum","volume":"3","author":"Kuflik","year":"2011","journal-title":"ACM J. Comput. Cult. Heritage"},{"key":"ref_15","unstructured":"Damala, A. (2009). Interaction Design and Evaluation of Mobile Guides for the Museum Visit: A Case Study in Multimedia and Mobile Augmented Reality Synthesis, Conservatoire National des Arts et de Metiers."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Earl, G., Sly, T., Chrysanthi, A., Murrieta-Flores, P., Papadopoulos, C., Romanowska, I., and Wheatley, D. (2013). Personalizing interactive digital storytelling in archaeological museums: The CHESS project. Archaeology in the Digital Era, Proceedings of the 40th Annual Conference of Computer Applications and Quantitative Methods in Archaeology (CAA), Southampton, UK, 26\u201329 March 2012, Amsterdam University Press.","DOI":"10.2307\/j.ctt6wp7kg"},{"key":"ref_17","unstructured":"Vayanou, M., Karvounis, M., Kyriakidi, M., Katifori, A., Manola, N., Roussou, M., and Ioannidis, Y. (2012, January 31). Towards Personalized Storytelling for Museum Visits. Proceedings of the 6th International Workshop on Personalized Access, Profile Management, and Context Awareness in Databases (PersDB 2012), Istanbul, Turkey."},{"key":"ref_18","unstructured":"Rennick-Egglestone, S.J., Roussou, M., Brundell, P., Chaffardon, C., Kourtis, V., Koleva, B., and Benford, S. (2013, January 1\u20133). Indoors and outdoors: Designing mobile experiences for Cit\u00e9 de l\u2019Espace. Proceedings of the 6th NODEM (Network of Design and Digital Heritage) 2013 Conference: Beyond Control\u2014The Collaborative Museum and its Challenges, Stockholm, Sweden."},{"key":"ref_19","first-page":"11","article-title":"Families and mobile devices in museums: Designing for integrated experiences","volume":"9","author":"Brundell","year":"2016","journal-title":"ACM J. Comput. Cult. Heritage"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"461","DOI":"10.1111\/j.2151-6952.2011.00110.x","article-title":"Digital Storytelling in Museums: Observations and Best Practices","volume":"54","author":"Wyman","year":"2011","journal-title":"Curator Mus. J."},{"key":"ref_21","unstructured":"Tallon, L., and Walker, K. (2008). Enhancing Visitor Interaction and Learning with Mobile Technologies. Digital Technologies and the Museum Experience: Handheld Guides and Other Media, AltaMira Press."},{"key":"ref_22","unstructured":"Vom Lehn, D., and Heath, C. (2003, January 8\u201312). Displacing the object: Mobile technologies and interpretive resources. Proceedings of the ICHIM03, International Cultural Heritage Informatics Meeting, Paris, France."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Grinter, R.E., Aoki, P.M., Hurst, A., Szymanski, M.H., Thornton, J.D., and Woodruff, A. (2002, January 16\u201320). Revisiting the Visit: Understanding How Technology Can Shape the Museum Visit. Proceedings of the Computer Supported Collaborative Work (CSCW), New Orleans, LA, USA.","DOI":"10.1145\/587078.587100"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"11","DOI":"10.1080\/13614568.2012.617846","article-title":"Storytelling on mobile devices for cultural heritage","volume":"18","author":"Lombardo","year":"2012","journal-title":"New Rev. Hypermedia Multimedia"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Falk, J.H., and Dierking, L.D. (2016). The Museum Experience Revisited, Routledge.","DOI":"10.4324\/9781315417851"},{"key":"ref_26","unstructured":"Massung, E. (2012). Visitor Reception to Location-based Interpretation at Archaeological and Heritage Sites. Thinking beyond the Tool: Archaeological Computing and the Interpretive Process, Archaeopress."},{"key":"ref_27","unstructured":"Danks, M., Goodchild, M., Rodriguez-Echavarria, K., Arnold, D., and Griffiths, R. (2007, January 11\u201313). Interactive Storytelling and Gaming Environments for Museums: The Interactive Storytelling Exhibition Project. Proceedings of the 2nd International Conference on Technologies for E-Learning and Digital Entertainment, LNCS 4469, Hong Kong, China."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"308","DOI":"10.1046\/j.0266-4909.2003.jca_023.x","article-title":"A study of user experiences mediated by nomadic web content in a museum","volume":"19","author":"Hsi","year":"2003","journal-title":"J. Comput. Assist. Learn."},{"key":"ref_29","unstructured":"Woodruff, A., Aoki, P.M., Hurst, A., and Szymanski, M.H. (2001, January 3\u20137). Electronic Guidebooks and Visitor Attention. Proceedings of the 6th International Cultural Heritage Informatics Meeting (ICHIM), Milan, Italy."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Damala, A., Cubaud, P., Bationo, A., Houlier, P., and Marchal, I. (2008, January 10\u201312). Bridging the Gap between the Digital and the Physical: Design and Evaluation of a Mobile Augmented Reality Guide for the Museum Visit. Proceedings of the 3rd International Conference on Digital Interactive Media in Entertainment and Arts\u2014DIMEA \u201908, Athens, Greece.","DOI":"10.1145\/1413634.1413660"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/2677083","article-title":"Conducting Visitor Studies Using Smartphone-Based Location Sensing","volume":"8","author":"Moussouri","year":"2015","journal-title":"ACM J. Comput. Cult. Heritage"},{"key":"ref_32","unstructured":"Abowd, G.D., Shafer, S., and Brumitt, B. (October, January 30). The Conversational Role of Electronic Guidebooks. Proceedings of the 3rd International Conference on Ubiquitous Computing, Atlanta, GA, USA."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"235","DOI":"10.1111\/j.1365-2729.2004.00089.x","article-title":"A constructivist mobile learning environment supported by a wireless handheld network","volume":"20","author":"Zurita","year":"2004","journal-title":"J. Comput. Assist. Learn."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"73","DOI":"10.1007\/s11257-011-9104-x","article-title":"Personalization in cultural heritage: The road travelled and the one ahead","volume":"22","author":"Ardissono","year":"2011","journal-title":"User Model. User Adapt. Interact."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"417","DOI":"10.1007\/s11257-008-9053-1","article-title":"A stroll with Carletto: Adaptation in drama-based tours with virtual characters","volume":"18","author":"Damiano","year":"2008","journal-title":"User Model. User Adapt. Interact."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Roussou, M., Katifori, A., Pujol, L., Vayanou, M., and Rennick-Egglestone, S.J. (May, January 27). A Life of Their Own: Museum Visitor Personas Penetrating the Design Lifecycle of a Mobile Experience. Proceedings of the CHI 2013 Extended Abstracts on Human Factors in Computing Systems\u2014CHIEA\u201913, Paris, France.","DOI":"10.1145\/2468356.2468453"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Tolmie, P., Benford, S., Greenhalgh, C., Rodden, T., and Reeves, S. (2014, January 15\u201319). Supporting group interactions in museum visiting. Proceedings of the 17th ACM Conference on Computer Supported Cooperative Work & Social Computing\u2014CSCW\u201914, Baltimore, MD, USA.","DOI":"10.1145\/2531602.2531619"},{"key":"ref_38","unstructured":"Roussou, M., Pujol, L., Katifori, A., Chrysanthi, A., Perry, S., and Vayanou, M. (2015, January 8\u201311). The museum as digital storyteller: Collaborative participatory creation of interactive digital experiences. Proceedings of the 19th annual Museums and the Web Conference, Chicago, IL, USA."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Benford, S., Giannachi, G., Koleva, B., and Rodden, T. (2009, January 4\u20139). From Interaction to Trajectories: Designing Coherent Journeys through User Experiences. Proceedings of the CHI \u201909: SIGCHI Conference on Human Factors in Computing Systems, Boston, MA, USA.","DOI":"10.1145\/1518701.1518812"},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Roto, V., Vermeeren, A.P.O.S., V\u00e4\u00e4n\u00e4nen-Vainio-Mattila, K., and Law, E.L.-C. (2011, January 5\u20139). User Experience Evaluation\u2013Which Method to Choose?. Proceedings of the 13th IFIP TC 13 International Conference, Human-Computer Interaction\u2014INTERACT 2011, Lisbon, Portugal.","DOI":"10.1007\/978-3-642-23768-3_129"},{"key":"ref_41","unstructured":"Antoniou, A., Katifori, A., Roussou, M., Vayanou, M., Karvounis, M., Kyriakidi, M., and Pujol-Tost, L. (2016, January 13\u201317). Capturing the Visitor Profile for a Personalized Mobile Museum Experience: An Indirect Approach. Proceedings of the 24th ACM Conference on User Modeling, Adaptation and Personalisation (UMAP 2016), Halifax, NS, Canada."},{"key":"ref_42","unstructured":"Fosh, L., Benford, S., Reeves, S., Koleva, B., and Brundell, P. (May, January 27). \u2018See Me, Feel Me, Touch Me, Hear Me\u2019: Trajectories and Interpretation in a Sculpture Garden. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems\u2014CHI\u201913, Paris, France."},{"key":"ref_43","unstructured":"Katifori, A., Perry, S., Vayanou, M., Pujol, L., Chrysanthi, A., and Ioannidis, Y. (2016, January 6\u20139). Cultivating mobile-mediated social interaction in the museum: Towards group-based digital storytelling experiences. Proceedings of the MW2016: Museums and the Web 2016, Los Angeles, CA, USA."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"685","DOI":"10.1109\/DigitalHeritage.2013.6744836","article-title":"A digital look at physical museum exhibits: Designing personalized stories with handheld Augmented Reality in museums","volume":"Volume 2","author":"Keil","year":"2013","journal-title":"Proceedings of the Digital Heritage International Congress (DigitalHeritage)"},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"313","DOI":"10.1007\/s00779-016-0994-9","article-title":"Visualizing museum visitors\u2019 behavior: Where do they go and what do they do there?","volume":"21","author":"Lanir","year":"2017","journal-title":"Pers. Ubiquitous Comput."}],"container-title":["Multimodal Technologies and Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2414-4088\/2\/2\/32\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T15:08:08Z","timestamp":1760195288000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2414-4088\/2\/2\/32"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,6,11]]},"references-count":45,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2018,6]]}},"alternative-id":["mti2020032"],"URL":"https:\/\/doi.org\/10.3390\/mti2020032","relation":{},"ISSN":["2414-4088"],"issn-type":[{"value":"2414-4088","type":"electronic"}],"subject":[],"published":{"date-parts":[[2018,6,11]]}}}