{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T03:58:15Z","timestamp":1760241495094,"version":"build-2065373602"},"reference-count":63,"publisher":"MDPI AG","issue":"2","license":[{"start":{"date-parts":[[2018,4,5]],"date-time":"2018-04-05T00:00:00Z","timestamp":1522886400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["MTI"],"abstract":"<jats:p>With the emerging trend in Human-Computer Interaction (HCI) shifting focus from usability to facilitating meaningful experiences, the notion of embodied cognition provides designers and researchers with valuable insight into how the body\u2013mind interplay can influence meaning-making during embodied experiences. This paper presents an approach to designing embodied interactions with ambient media. Building on theories of embodied cognition and cognitive semantics, we developed our approach by conducting a series of studies, including an interpretive case analysis, empirical research into audience experience and design ideations, as well as designerly reflections on design. Our findings showed that an embodied approach is applicable for designing meaningful interactions, by coupling bodily engagement with metaphorical meanings. Design implications and future work are also presented.<\/jats:p>","DOI":"10.3390\/mti2020013","type":"journal-article","created":{"date-parts":[[2018,4,5]],"date-time":"2018-04-05T16:50:58Z","timestamp":1522947058000},"page":"13","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":10,"title":["An Embodied Approach to Designing Meaningful Experiences with Ambient Media"],"prefix":"10.3390","volume":"2","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-7481-5670","authenticated-orcid":false,"given":"Liang","family":"Tan","sequence":"first","affiliation":[{"name":"School of Design, The Hong Kong Polytechnic University, 11 Yuk Choi Rd, Hung Hom, Hong Kong, China"}]},{"given":"Kenny","family":"Chow","sequence":"additional","affiliation":[{"name":"School of Design, The Hong Kong Polytechnic University, 11 Yuk Choi Rd, Hung Hom, Hong Kong, China"}]}],"member":"1968","published-online":{"date-parts":[[2018,4,5]]},"reference":[{"key":"ref_1","unstructured":"Gibson, J.J. (1979). The Ecological Approach to Visual Perception, Houghton Mifflin."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"625","DOI":"10.3758\/BF03196322","article-title":"Six views of embodied cognition","volume":"9","author":"Wilson","year":"2002","journal-title":"Psychon. Bull. Rev."},{"key":"ref_3","first-page":"524","article-title":"Bodily action and metaphorical meaning","volume":"36","author":"Gibbs","year":"2002","journal-title":"Style"},{"key":"ref_4","unstructured":"Karat, J., and Vanderdonckt, J. (2011). Springboard: Designing image schema based embodied interaction for an abstract domain. Whole Body Interaction, Springer."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"525","DOI":"10.1016\/j.destud.2008.07.009","article-title":"Designing for creative engagement","volume":"29","author":"Bilda","year":"2008","journal-title":"Des. Stud."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"451","DOI":"10.1093\/iwc\/iwv022","article-title":"Provoking Imagination and Emotion through a Lively Mobile Phone: A User Experience Study","volume":"28","author":"Chow","year":"2016","journal-title":"Interact. Comput."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1080\/10447318.2016.1232227","article-title":"How Cognitive Linguistics Inspires HCI: Image Schemas and Image-Schematic Metaphors","volume":"33","author":"Hurtienne","year":"2017","journal-title":"Int. J. Hum.-Comput. Interact."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"315","DOI":"10.1016\/j.actpsy.2005.02.001","article-title":"Grounding abstract object characteristics in embodied interactions","volume":"119","author":"Hekkert","year":"2005","journal-title":"Acta Psychol."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"7","DOI":"10.1145\/2442106.2442113","article-title":"Moving and making strange: An embodied approach to movement-based interaction design","volume":"20","author":"Loke","year":"2013","journal-title":"ACM Trans. Comput.-Hum. Interact."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"353","DOI":"10.1016\/j.intcom.2010.04.002","article-title":"Needs, affect, and interactive products\u2014Facets of user experience","volume":"22","author":"Hassenzahl","year":"2010","journal-title":"Interact. Comput."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"256","DOI":"10.1108\/09555341111130245","article-title":"Sensory marketing: The multi-sensory brand-experience concept","volume":"23","author":"Hulten","year":"2011","journal-title":"Eur. Bus. Rev."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"160","DOI":"10.1016\/j.destud.2013.10.001","article-title":"A framework for user experience, needs and affordances","volume":"35","author":"Pucillo","year":"2014","journal-title":"Des. Stud."},{"key":"ref_13","first-page":"1","article-title":"The current relevance of Merleau-Ponty\u2019s phenomenology of embodiment","volume":"4","author":"Dreyfus","year":"1996","journal-title":"Electron. J. Anal. Philos."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Varela, F., Thompson, E., and Rosch, E. (1991). The Embodied Mind: Cognitive Science and Human Experience, MIT Press.","DOI":"10.7551\/mitpress\/6730.001.0001"},{"key":"ref_15","unstructured":"Merleau-Ponty, M. (1962). Phenomenology of Perception, Routledge & Kegan Paul."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Dourish, P. (2001). Where the Action Is: The Foundations of Embodied Interaction, MIT Press.","DOI":"10.7551\/mitpress\/7221.001.0001"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"433","DOI":"10.1007\/s00779-011-0410-4","article-title":"Embodied metaphors in tangible interaction design","volume":"16","author":"Bakker","year":"2012","journal-title":"Pers. Ubiquitous Comput."},{"key":"ref_18","first-page":"9","article-title":"An analysis of input-output relations in interaction with smart tangible objects","volume":"20","author":"Offermans","year":"2013","journal-title":"ACM Trans. Comput.-Hum. Interact."},{"key":"ref_19","first-page":"1","article-title":"Interaction design for and with the lived body: Some implications of merleau-ponty\u2019s phenomenology","volume":"20","year":"2013","journal-title":"ACM Trans. Comput.-Hum. Interact."},{"key":"ref_20","unstructured":"Hornecker, E., Marshall, P., and Hurtienne, J. (2017, January 6\u201311). Locating Theories of Embodiment along Three Axes: 1st\u20133d Person, Body-Context, Practice-Cognition. Proceedings of the Workshop Position Paper for CHI 2017 Workshop on Soma-Based Design Theory, Denver, CO, USA."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Johnson, M. (1987). The Body in the Mind: The Bodily Basis of Meaning, Imagination, and Reason, University of Chicago Press.","DOI":"10.7208\/chicago\/9780226177847.001.0001"},{"key":"ref_22","unstructured":"Lakoff, G., and Johnson, M. (1980). Metaphors We Live By, University of Chicago Press."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"49","DOI":"10.1207\/s15516709cog1201_2","article-title":"Force dynamics in language and cognition","volume":"12","author":"Talmy","year":"1988","journal-title":"Cognit. Sci."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Talmy, L. (2000). Toward a Cognitive Semantics, MIT Press.","DOI":"10.7551\/mitpress\/6847.001.0001"},{"key":"ref_25","unstructured":"Evans, V., and Green, M. (2006). Cognitive Linguistics: An Introduction, Edinburgh University Press."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"773","DOI":"10.1111\/j.1756-8765.2012.01222.x","article-title":"Explaining Embodied Cognition Results","volume":"4","author":"Lakoff","year":"2012","journal-title":"Top. Cognit. Sci."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Chow, K.K.N. (2017, January 9\u201314). Investigating User Interpretation of Dynamic Metaphorical Interfaces. Proceedings of the International Conference of Design, User Experience, and Usability, Vancouver, BC, Canada.","DOI":"10.1007\/978-3-319-58634-2_4"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Hurtienne, J., and Israel, J.H. (2007, January 15\u201317). Image Schemas and Their Metaphorical Extensions\u2014Intuitive Patterns for Tangible Interaction. Proceedings of the 1st international conference on Tangible and embedded interaction, TEI \u203207, Baton Rouge, LA, USA.","DOI":"10.1145\/1226969.1226996"},{"key":"ref_29","unstructured":"Tan, L., and Chow, K.K.N. (2016, January 2\u20134). An embodied interaction framework for facilitating audience experience with ambient media. Proceedings of the Fourth International Conference on Design Creativity (4th ICDC), Atlanta, GA, USA."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"442","DOI":"10.1111\/tops.12024","article-title":"TEST: A tropic, embodied, and situated theory of cognition","volume":"6","author":"Myachykov","year":"2014","journal-title":"Top. Cognit. Sci."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Shapiro, L. (2010). Embodied Cognition, Routledge.","DOI":"10.4324\/9780203850664"},{"key":"ref_32","unstructured":"Oxford-Dictionaries (2017, November 21). Ambient. Available online: https:\/\/en.oxforddictionaries.com."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Tan, L., and Chow, K.K.N. (2017, January 8\u20139). Facilitating Meaningful Experience with Ambient Media: An Embodied Engagement Model. Proceedings of the Fifth International Symposium of Chinese CHI, Guangzhou, China.","DOI":"10.1145\/3080631.3080638"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"385","DOI":"10.1007\/s11042-010-0671-3","article-title":"Connecting the real world with the digital overlay with smart ambient media\u2014Applying Peirce\u2019s categories in the context of ambient media","volume":"58","author":"Lugmayr","year":"2012","journal-title":"Multimedia Tools Appl."},{"key":"ref_35","unstructured":"Vatavu, R.D. (2009, January 31\u201331). Enhancing human-human interactions through emotional responsive ambient media. Proceedings of the 2nd Workshop on Semantic Ambient Media Experience\u2014SAME, Salzburg, Austria."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Krueger, M.W. (1977, January 13\u201316). Responsive environments. Proceedings of the National Computer Conference, Dallas, TX, USA.","DOI":"10.1145\/1499402.1499476"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"347","DOI":"10.3233\/AIS-2010-0080","article-title":"Responsive environments: User experiences for ambient intelligence","volume":"2","author":"Salem","year":"2010","journal-title":"J. Ambient Intell. Smart Environ."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1111\/j.1468-5914.1989.tb00133.x","article-title":"Affordances and the body: An intentional analysis of Gibson\u2019s ecological approach to visual perception","volume":"19","author":"Heft","year":"1989","journal-title":"J. Theory Soc. Behave."},{"key":"ref_39","unstructured":"Norman, D. (1988). The Design of Everyday Things, Basic Books."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"40","DOI":"10.1080\/07370024.2012.688468","article-title":"Understanding the role of body movement in player engagement","volume":"28","year":"2013","journal-title":"Hum.-Comput. Interact."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Green, W., and Jordan, P. (2002). The basis of product emotions. Pleasure with Products, beyond Usability, Taylor & Francis.","DOI":"10.1201\/9780203302279.ch0"},{"key":"ref_42","first-page":"1","article-title":"Types of Embodiment in Design: The Embodied Foundations of Meaning and Affect in Product Design","volume":"9","author":"Ludden","year":"2015","journal-title":"Int. J. Des."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"52","DOI":"10.1509\/jmkg.73.3.052","article-title":"Brand experience: What is it? How is it measured? Does it affect loyalty?","volume":"73","author":"Brakus","year":"2009","journal-title":"J. Market."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"311","DOI":"10.1093\/iwc\/iwu051","article-title":"Strategies for Intuitive Interaction in Public Urban Spaces","volume":"27","author":"Hespanhol","year":"2015","journal-title":"Interact. Comput."},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Wouters, N., Downs, J., Harrop, M., Cox, T., Oliveira, E., Webber, S., and Vande Moere, A. (2016, January 4\u20138). Uncovering the honeypot effect: How audiences engage with public interactive systems. Proceedings of the 2016 ACM Conference on Designing Interactive Systems, Brisbane, Australia.","DOI":"10.1145\/2901790.2901796"},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"42","DOI":"10.1177\/160940690400300104","article-title":"A phenomenological research design illustrated","volume":"3","author":"Groenewald","year":"2004","journal-title":"Int. J. Qual. Methods"},{"key":"ref_47","unstructured":"Creswell, J.W. (2007). Qualitative Inquiry and Research Design: Choosing among Five Approaches, Sage Publications."},{"key":"ref_48","first-page":"143","article-title":"Pragmatism and Design Thinking","volume":"8","author":"Dalsgaard","year":"2014","journal-title":"Int. J. Des."},{"key":"ref_49","first-page":"32","article-title":"Research through design is more than just a new form of disseminating design outcomes","volume":"11","author":"Jonas","year":"2015","journal-title":"Constr. Found."},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Zimmerman, J., Stolterman, E., and Forlizzi, J. (2010, January 16\u201320). An analysis and critique of research through design: Towards a formalization of a research approach. Proceedings of the 8th ACM Conference on Designing Interactive Systems, Aarhus, Denmark.","DOI":"10.1145\/1858171.1858228"},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"20","DOI":"10.1145\/3076255","article-title":"What Makes a Good CHI Design Paper?","volume":"24","author":"Gaver","year":"2017","journal-title":"Interactions"},{"key":"ref_52","doi-asserted-by":"crossref","unstructured":"Guest, G., MacQueen, K.M., and Namey, E.E. (2012). Applied Thematic Analysis, Sage.","DOI":"10.4135\/9781483384436"},{"key":"ref_53","doi-asserted-by":"crossref","unstructured":"Tan, L., and Chow, K.K.N. (2017, January 25\u201329). Piano Staircase: Exploring Movement-based Meaning Making in Interacting with Ambient Media. Proceedings of the IFIP Conference on Human-Computer Interaction, Mumbai, India.","DOI":"10.1007\/978-3-319-67744-6_19"},{"key":"ref_54","unstructured":"DDB (2017, April 28). Piano Staircase. Available online: http:\/\/www.thefuntheory.com\/piano-staircase."},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"315","DOI":"10.1080\/01449290310001592587","article-title":"Cognitive, physical, sensory, and functional affordances in interaction design","volume":"22","author":"Hartson","year":"2003","journal-title":"Behav. Inf. Technol."},{"key":"ref_56","unstructured":"Zimmerman, J., Forlizzi, J., and Evenson, S. (May, January 30). Research through design as a method for interaction design research in HCI. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, San Jose, CA, USA."},{"key":"ref_57","doi-asserted-by":"crossref","unstructured":"Hampe, B., and Grady, J.E. (2005). The philosophical significance of image schemas. From Perception to Meaning: Image Schemas in Cognitive Linguistics, Walter de Gruyter.","DOI":"10.1515\/9783110197532"},{"key":"ref_58","unstructured":"UN (2017, September 20). The Global Goals. Available online: www.globalgoals.org."},{"key":"ref_59","first-page":"1","article-title":"Approachability: How people interpret automatic door movement as gesture","volume":"3","author":"Ju","year":"2009","journal-title":"Int. J. Des."},{"key":"ref_60","first-page":"283","article-title":"Analogies and metaphors in creative design","volume":"24","author":"Hey","year":"2008","journal-title":"Int. J. Eng. Educ."},{"key":"ref_61","doi-asserted-by":"crossref","first-page":"57","DOI":"10.1145\/198366.198381","article-title":"A guide to metaphorical design","volume":"37","author":"Madsen","year":"1994","journal-title":"Commun. ACM"},{"key":"ref_62","doi-asserted-by":"crossref","first-page":"33","DOI":"10.1080\/13527266.2014.970823","article-title":"Unusual location and unexpected execution in advertising: A content analysis and test of effectiveness in ambient advertisements","volume":"21","author":"Hutter","year":"2015","journal-title":"J. Market. Commun."},{"key":"ref_63","first-page":"41","article-title":"Designing for unexpected encounters with digital products: Case studies of serendipity as felt experience","volume":"6","author":"Liang","year":"2012","journal-title":"Int. J. Des."}],"container-title":["Multimodal Technologies and Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2414-4088\/2\/2\/13\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T14:59:45Z","timestamp":1760194785000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2414-4088\/2\/2\/13"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,4,5]]},"references-count":63,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2018,6]]}},"alternative-id":["mti2020013"],"URL":"https:\/\/doi.org\/10.3390\/mti2020013","relation":{},"ISSN":["2414-4088"],"issn-type":[{"type":"electronic","value":"2414-4088"}],"subject":[],"published":{"date-parts":[[2018,4,5]]}}}