{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,24]],"date-time":"2026-01-24T02:41:49Z","timestamp":1769222509900,"version":"3.49.0"},"reference-count":63,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2023,11,15]],"date-time":"2023-11-15T00:00:00Z","timestamp":1700006400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Comput. Sci."],"abstract":"<jats:sec><jats:title>Introduction<\/jats:title><jats:p>When we taste, we take in a variety of sensory information that can be completely independent from the properties of the food itself: the ambient lighting and environmental sounds can all influence our taste perception and affective responses. However, current multisensory research is mixed as to whether these In Real Life (IRL) findings also apply to Extended Reality (XR) environments. A potential reason for this may be the limited realism of some XR scenarios, which this study aimed to overcome through an immersive Virtual Reality experience (VR, chosen for its greater realism relative to other XR applications) whilst also expanding the scope to flavour perception.<\/jats:p><\/jats:sec><jats:sec><jats:title>Methods<\/jats:title><jats:p>A total of 34 participants rated food samples under neutral, red, and green ambient lighting in VR. Participants ate either lime flavoured, strawberry flavoured, or \u201cNeutral\u201d (no added flavour) samples.<\/jats:p><\/jats:sec><jats:sec><jats:title>Results<\/jats:title><jats:p>While participants were equally immersed in all three environments, they rated the red and green lighting environments as substantially less natural than the neutral lighting environment. Interestingly, while participants associated sweetness and sourness with red lighting and green lighting respectively, this minimally extended to their behavioural ratings, when sampling the stimuli in VR. Samples eaten under red lighting were rated as significantly sweeter than those eaten under neutral lighting. However, neither red nor green lighting affected sample sourness nor the intensity of strawberry or lime flavour.<\/jats:p><\/jats:sec><jats:sec><jats:title>Discussion<\/jats:title><jats:p>This study found limited evidence of multisensory integration in XR, wherein taste expectations do not extend to taste experiences. We discuss these results in light of prior works on crossmodal associations and raise a reflection on why multisensory integration of taste may not apply to XR in our study. While there is much excitement about the opportunities XR can offer, we argue that we are only at the beginning of understanding the experiences on the reality-virtuality continuum and that we need to establish a richer understanding of participants' experiences, expectations, and taste\/flavour perceptions between IRL and XR.<\/jats:p><\/jats:sec>","DOI":"10.3389\/fcomp.2023.1268849","type":"journal-article","created":{"date-parts":[[2023,11,15]],"date-time":"2023-11-15T09:32:26Z","timestamp":1700040746000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":9,"title":["Reality bites: highlighting the potential discrepancies between multisensory taste perception in extended and physical reality"],"prefix":"10.3389","volume":"5","author":[{"given":"Christopher","family":"Dawes","sequence":"first","affiliation":[]},{"given":"Sabina","family":"Beganovic","sequence":"additional","affiliation":[]},{"given":"Matti","family":"Schwalk","sequence":"additional","affiliation":[]},{"given":"Michaela","family":"Mai","sequence":"additional","affiliation":[]},{"given":"Steve","family":"Pawlizak","sequence":"additional","affiliation":[]},{"given":"Jingxin","family":"Zhang","sequence":"additional","affiliation":[]},{"given":"Gabriele","family":"Nelles","sequence":"additional","affiliation":[]},{"given":"Nadejda","family":"Krasteva","sequence":"additional","affiliation":[]},{"given":"Marianna","family":"Obrist","sequence":"additional","affiliation":[]}],"member":"1965","published-online":{"date-parts":[[2023,11,15]]},"reference":[{"key":"B1","doi-asserted-by":"publisher","first-page":"103998","DOI":"10.1016\/j.foodqual.2020.103998","article-title":"True colours: Advantages and challenges of virtual reality in a sensory science experiment on the influence of colour on flavour identification","volume":"86","author":"Ammann","year":"2020","journal-title":"Food Qual. Prefer."},{"key":"B2","doi-asserted-by":"publisher","first-page":"293","DOI":"10.1136\/tobaccocontrol-2019-055524","article-title":"\u201cIt has candy. You need to press on it\u201d: Young adults' perceptions of flavoured cigarettes in the Philippines","volume":"30","author":"Brown","year":"2021","journal-title":"Tob. Control"},{"key":"B3","doi-asserted-by":"publisher","first-page":"157","DOI":"10.1016\/j.foodqual.2019.03.001","article-title":"Cup colour influences consumers' expectations and experience on tasting specialty coffee","volume":"75","author":"Carvalho","year":"2019","journal-title":"Food Qual. Prefer."},{"key":"B4","doi-asserted-by":"publisher","first-page":"465","DOI":"10.3390\/foods9040465","article-title":"Assessing the influence of visual-taste congruency on perceived sweetness and product liking in immersive VR","volume":"9","author":"Chen","year":"2020","journal-title":"Foods"},{"key":"B5","doi-asserted-by":"publisher","first-page":"100626","DOI":"10.1016\/j.ijgfs.2022.100626","article-title":"Virtually tasty: An investigation of the effect of ambient lighting and 3D-shaped taste stimuli on taste perception in virtual reality","volume":"30","author":"Cornelio","year":"2022","journal-title":"Int. J. Gastron. Food Sci."},{"key":"B6","first-page":"706","article-title":"Visual analogue scale (VAS)","volume":"10","author":"Crichton","year":"2001","journal-title":"J. Clin. Nurs."},{"key":"B7","doi-asserted-by":"crossref","DOI":"10.1016\/B978-008045046-9.01674-0","article-title":"\u201cTaste: vertebrate psychophysics,\u201d","volume-title":"Encyclopedia of Neuroscience","author":"Duffy","year":"2009"},{"key":"B8","doi-asserted-by":"publisher","first-page":"133","DOI":"10.1163\/22134808-00002497","article-title":"When sandpaper is \u201ckiki\u201d and satin is \u201cbouba\u201d: An exploration of the associations between words, emotional states, and the tactile attributes of everyday materials","volume":"29","author":"Etzi","year":"2016","journal-title":"Multisens. Res."},{"key":"B9","doi-asserted-by":"publisher","first-page":"22","DOI":"10.1186\/s13411-015-0032-2","article-title":"Bouba-Kiki in the plate: combining crossmodal correspondences to change flavour experience","volume":"4","author":"Fairhurst","year":"2015","journal-title":"Flavour"},{"key":"B10","doi-asserted-by":"publisher","first-page":"37034","DOI":"10.1038\/srep37034","article-title":"Food color is in the eye of the beholder: the role of human trichromatic vision in food evaluation","volume":"6","author":"Foroni","year":"2016","journal-title":"Sci. Rep."},{"key":"B11","doi-asserted-by":"publisher","first-page":"200","DOI":"10.1016\/j.actpsy.2018.05.011","article-title":"Bouba or kiki with and without vision: Shape-audio regularities and mental images","volume":"188","author":"Graven","year":"2018","journal-title":"Acta Psychol."},{"key":"B12","doi-asserted-by":"publisher","first-page":"21","DOI":"10.1186\/2044-7248-2-21","article-title":"The taste of cutlery: how the taste of food is affected by the weight, size, shape, and colour of the cutlery used to eat it","volume":"2","author":"Harrar","year":"2013","journal-title":"Flavour"},{"key":"B13","doi-asserted-by":"publisher","first-page":"168","DOI":"10.1016\/j.chb.2019.01.027","article-title":"Influence of virtual color on taste: Multisensory integration between virtual and real worlds","volume":"95","author":"Huang","year":"2019","journal-title":"Comput. Hum. Behav."},{"key":"B14","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3001773.3001776","article-title":"\u201cMoving feast: effects of color, shape and animation on taste associations and taste perceptions,\u201d","author":"Huisman","year":"2016","journal-title":"ACM International Conference Proceeding Series"},{"key":"B15","first-page":"105","article-title":"\u201cThe influence of multisensory design in indoor environment on the fruit juice drinking experience,\u201d","author":"Istiani","year":"2022","journal-title":"Proceedings of the 24th International Congress on Acoustics October 24\u201328th"},{"key":"B16","doi-asserted-by":"publisher","first-page":"233","DOI":"10.1080\/00223980309600611","article-title":"Preconceptions of taste based on color","volume":"137","author":"Koch","year":"2003","journal-title":"J. Psychol. Interdiscip. Appl."},{"key":"B17","volume-title":"Gestalt Psychology","author":"K\u00f6hler","year":"1929"},{"key":"B18","doi-asserted-by":"publisher","first-page":"189402","DOI":"10.1155\/2015\/189402","article-title":"Umami the fifth basic taste: history of studies on receptor mechanisms and role as a food flavor","volume":"2015","author":"Kurihara","year":"2015","journal-title":"Biomed Res. Int."},{"key":"B19","first-page":"216","article-title":"Package \u201cemmeans.\u201d","volume":"34","author":"Lenth","year":"2020","journal-title":"CRAN Repos."},{"key":"B20","doi-asserted-by":"publisher","first-page":"e101651","DOI":"10.1371\/journal.pone.0101651","article-title":"Cross-cultural color-odor associations","volume":"9","author":"Levitan","year":"2014","journal-title":"PLoS ONE"},{"key":"B21","doi-asserted-by":"publisher","first-page":"207","DOI":"10.1163\/22134808-00002457","article-title":"Red hot: the crossmodal effect of color intensity on perceived piquancy","volume":"27","author":"Levitan","year":"2014","journal-title":"Multisens. Res."},{"key":"B22","doi-asserted-by":"publisher","first-page":"19","DOI":"10.1016\/j.foodres.2018.04.024","article-title":"Using immersive technologies to explore the effects of congruent and incongruent contextual cues on context recall, product evaluation time, and preference and liking during consumer hedonic testing","volume":"117","author":"Liu","year":"2019","journal-title":"Food Res. Int."},{"key":"B23","doi-asserted-by":"publisher","first-page":"104315","DOI":"10.1016\/j.foodqual.2021.104315","article-title":"Tasting atmospherics: Taste associations with colour parameters of coffee shop interiors","volume":"94","author":"Motoki","year":"2021","journal-title":"Food Qual. Prefer."},{"key":"B24","doi-asserted-by":"publisher","first-page":"93","DOI":"10.1145\/1978942.1978957","article-title":"\u201cAugmented reality flavors: Gustatory display based on Edible Marker and cross-modal interaction,\u201d","author":"Narumi","year":"2011","journal-title":"Conference on Human Factors in Computing Systems - Proceedings"},{"key":"B25","doi-asserted-by":"publisher","first-page":"361","DOI":"10.1016\/j.foodqual.2012.10.004","article-title":"Assessing crossmodal correspondences in exotic fruit juices: the case of shape and sound symbolism","volume":"28","author":"Ngo","year":"2013","journal-title":"Food Qual. Prefer."},{"key":"B26","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3001959.3001966","article-title":"\u201cProjective-AR system for customizing the appearance and taste of food,\u201d","volume":"2016","author":"Nishizawa","year":"2016","journal-title":"Proceedings of the 2016 Workshop on Multimodal Virtual and Augmented Reality, MVAR 2016 - In Conjunction with ACM ICMI"},{"key":"B27","doi-asserted-by":"publisher","first-page":"293","DOI":"10.1111\/j.2044-8295.2011.02072.x","article-title":"The effect of background music on the taste of wine","volume":"103","author":"North","year":"2012","journal-title":"Br. J. Psychol."},{"key":"B28","author":"Nyg\u00e5rd","year":"2020","journal-title":"How changes in environmental colour hue affect taste expectations, perceptions, and product preferences at different levels of attention towards atmospheric cues: A mixed experimental design."},{"key":"B29","doi-asserted-by":"publisher","first-page":"2853","DOI":"10.1145\/2556288.2557007","article-title":"\u201cTemporal, affective, and embodied characteristics of taste experiences: A framework for design,\u201d","author":"Obrist","year":"2014","journal-title":"Proceedings of the SIGCHI Conference on Human Factors in Computing Systems"},{"key":"B30","doi-asserted-by":"publisher","first-page":"627","DOI":"10.1068\/p120627","article-title":"Gustatory responses to nongustatory stimuli","volume":"12","author":"O'Mahony","year":"1983","journal-title":"Perception"},{"key":"B31","doi-asserted-by":"publisher","first-page":"16734","DOI":"10.3390\/ijerph192416734","article-title":"Digital forms of commensality in the 21st Century: a scoping review","volume":"19","author":"Pereira-Castro","year":"2022","journal-title":"Int. J. Environ. Res. Public Health"},{"key":"B32","doi-asserted-by":"publisher","DOI":"10.3390\/foods8020042","article-title":"Environmental immersion's influence on hedonics, perceived appropriateness, and willingness to pay in alcoholic beverages","author":"Picket","year":"2019","journal-title":"Foods"},{"key":"B33","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4419-0318-1","article-title":"\u201cLinear mixed-effects models: basic concepts and examples,\u201d","author":"Pinheiro","year":"2000","journal-title":"Mixed-Effects Models in S and S-Plus"},{"key":"B34","doi-asserted-by":"publisher","first-page":"358","DOI":"10.1111\/j.1745-459X.2011.00351.x","article-title":"Do the material properties of cutlery affect the perception of the food you eat? An exploratory study","volume":"26","author":"Piqueras-Fiszman","year":"2011","journal-title":"J. Sensory Stud."},{"key":"B35","doi-asserted-by":"publisher","first-page":"165","DOI":"10.1016\/j.foodqual.2014.09.013","article-title":"Sensory expectations based on product-extrinsic food cues: an interdisciplinary review of the empirical evidence and theoretical accounts","volume":"40","author":"Piqueras-Fiszman","year":"2015","journal-title":"Food Qual. Prefer."},{"key":"B36","volume-title":"R: A Language and Environment for Statistical Computing.","year":"2019"},{"key":"B37","doi-asserted-by":"publisher","first-page":"e12549","DOI":"10.1111\/joss.12549","article-title":"Relationship between tactile stimuli and basic tastes: CATA with consumers with visual disability","volume":"35","author":"Riofrio-Grijalva","year":"2020","journal-title":"J. Sens. Stud."},{"key":"B38","doi-asserted-by":"publisher","first-page":"1382","DOI":"10.3389\/fpsyg.2015.01382","article-title":"The sweetest thing: the influence of angularity, symmetry, and the number of elements on shape-valence and shape-taste matches","volume":"6","author":"Salgado-Montejo","year":"2015","journal-title":"Front. Psychol."},{"key":"B39","doi-asserted-by":"publisher","first-page":"475","DOI":"10.1093\/chemse\/bjy033","article-title":"Cross-modal associations between real tastes and colors","volume":"43","author":"Saluja","year":"2018","journal-title":"Chem. Senses"},{"key":"B40","doi-asserted-by":"publisher","first-page":"1981","DOI":"10.3758\/APP.72.7.1981","article-title":"An expectations-based approach to explaining the cross43 modal influence of color on orthonasal olfactory identification: The influence of the degree of discrepancy","volume":"72","author":"Shankar","year":"2010","journal-title":"Atten Percept Psychophys."},{"key":"B41","doi-asserted-by":"publisher","first-page":"58","DOI":"10.1016\/j.neuropsychologia.2015.07.011","article-title":"Cross-modal tactile\u2013taste interactions in food evaluations","volume":"88","author":"Slocombe","year":"2016","journal-title":"Neuropsychologia"},{"key":"B42","doi-asserted-by":"publisher","first-page":"971","DOI":"10.3758\/s13414-010-0073-7","article-title":"Crossmodal correspondences: a tutorial review","volume":"73","author":"Spence","year":"2011","journal-title":"Attent. Percept. Psychophys."},{"key":"B43","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/s13411-015-0031-3","article-title":"On the psychological impact of food colour","volume":"4","author":"Spence","year":"2015","journal-title":"Flavour"},{"key":"B44","doi-asserted-by":"publisher","first-page":"645","DOI":"10.1163\/22134808-20191494","article-title":"Temperature-based crossmodal correspondences: causes and consequences","volume":"33","author":"Spence","year":"2020","journal-title":"Multisens. Res."},{"key":"B45","doi-asserted-by":"publisher","first-page":"100695","DOI":"10.1016\/j.ijgfs.2023.100695","article-title":"Digitally enhancing tasting experiences","volume":"32","author":"Spence","year":"2023","journal-title":"Int. J. Gastron. Food Sci."},{"key":"B46","doi-asserted-by":"publisher","first-page":"20416695211018223","DOI":"10.1177\/20416695211018223","article-title":"Explaining crossmodal correspondences between colours and tastes","volume":"12","author":"Spence","year":"2021","journal-title":"Iperception."},{"key":"B47","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/2044-7248-3-8","article-title":"A large sample study on the influence of the multisensory environment on the wine drinking experience","volume":"3","author":"Spence","year":"2014","journal-title":"Flavour"},{"key":"B48","doi-asserted-by":"publisher","first-page":"100179","DOI":"10.1016\/j.ijgfs.2019.100179","article-title":"Synaesthesia: the multisensory dining experience","volume":"18","author":"Spence","year":"2019","journal-title":"Int. J. Gastron. Food Sci."},{"key":"B49","doi-asserted-by":"publisher","first-page":"85","DOI":"10.1006\/appe.1996.0065","article-title":"Colour and its role in sweetness perception","volume":"28","author":"Strugnell","year":"1997","journal-title":"Appetite"},{"key":"B50","doi-asserted-by":"publisher","first-page":"574","DOI":"10.1016\/j.foodres.2016.09.011","article-title":"Yogurt viscosity and fruit pieces affect satiating capacity expectations","volume":"89","author":"Tarrega","year":"2016","journal-title":"Food Res. Int."},{"key":"B51","doi-asserted-by":"publisher","first-page":"251","DOI":"10.1111\/j.1745-459X.2008.00153.x","article-title":"Scaling of sensory impressions","volume":"23","author":"Tomasik-Kr\u00d3tki","year":"2008","journal-title":"J. Sens. Stud."},{"key":"B52","doi-asserted-by":"publisher","first-page":"16175","DOI":"10.1038\/s41598-020-73189-8","article-title":"Effects of varying the standard deviation of the luminance on the appearance of food, flavour expectations, and taste\/flavour perception","volume":"10","author":"Ueda","year":"2020","journal-title":"Sci. Rep."},{"key":"B53","doi-asserted-by":"publisher","first-page":"23","DOI":"10.1186\/2044-7248-2-23","article-title":"Assessing the influence of the multisensory environment on the whisky drinking experience","volume":"2","author":"Velasco","year":"2013","journal-title":"Flavour"},{"key":"B54","doi-asserted-by":"publisher","first-page":"614524","DOI":"10.3389\/fcomp.2021.614524","article-title":"Multisensory experiences: a primer","volume":"3","author":"Velasco","year":"2021","journal-title":"Front. Comput. Sci."},{"key":"B55","doi-asserted-by":"publisher","first-page":"151","DOI":"10.1016\/j.foodqual.2014.11.010","article-title":"Hedonic mediation of the crossmodal correspondence between taste and shape","volume":"41","author":"Velasco","year":"2015","journal-title":"Food Qual. Prefer."},{"key":"B56","doi-asserted-by":"publisher","first-page":"783","DOI":"10.1111\/j.1365-2621.1983.tb14898.x","article-title":"Pleasantness of Food Sounds","volume":"48","author":"Vickers","year":"1983","journal-title":"J. Food Sci."},{"key":"B57","doi-asserted-by":"publisher","first-page":"1365","DOI":"10.3389\/fpsyg.2014.01365","article-title":"Cross-cultural differences in crossmodal correspondences between basic tastes and visual features","volume":"5","author":"Wan","year":"2014","journal-title":"Front. Psychol."},{"key":"B58","doi-asserted-by":"publisher","first-page":"204","DOI":"10.3390\/beverages1030204","article-title":"Assessing the influence of the multisensory atmosphere on the taste of vodka","volume":"1","author":"Wang","year":"2015","journal-title":"Beverages"},{"key":"B59","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/j.foodqual.2016.12.014","article-title":"Sounds spicy: Enhancing the evaluation of piquancy by means of a customised crossmodally congruent soundtrack","volume":"58","author":"Wang","year":"2017","journal-title":"Food Qual Prefer."},{"key":"B60","doi-asserted-by":"publisher","first-page":"2423","DOI":"10.1109\/TVCG.2023.3247099","article-title":"Eating, smelling, and seeing: investigating multisensory integration and (in)congruent stimuli while eating in VR","volume":"29","author":"Weidner","year":"2023","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"B61","unstructured":"WickhamH.\n          ggplot2: Elegant Graphics for Data Analysis2016"},{"key":"B62","doi-asserted-by":"publisher","first-page":"225","DOI":"10.1162\/105474698565686","article-title":"Measuring presence in virtual environments: a presence questionnaire","volume":"7","author":"Witmer","year":"1998","journal-title":"Pres. Teleoper. Virtual Environ."},{"key":"B63","doi-asserted-by":"publisher","first-page":"1056782","DOI":"10.3389\/frvir.2022.1056782","article-title":"Examining cross-modal correspondence between ambient color and taste perception in virtual reality","volume":"3","author":"Wu","year":"2022","journal-title":"Front. Virtual Real."}],"container-title":["Frontiers in Computer Science"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fcomp.2023.1268849\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,11,15]],"date-time":"2023-11-15T09:32:33Z","timestamp":1700040753000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fcomp.2023.1268849\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,11,15]]},"references-count":63,"alternative-id":["10.3389\/fcomp.2023.1268849"],"URL":"https:\/\/doi.org\/10.3389\/fcomp.2023.1268849","relation":{},"ISSN":["2624-9898"],"issn-type":[{"value":"2624-9898","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,11,15]]},"article-number":"1268849"}}