{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,15]],"date-time":"2026-04-15T18:10:40Z","timestamp":1776276640894,"version":"3.50.1"},"reference-count":43,"publisher":"Springer Science and Business Media LLC","issue":"30","license":[{"start":{"date-parts":[[2021,9,6]],"date-time":"2021-09-06T00:00:00Z","timestamp":1630886400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2021,9,6]],"date-time":"2021-09-06T00:00:00Z","timestamp":1630886400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100004252","name":"Qatar University","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100004252","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Multimed Tools Appl"],"published-print":{"date-parts":[[2021,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Gustatory display research is still in its infancy despite being one of the essential everyday senses that human practice while eating and drinking. Indeed, the most important and frequent tasks that our brain deals with every day are foraging and feeding. The recent studies by psychologists and cognitive neuroscientist revealed how complex multisensory rely on the integration of cues from all the human senses in any flavor experiences. The perception of flavor is multisensory and involves combinations of gustatory and olfactory stimuli. The cross-modal mapping between these modalities needs to be more explored in the virtual environment and simulation, especially in liquid food. In this paper, we present a customized wearable Augmented Reality (AR) system and olfaction display to study the effect of vision and olfaction on the gustatory sense. A user experiment and extensive analysis conducted to study the influence of each stimulus on the overall flavor, including other factors like age, previous experience in Virtual Reality (VR)\/AR, and beverage consumption. The result showed that smell contributes strongly to the flavor with less contribution to the vision. However, the combination of these stimuli can deliver richer experience and a higher belief rate. Beverage consumption had a significant effect on the flavor belief rate. Experience is correlated with stimulus and age is correlated with belief rate, and both indirectly affected the belief rate.<\/jats:p>","DOI":"10.1007\/s11042-021-11321-0","type":"journal-article","created":{"date-parts":[[2021,9,6]],"date-time":"2021-09-06T11:04:58Z","timestamp":1630926298000},"page":"36423-36441","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":22,"title":["Augmented reality flavor: cross-modal mapping across gustation, olfaction, and vision"],"prefix":"10.1007","volume":"80","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-2052-0500","authenticated-orcid":false,"given":"Osama","family":"Halabi","sequence":"first","affiliation":[]},{"given":"Mohammad","family":"Saleh","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2021,9,6]]},"reference":[{"key":"11321_CR1","doi-asserted-by":"crossref","unstructured":"Aoyama K (2020) Galvanic taste stimulation method for virtual reality and augmented reality. pp 341\u2013349","DOI":"10.1007\/978-3-030-50020-7_24"},{"issue":"2","key":"11321_CR2","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1073\/pnas.2010932118","volume":"118","author":"JA Avery","year":"2021","unstructured":"Avery JA, Liu AG, Ingeholm JE, Gotts SJ, Martin A (2021) Viewing images of foods evokes taste quality-specific activity in gustatory insular cortex. Proc Natl Acad Sci U S A 118(2):1\u201344","journal-title":"Proc Natl Acad Sci U S A"},{"key":"11321_CR3","doi-asserted-by":"crossref","unstructured":"Brunetti R, Indraccolo A, Mastroberardino S, Spence C, Santangelo V (2017)\u00a0The impact of cross-modal correspondences on working memory performance. J Exp Psychol Hum Percept Perform","DOI":"10.1037\/xhp0000348"},{"key":"11321_CR4","doi-asserted-by":"crossref","unstructured":"Chiou R, Rich AN (2012)\u00a0Cross-modality correspondence between pitch and spatial location modulates attentional orienting. Perception","DOI":"10.1068\/p7161"},{"issue":"6","key":"11321_CR5","doi-asserted-by":"publisher","first-page":"531","DOI":"10.1093\/chemse\/bjj057","volume":"31","author":"ML Dematt\u00e8","year":"2006","unstructured":"Dematt\u00e8 ML, Sanabria D, Spence C (2006) Cross-modal associations between odors and colors. Chem Senses 31(6):531\u2013538","journal-title":"Chem Senses"},{"issue":"2","key":"11321_CR6","doi-asserted-by":"publisher","first-page":"1","DOI":"10.3390\/nu13020398","volume":"13","author":"PM Di Lorenzo","year":"2021","unstructured":"Di Lorenzo PM (2021) Neural coding of food is a multisensory, sensorimotor function. Nutrients 13(2):1\u201310","journal-title":"Nutrients"},{"issue":"3","key":"11321_CR7","doi-asserted-by":"publisher","first-page":"199","DOI":"10.1093\/chemse\/bjh022","volume":"29","author":"J Djordjevic","year":"2004","unstructured":"Djordjevic J, Zatorre RJ, Jones-Gotman M (2004) Effects of perceived and imagined odors on taste detection. Chem Senses 29(3):199\u2013208","journal-title":"Chem Senses"},{"key":"11321_CR8","first-page":"52","volume":"2013","author":"O Halabi","year":"2013","unstructured":"Halabi O, Al-Mesaifri F, Al-Ansari M, Al-Shaabi R, Barki H, Foufou S (2013) Incorporating haptic and olfactory into surgical simulation. In International Conference on Cyberworlds 2013:52\u201355","journal-title":"In International Conference on Cyberworlds"},{"key":"11321_CR9","doi-asserted-by":"crossref","unstructured":"Halabi O, Al-Mesaifri F, Al-Ansari M, Al-Shaabi R, Miyata K (2014) Incorporating olfactory into a multi-modal surgical simulation. IEICE Trans Inf Syst E97.D, no. 8, pp\u00a02048\u20132052","DOI":"10.1587\/transinf.E97.D.2048"},{"key":"11321_CR10","doi-asserted-by":"crossref","unstructured":"Halabi O,  Balakrishnan S,  Dakua SP,  Navab N, Warfa M (2020)\u00a0Virtual and augmented reality in surgery in the disruptive fourth industrial revolution.\u00a0Springer, pp 257\u2013285","DOI":"10.1007\/978-3-030-48230-5_11"},{"key":"11321_CR11","doi-asserted-by":"crossref","unstructured":"Halabi O, Chiba N (2009)\u00a0Multidimensional visual aid enhances haptic training simulations in proceedings - 3rd joint eurohaptics conference and symposium on haptic interfaces for virtual environment and teleoperator systems. World Haptics 2009\u00a0pp 500\u2013504","DOI":"10.1109\/WHC.2009.4810826"},{"key":"11321_CR12","doi-asserted-by":"crossref","unstructured":"Halabi O\u00a0et al (2014) Optimum design of haptic seat for driving simulator in proceedings of the 20th ACM symposium on Virtual Reality Software and Technology - VRST 14.\u00a0pp 233\u2013234","DOI":"10.1145\/2671015.2671134"},{"issue":"4","key":"11321_CR13","doi-asserted-by":"publisher","first-page":"409","DOI":"10.20965\/jrm.2006.p0409","volume":"18","author":"O Halabi","year":"2006","unstructured":"Halabi O, Daniulaitis V, Kawasaki H, Mouri T, Ohtuka Y (2006) Future haptic science encyclopedia: realistic stable haptic interaction with highly deformable objects using HIRO-II. J Robot Mechatronics 18(4):409\u2013417","journal-title":"J Robot Mechatronics"},{"issue":"3\u20134","key":"11321_CR14","doi-asserted-by":"publisher","first-page":"2987","DOI":"10.1007\/s11042-019-08214-8","volume":"79","author":"O Halabi","year":"2020","unstructured":"Halabi O (2020) Immersive virtual reality to enforce teaching in engineering education. Multimed Tools Appl 79(3\u20134):2987\u20133004","journal-title":"Multimed Tools Appl"},{"issue":"4","key":"11321_CR15","doi-asserted-by":"publisher","first-page":"653","DOI":"10.1111\/j.1365-2621.1997.tb15429.x","volume":"62","author":"M Harrison","year":"1997","unstructured":"Harrison M, Hills BP, Bakker J, Clothier T (1997) Mathematical models of flavor release from liquid emulsions. J Food Sci 62(4):653\u2013664","journal-title":"J Food Sci"},{"key":"11321_CR16","doi-asserted-by":"publisher","first-page":"168","DOI":"10.1016\/j.chb.2019.01.027","volume":"95","author":"F Huang","year":"2019","unstructured":"Huang F, Huang J, Wan X (2019) Influence of virtual color on taste: Multisensory integration between virtual and real worlds. Comput Human Behav 95:168\u2013174","journal-title":"Comput Human Behav"},{"key":"11321_CR17","unstructured":"Iwata H, Yano H, Uemura T, Moriya T (2004) Food simulator: A haptic interface for biting in Proceedings - Virtual Reality Annual International Symposium.\u00a0pp 51\u201357"},{"issue":"1","key":"11321_CR18","doi-asserted-by":"publisher","first-page":"31","DOI":"10.1080\/17458927.2018.1556952","volume":"14","author":"E Kerruish","year":"2019","unstructured":"Kerruish E (2019) Arranging sensations: smell and taste in augmented and virtual reality. Senses Soc 14(1):31\u201345","journal-title":"Senses Soc"},{"key":"11321_CR19","doi-asserted-by":"crossref","unstructured":"Klapetek A, Ngo MK,  Spence C (2012)\u00a0Does crossmodal correspondence modulate the facilitatory effect of auditory cues on visual search?. Atten Percept Psychophysiol","DOI":"10.3758\/s13414-012-0317-9"},{"key":"11321_CR20","doi-asserted-by":"crossref","unstructured":"Liang P, Jiang J, Wei L,  Ding Q (2021)\u00a0Direct mapping of affective pictures and taste words. Food Qual Prefer\u00a089(2):104151","DOI":"10.1016\/j.foodqual.2020.104151"},{"key":"11321_CR21","doi-asserted-by":"crossref","unstructured":"Makovac E, Kwok SC, Gerbino W (2014)\u00a0Attentional cueing by cross-modal congruency produces both facilitation and inhibition on short-term visual recognition. Acta Psychol (Amst)","DOI":"10.1016\/j.actpsy.2014.07.008"},{"key":"11321_CR22","doi-asserted-by":"crossref","unstructured":"Mitchel AD, Weiss DJ (2011)\u00a0Learning across senses: cross-modal effects in multisensory statistical learning. J Exp Psychol Learn Mem Cogn","DOI":"10.1037\/a0023700"},{"key":"11321_CR23","doi-asserted-by":"crossref","unstructured":"Nakano K,  Horita D, Sakata N, Kiyokawa K, Yanai K, Narumi T (2019)\u00a0DeepTaste: Augmented reality gustatory manipulation with GAN-based real-time food-to-food translation. Proc. - 2019 IEEE Int Symp Mix Augment Reality ISMAR 2019\u00a0pp 212\u2013223","DOI":"10.1109\/ISMAR.2019.000-1"},{"key":"11321_CR24","doi-asserted-by":"crossref","unstructured":"Narumi T, Kajinami T, Nishizaka S, Tanikawa T, Hirose M (2011)\u00a0Pseudo-gustatory display system based on cross-modal integration of vision, olfaction and gustation. pp 127\u2013130","DOI":"10.1109\/VR.2011.5759450"},{"issue":"4","key":"11321_CR25","first-page":"504","volume":"20","author":"T Narumi","year":"2014","unstructured":"Narumi T, Miyaura M, Tanikawa T, Hirose M (2014) Simplification of olfactory stimuli in pseudo-gustatory displays. IEEE Trans Vis Comput Graph 20(4):504\u201350412","journal-title":"IEEE Trans Vis Comput Graph"},{"key":"11321_CR26","doi-asserted-by":"publisher","first-page":"42","DOI":"10.1016\/j.intmar.2018.07.004","volume":"45","author":"O Petit","year":"2019","unstructured":"Petit O, Velasco C, Spence C (2019) Digital sensory marketing: integrating new technologies into multisensory online experience. J Interact Mark 45:42\u201361","journal-title":"J Interact Mark"},{"issue":"4","key":"11321_CR27","doi-asserted-by":"publisher","first-page":"331","DOI":"10.1093\/chemse\/bjh036","volume":"29","author":"J Prescott","year":"2004","unstructured":"Prescott J, Johnstone V, Francis J (2004) Odor-taste interactions: Effects of attentional strategies during exposure. Chem Senses 29(4):331\u2013340","journal-title":"Chem Senses"},{"key":"11321_CR28","doi-asserted-by":"crossref","unstructured":"Ranasinghe N\u00a0et al (2018)\u00a0Season traveller: Multisensory narration for enhancing the virtual reality experience. In Conference on Human Factors in Computing Systems - Proceedings","DOI":"10.1145\/3173574.3174151"},{"key":"11321_CR29","doi-asserted-by":"crossref","unstructured":"Ranasinghe N,  Lee KY, Suthokumar G, Do EYL (2014)\u00a0The sensation of taste in the future of immersive media. in Proceedings of the 2nd ACM International Workshop on Immersive Media Experiences - ImmersiveMe 14","DOI":"10.1145\/2660579.2660586"},{"key":"11321_CR30","doi-asserted-by":"crossref","unstructured":"Ranasinghe N, Nguyen TNT, Liangkun Y, Lin LY, Tolley D, Do EYL (2017) Vocktail: a virtual cocktail for pairing digital taste, smell, and color sensations. in Proceedings of the 2017 ACM on Multimedia Conference - MM 17\u00a0pp 1139\u20131147","DOI":"10.1145\/3123266.3123440"},{"key":"11321_CR31","doi-asserted-by":"crossref","unstructured":"Ranasinghe N, Suthokumar G,  Lee KY,  Do EYL (2015) Digital flavor: towards digitally simulating virtual flavors. Proc 2015 ACM Int Conf Multimodal Interact.\u00a0pp 139\u2013146","DOI":"10.1145\/2818346.2820761"},{"key":"11321_CR32","doi-asserted-by":"crossref","unstructured":"Sammons JD, Weiss MS, Victor JD, Di Lorenzo PM (2016)\u00a0Taste coding of complex naturalistic taste stimuli and traditional taste stimuli in the parabrachial pons of the awake, freely licking rat. J Neurophysiol","DOI":"10.1152\/jn.01119.2015"},{"key":"11321_CR33","doi-asserted-by":"crossref","unstructured":"Simner J, Cuskley C, Kirby S (2010)\u00a0What sound does that taste? Cross-modal mappings across gustation and audition. Perception","DOI":"10.1068\/p6591"},{"key":"11321_CR34","unstructured":"Spence A, Malika A (2008) The multisensory perception of flavour. Psychologist"},{"key":"11321_CR35","unstructured":"Spence C (2010)\u00a0The multisensory perception of flavour. Psychologist"},{"issue":"1","key":"11321_CR36","doi-asserted-by":"publisher","first-page":"373","DOI":"10.1002\/9781118929384.ch16","volume":"161","author":"C Spence","year":"2016","unstructured":"Spence C (2016) Multisensory flavour perception. Flavour From Food to Percept 161(1):373\u2013394","journal-title":"Flavour From Food to Percept"},{"key":"11321_CR37","doi-asserted-by":"crossref","unstructured":"Spence C (2011) Crossmodal correspondences: A tutorial review. Atten Percept Psychophysiol","DOI":"10.3758\/s13414-010-0073-7"},{"key":"11321_CR38","doi-asserted-by":"crossref","unstructured":"Spence C, Auvray M, Smith B (2014)\u00a0Confusing tastes with flavours. In Perception and its Modalities","DOI":"10.1093\/acprof:oso\/9780199832798.003.0011"},{"key":"11321_CR39","doi-asserted-by":"crossref","unstructured":"Spence C (2013) Book review: Taste what you\u2019re missing: the passionate eater\u2019s guide to why good food tastes good by Barb Stuckey.\u00a0Flavour","DOI":"10.1186\/2044-7248-2-2"},{"key":"11321_CR40","doi-asserted-by":"publisher","unstructured":"Taylor AJ, Linforth RST (2010) Food flavour technology: Second edition. In A. J. Taylor & R. S. T. Linforth (Eds.), Food Flavour Technology: Second Edition. https:\/\/doi.org\/10.1002\/9781444317770","DOI":"10.1002\/9781444317770"},{"key":"11321_CR41","doi-asserted-by":"crossref","unstructured":"Walker L, Walker P (2016)\u00a0Cross-sensory mapping of feature values in the size-brightness correspondence can be more relative than absolute. J Exp Psychol Hum Percept Perform","DOI":"10.1037\/xhp0000128"},{"key":"11321_CR42","doi-asserted-by":"crossref","unstructured":"Wang QJ, Meyer R, Waters S, Zendle D (2020)\u00a0A Dash of virtual milk: altering product color in virtual reality influences flavor perception of cold-brew coffee. Front Psychol\u00a011","DOI":"10.3389\/fpsyg.2020.595788"},{"key":"11321_CR43","doi-asserted-by":"crossref","unstructured":"Yanai K, Horita D, Cho J (2020)\u00a0Food image generation and translation and its application to augmented reality. Proc - 3rd Int Conf Multimed Inf Process Retrieval MIPR 2020\u00a0pp 181\u2013186","DOI":"10.1109\/MIPR49039.2020.00045"}],"container-title":["Multimedia Tools and Applications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11042-021-11321-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s11042-021-11321-0\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11042-021-11321-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,12,3]],"date-time":"2021-12-03T21:00:37Z","timestamp":1638565237000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s11042-021-11321-0"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,9,6]]},"references-count":43,"journal-issue":{"issue":"30","published-print":{"date-parts":[[2021,12]]}},"alternative-id":["11321"],"URL":"https:\/\/doi.org\/10.1007\/s11042-021-11321-0","relation":{},"ISSN":["1380-7501","1573-7721"],"issn-type":[{"value":"1380-7501","type":"print"},{"value":"1573-7721","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,9,6]]},"assertion":[{"value":"11 July 2020","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"8 February 2021","order":2,"name":"revised","label":"Revised","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"23 July 2021","order":3,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"6 September 2021","order":4,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}