{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,26]],"date-time":"2026-02-26T22:53:57Z","timestamp":1772146437085,"version":"3.50.1"},"reference-count":81,"publisher":"Springer Science and Business Media LLC","issue":"11-12","license":[{"start":{"date-parts":[[2020,1,3]],"date-time":"2020-01-03T00:00:00Z","timestamp":1578009600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2020,1,3]],"date-time":"2020-01-03T00:00:00Z","timestamp":1578009600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/100010661","name":"Horizon 2020 Framework Programme","doi-asserted-by":"publisher","award":["688503"],"award-info":[{"award-number":["688503"]}],"id":[{"id":"10.13039\/100010661","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100002322","name":"CAPES","doi-asserted-by":"crossref","award":["8881.187844\/2018-01"],"award-info":[{"award-number":["8881.187844\/2018-01"]}],"id":[{"id":"10.13039\/501100002322","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Multimed Tools Appl"],"published-print":{"date-parts":[[2020,3]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>A great deal of research effort has been put in exploring crossmodal correspondences in the field of cognitive science which refer to the systematic associations frequently made between different sensory modalities (e.g. high pitch is matched with angular shapes). However, the possibilities cross-modality opens in the digital world have been relatively unexplored. Therefore, we consider that studying the plasticity and the effects of crossmodal correspondences in a mulsemedia setup can bring novel insights about improving the human-computer dialogue and experience. Mulsemedia refers to the combination of three or more senses to create immersive experiences. In our experiments, users were shown six video clips associated with certain visual features based on color, brightness, and shape. We examined if the pairing with crossmodal matching sound and the corresponding auto-generated haptic effect, and smell would lead to an enhanced user QoE. For this, we used an eye-tracking device as well as a heart rate monitor wristband to capture users\u2019 eye gaze and heart rate whilst they were experiencing mulsemedia. After each video clip, we asked the users to complete an on-screen questionnaire with a set of questions related to smell, sound and haptic effects targeting their enjoyment and perception of the experiment. Accordingly, the eye gaze and heart rate results showed significant influence of the cross-modally mapped multisensorial effects on the users\u2019 QoE. Our results highlight that when the olfactory content is crossmodally congruent with the visual content, the visual attention of the users seems shifted towards the correspondent visual feature. Crosmodally matched media is also shown to result in an enhanced QoE compared to a video only condition.<\/jats:p>","DOI":"10.1007\/s11042-019-08473-5","type":"journal-article","created":{"date-parts":[[2020,1,3]],"date-time":"2020-01-03T09:02:39Z","timestamp":1578042159000},"page":"7987-8009","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":12,"title":["QoE of cross-modally mapped Mulsemedia: an assessment using eye gaze and heart rate"],"prefix":"10.1007","volume":"79","author":[{"given":"Gebremariam","family":"Mesfin","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Nadia","family":"Hussain","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Elahe","family":"Kani-Zabihi","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Alexandra","family":"Covaci","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Est\u00eav\u00e3o B.","family":"Saleme","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2578-5580","authenticated-orcid":false,"given":"Gheorghita","family":"Ghinea","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2020,1,3]]},"reference":[{"issue":"3","key":"8473_CR1","first-page":"17","volume":"9","author":"OA Ademoye","year":"2013","unstructured":"Ademoye OA, Ghinea G (2013) Information recall task impact in olfaction-enhanced multimedia. ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM) 9(3):17","journal-title":"ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM)"},{"key":"8473_CR2","doi-asserted-by":"crossref","unstructured":"Ademoye OA, Murray N, Muntean G-M, Ghinea G (2016, 2016) Audio masking effect on inter-component skews in olfaction-enhanced multimedia presentations. ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM) 12(4):\u201351","DOI":"10.1145\/2957753"},{"key":"8473_CR3","doi-asserted-by":"crossref","unstructured":"Brkic BR, Chalmers A, Boulanger K, Pattanaik S, Covington J (2009) Cross-modal affects of smell on the real-time rendering of grass. In Proceedings of the 25th Spring Conference on Computer Graphics. ACM, 161\u2013166","DOI":"10.1145\/1980462.1980494"},{"key":"8473_CR4","unstructured":"Brunnstr\u00f6m K, Beker SA, De Moor K, Dooms A, Egger S, Garcia M-N, Hossfeld T, Jumisko-Pyykk\u00f6 S, Keimel C, Larabi M-C et al (2013) Qualinet white paper on definitions of quality of experience"},{"key":"8473_CR5","unstructured":"Choi B, Lee ES, Yoon K (2011) Streaming media with sensory effect. In: Information Science and Applications (ICISA), 2011 International Conference on. IEEE, 1\u20136. 10.1109\/ICISA.2011.5772390"},{"key":"8473_CR6","doi-asserted-by":"crossref","unstructured":"Covaci A, Zhou L, Tal I, Muntean G-M, Ghinea G (2018) Is multimedia multisensorial? - a review of Mulsemedia systems. ACM Computing Surveys (CSUR), 35 pages. In press. https:\/\/bura.brunel.ac.uk\/bitstream\/2438\/16449\/1\/Fulltext.pdf","DOI":"10.1145\/3233774"},{"issue":"1","key":"8473_CR7","doi-asserted-by":"publisher","first-page":"39","DOI":"10.1016\/j.neulet.2009.08.016","volume":"464","author":"A-S Crisinel","year":"2009","unstructured":"Crisinel A-S, Spence C (2009) Implicit association between basic tastes and pitch. Neurosci Lett 464(1):39\u201342","journal-title":"Neurosci Lett"},{"key":"8473_CR8","doi-asserted-by":"crossref","unstructured":"Dalmaijer A (2014) Is the low-cost EyeTribe eye tracker any good for research? Peer J PrePrints","DOI":"10.7287\/peerj.preprints.585"},{"issue":"2","key":"8473_CR9","doi-asserted-by":"publisher","first-page":"193","DOI":"10.1109\/TOH.2012.70","volume":"6","author":"A Danieau","year":"2013","unstructured":"Danieau A, L\u00e9cuyer A, Guillotel P, Fleureau J, Mollet N, Christie M (2013) Enhancing audiovisual experience with haptic feedback: a survey on HAV. IEEE Transactions on Haptics 6(2):193\u2013205","journal-title":"IEEE Transactions on Haptics"},{"issue":"4","key":"8473_CR10","doi-asserted-by":"publisher","first-page":"1171","DOI":"10.3758\/s13423-016-1179-2","volume":"24","author":"JM de Valk","year":"2017","unstructured":"de Valk JM, Wnuk E, Huisman JLA, Majid A (2017) Odor\u2013color associations differ with verbal descriptors for odors: a comparison of three linguistically diverse groups. Psychon Bull Rev 24(4):1171\u20131179. https:\/\/doi.org\/10.3758\/s13423-016-1179-2","journal-title":"Psychon Bull Rev"},{"key":"8473_CR11","doi-asserted-by":"publisher","unstructured":"M. L. Dematt\u00e8, D. Sanabria, and C. Spence. 2006. Cross-Modal Associations Between Odors and Colors. Chemical Senses 31, 6 (2006), 531\u2013538. https:\/\/doi.org\/10.1093\/chemse\/bjj057","DOI":"10.1093\/chemse\/bjj057"},{"key":"8473_CR12","doi-asserted-by":"publisher","unstructured":"Deroy O, Spence C (2013) Why we are not all synesthetes (not even weakly so). Psychonomic Bulletin & Review 20, 4 (01 Aug 2013), 643\u2013664. https:\/\/doi.org\/10.3758\/s13423-013-0387-2","DOI":"10.3758\/s13423-013-0387-2"},{"key":"8473_CR13","doi-asserted-by":"crossref","unstructured":"Egan D, Brennan S, Barrett J, Qiao Y, Timmerer C, Murray N (2016) An evaluation of heart rate and ElectroDermal activity as an objective QoE evaluation method for immersive virtual reality environments. In: Quality of Multimedia Experience (QoMEX), 2016 Eighth International Conference on. IEEE, 1\u20136","DOI":"10.1109\/QoMEX.2016.7498964"},{"key":"8473_CR14","doi-asserted-by":"crossref","unstructured":"Eid M, Cha J, El Saddik A (2008) HugMe: A haptic videoconferencing system for interpersonal communication. In Virtual Environments, Human-Computer Interfaces and Measurement Systems. VECIMS 2008. IEEE Conference on IEEE, 5\u20139","DOI":"10.1109\/VECIMS.2008.4592743"},{"key":"8473_CR15","unstructured":"Gal D, Wheeler SC, Shiv B (2007) Cross-modal influences on gustatory perception"},{"issue":"1","key":"8473_CR16","first-page":"2","volume":"8","author":"G Ghinea","year":"2012","unstructured":"Ghinea G, Ademoye O (2012) The sweet smell of success: enhancing multimedia applications with olfaction. ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM) 8(1):2","journal-title":"ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM)"},{"key":"8473_CR17","doi-asserted-by":"crossref","unstructured":"G. Ghinea, F. Andres, and S. R. Gulliver. 2011. Multiple sensorial media advances and applications: new developments in MulSeMedia: new developments in MulSeMedia. Information Science Reference","DOI":"10.4018\/978-1-60960-821-7"},{"key":"8473_CR18","doi-asserted-by":"crossref","unstructured":"Ghinea G, Timmerer C, Lin W, Gulliver SR (2014) Mulsemedia: State of the art, perspectives, and challenges. ACM Trans. Multimedia Comput. Commun. Appl., 11(1s):17:1\u201317:23","DOI":"10.1145\/2617994"},{"key":"8473_CR19","doi-asserted-by":"publisher","first-page":"335","DOI":"10.2307\/1423010","volume":"1996","author":"N Gilbert","year":"1996","unstructured":"Gilbert N, Martin R, Kemp SE (1996) Cross-modal correspondence between vision and olfaction: the color of smells. Am J Psychol 1996:335\u2013351","journal-title":"Am J Psychol"},{"issue":"4","key":"8473_CR20","doi-asserted-by":"publisher","first-page":"551","DOI":"10.1509\/jmr.14.0414","volume":"53","author":"H Hagtvedt","year":"2016","unstructured":"Hagtvedt H, Brasel SA (2016) Cross-Modal Communication: Sound Frequency Influences Consumer Responses to Color Lightness. J Mark Res 53(4):551\u2013562","journal-title":"J Mark Res"},{"issue":"2","key":"8473_CR21","doi-asserted-by":"publisher","first-page":"161","DOI":"10.1093\/chemse\/bjs087","volume":"38","author":"G Hanson-Vaux","year":"2012","unstructured":"Hanson-Vaux G, Crisinel A-S, Spence C (2012) Smelling shapes: Crossmodal correspondences between odors and shapes. Chem Senses 38(2):161\u2013166","journal-title":"Chem Senses"},{"key":"8473_CR22","unstructured":"Hoggan E, Brewster SA (2006) Mobile crossmodal auditory and tactile displays. In Proceedings of HAID 2006: First International Workshop on Haptic and Audio Interaction Design. 9\u201312"},{"key":"8473_CR23","doi-asserted-by":"crossref","unstructured":"Huisman G, Bruijnes M, Heylen DK (2016) A moving feast: effects of color, shape and animation on taste associations and taste perceptions. In: Proceedings of the 13th International Conference on Advances in Computer Entertainment Technology. ACM, 13","DOI":"10.1145\/3001773.3001776"},{"key":"8473_CR24","doi-asserted-by":"crossref","unstructured":"Hulusi\u0107 V, Czanner G, Debattista K, Sikudova E, Dubla P, Chalmers A (2009) Investigation of the beat rate effect on frame rate for animated content. In: Proceedings of the 25th Spring Conference on Computer Graphics. ACM, 151\u2013159","DOI":"10.1145\/1980462.1980493"},{"key":"8473_CR25","doi-asserted-by":"crossref","unstructured":"Hulusic V, Debattista K, Aggarwal V, Chalmers A (2010) Exploiting audio-visual cross-modal interaction to reduce computational requirements in interactive environments. In: Games and Virtual Worlds for Serious Applications (VS-GAMES), 2010 Second International Conference on. IEEE, 126\u2013132","DOI":"10.1109\/VS-GAMES.2010.20"},{"issue":"2","key":"8473_CR26","doi-asserted-by":"publisher","first-page":"79","DOI":"10.1007\/s12078-016-9209-z","volume":"9","author":"M Jacquot","year":"2016","unstructured":"Jacquot M, Noel F, Velasco C, Spence C (2016) On the Colours of Odours. Chemosens Percept 9(2):79\u201393. https:\/\/doi.org\/10.1007\/s12078-016-9209-z","journal-title":"Chemosens Percept"},{"issue":"2","key":"8473_CR27","doi-asserted-by":"publisher","first-page":"552","DOI":"10.1109\/TBC.2018.2823914","volume":"64","author":"L Jalal","year":"2018","unstructured":"Jalal L, Anedda M, Popescu V, Murroni M (2018) QoE Assessment for IoT-Based Multi Sensorial Media Broadcasting. IEEE Trans Broadcast 64(2):552\u2013560. https:\/\/doi.org\/10.1109\/TBC.2018.2823914","journal-title":"IEEE Trans Broadcast"},{"key":"8473_CR28","doi-asserted-by":"crossref","unstructured":"Jezler O, Gatti E, Gilardi M, Obrist M (2016) Scented Material: Changing Features of Physical Creations Based on Odors. In Proceedings of the 2016 CHI conference extended abstracts on human factors in computing systems (CHI EA \u201816). ACM, New York, 1677\u20131683. 10.1145\/2851581.2892471","DOI":"10.1145\/2851581.2892471"},{"key":"8473_CR29","doi-asserted-by":"crossref","unstructured":"Jokinen JPP (2015) Emotional user experience and feeling of control. In Proceedings of the 19th International Academic Mindtrek Conference (AcademicMindTrek \u201815). ACM, New York, 163\u2013166. 10.1145\/2818187.2818284","DOI":"10.1145\/2818187.2818284"},{"key":"8473_CR30","doi-asserted-by":"crossref","unstructured":"Keighrey C, Flynn R, Murray S, Murray N (2017) A QoE evaluation of immersive augmented and virtual reality speech & language assessment applications. In: Quality of Multimedia Experience (QoMEX), 2017 Ninth International Conference on. IEEE, 1\u20136","DOI":"10.1109\/QoMEX.2017.7965656"},{"issue":"1","key":"8473_CR31","doi-asserted-by":"publisher","first-page":"35","DOI":"10.2307\/1423699","volume":"110","author":"SE Kemp","year":"1997","unstructured":"Kemp SE, Gilbert AN (1997) Odor intensity and color lightness are correlated sensory dimensions. Am J Psychol 110(1):35","journal-title":"Am J Psychol"},{"issue":"2","key":"8473_CR32","doi-asserted-by":"publisher","first-page":"162","DOI":"10.1016\/j.image.2012.10.011","volume":"28","author":"S-K Kim","year":"2013","unstructured":"Kim S-K (2013) Authoring multisensorial content. Signal Process Image Commun 28(2):162\u2013167. https:\/\/doi.org\/10.1016\/j.image.2012.10.011","journal-title":"Signal Process Image Commun"},{"issue":"2","key":"8473_CR33","doi-asserted-by":"publisher","first-page":"224","DOI":"10.4218\/etrij.14.2113.0065","volume":"36","author":"S-K Kim","year":"2014","unstructured":"Kim S-K, Yang S-J, Ahn CH, Joo YS (2014) Sensorial Information Extraction and Mapping to Generate Temperature Sensory Effects. ETRI J 36(2):224\u2013231. https:\/\/doi.org\/10.4218\/etrij.14.2113.0065","journal-title":"ETRI J"},{"issue":"1","key":"8473_CR34","doi-asserted-by":"publisher","first-page":"18","DOI":"10.1109\/T-AFFC.2011.15","volume":"3","author":"S Koelstra","year":"2012","unstructured":"Koelstra S, Muhl C, Soleymani M, Lee J-S, Yazdani A, Ebrahimi T, Pun T, Nijholt A, Patras I (2012) Deap: A database for emotion analysis; using physiological signals. IEEE Trans Affect Comput 3(1):18\u201331","journal-title":"IEEE Trans Affect Comput"},{"key":"8473_CR35","doi-asserted-by":"crossref","unstructured":"Koizumi N, Tanaka H, Uema Y, Inami M (2011) Chewing jockey: augmented food texture by using sound based on the cross-modal effect. In: Proceedings of the 8th International Conference on Advances in Computer Entertainment Technology. ACM, 21","DOI":"10.1145\/2071423.2071449"},{"key":"8473_CR36","doi-asserted-by":"crossref","unstructured":"Marks LE (1974) On associations of light and sound: the mediation of brightness, pitch, and loudness. Am J Psychol:173\u2013188","DOI":"10.2307\/1422011"},{"issue":"3","key":"8473_CR37","doi-asserted-by":"publisher","first-page":"384","DOI":"10.1037\/0096-1523.13.3.384","volume":"13","author":"LE Marks","year":"1987","unstructured":"Marks LE (1987) On cross-modal similarity: Auditory\u2013visual interactions in speeded discrimination. J Exp Psychol Hum Percept Perform 13(3):384","journal-title":"J Exp Psychol Hum Percept Perform"},{"key":"8473_CR38","unstructured":"Mastoropoulou G (2007) The effect of audio on the visual perception of high-fidelity animated 3d computer graphics. Ph.D. Dissertation. University of Bristol"},{"key":"8473_CR39","doi-asserted-by":"crossref","unstructured":"Mastoropoulou G, Debattista K, Chalmers A, Troscianko T (2005) Auditory bias of visual attention for perceptually-guided selective rendering of animations. In: Proceedings of the 3rd international conference on Computer graphics and interactive techniques in Australasia and South East Asia. ACM, 363\u2013369","DOI":"10.1145\/1101389.1101462"},{"key":"8473_CR40","doi-asserted-by":"crossref","unstructured":"Metatla O, Maggioni E, Cullen C, Obrist M (2019) \"Like popcorn\": Crossmodal correspondences between scents, 3D shapes and emotions in children. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (p. 459). ACM","DOI":"10.1145\/3290605.3300689"},{"key":"8473_CR41","doi-asserted-by":"publisher","unstructured":"M\u00f6ller S, Raake A (2014) Quality of Experience: Advanced Concepts, Applications and Methods. Springer, Cham. https:\/\/doi.org\/10.1007\/978-3-319-02681-7","DOI":"10.1007\/978-3-319-02681-7"},{"key":"8473_CR42","doi-asserted-by":"crossref","unstructured":"Monks J, Olaru A, Tal I, Muntean GM (2017) Quality of experience assessment of 3D video synchronised with multisensorial media components. In: 2017 IEEE International Symposium on Broadband Multimedia Systems and Broadcasting (BMSB). 1\u20136. 10.1109\/BMSB.2017.7986129","DOI":"10.1109\/BMSB.2017.7986129"},{"key":"8473_CR43","first-page":"303","volume":"612","author":"G Munster","year":"2015","unstructured":"Munster G, Jakel T, Clinton D, Murphy E (2015) Next mega tech theme is virtual reality. Gene 612:303\u20136452","journal-title":"Gene"},{"issue":"5","key":"8473_CR44","doi-asserted-by":"publisher","first-page":"67","DOI":"10.1145\/3108243","volume":"50","author":"N Murray","year":"2017","unstructured":"Murray N, Ademoye OA, Ghinea G, Muntean G-M (2017a) A tutorial for olfaction-based multisensorial media application design and evaluation. ACM Computing Surveys (CSUR) 50(5):67","journal-title":"ACM Computing Surveys (CSUR)"},{"key":"8473_CR45","doi-asserted-by":"crossref","unstructured":"Murray N, Lee B, Qiao Y, Muntean G-M (2014) Multiple-scent enhanced multimedia synchronization. ACM Trans. Multimedia Comput. Commun. Appl. 11, 1s, article 12, 28 pages. 10.1145\/2637293","DOI":"10.1145\/2637293"},{"key":"8473_CR46","doi-asserted-by":"crossref","unstructured":"N. Murray, B. Lee, Y. Qiao, and G. M. Muntean. 2016. The influence of human factors on olfaction based mulsemedia quality of experience. In 2016 Eighth International Conference on Quality of Multimedia Experience (QoMEX). 1\u20136. 10.1109\/QoMEX.2016.7498975","DOI":"10.1109\/QoMEX.2016.7498975"},{"issue":"9","key":"8473_CR47","doi-asserted-by":"publisher","first-page":"2503","DOI":"10.1109\/TSMC.2016.2531654","volume":"47","author":"N Murray","year":"2017","unstructured":"Murray N, Lee B, Qiao Y, Muntean G-M (2017b) The Impact of Scent Type on Olfaction-Enhanced Multimedia Quality of Experience. IEEE Transactions on Systems, Man, and Cybernetics: Systems 47(9):2503\u20132515. https:\/\/doi.org\/10.1109\/TSMC.2016.2531654","journal-title":"IEEE Transactions on Systems, Man, and Cybernetics: Systems"},{"key":"8473_CR48","unstructured":"Oh H-W, Huh J-D (2017) Auto generation system of MPEG-V motion sensory effects based on media scene. In Consumer Electronics (ICCE), 2017 IEEE International Conference on. IEEE, 160\u2013163. 10.1109\/ICCE.2017.7889269"},{"key":"8473_CR49","doi-asserted-by":"crossref","unstructured":"B. Rainer, M. Waltl, E. Cheng, M. Shujau, C. Timmerer, S. Davis, I. Burnett, C. Ritz, and H. Hellwagner. 2012. Investigating the impact of sensory effects on the quality of experience and emotional response in web videos. In 4th International Workshop on Quality of Multimedia Experience (QoMEX\u201912). http:\/\/www-itec.uni-klu.ac.at\/bib\/files\/QoMEx2012_UserStudy.pdf","DOI":"10.1109\/QoMEX.2012.6263842"},{"key":"8473_CR50","doi-asserted-by":"crossref","unstructured":"Ramic-Brkic B, Chalmers A, Sadzak A, Debattista K, Sultanic S (2013) Exploring multiple modalities for selective rendering of virtual environments. In: Proceedings of the 29th Spring Conference on Computer Graphics. ACM, 91\u201398","DOI":"10.1145\/2508244.2508256"},{"key":"8473_CR51","doi-asserted-by":"crossref","unstructured":"Ranasinghe N, Lee K-Y, Do EYL (2014) FunRasa: an interactive drinking platform. In: Proceedings of the 8th International Conference on Tangible, Embedded and Embodied Interaction. ACM, 133\u2013136","DOI":"10.1145\/2540930.2540939"},{"key":"8473_CR52","doi-asserted-by":"crossref","unstructured":"Ranasinghe N, Nguyen TNT, Liangkun Y, Lin L-Y, Tolley D, Do EYL (2017) Vocktail: A Virtual Cocktail for Pairing Digital Taste, Smell, and Color Sensations. In: Proceedings of the 2017 ACM on multimedia conference. ACM, 1139\u20131147","DOI":"10.1145\/3123266.3123440"},{"key":"8473_CR53","doi-asserted-by":"crossref","unstructured":"Rousi RA, Silvennoinen JM, Per\u00e4l\u00e4 PMH, Jokinen JPP (2017) Beyond MAYA for game-changing multisensory design. In: Proceedings of the 21st International Academic Mindtrek Conference (AcademicMindtrek \u201817). ACM, New York, 147\u2013153. 10.1145\/3131085.3131113","DOI":"10.1145\/3131085.3131113"},{"issue":"Suppl 1","key":"8473_CR54","doi-asserted-by":"publisher","first-page":"i244","DOI":"10.1093\/chemse\/bjh205","volume":"30","author":"N Sakai","year":"2005","unstructured":"Sakai N, Imada S, Saito S, Kobayakawa T, Deguchi Y (2005) The effect of visual images on perception of odors. Chem Senses 30(Suppl 1):i244\u2013i245","journal-title":"Chem Senses"},{"key":"8473_CR55","unstructured":"Saleme EB, Santos CAS (2015) PlaySEM: a platform for rendering MulSeMedia compatible with MPEG-V. In: Proceedings of the 21st Brazilian Symposium on Multimedia and the Web (WebMedia \u201815). ACM, New York, 145\u2013148. 10.1145\/2820426.2820450"},{"key":"8473_CR56","unstructured":"Saleme EB, Santos CAS, Falbo RA, Ghinea G, Andres F (2018b) Towards a reference ontology on Mulsemedia systems. In Proceedings of International Conference on Management of Emergent Digital EcoSystems, Tokyo, (MEDES\u201918). 8 pages. In press. https:\/\/www.dropbox.com\/s\/vn39mi425a78q3t\/4.pdf?dl=0"},{"key":"8473_CR57","unstructured":"Saleme EB, Santos CAS, Ghinea G (2018a) Coping with the challenges of delivering multiple sensorial media. IEEE MultiMedia, 11 pages. In press. https:\/\/bura.brunel.ac.uk\/handle\/2438\/16592"},{"issue":"3","key":"8473_CR58","doi-asserted-by":"publisher","first-page":"175","DOI":"10.1016\/j.neulet.2010.05.011","volume":"478","author":"H-S Seo","year":"2010","unstructured":"Seo H-S, Arshamian A, Schemmer K, Scheer I, Sander T, Ritter G, Hummel T (2010) Cross-modal integration between odors and abstract symbols. Neurosci Lett 478(3):175\u2013178. https:\/\/doi.org\/10.1016\/j.neulet.2010.05.011","journal-title":"Neurosci Lett"},{"key":"8473_CR59","unstructured":"Shin S-H, Ha K-S, Yun H-O, Nam Y-S (2016) Realistic media authoring tool based on MPEG-V international standard. In: Ubiquitous and Future Networks (ICUFN), 2016 Eighth International Conference on. IEEE, 730\u2013732. 10.1109\/ICUFN.2016.7537133"},{"key":"8473_CR60","volume-title":"What colour does that feel? Cross-modal correspondences from touch to colour","author":"J Simner","year":"2009","unstructured":"Simner J, Ludwig V (2009) What colour does that feel? Cross-modal correspondences from touch to colour. Granada, Third International Conference of Synaesthesia and Art"},{"issue":"1","key":"8473_CR61","doi-asserted-by":"publisher","first-page":"95","DOI":"10.1080\/00221325.1956.10532990","volume":"89","author":"RH Simpson","year":"1956","unstructured":"Simpson RH, Quinn M, Ausubel DP (1956) Synesthesia in children: Association of colors with pure tone frequencies. J Genet Psychol 89(1):95\u2013103","journal-title":"J Genet Psychol"},{"issue":"6","key":"8473_CR62","doi-asserted-by":"publisher","first-page":"655","DOI":"10.1163\/187847612X648800","volume":"25","author":"FJ Spector","year":"2012","unstructured":"Spector FJ, Maurer D (2012) Making sense of scents: the colour and texture of odours. Seeing and Perceiving 25(6):655\u2013677","journal-title":"Seeing and Perceiving"},{"issue":"2010","key":"8473_CR63","first-page":"122","volume":"28","author":"C Spence","year":"2010","unstructured":"Spence C (2010) The color of wine\u2013part 1. The World of Fine Wine 28(2010):122\u2013129","journal-title":"The World of Fine Wine"},{"issue":"4","key":"8473_CR64","doi-asserted-by":"publisher","first-page":"971","DOI":"10.3758\/s13414-010-0073-7","volume":"73","author":"C Spence","year":"2011","unstructured":"Spence C (2011) Crossmodal correspondences: A tutorial review. Attention, Perception, & Psychophysics 73(4):971\u2013995","journal-title":"Attention, Perception, & Psychophysics"},{"key":"8473_CR65","unstructured":"Stephen P, Hornby S (1997) Simple statistics for library and information professionals"},{"issue":"1\u20132","key":"8473_CR66","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/s12078-010-9082-0","volume":"4","author":"NL Streeter","year":"2011","unstructured":"Streeter NL, White TL (2011) Incongruent contextual information intrudes on short-term olfactory memory. Chemosens Percept 4(1\u20132):1\u20138","journal-title":"Chemosens Percept"},{"key":"8473_CR67","unstructured":"Striner A (2018) Can Multisensory Cues in VR Help Train Pattern Recognition to Citizen Scientists? arXiv preprint arXiv:1804.00229"},{"key":"8473_CR68","unstructured":"Sulema Y (2016) Mulsemedia vs. Multimedia: state of the art and future trends. In Systems, Signals and Image Processing (IWSSIP), 2016 International Conference on. IEEE, 1\u20135"},{"key":"8473_CR69","doi-asserted-by":"publisher","first-page":"e4443","DOI":"10.7717\/peerj.4443","volume":"6","author":"X Sun","year":"2018","unstructured":"Sun X, Li X, Ji L, Han F, Wang H, Liu Y, Chen Y, Lou Z, Li Z (2018) An extended research of crossmodal correspondence between color and sound in psychology and cognitive ergonomics. Peer J 6:e4443. https:\/\/doi.org\/10.7717\/peerj.4443","journal-title":"Peer J"},{"key":"8473_CR70","doi-asserted-by":"crossref","unstructured":"Tag B, Goto T, Minamizawa K, Mannschreck R, Fushimi H, Kunze K (2017) atmoSphere: mindfulness over haptic-audio cross modal correspondence. In: Proceedings of the 2017 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2017 ACM International Symposium on Wearable Computers. ACM, 289\u2013292","DOI":"10.1145\/3123024.3123190"},{"key":"8473_CR71","doi-asserted-by":"crossref","unstructured":"Tanaka A, Parkinson A (2016) Haptic wave: A cross-modal interface for visually impaired audio producers. In Proceedings of the 2016 CHI conference on human factors in computing systems. ACM, 2150\u20132161","DOI":"10.1145\/2858036.2858304"},{"key":"8473_CR72","unstructured":"Tsiros A (2017) The parallels between the study of cross-modal correspondence and the design of cross-sensory mappings. In: Proceedings of the conference on Electronic Visualisation and the Arts. BCS Learning & Development Ltd., 175\u2013182"},{"key":"8473_CR73","unstructured":"Ur R\u00e9hman S, Khan MSL, Li L, Li H (2014) Vibrotactile TV for immersive experience. In Signal and Information Processing Association Annual Summit and Conference (APSIPA), 2014 Asia-Pacific. IEEE, 1\u20134"},{"key":"8473_CR74","doi-asserted-by":"crossref","unstructured":"Valenti G, Westerterp KR (2013) Optical heart rate monitoring module validation study. In: Consumer Electronics (ICCE), 2013 IEEE International Conference on. IEEE, 195\u2013196","DOI":"10.1109\/ICCE.2013.6486856"},{"issue":"2","key":"8473_CR75","doi-asserted-by":"publisher","first-page":"136","DOI":"10.1016\/j.image.2012.10.009","volume":"28","author":"M Waltl","year":"2013","unstructured":"Waltl M, Rainer B, Timmerer C, Hellwagner H (2013) An end-to-end tool chain for Sensory Experience based on MPEG-V. Signal Process Image Commun 28(2):136\u2013150. https:\/\/doi.org\/10.1016\/j.image.2012.10.009","journal-title":"Signal Process Image Commun"},{"key":"8473_CR76","doi-asserted-by":"crossref","unstructured":"Waltl M, Timmerer C, Hellwagner H (2010) Improving the quality of multimedia experience through sensory effects. In 2010 Second International Workshop on Quality of Multimedia Experience (QoMEX). 124\u2013129. 10.1109\/QOMEX.2010.5517704","DOI":"10.1109\/QOMEX.2010.5517704"},{"issue":"7","key":"8473_CR77","doi-asserted-by":"publisher","first-page":"561","DOI":"10.1016\/j.cub.2009.02.013","volume":"19","author":"JM Yau","year":"2009","unstructured":"Yau JM, Olenczak JB, Dammann JF, Bensmaia SJ (2009) Temporal frequency channels are linked across audition and touch. Curr Biol 19(7):561\u2013566","journal-title":"Curr Biol"},{"issue":"99","key":"8473_CR78","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1109\/TMM.2015.2431915","volume":"PP","author":"Z Yuan","year":"2015","unstructured":"Yuan Z, Bi T, Muntean GM, Ghinea G (2015a) Perceived synchronization of Mulsemedia services. IEEE Transactions on Multimedia PP(99):1. https:\/\/doi.org\/10.1109\/TMM.2015.2431915","journal-title":"IEEE Transactions on Multimedia"},{"key":"8473_CR79","doi-asserted-by":"crossref","unstructured":"Yuan Z, Chen S, Ghinea G, Muntean G-M (2014) User quality of experience of mulsemedia applications. ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM) 11, 1s: 15. 10.1145\/2661329","DOI":"10.1145\/2661329"},{"issue":"1","key":"8473_CR80","doi-asserted-by":"publisher","first-page":"104","DOI":"10.1109\/TMM.2014.2371240","volume":"17","author":"Z Yuan","year":"2015","unstructured":"Yuan Z, Ghinea G, Muntean G-M (2015b) Beyond multimedia adaptation: Quality of experience-aware multi-sensorial media delivery. IEEE Transactions on Multimedia 17(1):104\u2013117","journal-title":"IEEE Transactions on Multimedia"},{"key":"8473_CR81","doi-asserted-by":"crossref","unstructured":"Zou L, Tal I, Covaci A, Ibarrola E, Ghinea G, Muntean G-M (2017) Can multisensorial media improve learner experience?. In Proceedings of the 8th ACM on Multimedia Systems Conference. ACM, 315\u2013320","DOI":"10.1145\/3083187.3084014"}],"container-title":["Multimedia Tools and Applications"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s11042-019-08473-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/article\/10.1007\/s11042-019-08473-5\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s11042-019-08473-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,9,24]],"date-time":"2023-09-24T17:08:19Z","timestamp":1695575299000},"score":1,"resource":{"primary":{"URL":"http:\/\/link.springer.com\/10.1007\/s11042-019-08473-5"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,1,3]]},"references-count":81,"journal-issue":{"issue":"11-12","published-print":{"date-parts":[[2020,3]]}},"alternative-id":["8473"],"URL":"https:\/\/doi.org\/10.1007\/s11042-019-08473-5","relation":{},"ISSN":["1380-7501","1573-7721"],"issn-type":[{"value":"1380-7501","type":"print"},{"value":"1573-7721","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,1,3]]},"assertion":[{"value":"8 January 2019","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"5 September 2019","order":2,"name":"revised","label":"Revised","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"12 November 2019","order":3,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"3 January 2020","order":4,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}