{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,11]],"date-time":"2026-03-11T23:02:17Z","timestamp":1773270137115,"version":"3.50.1"},"reference-count":56,"publisher":"MDPI AG","issue":"6","license":[{"start":{"date-parts":[[2021,5,31]],"date-time":"2021-05-31T00:00:00Z","timestamp":1622419200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100000266","name":"Engineering and Physical Sciences Research Council","doi-asserted-by":"publisher","award":["EP\/N509619\/1"],"award-info":[{"award-number":["EP\/N509619\/1"]}],"id":[{"id":"10.13039\/501100000266","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100000266","name":"Engineering and Physical Sciences Research Council","doi-asserted-by":"publisher","award":["EP\/M020460\/1"],"award-info":[{"award-number":["EP\/M020460\/1"]}],"id":[{"id":"10.13039\/501100000266","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100000266","name":"Engineering and Physical Sciences Research Council","doi-asserted-by":"publisher","award":["EP\/R02961X\/1"],"award-info":[{"award-number":["EP\/R02961X\/1"]}],"id":[{"id":"10.13039\/501100000266","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100000266","name":"Engineering and Physical Sciences Research Council","doi-asserted-by":"publisher","award":["EP\/S026096\/1"],"award-info":[{"award-number":["EP\/S026096\/1"]}],"id":[{"id":"10.13039\/501100000266","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100000266","name":"Engineering and Physical Sciences Research Council","doi-asserted-by":"publisher","award":["EP\/T020792\/1"],"award-info":[{"award-number":["EP\/T020792\/1"]}],"id":[{"id":"10.13039\/501100000266","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["MTI"],"abstract":"<jats:p>We present and evaluate the concept of FeelMusic and evaluate an implementation of it. It is an augmentation of music through the haptic translation of core musical elements. Music and touch are intrinsic modes of affective communication that are physically sensed. By projecting musical features such as rhythm and melody into the haptic domain, we can explore and enrich this embodied sensation; hence, we investigated audio-tactile mappings that successfully render emotive qualities. We began by investigating the affective qualities of vibrotactile stimuli through a psychophysical study with 20 participants using the circumplex model of affect. We found positive correlations between vibration frequency and arousal across participants, but correlations with valence were specific to the individual. We then developed novel FeelMusic mappings by translating key features of music samples and implementing them with \u201cPump-and-Vibe\u201d, a wearable interface utilising fluidic actuation and vibration to generate dynamic haptic sensations. We conducted a preliminary investigation to evaluate the FeelMusic mappings by gathering 20 participants\u2019 responses to the musical, tactile and combined stimuli, using valence ratings and descriptive words from Hevner\u2019s adjective circle to measure affect. These mappings, and new tactile compositions, validated that FeelMusic interfaces have the potential to enrich musical experiences and be a means of affective communication in their own right. FeelMusic is a tangible realisation of the expression \u201cfeel the music\u201d, enriching our musical experiences.<\/jats:p>","DOI":"10.3390\/mti5060029","type":"journal-article","created":{"date-parts":[[2021,5,31]],"date-time":"2021-05-31T23:33:33Z","timestamp":1622504013000},"page":"29","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":28,"title":["FeelMusic: Enriching Our Emotive Experience of Music through Audio-Tactile Mappings"],"prefix":"10.3390","volume":"5","author":[{"given":"Alice","family":"Haynes","sequence":"first","affiliation":[{"name":"Department of Engineering Mathematics, University of Bristol, Bristol BS8 1TH, UK"}]},{"given":"Jonathan","family":"Lawry","sequence":"additional","affiliation":[{"name":"Department of Engineering Mathematics, University of Bristol, Bristol BS8 1TH, UK"}]},{"given":"Christopher","family":"Kent","sequence":"additional","affiliation":[{"name":"School of Psychological Science, University of Bristol, Bristol BS8 1TH, UK"}]},{"given":"Jonathan","family":"Rossiter","sequence":"additional","affiliation":[{"name":"Department of Engineering Mathematics, University of Bristol, Bristol BS8 1TH, UK"}]}],"member":"1968","published-online":{"date-parts":[[2021,5,31]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"573","DOI":"10.1016\/j.cub.2009.02.058","article-title":"Universal recognition of three basic emotions in music","volume":"19","author":"Fritz","year":"2009","journal-title":"Curr. Biol."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Clayton, M. (2013). The Cultural Study of Music: A Critical Introduction, Routledge.","DOI":"10.4324\/9780203821015"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"367","DOI":"10.1016\/j.dr.2011.01.001","article-title":"Touch for socioemotional and physical well-being: A review","volume":"30","author":"Field","year":"2010","journal-title":"Dev. Rev."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"MacDonald, R., Kreutz, G., and Mitchell, L. (2013). Music, Health, and Wellbeing, Oxford University Press.","DOI":"10.1093\/acprof:oso\/9780199586974.001.0001"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1016\/j.ijpsycho.2004.02.002","article-title":"Affective and physiological responses to environmental noises and music","volume":"53","author":"Gomez","year":"2004","journal-title":"Int. J. Psychophysiol."},{"key":"ref_6","unstructured":"Hoffman, H.G. (1998, January 14\u201318). Physically touching virtual objects using tactile augmentation enhances the realism of virtual environments. Proceedings of the IEEE 1998 Virtual Reality Annual International Symposium (Cat. No. 98CB36180), Atlanta, GA, USA."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"26","DOI":"10.1109\/ACCESS.2015.2497316","article-title":"Affective haptics: Current research and future directions","volume":"4","author":"Eid","year":"2015","journal-title":"IEEE Access"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"83","DOI":"10.1196\/annals.1305.006","article-title":"Tactile sensory substitution studies","volume":"1013","year":"2004","journal-title":"Ann. N. Y. Acad. Sci."},{"key":"ref_9","unstructured":"Merchel, S., Leppin, A., and Altinsoy, E. (2009, January 5\u20139). Hearing with your body: The influence of whole-body vibrations on loudness perception. Proceedings of the 16th International Congress on Sound and Vibration (ICSV), Krak\u00f3w, Poland."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"220","DOI":"10.17743\/jaes.2014.0016","article-title":"The influence of vibrations on musical experience","volume":"62","author":"Merchel","year":"2014","journal-title":"J. Audio Eng. Soc."},{"key":"ref_11","unstructured":"Altinsoy, M.E., and Merchel, S. Cross-modal frequency matching: Sound and whole-body vibration. Proceedings of the International Workshop on Haptic and Audio Interaction Design."},{"key":"ref_12","first-page":"333","article-title":"Auditory and tactile frequency representations overlap in parietal operculum","volume":"45","author":"Barnes","year":"2016","journal-title":"Perception"},{"key":"ref_13","unstructured":"CuteCircuit (2019, September 19). Sound Shirt. Available online: http:\/\/cutecircuit.com\/soundshirt\/."},{"key":"ref_14","unstructured":"Yao, L., Shi, Y., Chi, H., Ji, X., and Ying, F. Music-touch shoes: Vibrotactile interface for hearing impaired dancers. Proceedings of the ACM Fourth International Conference on Tangible, Embedded, and Embodied Interaction."},{"key":"ref_15","unstructured":"Allwood, J. (2019, September 19). Real-Tme Sound to Tactile Mapping. Available online: http:\/\/www.coroflot.com\/jackjallwood\/outer-ear."},{"key":"ref_16","unstructured":"Podzuweit, F. (2019, September 19). Music for Deaf People. Available online: http:\/\/www.coroflot.com\/frederik\/Music-for-deaf-people."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Novich, S.D., and Eagleman, D.M. (2014, January 23\u201326). A vibrotactile sensory substitution device for the deaf and profoundly hearing impaired. Proceedings of the IEEE Haptics Symposium (HAPTICS), Houston, TX, USA.","DOI":"10.1109\/HAPTICS.2014.6775419"},{"key":"ref_18","unstructured":"Eagleman, D. (2019, September 19). Sensory Substitution. Available online: https:\/\/www.eagleman.com\/research\/sensory-substitution."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"369","DOI":"10.1076\/jnmr.32.4.369.18856","article-title":"Cutaneous grooves: Composing for the sense of touch","volume":"32","author":"Gunther","year":"2003","journal-title":"J. New Music Res."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Karam, M., Branje, C., Nespoli, G., Thompson, N., Russo, F.A., and Fels, D.I. (2010, January 10\u201315). The emoti-chair: An interactive tactile music exhibit. Proceedings of the ACM CHI\u201910 Extended Abstracts on Human Factors in Computing Systems, Atlanta, GA, USA.","DOI":"10.1145\/1753846.1753919"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"160","DOI":"10.1109\/TOH.2009.32","article-title":"Designing the model human cochlea: An ambient crossmodal audio-tactile display","volume":"2","author":"Karam","year":"2009","journal-title":"IEEE Trans. Haptics"},{"key":"ref_22","unstructured":"Jack, R., McPherson, A., and Stockman, T. (2015, January 23\u201325). Designing tactile musical devices with and for deaf users: A case study. Proceedings of the International Conference on the Multimodal Experience of Music, Sheffield, UK."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"377","DOI":"10.1037\/1528-3542.7.2.377","article-title":"Relationships between musical structure and psychophysiological measures of emotion","volume":"7","author":"Gomez","year":"2007","journal-title":"Emotion"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"111","DOI":"10.1016\/S0010-0277(98)00043-2","article-title":"Music and emotion: Perceptual determinants, immediacy, and isolation after brain damage","volume":"68","author":"Peretz","year":"1998","journal-title":"Cognition"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"449","DOI":"10.1177\/0305735610377592","article-title":"How music touches: Musical parameters and listeners audio-tactile metaphorical mappings","volume":"39","author":"Eitan","year":"2011","journal-title":"Psychol. Music"},{"key":"ref_26","unstructured":"Peeva, D., Baird, B., Izmirli, O., and Blevins, D. (2004, January 16). Haptic and sound correlations: Pitch, Loudness and Texture. Proceedings of the IEEE Eighth International Conference on Information Visualisation, London, UK."},{"key":"ref_27","unstructured":"Vant Klooster, A.R., and Collins, N. (July, January 30). In A State: Live Emotion Detection and Visualisation for Music Performance. Proceedings of the NIME, London, UK."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"169","DOI":"10.1080\/02699939208411068","article-title":"An argument for basic emotions","volume":"6","author":"Ekman","year":"1992","journal-title":"Cognit. Emot."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"1161","DOI":"10.1037\/h0077714","article-title":"A circumplex model of affect","volume":"39","author":"Russell","year":"1980","journal-title":"J. Pers. Soc. Psychol."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"820","DOI":"10.1037\/0022-3514.76.5.820","article-title":"The two general activation systems of affect: Structural findings, evolutionary considerations, and psychobiological evidence","volume":"76","author":"Watson","year":"1999","journal-title":"J. Pers. Soc. Psychol."},{"key":"ref_31","unstructured":"Thayer, R.E. (1997). The Origin of Everyday Moods: Managing Energy, Tension, and Stress, Oxford University Press."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1177\/0305735604039281","article-title":"The relative utility of pleasantness and liking dimensions in predicting the emotions expressed by music","volume":"32","author":"Ritossa","year":"2004","journal-title":"Psychol. Music"},{"key":"ref_33","unstructured":"Yoo, Y., Yoo, T., Kong, J., and Choi, S. (2015, January 22\u201326). Emotional responses of tactile icons: Effects of amplitude, frequency, duration, and envelope. Proceedings of the 2015 IEEE World Haptics Conference (WHC), Evanston, IL, USA."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Salminen, K., Surakka, V., Lylykangas, J., Raisamo, J., Saarinen, R., Raisamo, R., Rantala, J., and Evreinov, G. (2008, January 8\u201313). Emotional and behavioral responses to haptic stimulation. Proceedings of the ACM SIGCHI Conference on Human Factors in Computing Systems, Yokohama, Japan.","DOI":"10.1145\/1357054.1357298"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Kryssanov, V.V., Cooper, E.W., Ogawa, H., and Kurose, I. (2009, January 10\u201312). A computational model to relay emotions with tactile stimuli. Proceedings of the IEEE 2009 3rd International Conference on Affective Computing and Intelligent Interaction and Workshops, Amsterdam, The Netherlands.","DOI":"10.1109\/ACII.2009.5349329"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Takahashi, K., Mitsuhashi, H., Murata, K., Norieda, S., and Watanabe, K. (2011, January 9\u201312). Feelings of animacy and pleasantness from tactile stimulation: Effect of stimulus frequency and stimulated body part. Proceedings of the 2011 IEEE International Conference on Systems, Man, and Cybernetics, Anchorage, AK, USA.","DOI":"10.1109\/ICSMC.2011.6084177"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"192","DOI":"10.1016\/j.neubiorev.2009.02.003","article-title":"Quantitative assessment of pleasant touch","volume":"34","author":"Essick","year":"2010","journal-title":"Neurosci. Biobehav. Rev."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Bianchi, M., Valenza, G., Serio, A., Lanata, A., Greco, A., Nardelli, M., Scilingo, E.P., and Bicchi, A. (2014, January 23\u201326). Design and preliminary affective characterization of a novel fabric-based tactile display. Proceedings of the 2014 IEEE Haptics Symposium (HAPTICS), Houston, TX, USA.","DOI":"10.1109\/HAPTICS.2014.6775522"},{"key":"ref_39","unstructured":"Swindells, C., MacLean, K.E., Booth, K.S., and Meitner, M. A case-study of affect measurement tools for physical user interface design. Proceedings of the Graphics Interface 2006."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"147","DOI":"10.5057\/E081120-ISES06","article-title":"Tactile sensation as emotion elicitor","volume":"8","author":"Suk","year":"2009","journal-title":"Kansei Eng. Int."},{"key":"ref_41","unstructured":"Design, D. (2019, September 19). Tactor. Available online: http:\/\/www.dancerdesign.co.uk\/products\/tactor.html."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"49","DOI":"10.1007\/s00221-008-1494-6","article-title":"Vibrotactile amplitude discrimination capacity parallels magnitude changes in somatosensory cortex and follows Weber\u015b Law","volume":"191","author":"Francisco","year":"2008","journal-title":"Exp. Brain Res."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"2753","DOI":"10.1152\/jn.1999.81.6.2753","article-title":"Unmyelinated afferents constitute a second system coding tactile stimuli of the human hairy skin","volume":"81","author":"Vallbo","year":"1999","journal-title":"J. Neurophysiol."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"34","DOI":"10.3389\/fnbeh.2014.00034","article-title":"Quantifying the sensory and emotional perception of touch: Differences between glabrous and hairy skin","volume":"8","author":"Ackerley","year":"2014","journal-title":"Front. Behav. Neurosci."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"26","DOI":"10.1080\/02643294.2016.1168791","article-title":"Towards explaining spatial touch perception: Weighted integration of multiple location codes","volume":"33","author":"Badde","year":"2016","journal-title":"Cognit. Neuropsychol."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"40504","DOI":"10.1038\/srep40504","article-title":"Feeling touched: Emotional modulation of somatosensory potentials to interpersonal touch","volume":"7","author":"Ravaja","year":"2017","journal-title":"Sci. Rep."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"42197","DOI":"10.1038\/srep42197","article-title":"Sensory augmentation: Integration of an auditory compass signal into human perception of space","volume":"7","author":"Schumann","year":"2017","journal-title":"Sci. Rep."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"767","DOI":"10.3389\/fpsyg.2018.00767","article-title":"Why early tactile speech aids may have failed: No perceptual integration of tactile and auditory signals","volume":"9","author":"Rizza","year":"2018","journal-title":"Front. Psychol."},{"key":"ref_49","unstructured":"Rossiter, J. (2021, May 20). Pump and Vibe. Available online: https:\/\/data.bris.ac.uk\/data\/dataset\/1vj7fcw8m7gzl2uo35fsb3l4zn."},{"key":"ref_50","unstructured":"Schutte, K. (2009). MathWorks File Exchange, MathWorks."},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"429","DOI":"10.3758\/s13423-011-0070-4","article-title":"Audiotactile interactions in temporal perception","volume":"18","author":"Occelli","year":"2011","journal-title":"Psychon. Bull. Rev."},{"key":"ref_52","doi-asserted-by":"crossref","unstructured":"Adelstein, B.D., Begault, D.R., Anderson, M.R., and Wenzel, E.M. (2003, January 5\u20137). Sensitivity to haptic-audio asynchrony. Proceedings of the 5th International Conference on Multimodal Interfaces, Vancouver, BC, Canada.","DOI":"10.1145\/958432.958448"},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"432","DOI":"10.1177\/0305735616671587","article-title":"Affective reactions to music: Norms for 120 excerpts of modern and classical music","volume":"45","author":"Imbir","year":"2017","journal-title":"Psychol. Music"},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"186","DOI":"10.1037\/h0054832","article-title":"Expression in music: A discussion of experimental studies and theories","volume":"42","author":"Hevner","year":"1935","journal-title":"Psychol. Rev."},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"341","DOI":"10.1007\/BF02856522","article-title":"The development of emotional responses to music in young children","volume":"20","author":"Gregory","year":"1996","journal-title":"Motiv. Emot."},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"47","DOI":"10.1177\/0305735696241005","article-title":"Cross-cultural comparisons in the affective response to music","volume":"24","author":"Gregory","year":"1996","journal-title":"Psychol. Music"}],"container-title":["Multimodal Technologies and Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2414-4088\/5\/6\/29\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T06:09:40Z","timestamp":1760162980000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2414-4088\/5\/6\/29"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,5,31]]},"references-count":56,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2021,6]]}},"alternative-id":["mti5060029"],"URL":"https:\/\/doi.org\/10.3390\/mti5060029","relation":{},"ISSN":["2414-4088"],"issn-type":[{"value":"2414-4088","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,5,31]]}}}