{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,27]],"date-time":"2026-09-27T12:26:42Z","timestamp":1790512002107,"version":"4.1.0"},"reference-count":45,"publisher":"Springer Science and Business Media LLC","issue":"2","license":[{"start":{"date-parts":[[2020,3,30]],"date-time":"2020-03-30T00:00:00Z","timestamp":1585526400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2020,3,30]],"date-time":"2020-03-30T00:00:00Z","timestamp":1585526400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100000266","name":"Engineering and Physical Sciences Research Council","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100000266","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["J Multimodal User Interfaces"],"published-print":{"date-parts":[[2020,6]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>When designing movement sonifications, their effect on people\u2019s movement must be considered. Recent work has shown how real-time sonification can be designed to alter the way people move. However, the mechanisms through which these sonifications alter people\u2019s expectations of their movement is not well explained. This is especially important when considering musical sonifications, to which people bring their own associations and musical expectation, and which can, in turn, alter their perception of the sonification. This paper presents a Movement Expectation Sonification Model, based on theories of motor-feedback and expectation, to explore how musical sonification can impact the way people perceive their movement. Secondly, we present a study that validates the predictions of this model by exploring how harmonic stability within sonification interacts with contextual cues in the environment to impact movement behaviour and perceptions. We show how musical expectancy can be built to either reward or encourage movement, and how such an effect is mediated through the presence of additional cues. This model offers a way for sonification designers to create movement sonifications that not only inform movement but can be used to encourage progress and reward successes.<\/jats:p>","DOI":"10.1007\/s12193-020-00322-2","type":"journal-article","created":{"date-parts":[[2020,3,30]],"date-time":"2020-03-30T09:03:42Z","timestamp":1585559022000},"page":"153-166","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":18,"title":["Movement sonification expectancy model: leveraging musical expectancy theory to create movement-altering sonifications"],"prefix":"10.1007","volume":"14","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-0198-3198","authenticated-orcid":false,"given":"Joseph","family":"Newbold","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Nicolas E.","family":"Gold","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Nadia","family":"Bianchi-Berthouze","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2020,3,30]]},"reference":[{"key":"322_CR1","doi-asserted-by":"publisher","first-page":"244","DOI":"10.3389\/fpsyg.2019.00244","volume":"10","author":"N Schaffert","year":"2019","unstructured":"Schaffert N, Janzen TB, Mattes K, Thaut MH (2019) A review on the relationship between sound and movement in sports and rehabilitation. Front Psychol 10:244","journal-title":"Front Psychol"},{"key":"322_CR2","doi-asserted-by":"crossref","unstructured":"Tajadura-Jim\u00e9nez A, Basia M, Deroy O, Fairhurst M, Marquardt N, Bianchi-Berthouze N (2015) As light as your footsteps: altering walking sounds to change perceived body weight. Emotional state and gait","DOI":"10.1145\/2702123.2702374"},{"key":"322_CR3","doi-asserted-by":"publisher","first-page":"26","DOI":"10.3389\/fncom.2013.00026","volume":"7","author":"EO Boyer","year":"2013","unstructured":"Boyer EO, Babayan BM, Bevilacqua F, Noisternig M, Warusfel O, Roby-Brami A, Hanneton S, Viaud-Delmon I (2013) From ear to hand: the role of the auditory-motor loop in pointing to an auditory source. Front Comput Neurosci 7:26","journal-title":"Front Comput Neurosci"},{"key":"322_CR4","doi-asserted-by":"crossref","unstructured":"Newbold JW, Bianchi-Berthouze N, Gold NE, Tajadura-Jim\u00e9nez A, Williams AC (2016) Musically informed sonification for chronic pain rehabilitation: facilitating progress & avoiding over-doing. In: CHI \u201916","DOI":"10.1145\/2858036.2858302"},{"issue":"10","key":"322_CR5","doi-asserted-by":"publisher","first-page":"3129","DOI":"10.1007\/s00221-017-5047-8","volume":"235","author":"JF Dyer","year":"2017","unstructured":"Dyer JF, Stapleton P, Rodger MWM (2017) Advantages of melodic over rhythmic movement sonification in bimanual motor skill learning. Exp Brain Res 235(10):3129\u20133140. https:\/\/doi.org\/10.1007\/s00221-017-5047-8","journal-title":"Exp Brain Res"},{"key":"322_CR6","unstructured":"Polotti P, Rocchesso D (2008) Sound to sense, sense to sound a state of the art in sound and music computing. http:\/\/smcnetwork.org\/public\/S2S2BOOK1.pdf"},{"key":"322_CR7","volume-title":"Embodied music cognition and mediation technology","author":"M Leman","year":"2008","unstructured":"Leman M (2008) Embodied music cognition and mediation technology. MIT Press, Cambridge"},{"issue":"1","key":"322_CR8","first-page":"67","volume":"6","author":"H Mohammadzadeh","year":"2008","unstructured":"Mohammadzadeh H, Tartibiyan B, Ahmadi A (2008) The effects of music on the perceived exertion rate and performance of trained and untrained individuals during progressive exercise. Facta Univ Ser Phys Educ Sport 6(1):67\u201374","journal-title":"Facta Univ Ser Phys Educ Sport"},{"key":"322_CR9","doi-asserted-by":"publisher","first-page":"371","DOI":"10.1002\/9781118976005.ch18","volume-title":"The Wiley handbook of human computer interaction","author":"A Tajadura-Jim\u00e9nez","year":"2017","unstructured":"Tajadura-Jim\u00e9nez A, V\u00e4ljam\u00e4e A, Bevilacqua F, Bianchi-Berthouze N (2017) Principles for designing body-centered auditory feedback. In: Norman KL, Kirakowski J (eds) The Wiley handbook of human computer interaction. Wiley, Chichester, pp 371\u2013403. https:\/\/doi.org\/10.1002\/9781118976005.ch18"},{"issue":"4","key":"322_CR10","doi-asserted-by":"publisher","first-page":"199","DOI":"10.1080\/07370016.2015.1087262","volume":"32","author":"C Shieh","year":"2015","unstructured":"Shieh C, Weaver MT, Hanna KM, Newsome K, Mogos M (2015) Association of self-efficacy and self-regulation with nutrition and exercise behaviors in a community sample of adults. J Community Health Nurs 32(4):199\u2013211","journal-title":"J Community Health Nurs"},{"key":"322_CR11","first-page":"0011","volume-title":"Handbook of principles of organization behavior","author":"A Bandura","year":"2000","unstructured":"Bandura A (2000) Cultivate self-efficacy for personal and organizational effectiveness. In: Locke EA (ed) Handbook of principles of organization behavior, vol 2. Blackwell, Oxford, pp 0011\u20130021"},{"issue":"4","key":"322_CR12","doi-asserted-by":"publisher","first-page":"424","DOI":"10.1080\/02701367.1991.10607544","volume":"62","author":"PA Fitzsimmons","year":"1991","unstructured":"Fitzsimmons PA, Landers DM, Thomas JR, van der Mars H (1991) Does self-efficacy predict performance in experienced weightlifters? Res Q Exerc Sport 62(4):424\u2013431","journal-title":"Res Q Exerc Sport"},{"issue":"4","key":"322_CR13","doi-asserted-by":"publisher","first-page":"548","DOI":"10.1037\/0022-0663.74.4.548","volume":"74","author":"DH Schunk","year":"1982","unstructured":"Schunk DH (1982) Effects of effort attributional feedback on children\u2019s perceived self-efficacy and achievement. J Educ Psychol 74(4):548","journal-title":"J Educ Psychol"},{"key":"322_CR14","unstructured":"Singh A, Klapper A, Jia J, Fidalgo A, Tajadura-Jim\u00e9nez A, Kanakam N, Bianchi-Berthouze N, Williams A. In: CHI \u201914, New York, NY, USA"},{"issue":"6","key":"322_CR15","doi-asserted-by":"publisher","first-page":"385","DOI":"10.7326\/M15-1635","volume":"164","author":"M Patel","year":"2016","unstructured":"Patel M, Asch D, Rosin R et al (2016) Framing financial incentives to increase physical activity among overweight and obese adults: a randomized, controlled trial. Ann Intern Med 164(6):385\u2013394. https:\/\/doi.org\/10.7326\/M15-1635","journal-title":"Ann Intern Med"},{"key":"322_CR16","volume-title":"Body, sound and space in music and beyond: multimodal explorations","author":"P Vickers","year":"2017","unstructured":"Vickers P, Hogg B, Worrall D (2017) Aesthetics of sonification: taking the subject-position. In: W\u00f6llner C (ed) Body, sound and space in music and beyond: multimodal explorations. Routledge, London"},{"key":"322_CR17","unstructured":"Wallis RI, Ingalls T, Rikakis T, Olsen L, Chen Y, Xu W, Sundaram H(2007) Real-time sonification movement for an immersive stroke rehabilitation environment. In: ICAD 2007"},{"key":"322_CR18","doi-asserted-by":"crossref","unstructured":"Khan RA, Jeon M, Yoon T (jun 2018) \u201cMusical exercise\u201d for people with visual impairments: a preliminary study with the blindfolded. In: Proceedings of the 24th international conference on auditory display\u2014ICAD 2018. The International Community for Auditory Display, Arlington, Virginia, pp 204\u2013211. http:\/\/hdl.handle.net\/1853\/60091. Accessed 30 May 2019","DOI":"10.21785\/icad2018.030"},{"key":"322_CR19","doi-asserted-by":"crossref","unstructured":"Middleton J, Hakulinen J, Tiitinen , Hella J, Keskinen T, Huuskonen P, Linna J, Turunen M, Ziat M, Raisamo R (jun 2018) Sonification with musical characteristics: a path guided by user engagement. In: Proceedings of the 24th international conference on auditory display\u2014ICAD 2018. The International Community for Auditory Display","DOI":"10.21785\/icad2018.006"},{"key":"322_CR20","first-page":"363","volume-title":"The Oxford handbook of algorithmic music","author":"C Scaletti","year":"2018","unstructured":"Scaletti C (2018) Sonification$$\\ne $$ music. In: Dean RT, McLean A (eds) The Oxford handbook of algorithmic music. Oxford University Press, Oxford, p 363"},{"key":"322_CR21","unstructured":"Roddy S. Embodied sonification. Ph.D. dissertation"},{"key":"322_CR22","doi-asserted-by":"publisher","DOI":"10.7551\/mitpress\/6575.001.0001","volume-title":"Sweet anticipation: music and the psychology of expectation","author":"D Huron","year":"2006","unstructured":"Huron D (2006) Sweet anticipation: music and the psychology of expectation. MIT Press, Cambridge, MA"},{"issue":"Suppl","key":"322_CR23","doi-asserted-by":"publisher","first-page":"1212","DOI":"10.1038\/81497","volume":"3","author":"DM Wolpert","year":"2000","unstructured":"Wolpert DM, Ghahramani Z (2000) Computational principles of movement neuroscience. Nat Neurosci 3(Suppl):1212\u20131217","journal-title":"Nat Neurosci"},{"key":"322_CR24","doi-asserted-by":"publisher","first-page":"385","DOI":"10.3389\/fnins.2016.00385","volume":"10","author":"F Bevilacqua","year":"2016","unstructured":"Bevilacqua F, Boyer EO, Fran\u00e7ose J, Houix O, Susini P, Roby-Brami A, Hanneton S (2016) Sensori-motor learning with movement sonification: Perspectives from recent interdisciplinary studies. Front Neurosci 10:385","journal-title":"Front Neurosci"},{"key":"322_CR25","first-page":"54","volume":"20","author":"C Karageorghis","year":"1997","unstructured":"Karageorghis C, Terry P (1997) The psychophysical effects of music in sport and exercise: a review. J Sport Behav 20:54","journal-title":"J Sport Behav"},{"key":"322_CR26","doi-asserted-by":"crossref","unstructured":"Bigand E (1997) Perceiving musical stability: the effect of tonal structure, rhythm, and musical expertise. ...of experimental psychology: human perception and .... http:\/\/psycnet.apa.org\/journals\/xhp\/23\/3\/808\/. Accessed 30 May 2019","DOI":"10.1037\/0096-1523.23.3.808"},{"key":"322_CR27","doi-asserted-by":"crossref","first-page":"359","DOI":"10.1515\/9783110215366.6.359","volume-title":"Multimodal metaphor","author":"LM Zbikowski","year":"2009","unstructured":"Zbikowski LM (2009) Music, language, and multimodal metaphor. In: Forceville C, Urios-Aparisi E (eds) Multimodal metaphor. Oxford University Press, Oxford, pp 359\u2013381"},{"issue":"5","key":"322_CR28","doi-asserted-by":"publisher","first-page":"1585","DOI":"10.1007\/s00221-015-4233-9","volume":"233","author":"N Komeilipoor","year":"2015","unstructured":"Komeilipoor N, Rodger MWM, Craig CM, Cesari P (2015) (Dis-)harmony in movement: effects of musical dissonance on movement timing and form. Exp Brain Res 233(5):1585\u20131595. https:\/\/doi.org\/10.1007\/s00221-015-4233-9","journal-title":"Exp Brain Res"},{"key":"322_CR29","unstructured":"Huang H, Ingalls T, Olson L, Ganley K, Rikakis T, He J (2005) Interactive multimodal biofeedback for task-oriented neural rehabilitation. In: Conference proceedings: ...annual international conference of the IEEE engineering in medicine and biology society. IEEE engineering in medicine and biology society. Conference, vol 3, pp 2547\u20132550"},{"key":"322_CR30","doi-asserted-by":"crossref","unstructured":"Newbold JW, Bianchi-Berthouze N, Gold NE (2017) Musical expectancy in squat sonification for people who struggle with physical activity. In: International conference on auditory display, Penn State University","DOI":"10.21785\/icad2017.008"},{"key":"322_CR31","unstructured":"Roddy S, Furlong D (2015) Sonification listening: an empirical embodied approach. In: Proceedings of the 21st international conference on auditory display (ICAD 2015)"},{"issue":"7","key":"322_CR32","doi-asserted-by":"publisher","first-page":"711","DOI":"10.1016\/j.ejpain.2006.10.009","volume":"11","author":"SR Woby","year":"2007","unstructured":"Woby SR, Urmston M, Watson PJ (2007) Self-efficacy mediates the relation between pain-related fear and outcome in chronic low back pain patients. Eur J Pain 11(7):711\u2013718","journal-title":"Eur J Pain"},{"issue":"3","key":"322_CR33","doi-asserted-by":"publisher","first-page":"329","DOI":"10.1249\/00005768-198906000-00018","volume":"21","author":"RJ Sonstroem","year":"1989","unstructured":"Sonstroem RJ, Morgan WP (1989) Exercise and self-esteem: rationale and model. Med Sci Sports Exerc 21(3):329\u201337","journal-title":"Med Sci Sports Exerc"},{"issue":"2","key":"322_CR34","doi-asserted-by":"publisher","first-page":"112","DOI":"10.1080\/10413209508406961","volume":"7","author":"DH Schunk","year":"1995","unstructured":"Schunk DH (1995) Self-efficacy, motivation, and performance. J Appl Sport Psychol 7(2):112\u2013137","journal-title":"J Appl Sport Psychol"},{"issue":"1","key":"322_CR35","first-page":"307","volume":"5","author":"A Bandura","year":"2006","unstructured":"Bandura A (2006) Guide for constructing self-efficacy scales. Self Effic Beliefs Adolesc 5(1):307\u2013337","journal-title":"Self Effic Beliefs Adolesc"},{"key":"322_CR36","volume-title":"Sonic interaction design","author":"S Serafin","year":"2011","unstructured":"Serafin S, Franinovic K, Hermann T, Lemaitre G, Rinott M, Rocchesso D (2011) Sonic interaction design. Logos Verlag, Berlin"},{"key":"322_CR37","volume-title":"Emotion and meaning in music","author":"LB Meyer","year":"1957","unstructured":"Meyer LB (1957) Emotion and meaning in music. University of Chicago Press, Chicago"},{"key":"322_CR38","unstructured":"Vickers P (2016) Sonification and music, music and sonification. In: The Routledge companion to sounding art"},{"issue":"3","key":"322_CR39","doi-asserted-by":"crossref","first-page":"344","DOI":"10.1525\/mp.2016.33.3.344","volume":"33","author":"E Chew","year":"2016","unstructured":"Chew E (2016) Playing with the edge: tipping points and the role of tonality. Music Percept Interdiscip J 33(3):344\u2013366","journal-title":"Music Percept Interdiscip J"},{"issue":"2","key":"322_CR40","doi-asserted-by":"publisher","first-page":"409","DOI":"10.3758\/BF03203962","volume":"16","author":"FB Colavita","year":"1974","unstructured":"Colavita FB (1974) Human sensory dominance. Percept Psychophys 16(2):409\u2013412","journal-title":"Percept Psychophys"},{"issue":"5","key":"322_CR41","doi-asserted-by":"publisher","first-page":"1449","DOI":"10.1111\/cdev.12397","volume":"86","author":"K Petrini","year":"2015","unstructured":"Petrini K, Jones PR, Smith L, Nardini M (2015) Hearing where the eyes see: children use an irrelevant visual cue when localizing sounds. Child Dev 86(5):1449\u20131457","journal-title":"Child Dev"},{"issue":"2","key":"322_CR42","doi-asserted-by":"publisher","first-page":"e89642","DOI":"10.1371\/journal.pone.0089642","volume":"9","author":"D M\u00fcllensiefen","year":"2014","unstructured":"M\u00fcllensiefen D, Gingras B, Musil J, Stewart L (2014) The musicality of non-musicians: an index for assessing musical sophistication in the general population. PloS one 9(2):e89642","journal-title":"PloS one"},{"key":"322_CR43","volume-title":"Methods of information integration theory","author":"NH Anderson","year":"1982","unstructured":"Anderson NH (1982) Methods of information integration theory, vol 2. Academic Press, New York"},{"issue":"4","key":"322_CR44","doi-asserted-by":"publisher","first-page":"232","DOI":"10.1111\/j.1468-5884.2008.00379.x","volume":"50","author":"NA De\u00a0S\u00e1 Teixeira","year":"2008","unstructured":"De\u00a0S\u00e1 Teixeira NA, Oliveira De AM, Viegas R (2008) Functional approach to the integration of kinematic and dynamic variables in causal perception: is there a link between phenomenology and behavioral responses? 1. Jpn Psychol Res 50(4):232\u2013241","journal-title":"Jpn Psychol Res"},{"issue":"6","key":"322_CR45","doi-asserted-by":"publisher","first-page":"551","DOI":"10.1111\/j.1467-7687.2005.00447.x","volume":"8","author":"EG Schellenberg","year":"2005","unstructured":"Schellenberg EG, Bigand E, Poulin-Charronnat B, Garnier C, Stevens C (2005) Children\u2019s implicit knowledge of harmony in Western music. Dev Sci 8(6):551\u2013566","journal-title":"Dev Sci"}],"container-title":["Journal on Multimodal User Interfaces"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s12193-020-00322-2.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/article\/10.1007\/s12193-020-00322-2\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s12193-020-00322-2.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,9,29]],"date-time":"2023-09-29T04:25:31Z","timestamp":1695961531000},"score":1,"resource":{"primary":{"URL":"http:\/\/link.springer.com\/10.1007\/s12193-020-00322-2"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,3,30]]},"references-count":45,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2020,6]]}},"alternative-id":["322"],"URL":"https:\/\/doi.org\/10.1007\/s12193-020-00322-2","relation":{},"ISSN":["1783-7677","1783-8738"],"issn-type":[{"value":"1783-7677","type":"print"},{"value":"1783-8738","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,3,30]]},"assertion":[{"value":"31 May 2019","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"17 March 2020","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"30 March 2020","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}