{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,5,13]],"date-time":"2025-05-13T16:27:09Z","timestamp":1747153629788,"version":"3.40.5"},"reference-count":84,"publisher":"Springer Science and Business Media LLC","issue":"5","license":[{"start":{"date-parts":[[2024,9,10]],"date-time":"2024-09-10T00:00:00Z","timestamp":1725926400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,9,10]],"date-time":"2024-09-10T00:00:00Z","timestamp":1725926400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"NordForsk\u2019s Nordic University Hub","award":["86892","86892"],"award-info":[{"award-number":["86892","86892"]}]},{"name":"NordForsk\u2019s Nordic University Hub","award":["86892"],"award-info":[{"award-number":["86892"]}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Pers Ubiquit Comput"],"published-print":{"date-parts":[[2024,10]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>In the growing field of sonic interaction design, increasing emphasis is being placed on walking-based interactions within an array of applications, including virtual reality, interactive media, and rehabilitation. Our study focuses on recreating the aural experience of wading through water, specifically the challenge of eliciting accurate and natural movement-sound associations for wading, both in interactive and listening-only contexts. We engineered a real-time wading simulation using a digital Foley technique that maps lower limb angular velocity contours to the intensity of steady-state flowing sounds. Our first iteration was evaluated in a perceptual experiment involving 16 participants, as well as an interactive test with 9 participants, which revealed the need for additional sensors along with time-domain preprocessing to ensure a consistently natural sound envelope across walking cadences (step tempi). We then refined the mapping function and incorporated more sound layers. In our subsequent listening test, 55 participants compared the realism of the initial and refined versions with real-life wading sounds at various step cadences. While the refined version demonstrated a notable improvement over the initial one and was deemed fairly realistic overall, it fell just short of the authenticity of the real-life recordings at faster cadences, suggesting room for further improvement of our simulation. Nevertheless, this research marks a stride in the evolution of walking-based sonic interactions, instigating wider acceptance and application of such systems in the future.<\/jats:p>","DOI":"10.1007\/s00779-024-01829-1","type":"journal-article","created":{"date-parts":[[2024,9,10]],"date-time":"2024-09-10T11:20:16Z","timestamp":1725967216000},"page":"823-843","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Sonifying gait kinematics: generating water wading sounds through a digital Foley approach"],"prefix":"10.1007","volume":"28","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5618-4265","authenticated-orcid":false,"given":"Prithvi Ravi","family":"Kantan","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0687-7810","authenticated-orcid":false,"given":"Sofia","family":"Dahl","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6971-1132","authenticated-orcid":false,"given":"Stefania","family":"Serafin","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1275-4064","authenticated-orcid":false,"given":"Erika G.","family":"Spaich","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2024,9,10]]},"reference":[{"key":"1829_CR1","unstructured":"Franinovic K, Serafin S (2013) Sonic interaction design, 1st edn. MIT Press, One Broadway 12th Floor Cambridge, MA 02142"},{"issue":"6","key":"1829_CR2","doi-asserted-by":"publisher","first-page":"602","DOI":"10.1097\/WCO.0000000000000026","volume":"26","author":"BH Dobkin","year":"2013","unstructured":"Dobkin BH (2013) Wearable motion sensors to continuously measure real-world physical activities. Curr Opin Neurol 26(6):602","journal-title":"Curr Opin Neurol"},{"key":"1829_CR3","doi-asserted-by":"crossref","unstructured":"DeWitt A, Bresin R (2007) Sound design for affective interaction. In: International conference on affective computing and intelligent interaction. Springer, pp 523\u2013533","DOI":"10.1007\/978-3-540-74889-2_46"},{"key":"1829_CR4","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-031-04021-4","volume-title":"Sonic interactions in virtual environments","author":"M Geronazzo","year":"2023","unstructured":"Geronazzo M, Serafin S (2023) Sonic interactions in virtual environments. Springer"},{"key":"1829_CR5","doi-asserted-by":"crossref","unstructured":"Salmouka F, Gazi A (2021) Mapping sonic practices in museum exhibitions\u2013an overview. In: Emerging technologies and the digital transformation of museums and heritage sites: first international conference, RISE IMET 2021, Nicosia, Cyprus, June 2\u20134, 2021, Proceedings 1. Springer, pp 61\u201375","DOI":"10.1007\/978-3-030-83647-4_5"},{"key":"1829_CR6","doi-asserted-by":"crossref","unstructured":"Amazonas M, Vasconcelos V, Brand\u00e3o A, Kienem G, Castro T, Gadelha B, Fuks H (2018) Collaborative music composition based on sonic interaction design. In: Distributed, ambient and pervasive interactions: understanding humans: 6th International Conference, DAPI 2018, Held as Part of HCI International 2018, Las Vegas, NV, USA, July 15\u201320, 2018, Proceedings, Part I 6. Springer, pp 335\u2013346","DOI":"10.1007\/978-3-319-91125-0_28"},{"key":"1829_CR7","doi-asserted-by":"crossref","unstructured":"Aly L, Penha R, Bernardes G (2018) Digit: a digital foley system to generate footstep sounds. In: Music technology with swing: 13th International Symposium, CMMR 2017, Matosinhos, Portugal, September 25-28, 2017, Revised Selected Papers 13. Springer, pp 429\u2013441","DOI":"10.1007\/978-3-030-01692-0_28"},{"issue":"2","key":"1829_CR8","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3165287","volume":"15","author":"D Moffat","year":"2018","unstructured":"Moffat D, Reiss JD (2018) Perceptual evaluation of synthesized sound effects. ACM Trans Appl Percept 15(2):1\u201319","journal-title":"ACM Trans Appl Percept"},{"issue":"3","key":"1829_CR9","doi-asserted-by":"publisher","first-page":"119","DOI":"10.1016\/j.scispo.2019.12.004","volume":"35","author":"J Guerra","year":"2020","unstructured":"Guerra J, Smith L, Vicinanza D, Stubbs B, Veronese N, Williams G (2020) The use of sonification for physiotherapy in human movement tasks: a scoping review. Sci Sports 35(3):119\u2013129","journal-title":"Sci Sports"},{"key":"1829_CR10","doi-asserted-by":"crossref","unstructured":"Tajadura-Jim\u00e9nez A, Basia M, Deroy O, Fairhurst M, Marquardt N, Bianchi-Berthouze N (2015) As light as your footsteps: altering walking sounds to change perceived body weight, emotional state and gait. In: Proceedings of the 33rd Annual ACM conference on human factors in computing systems. pp 2943\u20132952","DOI":"10.1145\/2702123.2702374"},{"issue":"3","key":"1829_CR11","doi-asserted-by":"publisher","first-page":"91688","DOI":"10.1371\/journal.pone.0091688","volume":"9","author":"I Senna","year":"2014","unstructured":"Senna I, Maravita A, Bolognini N, Parise CV (2014) The marble-hand illusion. PLoS One 9(3):91688","journal-title":"PLoS One"},{"issue":"6","key":"1829_CR12","doi-asserted-by":"publisher","first-page":"190","DOI":"10.1016\/S0960-9822(98)70120-4","volume":"8","author":"V Jousm\u00e4ki","year":"1998","unstructured":"Jousm\u00e4ki V, Hari R (1998) Parchment-skin illusion: sound-biased touch. Curr Biol 8(6):190\u2013191","journal-title":"Curr Biol"},{"issue":"1","key":"1829_CR13","first-page":"1","volume":"6","author":"DHM Kemper","year":"2014","unstructured":"Kemper DHM, Hug D (2014) From foley to function: a pedagogical approach to sound design for novel interactions. J Sonic Stud 6(1):1\u201323","journal-title":"J Sonic Stud"},{"key":"1829_CR14","unstructured":"Pauletto S, Selfridge R, Holzapfel A, Frisk H (2021) From foley professional practice to sonic interaction design: initial research conducted within the radio sound studio project. In: Nordic sound and music computing conference"},{"key":"1829_CR15","unstructured":"Hermann T, Williamson J, Murray-Smith R, Visell Y, Brazil E (2008) Sonification for sonic interaction design. In: Proc. of the CHI 2008 workshop on sonic interaction design (SID), Florence. CHI"},{"issue":"11","key":"1829_CR16","doi-asserted-by":"publisher","first-page":"947","DOI":"10.1016\/j.ijhcs.2009.07.007","volume":"67","author":"Y Visell","year":"2009","unstructured":"Visell Y, Fontana F, Giordano BL, Nordahl R, Serafin S, Bresin R (2009) Sound design and perception in walking interactions. Int J Hum Comput Stud 67(11):947\u2013959","journal-title":"Int J Hum Comput Stud"},{"key":"1829_CR17","first-page":"3","volume":"2010","author":"R Bresin","year":"2010","unstructured":"Bresin R, Witt A, Papetti S, Civolani M, Fontana F (2010) Expressive sonification of footstep sounds. Proc ISon 2010:3","journal-title":"Proc ISon"},{"issue":"4","key":"1829_CR18","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/2536764.2536770","volume":"10","author":"L Turchet","year":"2013","unstructured":"Turchet L, Serafin S, Cesari P (2013) Walking pace affected by interactive sounds simulating stepping on different terrains. ACM Trans Appl Percept 10(4):1\u201314","journal-title":"ACM Trans Appl Percept"},{"issue":"9","key":"1829_CR19","doi-asserted-by":"publisher","first-page":"1234","DOI":"10.1109\/TVCG.2011.30","volume":"17","author":"R Nordahl","year":"2011","unstructured":"Nordahl R, Turchet L, Serafin S (2011) Sound synthesis and evaluation of interactive footsteps and environmental sounds sendering for virtual reality applications. IEEE Trans Vis Comput Graph 17(9):1234\u20131244","journal-title":"IEEE Trans Vis Comput Graph"},{"issue":"aop","key":"1829_CR20","first-page":"1","volume":"1","author":"D Linnhoff","year":"2020","unstructured":"Linnhoff D, Alizadeh S, Schaffert N, Mattes K (2020) Use of acoustic feedback to change gait patterns: implementation and transfer to motor learning theory\u2013a scoping review. J Motor Learn Dev 1(aop):1\u201321","journal-title":"J Motor Learn Dev"},{"issue":"2","key":"1829_CR21","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3180658","volume":"16","author":"NC Nilsson","year":"2018","unstructured":"Nilsson NC, Serafin S, Steinicke F, Nordahl R (2018) Natural walking in virtual reality: a review. Comput Entertain 16(2):1\u201322","journal-title":"Comput Entertain"},{"key":"1829_CR22","doi-asserted-by":"publisher","first-page":"1","DOI":"10.3389\/fneur.2016.00001","volume":"7","author":"J Maculewicz","year":"2016","unstructured":"Maculewicz J, Kofoed LB, Serafin S (2016) A technological review of the instrumented footwear for rehabilitation with a focus on Parkinson\u2019s disease patients. Front Neurol 7:1","journal-title":"Front Neurol"},{"issue":"1","key":"1829_CR23","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1080\/19424280.2011.653990","volume":"4","author":"M Alfuth","year":"2012","unstructured":"Alfuth M, Rosenbaum D (2012) Effects of changes in plantar sensory feedback on human gait characteristics: a systematic review. Footwear Sci 4(1):1\u201322","journal-title":"Footwear Sci"},{"key":"1829_CR24","doi-asserted-by":"crossref","unstructured":"Lam T, Pearson KG (2002) The role of proprioceptive feedback in the regulation and adaptation of locomotor activity. Sensorimotor Control of Movement and Posture, 343\u2013355","DOI":"10.1007\/978-1-4615-0713-0_40"},{"key":"1829_CR25","doi-asserted-by":"publisher","first-page":"38","DOI":"10.3389\/fspor.2020.00038","volume":"2","author":"T Cornwell","year":"2020","unstructured":"Cornwell T, Woodward J, Wu M, Jackson B, Souza P, Siegel J, Dhar S, Gordon KE (2020) Walking with ears: altered auditory feedback impacts gait step length in older adults. Front Sports Act Living 2:38","journal-title":"Front Sports Act Living"},{"key":"1829_CR26","first-page":"689","volume":"6","author":"A Tajadura-Jim\u00e9nez","year":"2015","unstructured":"Tajadura-Jim\u00e9nez A, Tsakiris M, Marquardt T, Bianchi-Berthouze N (2015) Action sounds update the mental representation of arm dimension: contributions of kinaesthesia and agency. Front Psychol 6:689","journal-title":"Front Psychol"},{"issue":"4","key":"1829_CR27","doi-asserted-by":"publisher","first-page":"534","DOI":"10.1145\/1101530.1101554","volume":"2","author":"KVD Doel","year":"2005","unstructured":"Doel KVD (2005) Physically based models for liquid sounds. ACM Trans Appl Percept 2(4):534\u2013546. https:\/\/doi.org\/10.1145\/1101530.1101554","journal-title":"ACM Trans Appl Percept"},{"issue":"4","key":"1829_CR28","doi-asserted-by":"publisher","first-page":"322","DOI":"10.1162\/PRES_a_00276","volume":"25","author":"SB Gilbert","year":"2016","unstructured":"Gilbert SB (2016) Perceived realism of virtual environments depends on authenticity. Presence 25(4):322\u2013324","journal-title":"Presence"},{"key":"1829_CR29","doi-asserted-by":"crossref","unstructured":"Rogers K, Ribeiro G, Wehbe RR, Weber M, Nacke LE (2018) Vanishing importance: studying immersive effects of game audio perception on player experiences in virtual reality. In: Proceedings of the 2018 CHI conference on human factors in computing systems, pp 1\u201313","DOI":"10.1145\/3173574.3173902"},{"key":"1829_CR30","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/1471-2202-14-32","volume":"14","author":"G Schmitz","year":"2013","unstructured":"Schmitz G, Mohammadi B, Hammer A, Heldmann M, Samii A, M\u00fcnte TF, Effenberg AO (2013) Observation of sonified movements engages a basal ganglia frontocortical network. BMC Neurosci 14:1\u201311","journal-title":"BMC Neurosci"},{"key":"1829_CR31","doi-asserted-by":"publisher","unstructured":"Sigrist R, Rauter G, Riener R, Wolf P (2012) Augmented visual, auditory, haptic, and multimodal feedback in motor learning: a review. Psychon Bull Rev 20. https:\/\/doi.org\/10.3758\/s13423-012-0333-8","DOI":"10.3758\/s13423-012-0333-8"},{"key":"1829_CR32","doi-asserted-by":"publisher","first-page":"60","DOI":"10.1186\/1743-0003-10-60","volume":"10","author":"O Giggins","year":"2013","unstructured":"Giggins O, McCarthy Persson U, Caulfield B (2013) Biofeedback in rehabilitation. J Neuroeng Rehabil 10:60. https:\/\/doi.org\/10.1186\/1743-0003-10-60","journal-title":"J Neuroeng Rehabil"},{"key":"1829_CR33","doi-asserted-by":"publisher","unstructured":"Kos A, Umek A (2018) Biomechanical biofeedback. Springer, Gewerbestrasse 11, 6330 Cham, Switzerland. https:\/\/doi.org\/10.1007\/978-3-319-91349-0_2","DOI":"10.1007\/978-3-319-91349-0_2"},{"issue":"3","key":"1829_CR34","doi-asserted-by":"publisher","first-page":"1036","DOI":"10.3390\/ijerph7031036","volume":"7","author":"JJ Alvarsson","year":"2010","unstructured":"Alvarsson JJ, Wiens S, Nilsson ME (2010) Stress recovery during exposure to nature sound and environmental noise. Int J Environ Res Public Health 7(3):1036\u20131046","journal-title":"Int J Environ Res Public Health"},{"key":"1829_CR35","doi-asserted-by":"crossref","unstructured":"Ley-Flores J, Bevilacqua F, Bianchi-Berthouze N, Taiadura-Jimenez A (2019) Altering body perception and emotion in physically inactive people through movement sonification. In: 2019 8th International conference on affective computing and intelligent interaction (ACII). IEEE, pp 1\u20137","DOI":"10.1109\/ACII.2019.8925432"},{"issue":"8","key":"1829_CR36","doi-asserted-by":"publisher","first-page":"864","DOI":"10.1177\/0013916520952452","volume":"53","author":"TN Ray","year":"2021","unstructured":"Ray TN, Franz SA, Jarrett NL, Pickett SM (2021) Nature enhanced meditation: effects on mindfulness, connectedness to nature, and pro-environmental behavior. Environ Behav 53(8):864\u2013890","journal-title":"Environ Behav"},{"key":"1829_CR37","doi-asserted-by":"crossref","unstructured":"May AD, Maurin E (2021) Calm: a review of the mindful meditation app for use in clinical practice. Fam Syst Health 39(2)","DOI":"10.1037\/fsh0000621"},{"issue":"3","key":"1829_CR38","doi-asserted-by":"publisher","first-page":"015","DOI":"10.1093\/geroni\/igac015","volume":"6","author":"S Kalantari","year":"2022","unstructured":"Kalantari S, Bill Xu T, Mostafavi A, Lee A, Barankevich R, Boot WR, Czaja SJ (2022) Using a nature-based virtual reality environment for improving mood states and cognitive engagement in older adults: a mixed-method feasibility study. Innov Aging 6(3):015","journal-title":"Innov Aging"},{"key":"1829_CR39","doi-asserted-by":"publisher","first-page":"284","DOI":"10.1016\/j.chb.2014.10.032","volume":"43","author":"J Bertram","year":"2015","unstructured":"Bertram J, Moskaliuk J, Cress U (2015) Virtual training: making reality work? Comput Human Behav 43:284\u2013292","journal-title":"Comput Human Behav"},{"key":"1829_CR40","doi-asserted-by":"crossref","unstructured":"Ament VT (2021) The foley grail: the art of performing sound for film, games, and animation. Routledge, 70 Blanchard Road, Suite 402, Burlington, MA 01803","DOI":"10.4324\/9781003008439"},{"key":"1829_CR41","doi-asserted-by":"crossref","unstructured":"Kantan PR, Dahl S, Serafin S, Spaich EG (2023) Sonifying gait kinematics using the sound of wading: a study on ecological movement representations. In: 28th International conference on auditory display: sonification for the masses, pp 5049","DOI":"10.21785\/icad2023.5049"},{"issue":"3","key":"1829_CR42","doi-asserted-by":"publisher","first-page":"543","DOI":"10.1109\/TNSRE.2013.2285410","volume":"22","author":"MW Rodger","year":"2013","unstructured":"Rodger MW, Young WR, Craig CM (2013) Synthesis of walking sounds for alleviating gait disturbances in Parkinson\u2019s disease. IEEE Trans Neural Syst Rehabil Eng 22(3):543\u2013548","journal-title":"IEEE Trans Neural Syst Rehabil Eng"},{"issue":"3","key":"1829_CR43","doi-asserted-by":"publisher","first-page":"66","DOI":"10.3390\/brainsci9030066","volume":"9","author":"J Reh","year":"2019","unstructured":"Reh J, Hwang T-H, Schmitz G, Effenberg AO (2019) Dual mode gait sonification for rehabilitation after unilateral hip arthroplasty. Brain Sci 9(3):66","journal-title":"Brain Sci"},{"key":"1829_CR44","doi-asserted-by":"crossref","unstructured":"Cook PR (2002) Real sound synthesis for interactive applications. 1st edn. CRC Press, 6000 Broken Sound Parkway, NW, (Suite 300)","DOI":"10.1201\/b19597"},{"key":"1829_CR45","unstructured":"Fontana F, Bresin R (2003) Physics-based sound synthesis and control: crushing, walking and running by crumpling sounds. In: Proc. colloquium on musical informatics, pp 109\u2013114"},{"key":"1829_CR46","unstructured":"Turchet L, Serafin S, Dimitrov S, Nordahl R (2010) Physically based sound synthesis and control of footsteps sounds. In: Proceedings of the 13th International conference on digital audio effects (DAFx-10), pp 161\u2013168"},{"issue":"1","key":"1829_CR47","doi-asserted-by":"publisher","first-page":"48","DOI":"10.1111\/nyas.14276","volume":"1467","author":"A Gomez-Andres","year":"2020","unstructured":"Gomez-Andres A, Grau-S\u00e1nchez J, Duarte E, Rodriguez-Fornells A, Tajadura-Jim\u00e9nez A (2020) Enriching footsteps sounds in gait rehabilitation in chronic stroke patients: a pilot study. Ann N Y Acad Sci 1467(1):48\u201359","journal-title":"Ann N Y Acad Sci"},{"key":"1829_CR48","unstructured":"Kantan PR, Dahl S, Spaich EG, Bresin R (2022) Sonifying walking: a perceptual comparison of swing phase mapping schemes. In: Proceedings of the 7th interactive sonification workshop (ISon). CITEC, Bielefeld University, pp 37"},{"key":"1829_CR49","doi-asserted-by":"publisher","unstructured":"Gro\u00df-Vogt K, Svoronos-Kanavas I, Weger M, Amon C (2022) The augmented floor - assessing auditory augmentation. In: Proceedings of the 17th international audio mostly conference. AM \u201922. Association for Computing Machinery, New York, NY, USA, pp 7\u201314. https:\/\/doi.org\/10.1145\/3561212.3561219","DOI":"10.1145\/3561212.3561219"},{"issue":"3","key":"1829_CR50","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/1805964.1805965","volume":"29","author":"W Moss","year":"2010","unstructured":"Moss W, Yeh H, Hong J-M, Lin MC, Manocha D (2010) Sounding liquids: automatic sound synthesis from fluid simulation. ACM Trans Graph 29(3):1\u201313","journal-title":"ACM Trans Graph"},{"key":"1829_CR51","doi-asserted-by":"crossref","unstructured":"Giordano BL, Avanzini F (2014) Perception and synthesis of sound-generating materials. Multisensory softness: perceived compliance from multiple sources of information, pp 49\u201384","DOI":"10.1007\/978-1-4471-6533-0_4"},{"key":"1829_CR52","doi-asserted-by":"publisher","first-page":"101028","DOI":"10.1016\/j.gmod.2019.101028","volume":"103","author":"H Cheng","year":"2019","unstructured":"Cheng H, Liu S (2019) Liquid-solid interaction sound synthesis. Graph Models 103:101028","journal-title":"Graph Models"},{"key":"1829_CR53","doi-asserted-by":"crossref","unstructured":"Monache SD, Polotti P, Rocchesso D (2010) A toolkit for explorations in sonic interaction design. In: Proceedings of the 5th audio mostly conference: a conference on interaction with sound, pp 1\u20137","DOI":"10.1145\/1859799.1859800"},{"key":"1829_CR54","doi-asserted-by":"crossref","unstructured":"Heinrichs C, McPherson A (2014) Mapping and interaction strategies for performing environmental sound. In: 2014 IEEE VR Workshop: sonic interaction in virtual environments (SIVE). IEEE, pp 25\u201330","DOI":"10.1109\/SIVE.2014.7006286"},{"issue":"1","key":"1829_CR55","doi-asserted-by":"publisher","first-page":"15","DOI":"10.3366\/sound.2017.0094","volume":"7","author":"F Keenan","year":"2017","unstructured":"Keenan F, Pauletto S (2017) Listening back: exploring the sonic interactions at the heart of historical sound effects performance. New Soundtrack 7(1):15\u201330","journal-title":"New Soundtrack"},{"key":"1829_CR56","doi-asserted-by":"crossref","unstructured":"Collins K (2011) Making gamers cry: mirror neurons and embodied interaction with game sound. In: Proceedings of the 6th audio mostly conference: a conference on interaction with sound, pp 39\u201346","DOI":"10.1145\/2095667.2095673"},{"key":"1829_CR57","unstructured":"Rocchesso D, Polotti P, Delle\u00a0Monache S (2009) Designing continuous sonic interaction. Int J Des 3(3)"},{"key":"1829_CR58","doi-asserted-by":"crossref","unstructured":"Van Den\u00a0Doel K, Kry PG, Pai DK (2001) FoleyAutomatic: physically-based sound effects for interactive simulation and animation. In: Proceedings of the 28th annual conference on computer graphics and interactive techniques, pp 537\u2013544","DOI":"10.1145\/383259.383322"},{"key":"1829_CR59","unstructured":"Grond F, Berger J (2011) Parameter mapping sonification. In: The Sonification Handbook"},{"issue":"3","key":"1829_CR60","doi-asserted-by":"publisher","first-page":"983","DOI":"10.1037\/a0035441","volume":"40","author":"E Thoret","year":"2014","unstructured":"Thoret E, Aramaki M, Kronland-Martinet R, Velay J-L, Ystad S (2014) From sound to shape: auditory perception of drawing movements. J Exp Psychol Hum Percept Perform 40(3):983","journal-title":"J Exp Psychol Hum Percept Perform"},{"issue":"6","key":"1829_CR61","doi-asserted-by":"publisher","first-page":"533","DOI":"10.1163\/22134808-00002435","volume":"26","author":"PM Vinken","year":"2013","unstructured":"Vinken PM, Kr\u00f6ger D, Fehse U, Schmitz G, Brock H, Effenberg AO (2013) Auditory coding of human movement kinematics. Multisens Res 26(6):533\u2013552","journal-title":"Multisens Res"},{"issue":"12","key":"1829_CR62","doi-asserted-by":"publisher","first-page":"82491","DOI":"10.1371\/journal.pone.0082491","volume":"8","author":"G Dubus","year":"2013","unstructured":"Dubus G, Bresin R (2013) A systematic review of mapping strategies for the sonification of physical quantities. PloS One 8(12):82491","journal-title":"PloS One"},{"key":"1829_CR63","doi-asserted-by":"crossref","unstructured":"Nown TH, Upadhyay P, Kerr A, Andonovic I, Tachtatzis C, Grealy MA (2022) A mapping review of real-time movement sonification systems for movement rehabilitation. IEEE Rev Biomed Eng","DOI":"10.1109\/RBME.2022.3187840"},{"key":"1829_CR64","doi-asserted-by":"publisher","first-page":"806861","DOI":"10.3389\/fpsyg.2022.806861","volume":"13","author":"P Kantan","year":"2022","unstructured":"Kantan P, Spaich EG, Dahl S (2022) An embodied sonification model for sit-to-stand transfers. Front Psycho 13:806861","journal-title":"Front Psycho"},{"issue":"2","key":"1829_CR65","doi-asserted-by":"publisher","first-page":"157","DOI":"10.2522\/ptj.20090125","volume":"90","author":"AD Kuo","year":"2010","unstructured":"Kuo AD, Donelan JM (2010) Dynamic principles of gait and their clinical implications. Phys Therapy 90(2):157\u2013174","journal-title":"Phys Therapy"},{"issue":"4","key":"1829_CR66","doi-asserted-by":"publisher","first-page":"339","DOI":"10.1504\/IJART.2014.066453","volume":"7","author":"B Challis","year":"2014","unstructured":"Challis B, Dean R (2014) Defining digital-foley for live performance. Int J Arts Technol 7(4):339\u2013355","journal-title":"Int J Arts Technol"},{"issue":"2","key":"1829_CR67","doi-asserted-by":"publisher","first-page":"31","DOI":"10.1109\/MCG.2018.193142628","volume":"38","author":"S Serafin","year":"2018","unstructured":"Serafin S, Geronazzo M, Erkut C, Nilsson NC, Nordahl R (2018) Sonic interactions in virtual reality: state of the art, current challenges, and future directions. IEEE Comput Graph Appl 38(2):31\u201343","journal-title":"IEEE Comput Graph Appl"},{"key":"1829_CR68","doi-asserted-by":"crossref","unstructured":"Kantan PR, Spaich EG, Dahl S (2021) A metaphor-based technical framework for musical sonification in movement rehabilitation. In: The 26th International conference on auditory display (ICAD 2021)","DOI":"10.21785\/icad2021.008"},{"key":"1829_CR69","doi-asserted-by":"crossref","unstructured":"Ivaniski-Mello A, Zimmermann\u00a0Casal M, Costa RR, Alberton CL, Martinez FG, Peyr\u00e9-Tartaruga LA (2022) Quantifying physiological and biomechanical responses of shallow water walking: a systematic review and meta-analysis. Res Sports Med 1\u201315","DOI":"10.1080\/15438627.2021.2020786"},{"issue":"4","key":"1829_CR70","doi-asserted-by":"publisher","first-page":"255","DOI":"10.1038\/nrn2331","volume":"9","author":"BE Stein","year":"2008","unstructured":"Stein BE, Stanford TR (2008) Multisensory integration: current issues from the perspective of the single neuron. Nat Rev Neurosci 9(4):255\u2013266","journal-title":"Nat Rev Neurosci"},{"issue":"3","key":"1829_CR71","doi-asserted-by":"publisher","first-page":"184","DOI":"10.1080\/17588921003743581","volume":"1","author":"F Menzer","year":"2010","unstructured":"Menzer F, Brooks A, Halje P, Faller C, Vetterli M, Blanke O (2010) Feeling in control of your footsteps: conscious gait monitoring and the auditory consequences of footsteps. Cogn Neurosci 1(3):184\u2013192","journal-title":"Cogn Neurosci"},{"issue":"3","key":"1829_CR72","doi-asserted-by":"publisher","first-page":"402","DOI":"10.1037\/xhp0000611","volume":"45","author":"A Danielsen","year":"2019","unstructured":"Danielsen A, Nymoen K, Anderson E, C\u00e2mara GS, Langer\u00f8d MT, Thompson MR, London J (2019) Where is the beat in that note? Effects of attack, duration, and frequency on the perceived timing of musical and quasi-musical sounds. J Exp Psychol Hum Percept Perform 45(3):402","journal-title":"J Exp Psychol Hum Percept Perform"},{"key":"1829_CR73","doi-asserted-by":"crossref","unstructured":"Kantan P, Alecu RS, Dahl S (2019) The Effect of auditory pulse clarity on sensorimotor synchronization. In: International symposium on computer music multidisciplinary research, Springer, pp 379\u2013395","DOI":"10.1007\/978-3-030-70210-6_25"},{"issue":"1","key":"1829_CR74","doi-asserted-by":"publisher","first-page":"48","DOI":"10.1109\/MMUL.2015.14","volume":"22","author":"A Tajadura-Jim\u00e9nez","year":"2015","unstructured":"Tajadura-Jim\u00e9nez A, Bianchi-Berthouze N, Furfaro E, Bevilacqua F (2015) Sonification of surface tapping changes behavior, surface perception, and emotion. IEEE MultiMedia 22(1):48\u201357","journal-title":"IEEE MultiMedia"},{"issue":"3","key":"1829_CR75","doi-asserted-by":"publisher","first-page":"638","DOI":"10.1037\/0033-2909.88.3.638","volume":"88","author":"RB Welch","year":"1980","unstructured":"Welch RB, Warren DH (1980) Immediate perceptual response to intersensory discrepancy. Psychol Bull 88(3):638","journal-title":"Psychol Bull"},{"key":"1829_CR76","doi-asserted-by":"crossref","unstructured":"Dyer JF, Stapleton P, Rodger M (2017) Mapping sonification for perception and action in motor skill learning. Front Neurosci 11:463","DOI":"10.3389\/fnins.2017.00463"},{"key":"1829_CR77","doi-asserted-by":"crossref","unstructured":"Pizzera A, Hohmann T (2015) Acoustic information during motor control and action perception: a review. Open Psychol J 8(1)","DOI":"10.2174\/1874350101508010183"},{"issue":"4\u20135","key":"1829_CR78","doi-asserted-by":"publisher","first-page":"427","DOI":"10.1016\/S0167-9457(01)00061-6","volume":"20","author":"PM Mills","year":"2001","unstructured":"Mills PM, Barrett RS (2001) Swing phase mechanics of healthy young and elderly men. Hum Mov Sci 20(4\u20135):427\u2013446","journal-title":"Hum Mov Sci"},{"key":"1829_CR79","doi-asserted-by":"crossref","unstructured":"Pirkle W (2012) Designing audio effect plug-ins in C++: with digital audio signal processing theory. Routledge, 70 Blanchard Road, Suite 402, Burlington, MA 01803","DOI":"10.4324\/9780203573310"},{"key":"1829_CR80","doi-asserted-by":"crossref","unstructured":"Studenski S, Perera S, Patel K, Rosano C, Faulkner K, Inzitari M, Brach J, Chandler J, Cawthon P, Connor EB et al (2011) Gait speed and survival in older adults. Jama 305(1):50\u201358","DOI":"10.1001\/jama.2010.1923"},{"issue":"3","key":"1829_CR81","doi-asserted-by":"publisher","first-page":"203","DOI":"10.1525\/bio.2011.61.3.6","volume":"61","author":"BC Pijanowski","year":"2011","unstructured":"Pijanowski BC, Villanueva-Rivera LJ, Dumyahn SL, Farina A, Krause BL, Napoletano BM, Gage SH, Pieretti N (2011) Soundscape ecology: the science of sound in the landscape. BioScience 61(3):203\u2013216","journal-title":"BioScience"},{"issue":"8","key":"1829_CR82","doi-asserted-by":"publisher","first-page":"3964","DOI":"10.3390\/s23083964","volume":"23","author":"PR Kantan","year":"2023","unstructured":"Kantan PR, Dahl S, J\u00f8rgensen HR, Khadye C, Spaich EG (2023) Designing ecological auditory feedback on lower limb kinematics for hemiparetic gait training. Sensors 23(8):3964","journal-title":"Sensors"},{"key":"1829_CR83","unstructured":"Kramer G, Walker B, Bonebright T, Cook P, Flowers JH, Miner N, Neuhoff J (2010) Sonification report: status of the field and research agenda"},{"key":"1829_CR84","doi-asserted-by":"crossref","unstructured":"H\u00f6\u00f6k K, Caramiaux B, Erkut C, Forlizzi J, Hajinejad N, Haller M, Hummels CC, Isbister K, Jonsson M, Khut G et al (2018) Embracing first-person perspectives in soma-based design. In: Informatics, vol. 5. MDPI, pp 8","DOI":"10.3390\/informatics5010008"}],"container-title":["Personal and Ubiquitous Computing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00779-024-01829-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s00779-024-01829-1\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00779-024-01829-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,11,15]],"date-time":"2024-11-15T10:08:21Z","timestamp":1731665301000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s00779-024-01829-1"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,9,10]]},"references-count":84,"journal-issue":{"issue":"5","published-print":{"date-parts":[[2024,10]]}},"alternative-id":["1829"],"URL":"https:\/\/doi.org\/10.1007\/s00779-024-01829-1","relation":{},"ISSN":["1617-4909","1617-4917"],"issn-type":[{"type":"print","value":"1617-4909"},{"type":"electronic","value":"1617-4917"}],"subject":[],"published":{"date-parts":[[2024,9,10]]},"assertion":[{"value":"16 August 2023","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"12 August 2024","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"10 September 2024","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"All participants provided their informed consent for participating in the study.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent to participate"}},{"value":"All participants provided their informed consent for publication of the aggregated data collected from them.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"The authors declare no Conflict of interest.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}}]}}