{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,22]],"date-time":"2026-06-22T17:47:04Z","timestamp":1782150424407,"version":"3.54.5"},"reference-count":88,"publisher":"Association for Computing Machinery (ACM)","issue":"1","license":[{"start":{"date-parts":[[2022,1,6]],"date-time":"2022-01-06T00:00:00Z","timestamp":1641427200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"ELEMENT \u2013 Enabling Learnability in Embodied Movement Interaction","award":["ANR-18-CE33-0002"],"award-info":[{"award-number":["ANR-18-CE33-0002"]}]},{"name":"European Research Council","award":["695464, 321135"],"award-info":[{"award-number":["695464, 321135"]}]},{"name":"Insead-Sorbonne University Behavioral Lab."}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Appl. Percept."],"published-print":{"date-parts":[[2022,1,31]]},"abstract":"<jats:p>With the increasing interest in movement sonification and expressive gesture-based interaction, it is important to understand which factors contribute to movement learning and how. We explore the effects of movement sonification and users\u2019 musical background on motor variability in complex gesture learning. We contribute an empirical study in which musicians and non-musicians learn two gesture sequences over three days, with and without movement sonification. Results show the interlaced interaction effects of these factors and how they unfold in the three-day learning process. For gesture 1, which is fast and dynamic with a direct \u201caction-sound\u201d sonification, movement sonification induces higher variability for both musicians and non-musicians on day 1. While musicians reduce this variability to a similar level as no auditory feedback condition on day 2 and day 3, non-musicians remain to have significantly higher variability. Across three days, musicians also have significantly lower variability than non-musicians. For gesture 2, which is slow and smooth with an \u201caction-music\u201d metaphor, there are virtually no effects. Based on these findings, we recommend future studies to take into account participants\u2019 musical background, consider longitudinal study to examine these effects on complex gestures, and use awareness when interpreting the results given a specific design of gesture and sound.<\/jats:p>","DOI":"10.1145\/3482967","type":"journal-article","created":{"date-parts":[[2022,1,6]],"date-time":"2022-01-06T10:19:01Z","timestamp":1641464341000},"page":"1-21","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":9,"title":["Motor Variability in Complex Gesture Learning: Effects of Movement Sonification and Musical Background"],"prefix":"10.1145","volume":"19","author":[{"given":"Wanyu","family":"Liu","sequence":"first","affiliation":[{"name":"STMS, IRCAM, CNRS, Sorbonne Universit\u00e9, Paris, France"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Michelle Agnes","family":"Magalhaes","sequence":"additional","affiliation":[{"name":"STMS, IRCAM, CNRS, Sorbonne Universit\u00e9, Paris, France"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Wendy E.","family":"Mackay","sequence":"additional","affiliation":[{"name":"Universit\u00e9 Paris-Saclay, CNRS, Inria, Orsay, France"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Michel","family":"Beaudouin-Lafon","sequence":"additional","affiliation":[{"name":"Universit\u00e9 Paris-Saclay, CNRS, Inria, Orsay, France"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Fr\u00e9d\u00e9ric","family":"Bevilacqua","sequence":"additional","affiliation":[{"name":"STMS, IRCAM, CNRS, Sorbonne Universit\u00e9, Paris, France"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2022,1,6]]},"reference":[{"key":"e_1_3_3_2_2","doi-asserted-by":"publisher","DOI":"10.1080\/00222895.1971.10734898"},{"key":"e_1_3_3_3_2","doi-asserted-by":"publisher","DOI":"10.1145\/2317956.2318071"},{"key":"e_1_3_3_4_2","doi-asserted-by":"publisher","DOI":"10.1145\/2984511.2984560"},{"key":"e_1_3_3_5_2","first-page":"30","volume-title":"Proceedings of the SMC Sound and Music Computing Conference","author":"Bettens Fr\u00e9d\u00e9ric","year":"2009","unstructured":"Fr\u00e9d\u00e9ric Bettens and Todor Todoroff. 2009. Real-time dtw-based gesture recognition external object for max\/msp and puredata. In Proceedings of the SMC Sound and Music Computing Conference. 30\u201335."},{"key":"e_1_3_3_6_2","doi-asserted-by":"publisher","DOI":"10.3389\/fnins.2016.00385"},{"key":"e_1_3_3_7_2","doi-asserted-by":"publisher","DOI":"10.1145\/2948910.2948956"},{"key":"e_1_3_3_8_2","doi-asserted-by":"publisher","DOI":"10.1145\/1279740.1279762"},{"key":"e_1_3_3_9_2","doi-asserted-by":"crossref","first-page":"391","DOI":"10.4324\/9781315621364-43","volume-title":"The Routledge Companion to Embodied Music Interaction","author":"Bevilacqua Fr\u00e9d\u00e9ric","year":"2017","unstructured":"Fr\u00e9d\u00e9ric Bevilacqua, Norbert Schnell, Jules Fran\u00e7oise, \u00c9ric O. Boyer, Diemo Schwarz, and Baptiste Caramiaux. 2017. Designing action-sound metaphors using motion sensing and descriptor-based synthesis of recorded sound materials. In The Routledge Companion to Embodied Music Interaction, Micheline Lesaffre, Pieter-Jan Maes, and Marc Leman (Eds.). Taylor & Francis, New York, NY, 391\u2013401."},{"key":"e_1_3_3_10_2","doi-asserted-by":"publisher","DOI":"10.1007\/s00221-020-05770-6"},{"key":"e_1_3_3_11_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.cub.2009.01.036"},{"key":"e_1_3_3_12_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijhcs.2020.102500"},{"key":"e_1_3_3_13_2","doi-asserted-by":"publisher","DOI":"10.1145\/2968219.2968261"},{"key":"e_1_3_3_14_2","doi-asserted-by":"publisher","DOI":"10.1145\/2702123.2702515"},{"key":"e_1_3_3_15_2","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0193580"},{"key":"e_1_3_3_16_2","doi-asserted-by":"publisher","DOI":"10.1016\/0146-664X(80)90054-4"},{"key":"e_1_3_3_17_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.humov.2014.12.002"},{"key":"e_1_3_3_18_2","doi-asserted-by":"publisher","DOI":"10.1109\/THMS.2016.2641397"},{"key":"e_1_3_3_19_2","first-page":"200","volume-title":"Proceedings of the 10th International Symposium on Computer Music Multidisciplinary Research (CMMR\u201913)","author":"Danna J\u00e9r\u00e9my","year":"2013","unstructured":"J\u00e9r\u00e9my Danna, Jean-Luc Velay, Vietminh Paz-Villagr\u00e1n, Annabelle Capel, C\u00e9line Petroz, Charles Gondre, Etienne Thoret, Mitsuko Aramaki, Solvi Ystad, and Richard Kronland-Martinet. 2013. Handwriting Movement Sonification for the Rehabilitation of Dysgraphia. In Proceedings of the 10th International Symposium on Computer Music Multidisciplinary Research (CMMR\u201913). 200\u2013208."},{"key":"e_1_3_3_20_2","doi-asserted-by":"publisher","DOI":"10.2165\/00007256-200333040-00001"},{"key":"e_1_3_3_21_2","doi-asserted-by":"publisher","DOI":"10.1146\/annurev-neuro-072116-031548"},{"key":"e_1_3_3_22_2","first-page":"15","volume-title":"Algorithms for the Reduction of the Number of Points Required to Represent a Digitized Line or Its Caricature","author":"Douglas David H.","year":"2011","unstructured":"David H. Douglas and Thomas K. Peucker. 2011. Algorithms for the Reduction of the Number of Points Required to Represent a Digitized Line or Its Caricature. John Wiley & Sons, Ltd, New York, NY, 15\u201328."},{"key":"e_1_3_3_23_2","volume-title":"Where the Action Is: The Foundations of Embodied Interaction","author":"Dourish Paul","year":"2004","unstructured":"Paul Dourish. 2004. Where the Action Is: The Foundations of Embodied Interaction. MIT Press, Cambridge, MA."},{"key":"e_1_3_3_24_2","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0082491"},{"key":"e_1_3_3_25_2","doi-asserted-by":"publisher","DOI":"10.1007\/s12283-014-0164-0"},{"key":"e_1_3_3_26_2","doi-asserted-by":"publisher","DOI":"10.1007\/s00221-017-5047-8"},{"key":"e_1_3_3_27_2","doi-asserted-by":"publisher","DOI":"10.1109\/MMUL.2005.31"},{"key":"e_1_3_3_28_2","doi-asserted-by":"publisher","DOI":"10.3389\/fnins.2016.00219"},{"key":"e_1_3_3_29_2","doi-asserted-by":"publisher","DOI":"10.1037\/h0055392"},{"key":"e_1_3_3_30_2","volume-title":"Human Performance","author":"Fitts Paul M.","year":"1967","unstructured":"Paul M. Fitts and Michael I. Posner. 1967. Human Performance. Brooks\/Cole, Belmont, CA."},{"key":"e_1_3_3_31_2","doi-asserted-by":"publisher","DOI":"10.1145\/2851581.2892420"},{"key":"e_1_3_3_32_2","doi-asserted-by":"publisher","DOI":"10.5555\/2500985"},{"key":"e_1_3_3_33_2","volume-title":"Musical Gestures: Sound, Movement and Meaning","author":"God\u00f8y R. I.","year":"2009","unstructured":"R. I. God\u00f8y and M. Leman (Eds.). 2009. Musical Gestures: Sound, Movement and Meaning. Routledge, New York, NY."},{"key":"e_1_3_3_34_2","doi-asserted-by":"publisher","DOI":"10.4324\/9780203863411"},{"key":"e_1_3_3_35_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.scispo.2019.12.004"},{"key":"e_1_3_3_36_2","doi-asserted-by":"publisher","DOI":"10.1002\/j.1538-7305.1950.tb00463.x"},{"key":"e_1_3_3_37_2","doi-asserted-by":"publisher","DOI":"10.1080\/14647893.2017.1420156"},{"key":"e_1_3_3_38_2","first-page":"17","volume-title":"Proceedings of Interactive Sonification Workshop: Human Interaction with Auditory Displays (ISon\u201910)","author":"Hummel Jessica","year":"2010","unstructured":"Jessica Hummel, Thomas Hermann, Christopher Frauenberger, and Tony Stockman. 2010. Interactive sonification of german wheel sports. In Proceedings of Interactive Sonification Workshop: Human Interaction with Auditory Displays (ISon\u201910). 17\u201322."},{"key":"e_1_3_3_39_2","volume-title":"Musical Gestures: Sound, Movement, and Meaning","author":"Jensenius A. R.","year":"2009","unstructured":"A. R. Jensenius, M. M. Wanderley, R. I. God\u00f8y, and M. Leman. 2009. Musical gestures: Concepts and methods in research. In Musical Gestures: Sound, Movement, and Meaning. Routledge, New York, NY."},{"key":"e_1_3_3_40_2","doi-asserted-by":"publisher","DOI":"10.1080\/19346182.2009.9648498"},{"key":"e_1_3_3_41_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.conb.2011.06.012"},{"key":"e_1_3_3_42_2","doi-asserted-by":"publisher","DOI":"10.1109\/T-AFFC.2012.1"},{"key":"e_1_3_3_43_2","doi-asserted-by":"publisher","DOI":"10.5555\/1296232"},{"key":"e_1_3_3_44_2","volume-title":"The Expressive Moment: How Interaction (with Music) Shapes Human Empowerment","author":"Leman Marc","year":"2016","unstructured":"Marc Leman. 2016. The Expressive Moment: How Interaction (with Music) Shapes Human Empowerment. MIT Press, Cambridge, MA."},{"issue":"8","key":"e_1_3_3_45_2","first-page":"707","article-title":"Binary codes capable of correcting deletions, insertions, and reversals","volume":"10","author":"Levenshtein Vladimir I.","year":"1966","unstructured":"Vladimir I. Levenshtein. 1966. Binary codes capable of correcting deletions, insertions, and reversals. Sov. Phys. Doklady 10, 8 (1966), 707\u2013710.","journal-title":"Sov. Phys. Doklady"},{"key":"e_1_3_3_46_2","doi-asserted-by":"publisher","DOI":"10.1007\/s12193-018-0279-x"},{"key":"e_1_3_3_47_2","volume-title":"Motor Learning and Control: Concepts and Applications","author":"Magill Richard A.","year":"2007","unstructured":"Richard A. Magill and David I. Anderson. 2007. Motor Learning and Control: Concepts and Applications. Vol. 11. McGraw\u2013Hill, New York, NY."},{"key":"e_1_3_3_48_2","volume-title":"Direct Perception","author":"Michaels Claire F.","year":"1981","unstructured":"Claire F. Michaels and Claudia Carello. 1981. Direct Perception. Prentice-Hall, Englewood Cliffs, NJ."},{"key":"e_1_3_3_49_2","volume-title":"Constella(c)tions","author":"Magalhaes Benjamin Matuszewski, Michelle Agnes","year":"2020","unstructured":"Benjamin Matuszewski, Michelle Agnes Magalhaes, and Fr\u00e9d\u00e9ric Bevilacqua. 2020. Constella(c)tions. Technical Report. STARTS Residency Public Report."},{"key":"e_1_3_3_50_2","doi-asserted-by":"publisher","DOI":"10.1145\/2556288.2557163"},{"key":"e_1_3_3_51_2","doi-asserted-by":"publisher","DOI":"10.2174\/1874350101508010220"},{"key":"e_1_3_3_52_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-020-59979-0"},{"key":"e_1_3_3_53_2","volume-title":"Proceedings of the International Conference on Auditory Display","author":"Neuhoff John G.","year":"2002","unstructured":"John G. Neuhoff, Rebecca Knight, and Joseph Wayand. 2002. Pitch change, sonification, and musical expertise: Which way is up? In Proceedings of the International Conference on Auditory Display. Georgia Institute of Technology, Atlanta, GA."},{"key":"e_1_3_3_54_2","doi-asserted-by":"publisher","DOI":"10.1145\/2858036.2858302"},{"key":"e_1_3_3_55_2","first-page":"143","volume-title":"Motor Behavior and Human Skill: A Multidisciplinary Approach","author":"Newell Karl M.","year":"1998","unstructured":"Karl M. Newell and Andrew B. Slifkin. 1998. The nature of movement variability. In Motor Behavior and Human Skill: A Multidisciplinary Approach. Human Kinetics, Champaign, IL, 143\u2013160."},{"key":"e_1_3_3_56_2","doi-asserted-by":"publisher","DOI":"10.1007\/s12193-018-0284-0"},{"key":"e_1_3_3_57_2","doi-asserted-by":"publisher","DOI":"10.3389\/fnins.2019.01378"},{"key":"e_1_3_3_58_2","doi-asserted-by":"publisher","DOI":"10.3389\/fnins.2019.01378"},{"key":"e_1_3_3_59_2","doi-asserted-by":"publisher","DOI":"10.1007\/s00221-020-05757-3"},{"key":"e_1_3_3_60_2","doi-asserted-by":"publisher","DOI":"10.1145\/3323335"},{"key":"e_1_3_3_61_2","doi-asserted-by":"publisher","DOI":"10.1016\/S0146-664X(72)80017-0"},{"key":"e_1_3_3_62_2","doi-asserted-by":"publisher","DOI":"10.1007\/s11682-015-9498-x"},{"key":"e_1_3_3_63_2","doi-asserted-by":"publisher","DOI":"10.3389\/fnins.2016.00272"},{"key":"e_1_3_3_64_2","doi-asserted-by":"publisher","DOI":"10.1155\/2013\/586138"},{"key":"e_1_3_3_65_2","doi-asserted-by":"publisher","DOI":"10.1109\/WHC.2009.4810849"},{"key":"e_1_3_3_66_2","doi-asserted-by":"publisher","DOI":"10.1021\/ac60214a047"},{"key":"e_1_3_3_67_2","doi-asserted-by":"publisher","DOI":"10.3389\/fpsyg.2019.00244"},{"key":"e_1_3_3_68_2","doi-asserted-by":"publisher","DOI":"10.3389\/fneur.2015.00217"},{"key":"e_1_3_3_69_2","doi-asserted-by":"publisher","DOI":"10.1037\/h0076770"},{"key":"e_1_3_3_70_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-94-011-3626-6_6"},{"key":"e_1_3_3_71_2","volume-title":"Motor Control and Learning: A Behavioral Emphasis","author":"Schmidt Richard A.","year":"2018","unstructured":"Richard A. Schmidt, Timothy D. Lee, Carolee Winstein, Gabriele Wulf, and Howard N. Zelaznik. 2018. Motor Control and Learning: A Behavioral Emphasis. Human Kinetics, Champaign, IL."},{"key":"e_1_3_3_72_2","doi-asserted-by":"publisher","DOI":"10.1186\/1471-2202-14-32"},{"key":"e_1_3_3_73_2","doi-asserted-by":"publisher","DOI":"10.1007\/s40279-012-0011-z"},{"key":"e_1_3_3_74_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.humov.2010.12.003"},{"key":"e_1_3_3_75_2","doi-asserted-by":"publisher","DOI":"10.3758\/s13423-012-0333-8"},{"key":"e_1_3_3_76_2","doi-asserted-by":"publisher","DOI":"10.1007\/s00221-010-2322-3"},{"key":"e_1_3_3_77_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.humov.2011.06.002"},{"key":"e_1_3_3_78_2","doi-asserted-by":"publisher","DOI":"10.1080\/00140139.2010.535023"},{"key":"e_1_3_3_79_2","doi-asserted-by":"publisher","DOI":"10.1109\/MMUL.2015.14"},{"key":"e_1_3_3_80_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-018-23229-1"},{"key":"e_1_3_3_81_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-92069-6_9"},{"key":"e_1_3_3_82_2","volume-title":"Handbook of Neurologic Music Therapy","author":"Thaut Michael","year":"2014","unstructured":"Michael Thaut and Volker Hoemberg. 2014. Handbook of Neurologic Music Therapy. Oxford University Press, Oxford, UK."},{"key":"e_1_3_3_83_2","doi-asserted-by":"publisher","DOI":"10.3389\/fnins.2018.00850"},{"key":"e_1_3_3_84_2","first-page":"354","volume-title":"Proceedings of the Survey Research Methods Section","author":"Winkler William E.","year":"1990","unstructured":"William E. Winkler. 1990. String comparator metrics and enhanced decision rules in the Fellegi-Sunter model of record linkage. In Proceedings of the Survey Research Methods Section. American Statistical Association, Alexandria, VA, 354\u2013359."},{"key":"e_1_3_3_85_2","doi-asserted-by":"publisher","DOI":"10.1038\/nrn3112"},{"key":"e_1_3_3_86_2","doi-asserted-by":"publisher","DOI":"10.1038\/nn.3616"},{"key":"e_1_3_3_87_2","doi-asserted-by":"publisher","DOI":"10.1080\/1750984X.2012.723728"},{"key":"e_1_3_3_88_2","doi-asserted-by":"publisher","DOI":"10.3758\/BF03196276"},{"key":"e_1_3_3_89_2","volume-title":"Proceedings of the Workshop \u201cMobile HCI and Sound Workshop\u201d of the 6th International Conference on Human Computer Interaction with Mobile Devices and Services (MobileHCI\u201904)","author":"Yamamoto Goh","year":"2004","unstructured":"Goh Yamamoto, Kensuke Shiraki, Masami Takahata, Yutaka Sakane, and Yoichi Takebayashi. 2004. Multimodal knowledge for designing new sound environments. In Proceedings of the Workshop \u201cMobile HCI and Sound Workshop\u201d of the 6th International Conference on Human Computer Interaction with Mobile Devices and Services (MobileHCI\u201904)."}],"container-title":["ACM Transactions on Applied Perception"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3482967","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3482967","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T20:48:45Z","timestamp":1750193325000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3482967"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,1,6]]},"references-count":88,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2022,1,31]]}},"alternative-id":["10.1145\/3482967"],"URL":"https:\/\/doi.org\/10.1145\/3482967","relation":{},"ISSN":["1544-3558","1544-3965"],"issn-type":[{"value":"1544-3558","type":"print"},{"value":"1544-3965","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,1,6]]},"assertion":[{"value":"2020-05-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-08-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2022-01-06","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}