{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,15]],"date-time":"2026-01-15T09:30:38Z","timestamp":1768469438319,"version":"3.49.0"},"reference-count":42,"publisher":"Association for Computing Machinery (ACM)","issue":"1","license":[{"start":{"date-parts":[[2014,4,1]],"date-time":"2014-04-01T00:00:00Z","timestamp":1396310400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Appl. Percept."],"published-print":{"date-parts":[[2014,4]]},"abstract":"<jats:p>We investigated gesture description of sound stimuli performed during a listening task. Our hypothesis is that the strategies in gestural responses depend on the level of identification of the sound source and specifically on the identification of the action causing the sound. To validate our hypothesis, we conducted two experiments. In the first experiment, we built two corpora of sounds. The first corpus contains sounds with identifiable causal actions. The second contains sounds for which no causal actions could be identified. These corpora properties were validated through a listening test. In the second experiment, participants performed arm and hand gestures synchronously while listening to sounds taken from these corpora. Afterward, we conducted interviews asking participants to verbalize their experience while watching their own video recordings. They were questioned on their perception of the listened sounds and on their gestural strategies. We showed that for the sounds where causal action can be identified, participants mainly mimic the action that has produced the sound. In the other case, when no action can be associated with the sound, participants trace contours related to sound acoustic features. We also found that the interparticipants\u2019 gesture variability is higher for causal sounds compared to noncausal sounds. Variability demonstrates that, in the first case, participants have several ways of producing the same action, whereas in the second case, the sound features tend to make the gesture responses consistent.<\/jats:p>","DOI":"10.1145\/2536811","type":"journal-article","created":{"date-parts":[[2014,4,23]],"date-time":"2014-04-23T13:52:04Z","timestamp":1398261124000},"page":"1-19","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":27,"title":["The Role of Sound Source Perception in Gestural Sound Description"],"prefix":"10.1145","volume":"11","author":[{"given":"B.","family":"Caramiaux","sequence":"first","affiliation":[{"name":"Goldsmiths, University of London and UMR IRCAM-CNRS, Paris"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"F.","family":"Bevilacqua","sequence":"additional","affiliation":[{"name":"UMR IRCAM-CNRS, Paris, France"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"T.","family":"Bianco","sequence":"additional","affiliation":[{"name":"UMR IRCAM-CNRS, Paris, France"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"N.","family":"Schnell","sequence":"additional","affiliation":[{"name":"UMR IRCAM-CNRS, Paris, France"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"O.","family":"Houix","sequence":"additional","affiliation":[{"name":"UMR IRCAM-CNRS, Paris, France"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"P.","family":"Susini","sequence":"additional","affiliation":[{"name":"UMR IRCAM-CNRS, Paris, France"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2014,4]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1037\/0096-1523.19.2.250"},{"key":"e_1_2_1_2_1","unstructured":"Baptiste Caramiaux. 2012.\n  Studies on the Relationship between Gesture and Sound in Musical Performance\n  . Ph.D. Thesis. Universit\u00e9 Pierre et \n  Marie Curie (Paris\n   6).  Baptiste Caramiaux. 2012. Studies on the Relationship between Gesture and Sound in Musical Performance. Ph.D. Thesis. Universit\u00e9 Pierre et Marie Curie (Paris 6)."},{"key":"e_1_2_1_3_1","unstructured":"B. Caramiaux F. Bevilacqua and N. Schnell. 2010a. Mimicking Sound with Gesture as Interaction Paradigm. Technical Report. IRCAM - Centre Pompidou.  B. Caramiaux F. Bevilacqua and N. Schnell. 2010a. Mimicking Sound with Gesture as Interaction Paradigm. Technical Report. IRCAM - Centre Pompidou."},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-12553-9_14"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1207\/s15326969eco0504_2"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1207\/s15326969eco0501_1"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.bandc.2010.01.005"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1017\/S1355771806001439"},{"key":"e_1_2_1_10_1","volume-title":"Proceedings of the COST287-ConGAS 2nd International Symposium on Gesture Interfaces for Multimedia Systems (GIMS\u201906)","author":"God\u00f8y R. I.","unstructured":"R. I. God\u00f8y , E. Haga , and A. R. Jensenius . 2006a. Exploring music-related gestures by sound-tracing: A preliminary study . In Proceedings of the COST287-ConGAS 2nd International Symposium on Gesture Interfaces for Multimedia Systems (GIMS\u201906) . R. I. God\u00f8y, E. Haga, and A. R. Jensenius. 2006a. Exploring music-related gestures by sound-tracing: A preliminary study. In Proceedings of the COST287-ConGAS 2nd International Symposium on Gesture Interfaces for Multimedia Systems (GIMS\u201906)."},{"key":"e_1_2_1_11_1","doi-asserted-by":"crossref","unstructured":"R. I. God\u00f8y E. Haga and A. R. Jensenius. 2006b. Playing \u201cair instruments\u201d: Mimicry of sound-producing gestures by novices and experts. In Lecture Notes in Computer Science. Springer-Verlag.  R. I. God\u00f8y E. Haga and A. R. Jensenius. 2006b. Playing \u201cair instruments\u201d: Mimicry of sound-producing gestures by novices and experts. In Lecture Notes in Computer Science. Springer-Verlag.","DOI":"10.1007\/11678816_29"},{"key":"e_1_2_1_12_1","volume-title":"Categorization of environmental sounds. Canadian Journal of Experimental Psychology\/Revue canadienne de psychologie exp\u00e9rimentale 61, 1","author":"Guastavino C.","year":"2007","unstructured":"C. Guastavino . 2007. Categorization of environmental sounds. Canadian Journal of Experimental Psychology\/Revue canadienne de psychologie exp\u00e9rimentale 61, 1 ( 2007 ), 54. C. Guastavino. 2007. Categorization of environmental sounds. Canadian Journal of Experimental Psychology\/Revue canadienne de psychologie exp\u00e9rimentale 61, 1 (2007), 54."},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1121\/1.1635840"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.3758\/BF03193921"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1037\/a0026240"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9780511807572"},{"key":"e_1_2_1_17_1","doi-asserted-by":"crossref","unstructured":"E. Kohler C. Keysers M. A. Umilta L. Fogassi V. Gallese and G. Rizzolatti. 2002. Hearing sounds understanding actions: action representation in mirror neurons. Science 297 5582 (2002) 846.  E. Kohler C. Keysers M. A. Umilta L. Fogassi V. Gallese and G. Rizzolatti. 2002. Hearing sounds understanding actions: action representation in mirror neurons. Science 297 5582 (2002) 846.","DOI":"10.1126\/science.1070311"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0167-9457(00)00026-9"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1207\/s15516709cog2601_1"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1121\/1.3675946"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1037\/a0018762"},{"key":"e_1_2_1_22_1","volume-title":"Embodied Music Cognition and Mediation Technology","author":"Leman M.","unstructured":"M. Leman . 2007. Embodied Music Cognition and Mediation Technology . Massachusetts Institute of Technology Press . M. Leman. 2007. Embodied Music Cognition and Mediation Technology. Massachusetts Institute of Technology Press."},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1525\/mp.2009.26.3.263"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1093\/cercor\/bhh061"},{"key":"e_1_2_1_25_1","doi-asserted-by":"crossref","unstructured":"J. D. Loehr and C. Palmer. 2007. Cognitive and biomechanical influences in pianists finger tapping. Experimental brain research 178 4 (2007) 518--528.  J. D. Loehr and C. Palmer. 2007. Cognitive and biomechanical influences in pianists finger tapping. Experimental brain research 178 4 (2007) 518--528.","DOI":"10.1007\/s00221-006-0760-8"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/1753326.1753620"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1076\/jcen.22.6.830.949"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1093\/acprof:oso\/9780198522577.001.0001"},{"key":"e_1_2_1_30_1","volume-title":"Hand and Mind: What Gestures Reveal about Thought","author":"McNeill D.","unstructured":"D. McNeill . 1996. Hand and Mind: What Gestures Reveal about Thought . University of Chicago Press. D. McNeill. 1996. Hand and Mind: What Gestures Reveal about Thought. University of Chicago Press."},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/2072529.2072541"},{"key":"e_1_2_1_32_1","volume-title":"Proceedings of the Conference on New Interfaces for Musical Expression (NIME\u201910)","author":"Nymoen K.","unstructured":"K. Nymoen , K. Glette , S. Skogstad , J. Torresen , and A. R. Jensenius . 2010. Searching for cross-individual relationships between sound and movement features using an SVM classifier . In Proceedings of the Conference on New Interfaces for Musical Expression (NIME\u201910) . K. Nymoen, K. Glette, S. Skogstad, J. Torresen, and A. R. Jensenius. 2010. Searching for cross-individual relationships between sound and movement features using an SVM classifier. In Proceedings of the Conference on New Interfaces for Musical Expression (NIME\u201910)."},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/2465780.2465783"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuroimage.2004.09.025"},{"key":"e_1_2_1_35_1","doi-asserted-by":"crossref","unstructured":"J. O. Ramsay and B. W. Silverman. 1997. Functional Data Analysis. 2nd edition Springer Science.  J. O. Ramsay and B. W. Silverman. 1997. Functional Data Analysis. 2nd edition Springer Science.","DOI":"10.1007\/978-1-4757-7107-7"},{"key":"e_1_2_1_36_1","volume-title":"Proceedings of the International Conference on Auditory Display.","author":"Scavone G. P.","unstructured":"G. P. Scavone , S. Lakatos , and C. R. Harbke . 2002. The Sonic Mapper: An interactive program for obtaining similarity ratings with auditory stimuli . In Proceedings of the International Conference on Auditory Display. G. P. Scavone, S. Lakatos, and C. R. Harbke. 2002. The Sonic Mapper: An interactive program for obtaining similarity ratings with auditory stimuli. In Proceedings of the International Conference on Auditory Display."},{"key":"e_1_2_1_37_1","unstructured":"P. Schaeffer. 1966. Trait\u00e9 des Objets Musicaux. \u00c9ditions du Seuil.  P. Schaeffer. 1966. Trait\u00e9 des Objets Musicaux. \u00c9ditions du Seuil."},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1097\/AUD.0b013e31816a0cf1"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1017\/S1355771897009059"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1121\/1.1915893"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.apacoust.2009.04.004"},{"key":"e_1_2_1_43_1","volume-title":"Questionner l\u2019action: l\u2019entretien d\u2019explicitation. Psychologie fran\u00e7aise 35, 3","author":"Vermersch P.","year":"1990","unstructured":"P. Vermersch . 1990. Questionner l\u2019action: l\u2019entretien d\u2019explicitation. Psychologie fran\u00e7aise 35, 3 ( 1990 ), 227--235. P. Vermersch. 1990. Questionner l\u2019action: l\u2019entretien d\u2019explicitation. Psychologie fran\u00e7aise 35, 3 (1990), 227--235."},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1109\/JPROC.2004.825882"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1038\/nrn2152"}],"container-title":["ACM Transactions on Applied Perception"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2536811","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/2536811","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T08:10:18Z","timestamp":1750234218000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2536811"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2014,4]]},"references-count":42,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2014,4]]}},"alternative-id":["10.1145\/2536811"],"URL":"https:\/\/doi.org\/10.1145\/2536811","relation":{},"ISSN":["1544-3558","1544-3965"],"issn-type":[{"value":"1544-3558","type":"print"},{"value":"1544-3965","type":"electronic"}],"subject":[],"published":{"date-parts":[[2014,4]]},"assertion":[{"value":"2012-11-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2013-10-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2014-04-01","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}