{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,22]],"date-time":"2026-06-22T10:52:10Z","timestamp":1782125530456,"version":"3.54.5"},"reference-count":35,"publisher":"MIT Press - Journals","issue":"3","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Computer Music Journal"],"published-print":{"date-parts":[[2014,9]]},"abstract":"<jats:p>Gesture-to-sound mapping is generally defined as the association between gestural and sound parameters. This article describes an approach that brings forward the perception\u2013action loop as a fundamental design principle for gesture\u2013sound mapping in digital music instrument. Our approach considers the processes of listening as the foundation\u2014and the first step\u2014in the design of action\u2013sound relationships. In this design process, the relationship between action and sound is derived from actions that can be perceived in the sound. Building on previous work on listening modes and gestural descriptions, we propose to distinguish between three mapping strategies: instantaneous, temporal, and metaphorical. Our approach makes use of machine-learning techniques for building prototypes, from digital music instruments to interactive installations. Four different examples of scenarios and prototypes are described and discussed.<\/jats:p>","DOI":"10.1162\/comj_a_00255","type":"journal-article","created":{"date-parts":[[2014,9,15]],"date-time":"2014-09-15T19:26:23Z","timestamp":1410809183000},"page":"34-48","source":"Crossref","is-referenced-by-count":33,"title":["Mapping Through Listening"],"prefix":"10.1162","volume":"38","author":[{"given":"Baptiste","family":"Caramiaux","sequence":"first","affiliation":[{"name":"Department of Computing Goldsmiths College University of London New Cross London, SE16 6NW, United Kingdom."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jules","family":"Fran\u00e7oise","sequence":"additional","affiliation":[{"name":"STMS Lab IRCAM-CNRS-UPMC Institut de Recherche et Coordination Acoustique\/Musique 1 place Igor Stravinsky 75004 Paris, France."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Norbert","family":"Schnell","sequence":"additional","affiliation":[{"name":"STMS Lab IRCAM-CNRS-UPMC Institut de Recherche et Coordination Acoustique\/Musique 1 place Igor Stravinsky 75004 Paris, France."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Fr\u00e9d\u00e9ric","family":"Bevilacqua","sequence":"additional","affiliation":[{"name":"STMS Lab IRCAM-CNRS-UPMC Institut de Recherche et Coordination Acoustique\/Musique 1 place Igor Stravinsky 75004 Paris, France."}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"281","reference":[{"key":"p_1","doi-asserted-by":"publisher","DOI":"10.1017\/S1355771802002054"},{"key":"p_2","first-page":"73","author":"Bevilacqua F.","year":"2010","journal-title":"Springer"},{"key":"p_3","first-page":"127","author":"Bevilacqua F.","year":"2011","journal-title":"Springer"},{"key":"p_4","first-page":"1","author":"Cadoz C.","year":"1988","journal-title":"Proceedings of the International Computer Music Conference"},{"key":"p_6","first-page":"158","author":"Caramiaux B.","year":"2010","journal-title":"Springer Verlag"},{"key":"p_8","doi-asserted-by":"publisher","DOI":"10.1145\/2536811"},{"key":"p_10","first-page":"174","author":"Castagne N.","year":"2004","journal-title":"Proceedings of the Eurohaptics Meeting"},{"key":"p_12","doi-asserted-by":"publisher","DOI":"10.1046\/j.0953-816x.2001.01874.x"},{"key":"p_14","doi-asserted-by":"crossref","first-page":"147","DOI":"10.1145\/1978942.1978965","author":"Fiebrink R. A.","year":"2011","journal-title":"Proceedings of the SIGCHI Conference on Human Factors in Computing Systems"},{"key":"p_17","doi-asserted-by":"publisher","DOI":"10.1145\/2502081.2502184"},{"key":"p_18","doi-asserted-by":"publisher","DOI":"10.1525\/mp.2009.26.3.247"},{"key":"p_19","doi-asserted-by":"publisher","DOI":"10.1207\/s15326969eco0504_2"},{"key":"p_20","doi-asserted-by":"publisher","DOI":"10.1207\/s15326969eco0501_1"},{"key":"p_22","doi-asserted-by":"publisher","DOI":"10.1017\/S1355771806001439"},{"key":"p_23","first-page":"27","author":"God\u00f8y R. I.","year":"2006","journal-title":"Proceedings of the International Symposium on Gesture Interfaces for Multimedia Systems"},{"key":"p_24","doi-asserted-by":"publisher","DOI":"10.1162\/08989290152541449"},{"key":"p_26","first-page":"673","author":"Huron D.","year":"2002","journal-title":"Proceedings of the International Conference on Music Perception and Cognition"},{"key":"p_27","doi-asserted-by":"publisher","DOI":"10.1093\/llc\/fqs071"},{"key":"p_28","doi-asserted-by":"publisher","DOI":"10.1196\/annals.1360.042"},{"key":"p_29","doi-asserted-by":"publisher","DOI":"10.1016\/S0167-9457(00)00026-9"},{"key":"p_30","doi-asserted-by":"publisher","DOI":"10.1207\/s15516709cog2601_1"},{"key":"p_32","doi-asserted-by":"publisher","DOI":"10.1525\/mp.2009.26.3.263"},{"key":"p_33","doi-asserted-by":"publisher","DOI":"10.1016\/0010-0277(85)90021-6"},{"key":"p_39","doi-asserted-by":"publisher","DOI":"10.1162\/comj.2006.30.1.49"},{"key":"p_41","doi-asserted-by":"crossref","first-page":"39","DOI":"10.1145\/2072529.2072541","author":"Nymoen K.","year":"2011","journal-title":"Proceedings of the International ACM Workshop on Music Information Retrieval with User-centered and Multimodal Strategies"},{"key":"p_42","doi-asserted-by":"publisher","DOI":"10.1145\/1935701.1935704"},{"key":"p_43","first-page":"68","author":"Rovan J.","year":"1997","journal-title":"Proceedings of Kansei: The Technology of Emotion Workshop"},{"key":"p_45","first-page":"13","author":"Schwarz D.","year":"2009","journal-title":"Proceedings of the International Computer Music Conference"},{"key":"p_46","doi-asserted-by":"publisher","DOI":"10.1080\/09298215.2011.614951"},{"key":"p_47","doi-asserted-by":"publisher","DOI":"10.1017\/S1355771809000284"},{"key":"p_48","first-page":"87","author":"Van Nort D.","year":"2004","journal-title":"Proceedings of the Conference on New Interfaces for Musical Expression"},{"issue":"2","key":"p_50","doi-asserted-by":"crossref","first-page":"83","DOI":"10.1017\/S1355771802002017","volume":"7","author":"Wanderley M. M.","year":"2002","journal-title":"Organised Sound"},{"key":"p_51","doi-asserted-by":"publisher","DOI":"10.1109\/JPROC.2004.825882"},{"key":"p_52","doi-asserted-by":"publisher","DOI":"10.1162\/014892602320582981"},{"key":"p_53","doi-asserted-by":"publisher","DOI":"10.1038\/nrn2152"}],"container-title":["Computer Music Journal"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mitpressjournals.org\/doi\/pdf\/10.1162\/COMJ_a_00255","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,4,17]],"date-time":"2022-04-17T02:09:38Z","timestamp":1650161378000},"score":1,"resource":{"primary":{"URL":"https:\/\/direct.mit.edu\/comj\/article\/38\/3\/34-48\/94470"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2014,9]]},"references-count":35,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2014,9]]}},"alternative-id":["10.1162\/COMJ_a_00255"],"URL":"https:\/\/doi.org\/10.1162\/comj_a_00255","relation":{},"ISSN":["0148-9267","1531-5169"],"issn-type":[{"value":"0148-9267","type":"print"},{"value":"1531-5169","type":"electronic"}],"subject":[],"published":{"date-parts":[[2014,9]]}}}