{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,21]],"date-time":"2025-10-21T15:29:13Z","timestamp":1761060553162},"reference-count":51,"publisher":"MIT Press","issue":"1","content-domain":{"domain":["direct.mit.edu"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2018,4,1]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>In this article we describe a user-driven adaptive method to control the sonic response of digital musical instruments using information extracted from the timbre of the human voice. The mapping between heterogeneous attributes of the input and output timbres is determined from data collected through machine-listening techniques and then processed by unsupervised machine-learning algorithms. This approach is based on a minimum-loss mapping that hides any synthesizer-specific parameters and that maps the vocal interaction directly to perceptual characteristics of the generated sound. The mapping adapts to the dynamics detected in the voice and maximizes the timbral space covered by the sound synthesizer. The strategies for mapping vocal control to perceptual timbral features and for automating the customization of vocal interfaces for different users and synthesizers, in general, are evaluated through a variety of qualitative and quantitative methods.<\/jats:p>","DOI":"10.1162\/comj_a_00450","type":"journal-article","created":{"date-parts":[[2018,4,4]],"date-time":"2018-04-04T18:11:24Z","timestamp":1522865484000},"page":"37-59","update-policy":"http:\/\/dx.doi.org\/10.1162\/mitpressjournals.corrections.policy","source":"Crossref","is-referenced-by-count":2,"title":["Vocal Control of Sound Synthesis Personalized by Unsupervised Machine Listening and Learning"],"prefix":"10.1162","volume":"42","author":[{"given":"Stefano","family":"Fasciani","sequence":"first","affiliation":[{"name":"*Faculty of Engineering and Information Sciences University of Wollongong in Dubai Knowledge Park, Block 15, P.O. Box 20183 Dubai, United Arab Emirates stefanofasciani@stefanofasciani.com"}]},{"given":"Lonce","family":"Wyse","sequence":"additional","affiliation":[{"name":"\u2020Communication and New Media Department National University of Singapore 11 Computing Drive, 117416, Singapore lonce.wyse@nus.edu.sg"}]}],"member":"281","published-online":{"date-parts":[[2018,4,1]]},"reference":[{"key":"p_1","doi-asserted-by":"publisher","DOI":"10.1017\/S1355771802002054"},{"key":"p_2","first-page":"156","author":"Barbosa J.","year":"2015","journal-title":"Proceedings of the International Conference on New Interfaces for Musical Expression"},{"key":"p_3","first-page":"73","author":"Bevilacqua F.","year":"2010","journal-title":"Springer"},{"key":"p_4","first-page":"41","author":"Bongers B.","year":"2000","journal-title":"M. M. Wanderley and M. Battier, eds. Trends in Gestural Control of Music. Paris: IRCAM"},{"key":"p_7","first-page":"265","author":"Bullock J.","year":"2015","journal-title":"Proceedings of the International Conference on New Interfaces for Musical Expression"},{"key":"p_8","first-page":"73","author":"Burgoyne J. A.","year":"2007","journal-title":"Proceedings of the International Computer Music Conference"},{"key":"p_9","first-page":"513","author":"Caramiaux B.","year":"2013","journal-title":"Proceedings of the International Conference on New Interfaces for Musical Expression"},{"key":"p_10","first-page":"363","author":"Cartwright M.","year":"2014","journal-title":"Proceedings of the Conference on New Interfaces for Musical Expression"},{"key":"p_11","first-page":"43","author":"Cartwright M.","year":"2015","journal-title":"Proceedings of the Annual ACM Conference on Human Factors in Computing Systems"},{"key":"p_13","first-page":"3","author":"Cook P. R.","year":"2001","journal-title":"Proceedings of the ACM Computer-Human Interaction Workshop on New Interfaces for Musical Expression"},{"key":"p_14","first-page":"58","author":"Delle Monache S.","year":"2015","journal-title":"Proceedings of the International Conference on Auditory Display"},{"key":"p_15","first-page":"277","author":"Dobrian C.","year":"2006","journal-title":"Proceedings of the 6th International Conference on New Interfaces for Musical Expression"},{"key":"p_16","doi-asserted-by":"publisher","DOI":"10.1162\/COMJ_a_00357"},{"key":"p_18","first-page":"129","author":"Fasciani S.","year":"2016","journal-title":"Proceedings of the Sound and Music Computing International Conference"},{"key":"p_19","first-page":"501","author":"Fasciani S.","year":"2013","journal-title":"Proceedings of the International Conference on New Interfaces for Musical Expression"},{"key":"p_20","doi-asserted-by":"publisher","DOI":"10.1109\/JPROC.2004.825887"},{"key":"p_22","doi-asserted-by":"crossref","first-page":"2213","DOI":"10.1145\/1518701.1519040","author":"Gaver W.","year":"2009","journal-title":"Proceedings of the SIGCHI Conference on Human Factors in Computing Systems"},{"key":"p_23","first-page":"13","author":"Gelineck S.","year":"2009","journal-title":"Proceedings of the International Conference on New Interfaces for Musical Expression"},{"key":"p_24","first-page":"343","author":"Gillian N.","year":"2011","journal-title":"Proceedings of the International Conference on New Interfaces for Musical Expression"},{"key":"p_26","doi-asserted-by":"publisher","DOI":"10.1177\/1525822X05279903"},{"key":"p_30","doi-asserted-by":"publisher","DOI":"10.1076\/jnmr.32.4.429.18853"},{"key":"p_32","first-page":"183","author":"Janer J.","year":"2008","journal-title":"Proceedings of the Sound and Music Computing Conference"},{"key":"p_33","first-page":"170","author":"Kapur A.","year":"2004","journal-title":"Proceedings of the International Conference on Music Information Retrieval"},{"key":"p_37","first-page":"558","author":"Lemaitre G.","year":"2013","journal-title":"Springer"},{"key":"p_38","first-page":"172","author":"Loscos A.","year":"2005","journal-title":"Proceedings of the International Conference on New Interfaces for Musical Expression"},{"key":"p_39","first-page":"373","author":"Marquez-Borbon A.","year":"2011","journal-title":"Proceedings of the International Conference on New Interfaces for Musical Expression"},{"key":"p_40","first-page":"403","author":"Ness S. R","year":"2009","journal-title":"Proceedings of the International Computer Music Conference"},{"key":"p_41","doi-asserted-by":"publisher","DOI":"10.1016\/j.comgeo.2008.04.002"},{"key":"p_42","doi-asserted-by":"publisher","DOI":"10.1177\/1359105311417192"},{"key":"p_43","doi-asserted-by":"publisher","DOI":"10.1145\/263552.263619"},{"key":"p_44","first-page":"141","author":"Orio N.","year":"1997","journal-title":"Proceedings of the International Computer Music Conference"},{"key":"p_45","first-page":"391","author":"Orio N.","year":"1999","journal-title":"Proceedings of the International Computer Music Conference"},{"key":"p_46","first-page":"15","author":"Orio N.","year":"2001","journal-title":"Proceedings of the ACM Computer-Human Interaction Workshop on New Interfaces for Musical Expression"},{"key":"p_47","first-page":"391","author":"Poepel C.","year":"2005","journal-title":"Proceedings of the International Computer Music Conference"},{"key":"p_48","doi-asserted-by":"publisher","DOI":"10.1145\/634067.634348"},{"key":"p_49","doi-asserted-by":"publisher","DOI":"10.2307\/3680113"},{"key":"p_50","first-page":"328","author":"Puckette M.","year":"1994","journal-title":"Proceedings of the International Conference for Music Perception and Cognition"},{"key":"p_52","first-page":"100","author":"Ramakrishnan C.","year":"2004","journal-title":"Proceedings of the International Conference on New Interfaces for Musical Expression"},{"key":"p_54","first-page":"892","author":"Rothbauer P.","year":"2008","journal-title":"L. Given, ed. The SAGE Encyclopedia of Qualitative Research Methods. Thousand Oaks, California: Sage"},{"key":"p_57","first-page":"108","author":"Smith B. D.","year":"2011","journal-title":"Proceedings of the International Conference on New Interfaces for Musical Expression"},{"key":"p_58","first-page":"66","author":"Smith B. D.","year":"2012","journal-title":"Proceedings of the International Conference on New Interfaces for Musical Expression"},{"key":"p_59","first-page":"206","author":"Stevens K.","year":"1971","journal-title":"Proceedings of the International Congress on Phonetic Sciences"},{"issue":"1","key":"p_60","first-page":"55","volume":"2","author":"Stolterman E.","year":"2008","journal-title":"International Journal of Design"},{"key":"p_63","doi-asserted-by":"publisher","DOI":"10.1126\/science.290.5500.2319"},{"key":"p_65","doi-asserted-by":"publisher","DOI":"10.1049\/ip-i-2.1992.0018"},{"key":"p_66","first-page":"42","author":"Traube C.","year":"2003","journal-title":"Proceedings of the International Conference on New Interfaces for Musical Expression"},{"key":"p_67","doi-asserted-by":"publisher","DOI":"10.1109\/JPROC.2004.825882"},{"key":"p_68","doi-asserted-by":"publisher","DOI":"10.1162\/014892602320582981"},{"key":"p_69","doi-asserted-by":"publisher","DOI":"10.2307\/3680283"},{"key":"p_70","doi-asserted-by":"publisher","DOI":"10.2307\/3681079"},{"key":"p_71","doi-asserted-by":"publisher","DOI":"10.1109\/ICSLP.1996.607977"}],"container-title":["Computer Music Journal"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/direct.mit.edu\/comj\/article-pdf\/42\/1\/37\/2005540\/comj_a_00450.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/direct.mit.edu\/comj\/article-pdf\/42\/1\/37\/2005540\/comj_a_00450.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,8,18]],"date-time":"2022-08-18T02:22:21Z","timestamp":1660789341000},"score":1,"resource":{"primary":{"URL":"https:\/\/direct.mit.edu\/comj\/article\/42\/1\/37\/94655\/Vocal-Control-of-Sound-Synthesis-Personalized-by"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018]]},"references-count":51,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2018,4,1]]},"published-print":{"date-parts":[[2018,4,1]]}},"URL":"https:\/\/doi.org\/10.1162\/comj_a_00450","relation":{},"ISSN":["0148-9267","1531-5169"],"issn-type":[{"value":"0148-9267","type":"print"},{"value":"1531-5169","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2018]]},"published":{"date-parts":[[2018]]}}}