{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,13]],"date-time":"2026-04-13T20:45:14Z","timestamp":1776113114665,"version":"3.50.1"},"reference-count":73,"publisher":"MIT Press","issue":"4","content-domain":{"domain":["direct.mit.edu"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2022,12,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:p>In this article, we address the role of machine learning (ML) in the composition of two new musical works for acoustic instruments and electronics through autoethnographic reflection on the experience. Our study poses the key question of how ML shapes, and is in turn shaped by, the aesthetic commitments characterizing distinctive compositional practices. Further, we ask how artistic research in these practices can be informed by critical themes from humanities scholarship on material engagement and critical data studies. Through these frameworks, we consider in what ways the interaction with ML algorithms as part of the compositional process differs from that with other music technology tools. Rather than focus on narrowly conceived ML algorithms, we take into account the heterogeneous assemblage brought into play: from composers, performers, and listeners to loudspeakers, microphones, and audio descriptors. Our analysis focuses on a deconstructive critique of data as being contingent on the decisions and material conditions involved in the data-creation process. It also explores how interaction among the human and nonhuman collaborators in the ML assemblage has significant similarities to\u2014as well as differences from\u2014existing models of material engagement. Tracking the creative process of composing these works, we uncover the aesthetic implications of the many nonlinear collaborative decisions involved in composing the assemblage.<\/jats:p>","DOI":"10.1162\/comj_a_00658","type":"journal-article","created":{"date-parts":[[2023,11,9]],"date-time":"2023-11-09T17:26:52Z","timestamp":1699550812000},"page":"62-80","update-policy":"https:\/\/doi.org\/10.1162\/mitpressjournals.corrections.policy","source":"Crossref","is-referenced-by-count":5,"title":["Composing the Assemblage: Probing Aesthetic and Technical Dimensions\n                    of Artistic Creation with Machine Learning"],"prefix":"10.1162","volume":"46","author":[{"given":"Artemi-Maria","family":"Gioti","sequence":"first","affiliation":[{"name":"Department of Anthropology and Institute of Advanced Studies University College London Gower Street, London WC1E 6BT, United Kingdom artemi.gioti@ucl.ac.uk"}]},{"given":"Aaron","family":"Einbond","sequence":"additional","affiliation":[{"name":"City, University of London Northampton Square, London EC1V 0HB, United Kingdom aaron.einbond@city.ac.uk"}]},{"given":"Georgina","family":"Born","sequence":"additional","affiliation":[{"name":"Department of Anthropology and Institute of Advanced Studies University College London Gower Street, London WC1E 6BT, United Kingdom g.born@ucl.ac.uk"}]}],"member":"281","published-online":{"date-parts":[[2022,12,1]]},"reference":[{"key":"2024041813192329800_B1","volume-title":"Improvisation: Its Nature and Practice in\n                        Music","author":"Bailey","year":"1992"},{"issue":"2","key":"2024041813192329800_B2","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1177\/2053951716654502","article-title":"Data Journeys: Capturing the\n                        Socio-Material Constitution of Data Objects and\n                    Flows","volume":"3","author":"Bates","year":"2016","journal-title":"Big Data and Society"},{"key":"2024041813192329800_B3","first-page":"585","article-title":"Reflective Informatics: Conceptual\n                        Dimensions for Designing Technologies of Reflection","author":"Baumer","year":"2015","journal-title":"Proceedings of the ACM Conference on Human Factors in Computing\n                        Systems"},{"key":"2024041813192329800_B4","first-page":"7","article-title":"The Debate on Research in the\n                        Arts","volume-title":"Sensuous Knowledge: Focus on\n                        Artistic Research and Development","author":"Borgdorff","year":"2006"},{"key":"2024041813192329800_B5","doi-asserted-by":"crossref","DOI":"10.1525\/9780520916845","volume-title":"Rationalizing Culture: IRCAM, Boulez, and the\n                        Institutionalization of the Musical Avant-Garde","author":"Born","year":"1995"},{"issue":"1","key":"2024041813192329800_B6","doi-asserted-by":"publisher","first-page":"7","DOI":"10.1017\/S147857220500023X","article-title":"On Musical Mediation: Ontology,\n                        Technology and Creativity","volume":"2","author":"Born","year":"2005","journal-title":"Twentieth-Century\n                        Music"},{"issue":"2","key":"2024041813192329800_B7","doi-asserted-by":"publisher","first-page":"171","DOI":"10.1177\/1749975510368471","article-title":"The Social and the Aesthetic: For a\n                        Post-Bourdieuian Theory of Cultural Production","volume":"4","author":"Born","year":"2010","journal-title":"Cultural Sociology"},{"key":"2024041813192329800_B8","first-page":"261","article-title":"Music and the\n                    Social","volume-title":"The Cultural Study of Music","author":"Born","year":"2011","edition":"2nd ed."},{"key":"2024041813192329800_B9","first-page":"1","article-title":"Introduction.\u201d In\n                            Music, Sound and Space: Transformations of Public and Private\n                            Experience","author":"Born","year":"2013"},{"issue":"3","key":"2024041813192329800_B10","doi-asserted-by":"publisher","first-page":"361","DOI":"10.1353\/nlh.2015.0025","article-title":"Making Time: Temporality, History, and\n                        the Cultural Object","volume":"46","author":"Born","year":"2015","journal-title":"New Literary\n                        History"},{"key":"2024041813192329800_B11","doi-asserted-by":"crossref","first-page":"35","DOI":"10.14361\/9783839452875-004","article-title":"Artistic Research and Music\n                        Research","volume-title":"Knowing in Performing: Artistic Research in Music and the Performing\n                        Arts","author":"Born","year":"2021"},{"key":"2024041813192329800_B12","doi-asserted-by":"crossref","first-page":"305","DOI":"10.14324\/111.9781800082434","article-title":"The Dynamics of Pluralism in\n                        Contemporary Digital Art Music","volume-title":"Music\n                        and Digital Media: A Planetary Anthropology","author":"Born","year":"2022"},{"issue":"5\u20136","key":"2024041813192329800_B13","doi-asserted-by":"publisher","first-page":"443","DOI":"10.1080\/07494467.2018.1578107","article-title":"Introduction: Music, Mediation\n                        Theories and Actor-Network Theory","volume":"37","author":"Born","year":"2018","journal-title":"Contemporary Music Review"},{"key":"2024041813192329800_B14","article-title":"Artificial Intelligence, Music\n                        Recommendation, and the Curation of Culture","author":"Born","year":"2021"},{"key":"2024041813192329800_B15","doi-asserted-by":"crossref","DOI":"10.7551\/mitpress\/6352.001.0001","volume-title":"Sorting Things Out: Classification and Its\n                        Consequences","author":"Bowker","year":"2000"},{"issue":"5","key":"2024041813192329800_B16","doi-asserted-by":"publisher","first-page":"662","DOI":"10.1080\/1369118X.2012.678878","article-title":"Critical Questions for Big Data:\n                        Provocations for a Cultural, Technological, and Scholarly\n                        Phenomenon","volume":"15","author":"Boyd","year":"2012","journal-title":"Information, Communication and\n                        Society"},{"key":"2024041813192329800_B17","article-title":"Dark Matter: Interview between Daryl\n                        Buckley and Richard Barrett","author":"Buckley","year":"2003"},{"issue":"1","key":"2024041813192329800_B18","doi-asserted-by":"publisher","DOI":"10.1177\/2053951715622512","article-title":"How the Machine\n                        \u2018Thinks\u2019: Understanding Opacity in Machine Learning\n                        Algorithms","volume":"3","author":"Burrell","year":"2016","journal-title":"Big Data and Society"},{"key":"2024041813192329800_B19","first-page":"1","article-title":"Introduction and\n                        Overview","volume-title":"Distributed Creativity: Collaboration and Improvisation in\n                        Contemporary Music","author":"","year":"2017"},{"key":"2024041813192329800_B20","doi-asserted-by":"publisher","first-page":"1105","DOI":"10.1007\/s00146-021-01301-1","article-title":"Excavating AI: The Politics of\n                        Images in Machine Learning Training Sets","volume":"36","author":"Crawford","year":"2021","journal-title":"AI\n                        and Society"},{"issue":"3","key":"2024041813192329800_B21","doi-asserted-by":"publisher","first-page":"411","DOI":"10.1017\/S1062798719000073","article-title":"Big Data and\n                        Creativity","volume":"27","author":"Dahlstedt","year":"2019","journal-title":"European Review"},{"issue":"4","key":"2024041813192329800_B22","doi-asserted-by":"publisher","first-page":"357","DOI":"10.1109\/TASSP.1980.1163420","article-title":"Comparison of Parametric\n                        Representations for Monosyllabic Word Recognition in Continuously Spoken\n                        Sentences","volume":"28","author":"Davis","year":"1980","journal-title":"IEEE Transactions on Acoustics,\n                        Speech, and Signal Processing"},{"key":"2024041813192329800_B23","volume-title":"A New Philosophy of Society: Assemblage Theory and\n                        Social Complexity","author":"DeLanda","year":"2006"},{"key":"2024041813192329800_B24","volume-title":"Foucault","author":"Deleuze","year":"1988"},{"key":"2024041813192329800_B25","volume-title":"Dialogues","author":"Deleuze","year":"1987"},{"issue":"2","key":"2024041813192329800_B26","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1177\/20539517211035955","article-title":"On the Genealogy of Machine\n                        Learning Datasets: A Critical History of ImageNet","volume":"8","author":"Denton","year":"2021","journal-title":"Big Data and Society"},{"issue":"2","key":"2024041813192329800_B27","doi-asserted-by":"publisher","first-page":"31","DOI":"10.1080\/09697259808571982","article-title":"Questions Concerning Music\n                        Technology","volume":"3","author":"Di Scipio","year":"1998","journal-title":"Angelaki: Journal of the\n                        Theoretical Humanities"},{"issue":"2","key":"2024041813192329800_B28","doi-asserted-by":"publisher","first-page":"97","DOI":"10.1017\/S1355771811000033","article-title":"Listening to Yourself through the\n                        Otherself: On Background Noise Study and Other\n                    Works","volume":"16","author":"Di Scipio","year":"2011","journal-title":"Organised Sound"},{"issue":"3","key":"2024041813192329800_B29","doi-asserted-by":"publisher","first-page":"283","DOI":"10.1177\/1029864916656995","article-title":"Tracking the Creative Process in\n                        Music: New Issues, New Methods","volume":"20","author":"Donin","year":"2016","journal-title":"Musicae\n                        Scientiae"},{"key":"2024041813192329800_B30","doi-asserted-by":"crossref","DOI":"10.1093\/oxfordhb\/9780190636197.001.0001","volume-title":"The Oxford Handbook of Creative Process in\n                        Music","author":"Donin","year":"2018"},{"key":"2024041813192329800_B31","volume-title":"The Open Work","author":"Eco","year":"1989"},{"key":"2024041813192329800_B32","first-page":"57","article-title":"Subtractive Synthesis: Noise and\n                        Digital (Un)Creativity","volume-title":"Noise in and as Music","author":"Einbond","year":"2013"},{"key":"2024041813192329800_B33","first-page":"155","article-title":"Musique Instrumentale Concr\u00e8te:\n                        Timbral Transcription in What the Blind See and without\n                        Words","volume-title":"Open Music Composer's\n                        Book","author":"Einbond","year":"2016"},{"key":"2024041813192329800_B34","first-page":"140","article-title":"Introducing CatOracle:\n                        Corpus-based Concatenative Improvisation with the Audio Oracle\n                        Algorithm","author":"Einbond","year":"2016","journal-title":"Proceedings of the\n                        International Computer Music Conference"},{"key":"2024041813192329800_B35","first-page":"148","article-title":"Instrumental Radiation Patterns as\n                        Models for Corpus-Based Spatial Sound Synthesis: `Cosmologies' for Piano and\n                        3D Electronics","author":"Einbond","year":"2021","journal-title":"Proceedings of the\n                        International Computer Music Conference"},{"issue":"4","key":"2024041813192329800_B36","doi-asserted-by":"crossref","first-page":"43","DOI":"10.1162\/comj_a_00664","article-title":"Embodying Spatial Sound Synthesis\n                        with AI in Two Compositions for Instruments and 3-D\n                        Electronics","volume":"46","author":"Einbond","year":"2023","journal-title":"Computer Music Journal"},{"key":"2024041813192329800_B37","first-page":"237","article-title":"Reflections on Eight Years of\n                        Instrument Creation with Machine Learning","author":"Fiebrink","year":"2020","journal-title":"Proceedings of the International Conference on New Interfaces for\n                        Musical Expression"},{"issue":"1","key":"2024041813192329800_B38","doi-asserted-by":"publisher","first-page":"121","DOI":"10.1017\/S1355771817000371","article-title":"Sonic Autoethnographies: Personal\n                        Listening as Compositional Context","volume":"23","author":"Findlay-Walsh","year":"2018","journal-title":"Organised Sound"},{"key":"2024041813192329800_B39","first-page":"287","article-title":"Probabilistic Models for Designing\n                        Motion and Sound Relationships","author":"Fran\u00e7oise","year":"2014","journal-title":"Proceedings of the International Conference on New Interfaces for\n                        Musical Expression"},{"key":"2024041813192329800_B40","doi-asserted-by":"crossref","first-page":"53","DOI":"10.1007\/978-3-030-72116-9_3","article-title":"Artificial Intelligence for Music\n                        Composition","volume-title":"Handbook of Artificial Intelligence for Music","author":"Gioti","year":"2021"},{"key":"2024041813192329800_B41","article-title":"Agency and Distributed Creativity in\n                        Interactive Compositions.\u201d Doctoral dissertation, University of Music\n                        and Performing Arts Graz","author":"Gioti","year":"2021"},{"issue":"1","key":"2024041813192329800_B42","doi-asserted-by":"publisher","first-page":"59","DOI":"10.1080\/07494467.2014.906698","article-title":"Audible Ecosystemics as Artefactual\n                        Assemblages: Thoughts on Making and Knowing Prompted by Practical\n                        Investigation of Di Scipio's Work","volume":"33","author":"Green","year":"2014","journal-title":"Contemporary Music Review"},{"issue":"3","key":"2024041813192329800_B43","doi-asserted-by":"publisher","first-page":"575","DOI":"10.2307\/3178066","article-title":"Situated Knowledges: The Science\n                        Question in Feminism and the Privilege of Partial\n                        Perspective","volume":"14","author":"Haraway","year":"1988","journal-title":"Feminist Studies"},{"issue":"3","key":"2024041813192329800_B44","first-page":"567","article-title":"After the Neutrality Ideal: Science,\n                        Politics, and \u2018Strong Objectivity","volume":"59","author":"Harding","year":"1992","journal-title":"Social Research"},{"issue":"1","key":"2024041813192329800_B45","doi-asserted-by":"publisher","first-page":"44","DOI":"10.5334\/tismir.13","article-title":"Ethical Dimensions of Music\n                        Information Retrieval Technology","volume":"1","author":"Holzapfel","year":"2018","journal-title":"Transactions of the International Society for Music Information\n                        Retrieval"},{"issue":"1","key":"2024041813192329800_B46","doi-asserted-by":"publisher","first-page":"27","DOI":"10.1017\/S1355771800001059","article-title":"Situating the Invention in Interactive\n                        Music","volume":"5","author":"Impett","year":"2000","journal-title":"Organised Sound"},{"key":"2024041813192329800_B47","doi-asserted-by":"crossref","first-page":"117","DOI":"10.2307\/j.ctv1ccbg96.9","article-title":"Dissociation and Interference in\n                        Composers\u2019 Stories about Music: The Renewal of Musical\n                        Discourse","volume-title":"Sound Work: Composition as\n                        Critical Technical Practice","author":"Impett","year":"2021"},{"key":"2024041813192329800_B48","first-page":"333","article-title":"The Malice of Inanimate Objects:\n                        Material Agency","volume-title":"The Oxford Handbook of Material Culture Studies","author":"Jones","year":"2010"},{"issue":"1","key":"2024041813192329800_B49","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1177\/2053951714528481","article-title":"Big Data, New Epistemologies and\n                        Paradigm Shifts","volume":"1","author":"Kitchin","year":"2014","journal-title":"Big Data and\n                        Society"},{"key":"2024041813192329800_B50","article-title":"Towards Critical Data Studies:\n                        Charting and Unpacking Data Assemblages and Their\n                    Work","volume-title":"Thinking Big Data in Geography: New Regimes, New Research","author":"Kitchin","year":"2014"},{"key":"2024041813192329800_B51","doi-asserted-by":"crossref","first-page":"ix","DOI":"10.1007\/978-0-387-74711-8","volume-title":"Material Agency: Towards a Non-Anthropocentric\n                        Approach","author":"Knappett","year":"2008"},{"key":"2024041813192329800_B53","volume-title":"Musik als existentielle Erfahrung: Schriften\n                        1966\u20131995","author":"Lachenmann","year":"1996"},{"issue":"2","key":"2024041813192329800_B52","doi-asserted-by":"publisher","first-page":"130","DOI":"10.1017\/S1355771819000177","article-title":"Re-Composing Sounds . . . and Other\n                        Things","volume":"24","author":"Landy","year":"2019","journal-title":"Organised Sound"},{"issue":"3","key":"2024041813192329800_B54","doi-asserted-by":"publisher","first-page":"99","DOI":"10.1080\/07494469900640381","article-title":"Interacting with Latter-Day Musical\n                        Automata","volume":"18","author":"Lewis","year":"1999","journal-title":"Contemporary Music Review"},{"issue":"2","key":"2024041813192329800_B55","doi-asserted-by":"publisher","first-page":"168","DOI":"10.1017\/S1355771809000272","article-title":"Of Epistemic Tools: Musical\n                        Instruments as Cognitive Extensions","volume":"14","author":"Magnusson","year":"2009","journal-title":"Organised Sound"},{"key":"2024041813192329800_B56","first-page":"609","article-title":"Confessions of a Live\n                        Coder","author":"Magnusson","year":"2011","journal-title":"Proceedings of the International\n                        Computer Music Conference"},{"key":"2024041813192329800_B57","first-page":"53","article-title":"The Cognitive Basis of Material\n                        Engagement: Where Brain, Body and Culture Conflate","volume-title":"Rethinking Materiality: The Engagement of Mind with the Material\n                        World","author":"Malafouris","year":"2004"},{"key":"2024041813192329800_B58","doi-asserted-by":"crossref","first-page":"19","DOI":"10.1007\/978-0-387-74711-8_2","article-title":"At the Potter's Wheel: An\n                        Argument for Material Agency","volume-title":"Material Agency: Towards a Non-Anthropocentric Approach","author":"Malafouris","year":"2008"},{"key":"2024041813192329800_B59","doi-asserted-by":"crossref","DOI":"10.7551\/mitpress\/9476.001.0001","volume-title":"How Things Shape the Mind: A Theory of Material\n                        Engagement","author":"Malafouris","year":"2013"},{"issue":"10","key":"2024041813192329800_B60","article-title":"Undermining \u2018Data\u2019: A\n                        Critical Examination of a Core Term in Scientific\n                    Inquiry","volume":"18","author":"Markham","year":"2013","journal-title":"First Monday"},{"key":"2024041813192329800_B61","doi-asserted-by":"crossref","first-page":"153","DOI":"10.2307\/j.ctv1ccbg96.11","article-title":"The Impossibility of Material\n                        Foundations","volume-title":"Sound Work: Composition as Critical Technical Practice","author":"McLaughlin","year":"2021"},{"issue":"1","key":"2024041813192329800_B62","doi-asserted-by":"publisher","first-page":"53","DOI":"10.1017\/S1355771819000463","article-title":"Idiomatic Patterns and Aesthetic\n                        Influence in Computer Music Languages","volume":"25","author":"McPherson","year":"2020","journal-title":"Organised Sound"},{"key":"2024041813192329800_B63","article-title":"The Other Hegemony: Effects of Software Development\n                        Culture on Music Software, and What We Can Do About\n                    it","author":"Pardue","year":"2022","journal-title":"Proceedings of the International\n                        Conference on New Interfaces for Musical\n                    Expression"},{"key":"2024041813192329800_B64","article-title":"A Large Set of Audio Features for\n                        Sound Description (Similarity and Classification) in the Cuidado\n                        Project","author":"Peeters","year":"2004","journal-title":"Technical report,\n                            IRCAM"},{"key":"2024041813192329800_B65","doi-asserted-by":"crossref","DOI":"10.7208\/chicago\/9780226668253.001.0001","volume-title":"The Mangle of Practice: Time, Agency, and\n                        Science","author":"Pickering","year":"1995"},{"key":"2024041813192329800_B66","first-page":"191","article-title":"Material Culture and the Dance of\n                        Agency","volume-title":"The Oxford Handbook of Material Culture Studies","author":"Pickering","year":"2010"},{"issue":"2","key":"2024041813192329800_B67","doi-asserted-by":"publisher","DOI":"10.1177\/20539517211029322","article-title":"Reading Datasets: Strategies for\n                        Interpreting the Politics of Data Signification","volume":"8","author":"Poirier","year":"2021","journal-title":"Big Data and Society"},{"key":"2024041813192329800_B68","volume-title":"The Reflective Practitioner: How Professionals Think\n                        in Action","author":"Sch\u00f6n","year":"1983"},{"issue":"2","key":"2024041813192329800_B69","doi-asserted-by":"publisher","first-page":"92","DOI":"10.1109\/MSP.2007.323274","article-title":"Corpus-based Concatenative\n                        Synthesis","volume":"24","author":"Schwarz","year":"2007","journal-title":"IEEE Signal Processing\n                        Magazine"},{"key":"2024041813192329800_B70","doi-asserted-by":"crossref","DOI":"10.1017\/CBO9781139173452","volume-title":"Intentionality: An Essay in the Philosophy of\n                        Mind","author":"Searle","year":"1983"},{"key":"2024041813192329800_B71","first-page":"220","article-title":"Max, Music Software and the Mutual Mediation of\n                        Aesthetics and Digital Technologies","volume-title":"Music\n                        and Digital Media: A Planetary Anthropology","author":"Snape","year":"2022"},{"key":"2024041813192329800_B72","first-page":"114","article-title":"Feature Selection and Composition\n                        Using PyOracle","author":"Surges","year":"2013","journal-title":"Proceedings of the\n                        Artificial Intelligence and Interactive Digital Entertainment\n                        Conference"},{"issue":"10","key":"2024041813192329800_B73","article-title":"A Critical Reflection on Big Data:\n                        Considering APIs, Researchers and Tools as Data\n                    Makers","volume":"18","author":"Vis","year":"2013","journal-title":"First Monday"}],"container-title":["Computer Music Journal"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/direct.mit.edu\/comj\/article-pdf\/46\/4\/62\/2364567\/comj_a_00658.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/direct.mit.edu\/comj\/article-pdf\/46\/4\/62\/2364567\/comj_a_00658.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,4,18]],"date-time":"2024-04-18T13:19:51Z","timestamp":1713446391000},"score":1,"resource":{"primary":{"URL":"https:\/\/direct.mit.edu\/comj\/article\/46\/4\/62\/118093\/Composing-the-Assemblage-Probing-Aesthetic-and"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022]]},"references-count":73,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2022,12,1]]},"published-print":{"date-parts":[[2022,12,1]]}},"URL":"https:\/\/doi.org\/10.1162\/comj_a_00658","relation":{},"ISSN":["0148-9267","1531-5169"],"issn-type":[{"value":"0148-9267","type":"print"},{"value":"1531-5169","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2022]]},"published":{"date-parts":[[2022]]}}}