{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,20]],"date-time":"2026-07-20T15:10:35Z","timestamp":1784560235384,"version":"3.55.0"},"reference-count":40,"publisher":"MIT Press","issue":"2","content-domain":{"domain":["direct.mit.edu"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2021,6,1]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>This article presents a new software toolbox to enable programmatic mining of sound banks for musicking and musicking-driven research. The toolbox is available for three popular creative coding environments currently used by \u201ctechno-fluent\u201d musicians. The article describes the design rationale and functionality of the toolbox and its ecosystem, then the development methodology\u2014several versions of the toolbox have been seeded to early adopters who have, in turn, contributed to the design. Examples of these early usages are presented, and we describe some observed musical affordances of the proposed approach to the exploration and manipulation of music corpora, as well as the main roadblocks encountered. We finally reflect on a few emerging themes for the next steps in building a community around critical programmatic mining of sound banks.<\/jats:p>","DOI":"10.1162\/comj_a_00600","type":"journal-article","created":{"date-parts":[[2022,6,1]],"date-time":"2022-06-01T19:38:33Z","timestamp":1654112313000},"page":"9-23","update-policy":"https:\/\/doi.org\/10.1162\/mitpressjournals.corrections.policy","source":"Crossref","is-referenced-by-count":16,"title":["Enabling Programmatic Data Mining as Musicking: The Fluid Corpus Manipulation Toolkit"],"prefix":"10.1162","volume":"45","author":[{"given":"Pierre Alexandre","family":"Tremblay","sequence":"first","affiliation":[{"name":"Centre for Research in New Music University of Huddersfield Queensgate Campus, Huddersfield, HD1 3DH, United Kingdom p.a.tremblay@hud.ac.uk"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Gerard","family":"Roma","sequence":"additional","affiliation":[{"name":"Centre for Research in New Music University of Huddersfield Queensgate Campus, Huddersfield, HD1 3DH, United Kingdom g.roma@hud.ac.uk"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Owen","family":"Green","sequence":"additional","affiliation":[{"name":"Centre for Research in New Music University of Huddersfield Queensgate Campus, Huddersfield, HD1 3DH, United Kingdom o.green@hud.ac.uk"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"281","published-online":{"date-parts":[[2021,6,1]]},"reference":[{"key":"2022080313252497400_B1","first-page":"373","article-title":"Bach: An Environment for Computer-Aided Composition in Max","volume-title":"Proceedings of the International Computer Music Conference","author":"Agostini","year":"2012"},{"key":"2022080313252497400_B2","first-page":"3","article-title":"Freesound 2: An Improved Platform for Sharing Audio Clips","volume-title":"Proceedings of the International Conference on Music Information Retrieval","author":"Akkermans","year":"2011"},{"key":"2022080313252497400_B3","doi-asserted-by":"crossref","first-page":"1","DOI":"10.4324\/9780203584279","article-title":"Introduction","volume-title":"Interdisciplinarity: Reconfigurations of the Social and Natural Sciences. London: Routledge","author":"Barry","year":"2013"},{"issue":"4\u20135","key":"2022080313252497400_B4","doi-asserted-by":"publisher","first-page":"291","DOI":"10.1007\/BF00332918","article-title":"Auto-Association by Multilayer Perceptrons and Singular Value Decomposition","volume":"59","author":"Bourlard","year":"1988","journal-title":"Biological Cybernetics"},{"key":"2022080313252497400_B5","first-page":"108","article-title":"API Design for Machine Learning Software: Experiences from the scikit-learn Project","volume-title":"European Conference on Machine Learning and Principles and Practices of Knowledge Discovery in Databases","author":"Buitinck","year":"2013"},{"key":"2022080313252497400_B6","first-page":"265","article-title":"ml.lib: Robust, Cross-Platform, Open-Source Machine Learning for Max and Pure Data","volume-title":"International Conference on New Interface for Musical Expression","author":"Bullock","year":"2015"},{"issue":"1","key":"2022080313252497400_B7","doi-asserted-by":"publisher","first-page":"10","DOI":"10.1145\/248307.248315","article-title":"Artists and the Art of the Luthier","volume":"31","author":"Buxton","year":"1997","journal-title":"ACM SIGGRAPH Computer Graphics"},{"issue":"3","key":"2022080313252497400_B8","doi-asserted-by":"publisher","first-page":"24","DOI":"10.1162\/COMJ_a_00136","article-title":"Automatic Orchestration in Practice","volume":"36","author":"Carpentier","year":"2012","journal-title":"Computer Music Journal"},{"key":"2022080313252497400_B9","first-page":"499","article-title":"SCMIR: A SuperCollider Music Information Retrieval Library","volume-title":"Proceedings of the International Computer Music Conference","author":"Collins","year":"2011"},{"key":"2022080313252497400_B10","doi-asserted-by":"crossref","DOI":"10.4159\/9780674982109","volume-title":"Technosystem: The Social Life of Reason","author":"Feenberg","year":"2017"},{"key":"2022080313252497400_B11","article-title":"The Wekinator: A System for Real-Time, Interactive Machine Learning in Music","volume-title":"Proceedings of the International Conference on Music Information Retrieval","author":"Fiebrink","year":"2010"},{"key":"2022080313252497400_B12","first-page":"237","article-title":"Reflections on Eight Years of Instrument Creation with Machine Learning","volume-title":"International Conference on New Interfaces for Musical Expression","author":"Fiebrink","year":"2020"},{"key":"2022080313252497400_B13","first-page":"62","article-title":"AudioStellar, an Open Source Corpus-Based Musical Instrument for Latent Sound Structure Discovery and Sonic Experimentation","volume-title":"Proceedings of the International Computer Music Conference","author":"Garber","year":"2021"},{"key":"2022080313252497400_B14","first-page":"7","article-title":"Real-Time Corpus-Based Concatenative Synthesis for Symbolic Notation","volume-title":"Proceedings of the International Conference on Technologies for Music Notation and Representation","author":"Ghisi","year":"2016"},{"key":"2022080313252497400_B15","article-title":"Interdisciplinary Research as Musical Experimentation: A Case Study in Musicianly Approaches to Sound Corpora","volume-title":"Proceedings of the Electroacoustic Music Studies Network Conference","author":"Green","year":"2018"},{"key":"2022080313252497400_B16","article-title":"AudioGuide: A Framework for Creative Exploration of Concatenative Sound Synthesis","volume-title":"","author":"Hackbarth","year":"2010"},{"key":"2022080313252497400_B17","first-page":"148","article-title":"The HISSTools Impulse Response Toolbox: Convolution for the Masses","volume-title":"Proceedings of the International Computer Music Conference","author":"Harker","year":"2012"},{"issue":"1","key":"2022080313252497400_B18","doi-asserted-by":"publisher","first-page":"27","DOI":"10.1017\/S1355771800001059","article-title":"Situating the Invention in Interactive Music","volume":"5","author":"Impett","year":"2000","journal-title":"Organised Sound"},{"key":"2022080313252497400_B19","first-page":"293","article-title":"Musical Instrument Mapping Design with Echo State Networks","volume-title":"Proceedings of the International Conference on New Interfaces for Musical Expression","author":"Kiefer","year":"2014"},{"key":"2022080313252497400_B20","doi-asserted-by":"publisher","DOI":"10.7717\/peerj-cs.205","article-title":"Sample-level Sound Synthesis with Recurrent Neural Networks and Conceptors","volume":"5","author":"Kiefer","year":"2019","journal-title":"PeerJ Computer Science"},{"key":"2022080313252497400_B21","doi-asserted-by":"publisher","first-page":"788","DOI":"10.1038\/44565","article-title":"Learning the Parts of Objects by Non-Negative Matrix Factorization","volume":"401","author":"Lee","year":"1999","journal-title":"Nature"},{"issue":"2","key":"2022080313252497400_B22","doi-asserted-by":"publisher","first-page":"129","DOI":"10.1109\/TIT.1982.1056489","article-title":"Least Squares Quantization in PCM","volume":"28","author":"Lloyd","year":"1982","journal-title":"IEEE Transactions on Information Theory"},{"issue":"9","key":"2022080313252497400_B23","doi-asserted-by":"publisher","first-page":"2390","DOI":"10.1162\/NECO_a_00011","article-title":"Sound Retrieval and Ranking Using Sparse Auditory Representations","volume":"22","author":"Lyon","year":"2010","journal-title":"Neural Computation"},{"issue":"1","key":"2022080313252497400_B24","doi-asserted-by":"publisher","first-page":"53","DOI":"10.1017\/S1355771819000463","article-title":"Idiomatic Patterns and Aesthetic Influence in Computer Music Languages","volume":"25","author":"McPherson","year":"2020","journal-title":"Organised Sound"},{"key":"2022080313252497400_B25","doi-asserted-by":"crossref","first-page":"498","DOI":"10.1109\/ICASSP.2013.6637697","article-title":"The ERBlet Transform: An Auditory-Based Time\u2013Frequency Representation with Perfect Reconstruction","volume-title":"IEEE International Conference on Acoustics, Speech and Signal Processing","author":"Necciari","year":"2013"},{"key":"2022080313252497400_B26","first-page":"2825","article-title":"Scikit-learn: Machine Learning in Python","volume":"12","author":"Pedregosa","year":"2011","journal-title":"Journal of Machine Learning Research"},{"key":"2022080313252497400_B27","first-page":"313","article-title":"Adaptive Mapping of Sound Collections for Data-Driven Musical Interfaces","volume-title":"International Conference on New Interface for Musical Expression","author":"Roma","year":"2019"},{"key":"2022080313252497400_B28","first-page":"213","article-title":"Time Scale Modification of Audio Using Non-Negative Matrix Factorization","volume-title":"Proceedings of the International Conference on Digital Audio Effects","author":"Roma","year":"2019"},{"key":"2022080313252497400_B29","first-page":"147","article-title":"Audio Morphing Using Matrix Decomposition and Optimal Transport","volume-title":"Proceedings of the International Conference on Digital Audio Effects","author":"Roma","year":"2020"},{"key":"2022080313252497400_B30","first-page":"253","article-title":"Graph-Based Audio Looping and Granulation","volume-title":"Proceedings of the International Conference on Digital Audio Effects","author":"Roma","year":"2021"},{"key":"2022080313252497400_B31","first-page":"171","article-title":"Unsupervised Feature Learning for Urban Sound Classification","volume-title":"IEEE International Conference on Acoustics, Speech and Signal Processing","author":"Salamon","year":"2015"},{"key":"2022080313252497400_B32","first-page":"423","article-title":"Mubu and Friends: Assembling Tools for Content Based Real-Time Interactive Audio Processing in Max\/MSP","volume-title":"Proceedings of the International Computer Music Conference","author":"Schnell","year":"2009"},{"key":"2022080313252497400_B33","first-page":"361","article-title":"PiPo, a Plugin Interface for Afferent Data Stream Processing Modules","volume-title":"Proceedings of the International Symposium on Music Information Retrieval","author":"Schnell","year":"2017"},{"key":"2022080313252497400_B34","first-page":"279","article-title":"Real-Time Corpus-Based Concatenative Synthesis with CataRT","volume-title":"Proceedings of the International Conference on Digital Audio Effects","author":"Schwarz","year":"2006"},{"issue":"2","key":"2022080313252497400_B35","doi-asserted-by":"publisher","first-page":"128","DOI":"10.1109\/MSP.2007.914237","article-title":"Locality-Sensitive Hashing for Finding Nearest Neighbors [Lecture Notes]","volume":"25","author":"Slaney","year":"2008","journal-title":"IEEE Signal Processing Magazine"},{"key":"2022080313252497400_B36","volume-title":"Musicking: The Meanings of Performing and Listening","author":"Small","year":"1998"},{"key":"2022080313252497400_B37","doi-asserted-by":"crossref","first-page":"2069","DOI":"10.1109\/ICASSP.2008.4518048","article-title":"Shift-Invariant Probabilistic Latent Component Analysis","volume-title":"IEEE International Conference on Acoustics, Speech, and Signal Processing","author":"Smaragdis","year":"2008"},{"key":"2022080313252497400_B38","first-page":"1285","article-title":"ml.*: Machine Learning Library as a Musical Partner in the Computer-Acoustic Composition Flight","volume-title":"Proceedings of the International Computer Music Conference","author":"Smith","year":"2014"},{"key":"2022080313252497400_B39","first-page":"223","article-title":"From Collections to Corpora: Exploring Sounds through Fluid Decomposition","volume-title":"Proceedings of the International Computer Music Conference","author":"Tremblay","year":"2019"},{"key":"2022080313252497400_B40","first-page":"295","article-title":"Digging it: Programmatic Data Mining as Musicking","volume-title":"Proceedings of the International Computer Music Conference","author":"Tremblay","year":"2021"}],"container-title":["Computer Music Journal"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/direct.mit.edu\/comj\/article-pdf\/45\/2\/9\/2037541\/comj_a_00600.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/direct.mit.edu\/comj\/article-pdf\/45\/2\/9\/2037541\/comj_a_00600.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,2,7]],"date-time":"2023-02-07T00:00:15Z","timestamp":1675728015000},"score":1,"resource":{"primary":{"URL":"https:\/\/direct.mit.edu\/comj\/article\/45\/2\/9\/111383\/Enabling-Programmatic-Data-Mining-as-Musicking-The"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021]]},"references-count":40,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2021,6,1]]},"published-print":{"date-parts":[[2021,6,1]]}},"URL":"https:\/\/doi.org\/10.1162\/comj_a_00600","relation":{},"ISSN":["0148-9267","1531-5169"],"issn-type":[{"value":"0148-9267","type":"print"},{"value":"1531-5169","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2021]]},"published":{"date-parts":[[2021]]}}}