{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,7]],"date-time":"2026-03-07T08:08:46Z","timestamp":1772870926454,"version":"3.50.1"},"reference-count":163,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2025,8,20]],"date-time":"2025-08-20T00:00:00Z","timestamp":1755648000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Comput. Sci."],"abstract":"<jats:p>Neural Audio is a category of deep learning pipelines which output audio signals directly, in real-time scenarios of action-sound interactions. In this work, we examine how neural audio-based artificial intelligence, when embedded in digital musical instruments (DMIs), shapes embodied musical interaction. While DMIs have long struggled to match the physical immediacy of acoustic instruments, neural audio methods can magnify this challenge, requiring data collection, model training and deep theoretical knowledge that appear to push musicians toward symbolic or conceptual modes of engagement. Paradoxically, these same methods can also foster more embodied practices, by introducing opaque yet expressive behaviors that free performers from rigid technical models and encourage discovery through tactile, real-time experimentation. Drawing on established perspectives in DMI embodiment literature, as well as emerging neural-audio-focused efforts within the community, we highlight two seemingly conflicting aspects of these instruments: on one side, they inherit many \u201cdisembodying\u201d traits known from DMIs; on the other, they open pathways reminiscent of acoustic phenomenology and soma, potentially restoring the close physical interplay often missed in digital performance.<\/jats:p>","DOI":"10.3389\/fcomp.2025.1575168","type":"journal-article","created":{"date-parts":[[2025,8,20]],"date-time":"2025-08-20T05:35:04Z","timestamp":1755668104000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":1,"title":["Neural audio instruments: epistemological and phenomenological perspectives on musical embodiment of deep learning"],"prefix":"10.3389","volume":"7","author":[{"given":"Victor","family":"Zappi","sequence":"first","affiliation":[]},{"given":"K\u0131van\u00e7","family":"Tatar","sequence":"additional","affiliation":[]}],"member":"1965","published-online":{"date-parts":[[2025,8,20]]},"reference":[{"key":"B1","article-title":"Musiclm: generating music from text","author":"Agostinelli","year":"2023","journal-title":"arXiv [preprint]"},{"key":"B2","author":"Armstrong","year":"2006","journal-title":"An Enactive Approach to Digital Musical Instrument Design"},{"key":"B3","volume-title":"Listen = [Ecoute] [Video recording]","year":"2003"},{"key":"B4","first-page":"1","article-title":"\u201cSuspended circles: soma designing a musical instrument,\u201d","volume-title":"Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems","author":"Bang","year":"2023"},{"key":"B5","doi-asserted-by":"publisher","first-page":"385","DOI":"10.1613\/jair.1491","article-title":"On prediction using variable order Markov models","volume":"22","author":"Begleiter","year":"2004","journal-title":"J. Artif. Intell. Res"},{"key":"B6","doi-asserted-by":"publisher","first-page":"253","DOI":"10.1080\/09298215.2011.602693","article-title":"Interacting with 3D reactive widgets for musical performance","volume":"40","author":"Berthaut","year":"2011","journal-title":"J. New Music Res"},{"key":"B7","article-title":"\u201cRaw music from free movements: early experiments in using machine learning to create raw audio from dance movements,\u201d","author":"Bisig","year":"2021","journal-title":"Proceedings of the 2nd AI Music Creativity Conference"},{"key":"B8","doi-asserted-by":"publisher","first-page":"981","DOI":"10.1007\/s00521-018-3813-6","article-title":"Deep learning for music generation: challenges and directions","volume":"32","author":"Briot","year":"2020","journal-title":"Neural Comput. Appl"},{"key":"B9","doi-asserted-by":"publisher","first-page":"17","DOI":"10.1080\/07494460802663991","article-title":"Interacting with generative music through live coding","volume":"28","author":"Brown","year":"2009","journal-title":"Contemp. Music Rev"},{"key":"B10","doi-asserted-by":"publisher","first-page":"139","DOI":"10.1080\/14794713.2016.1227596","article-title":"Understanding live coding events","volume":"12","author":"Burland","year":"2016","journal-title":"Int. J. Perform. Arts Digit. Media"},{"key":"B11","doi-asserted-by":"publisher","first-page":"215","DOI":"10.1080\/09298210903137641","article-title":"Supra-instrumental interactions and gestures","volume":"38","author":"Cadoz","year":"2009","journal-title":"J. New Music Res"},{"key":"B12","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2111.05011","article-title":"Rave: a variational autoencoder for fast and high-quality neural audio synthesis","author":"Caillon","year":"2021","journal-title":"arXiv"},{"key":"B13","doi-asserted-by":"publisher","first-page":"14","DOI":"10.1162\/lmj_a_01056","article-title":"Hyperreal instruments: bridging VR and digital fabrication to facilitate new forms of musical expression","volume":"29","author":"\u00c7amc\u0131","year":"2019","journal-title":"Leonardo Music J"},{"key":"B14","first-page":"459","article-title":"\u201cThe investment of play: expression and affordances in digital musical instrument design,\u201d","author":"Cannon","year":"2012","journal-title":"Proceedings of the International Computer Music Conference"},{"key":"B15","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/2687922","article-title":"Understanding gesture expressivity through muscle sensing","volume":"21","author":"Caramiaux","year":"2015","journal-title":"ACM Trans. Comput.-Hum. Interact"},{"key":"B16","doi-asserted-by":"publisher","first-page":"34","DOI":"10.1162\/COMJ_a_00255","article-title":"Mapping through listening","volume":"38","author":"Caramiaux","year":"2014","journal-title":"Comput. Music J"},{"key":"B17","doi-asserted-by":"publisher","first-page":"14","DOI":"10.3389\/frai.2020.00014","article-title":"Computational creativity and music generation systems: an introduction to the state of the art","volume":"3","author":"Carnovalini","year":"2020","journal-title":"Front. Artif. Intell"},{"key":"B18","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.1811.06633","article-title":"Generating albums with sampleRNN to imitate metal, rock, and punk bands","author":"Carr","year":"2018","journal-title":"arXiv"},{"key":"B19","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3537972.3537976","article-title":"\u201cPerformers' use of space and body in movement interaction with a movement-based digital musical instrument,\u201d","volume-title":"Proceedings of the 8th International Conference on Movement and Computing","author":"Cavdir","year":"2022"},{"key":"B20","doi-asserted-by":"publisher","first-page":"906","DOI":"10.3389\/fpsyg.2015.00906","article-title":"When music \u201cflows\u201d. state and trait in musical performance, composition and listening: a systematic review","volume":"6","author":"Chirico","year":"2015","journal-title":"Front. Psychol"},{"key":"B21","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2106.03037","article-title":"Rtneural: fast neural inferencing for real-time systems","author":"Chowdhury","year":"2021","journal-title":"arXiv"},{"key":"B22","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1109\/IJCNN48605.2020.9207666","article-title":"\u201cConditioning autoencoder latent spaces for real-time timbre interpolation and synthesis,\u201d","volume-title":"2020 International Joint Conference on Neural Networks (IJCNN)","author":"Colonel","year":"2020"},{"key":"B23","article-title":"\u201cSimple and controllable music generation,\u201d","author":"Copet","year":"2024","journal-title":"Advances in Neural Information Processing Systems 36"},{"key":"B24","doi-asserted-by":"crossref","DOI":"10.1145\/3658852.3659065","article-title":"\u201cSinging for the missing: bringing the body back to ai voice and speech technologies,\u201d","volume-title":"Proceedings of the 9th International Conference on Movement and Computing","author":"Cotton","year":"2024"},{"key":"B25","unstructured":"\u201cSounding out extra-normal AI voice: non-normative musical engagements with normative AI voice and speech technologies,\u201d\n          \n          \n            \n              Cotton\n              K.\n            \n            \n              Tatar\n              K.\n            \n          \n          Proceedings of the 5th AI Music Creativity Conference\n          \n          2024"},{"key":"B26","volume-title":"Beyond Boredom and Anxiety","author":"Csikszentmihalyi","year":"1975"},{"key":"B27","first-page":"201","article-title":"\u201cTriggering sounds from discrete air gestures: what movement feature has the best timing?\u201d","author":"Dahl","year":"2014","journal-title":"Proceedings of the International Conference on New Interfaces for Musical Expression"},{"key":"B28","first-page":"574","article-title":"\u201cA self-sensing haptic actuator for tactile interaction with physical modelling synthesis,\u201d","author":"Davison","year":"2024","journal-title":"Proceedings of the International Conference on New Interfaces for Musical Expression"},{"key":"B29","doi-asserted-by":"publisher","first-page":"57","DOI":"10.5753\/jis.2020.749","article-title":"Songverse: a digital musical instrument based on virtual reality","volume":"11","author":"de Lima Costa","year":"2020","journal-title":"J. Interact. Syst"},{"key":"B30","doi-asserted-by":"crossref","DOI":"10.1093\/acprof:oso\/9780195387650.001.0001","volume-title":"Listening Through the Noise: The Aesthetics of Experimental Electronic Music","author":"Demers","year":"2010"},{"key":"B31","article-title":"\u201cInteractive neural resonators,\u201d","author":"Diaz","year":"2023","journal-title":"Proceedings of the International Conference on New Interfaces for Musical Expression"},{"key":"B32","doi-asserted-by":"crossref","DOI":"10.7551\/mitpress\/7221.001.0001","volume-title":"Where the Action is: The Foundations of Embodied Interaction, volume 210","author":"Dourish","year":"2001"},{"key":"B33","article-title":"\u201cGansynth: adversarial neural audio synthesis,\u201d","author":"Engel","year":"2019","journal-title":"Proceedings of The Seventh International Conference on Learning Representations"},{"key":"B34","article-title":"\u201cDDSP: differentiable digital signal processing,\u201d","author":"Engel","year":"2020","journal-title":"Proceedings of The 8th International Conference on Learning Representations"},{"key":"B35","first-page":"321","article-title":"\u201cExploring musical agents with embodied perspectives,\u201d","volume-title":"International Seminar on Sonic Design","author":"Erdem","year":"2022"},{"key":"B36","first-page":"369","article-title":"\u201cGenerative timbre spaces: regularizing variational auto-encoders with perceptual metrics,\u201d","volume-title":"Proceedings of the 21st International Conference on Digital Audio Effects","author":"Esling","year":"2018"},{"key":"B37","doi-asserted-by":"publisher","first-page":"285","DOI":"10.1017\/S135577180600152X","article-title":"An enactive approach to the design of new tangible musical instruments","volume":"11","author":"Essl","year":"2006","journal-title":"Organised Sound"},{"key":"B38","doi-asserted-by":"publisher","first-page":"672","DOI":"10.1109\/JPROC.2004.825887","article-title":"Designing for intimacy: creating new interfaces for musical expression","volume":"92","author":"Fels","year":"2004","journal-title":"Proc. IEEE"},{"key":"B39","doi-asserted-by":"publisher","first-page":"513","DOI":"10.1613\/jair.3908","article-title":"AI methods in algorithmic composition: a comprehensive survey","volume":"48","author":"Fern\u00e1ndez Rodr\u00edguez","year":"2013","journal-title":"J. Artif. Intell. Res"},{"key":"B40","first-page":"2","article-title":"\u201cThe wekinator: a system for real-time, interactive machine learning in music,\u201d","volume-title":"Proceedings of The Eleventh International Society for Music Information Retrieval Conference, Vol. 3","author":"Fiebrink","year":"2010"},{"key":"B41","first-page":"237","article-title":"\u201cReflections on eight years of instrument creation with machine learning,\u201d","author":"Fiebrink","year":"2020","journal-title":"Proceedings of the International Conference on New Interfaces for Musical Expression"},{"key":"B42","doi-asserted-by":"publisher","first-page":"45","DOI":"10.2307\/3391092","article-title":"The museum of music: a history of mechanical instruments","volume":"54","author":"Fowler","year":"1967","journal-title":"Music Educ. J"},{"key":"B43","article-title":"\u201cWhat is generative art? Complexity theory as a context for art theory,\u201d","author":"Galanter","year":"2003","journal-title":"Proceedings of the 6th Generative Art Conference"},{"key":"B44","doi-asserted-by":"crossref","first-page":"113","DOI":"10.4324\/9781315621364-13","article-title":"\u201cPostures and motion shaping musical experience,\u201d","volume-title":"The Routledge Companion to Embodied Music Interaction","author":"God\u00f8y","year":"2017"},{"key":"B45","volume-title":"Deep Learning","author":"Goodfellow","year":"2016"},{"key":"B46","doi-asserted-by":"crossref","first-page":"695","DOI":"10.1145\/2559206.2578860","article-title":"\u201cAbba-dabba-ooga-booga-hoojee-goojee-yabba-dabba-doo: stupidity, ignorance & nonsense as tools for nurturing creative thinking,\u201d","volume-title":"CHI '14 Extended Abstracts on Human Factors in Computing Systems","author":"Grammenos","year":"2014"},{"key":"B47","doi-asserted-by":"publisher","first-page":"134","DOI":"10.1017\/S1355771811000082","article-title":"Agility and playfulness: technology and skill in the performance ecosystem","volume":"16","author":"Green","year":"2011","journal-title":"Organised Sound"},{"key":"B48","doi-asserted-by":"publisher","first-page":"236","DOI":"10.1109\/TASSP.1984.1164317","article-title":"Signal estimation from modified short-time Fourier transform","volume":"32","author":"Griffin","year":"1984","journal-title":"IEEE Trans. Acoust"},{"key":"B49","first-page":"315","article-title":"\u201cSkill in interactive digital music systems,\u201d","volume-title":"The Oxford Handbook of Interactive Audio","author":"Gurevich","year":"2014"},{"key":"B50","doi-asserted-by":"publisher","first-page":"166","DOI":"10.1017\/S1355771811000112","article-title":"Digital musical interactions: performer-system relationships and their perception by spectators","volume":"16","author":"Gurevich","year":"2011","journal-title":"Organised Sound"},{"key":"B51","doi-asserted-by":"publisher","first-page":"698","DOI":"10.3389\/fpsyg.2019.00698","article-title":"Flow and satisfaction with life in elite musicians and top athletes","volume":"10","author":"Habe","year":"2019","journal-title":"Front. Psychol"},{"key":"B52","article-title":"\u201cFast and flexible neural audio synthesis,\u201d","author":"Hantrakul","year":"2019","journal-title":"Proceedings of the 20th International Society for Music Information Retrieval Conference"},{"key":"B53","doi-asserted-by":"publisher","first-page":"1284100","DOI":"10.3389\/frsip.2023.1284100","article-title":"A review of differentiable digital signal processing for music and speech synthesis","volume":"3","author":"Hayes","year":"2024","journal-title":"Front. Signal Process"},{"key":"B54","doi-asserted-by":"crossref","first-page":"23","DOI":"10.4324\/9781003008217-4","article-title":"\u201cWhy should we care about the body?: On what enactive-ecological musical approaches have to offer,\u201d","volume-title":"The Body in Sound, Music and Performance","author":"Hayes","year":"2022"},{"key":"B55","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3108242","article-title":"A functional taxonomy of music generation systems","volume":"50","author":"Herremans","year":"2017","journal-title":"ACM Comput. Surv"},{"key":"B56","doi-asserted-by":"crossref","DOI":"10.7551\/mitpress\/11481.001.0001","volume-title":"Designing with the Body: Somaesthetic Interaction Design","author":"H\u00f6\u00f6k","year":"2018"},{"key":"B57","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3462448","article-title":"Unpacking non-dualistic design: the soma design case","volume":"28","author":"H\u00f6\u00f6k","year":"2021","journal-title":"ACM Trans. Comput.-Hum. Interact"},{"key":"B58","first-page":"33","article-title":"\u201cNeural audio processing on android phones,\u201d","author":"Hoopes","year":"2024","journal-title":"Proceedings of the 27th International Conference on Digital Audio Effects"},{"key":"B59","doi-asserted-by":"crossref","first-page":"27","DOI":"10.1145\/3131785.3131805","article-title":"\u201cHand development kit: soft robotic fingers as prosthetic augmentation of the hand,\u201d","volume-title":"Adjunct Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology","author":"Hu","year":"2017"},{"key":"B60","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.1811.09620","article-title":"\u201cTimbreTron: a WaveNet(CycleGAN(CQT(Audio))) pipeline for musical timbre transfer,\u201d","author":"Huang","year":"2019","journal-title":"Proceedings of The 7th International Conference on Learning Representations"},{"key":"B61","doi-asserted-by":"publisher","first-page":"103","DOI":"10.1017\/S1355771802002030","article-title":"Mapping performance parameters to synthesis engine","volume":"7","author":"Hunt","year":"2002","journal-title":"Organised Sound"},{"key":"B62","doi-asserted-by":"crossref","DOI":"10.2979\/3108.0","volume-title":"Technology and the Lifeworld: From Garden to Earth","author":"Ihde","year":"1990"},{"key":"B63","volume-title":"Listening and Voice: Phenomenologies of Sound","author":"Ihde","year":"2012"},{"key":"B64","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3544548.3581285","article-title":"\u201cDuorhythmo: design and remote user experience evaluation (UXE) of a collaborative accessible digital musical interface (CADMI) for people with ALS (PALS),\u201d","volume-title":"Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems","author":"Ivanyi","year":"2023"},{"key":"B65","first-page":"717","article-title":"\u201cMaintaining and constraining performer touch in the design of digital musical instruments,\u201d","volume-title":"Proceedings of the Eleventh International Conference on Tangible, Embedded, and Embodied Interaction","author":"Jack","year":""},{"key":"B66","first-page":"1","article-title":"\u201cRich gesture, reduced control: the influence of constrained mappings on performance technique,\u201d","volume-title":"Proceedings of the 4th International Conference on Movement Computing","author":"Jack","year":""},{"key":"B67","doi-asserted-by":"publisher","first-page":"133","DOI":"10.1123\/jsep.24.2.133","article-title":"Assessing flow in physical activity: the flow state scale-2 and dispositional flow scale-2","volume":"24","author":"Jackson","year":"2002","journal-title":"J. Sport Exerc. Psychol"},{"key":"B68","first-page":"451","article-title":"\u201cTo gesture or not? an analysis of terminology in NIME proceedings 2001-2013,\u201d","volume-title":"A NIME Reader: Fifteen Years of New Interfaces for Musical Expression","author":"Jensenius","year":"2014"},{"key":"B69","doi-asserted-by":"publisher","DOI":"10.7551\/mitpress\/14220.001.0001","author":"Jensenius","year":"2022","journal-title":"Sound Actions: Conceptualizing Musical Instruments"},{"key":"B70","first-page":"24","article-title":"\u201cMusical gestures: concepts and methods in research,\u201d","volume-title":"Musical Gestures","author":"Jensenius","year":"2010"},{"key":"B71","first-page":"59","article-title":"\u201cDigital instruments and players: part I\u2013efficiency and apprenticeship,\u201d","author":"Jord\u00e0","year":"2004","journal-title":"Proceedings of the International Conference on New interfaces for Musical Expression"},{"key":"B72","author":"Jord\u00e0","year":"2005","journal-title":"Digital Lutherie Crafting Musical Computers for New Musics' Performance and Improvisation"},{"key":"B73","article-title":"\u201cCulture and politics of machine learning in NIME: a preliminary qualitative inquiry,\u201d","author":"Jourdan","year":"2023","journal-title":"Proceedings of the International Conference on New Interfaces for Musical Expression"},{"key":"B74","doi-asserted-by":"publisher","first-page":"15","DOI":"10.1017\/S135577180700163X","article-title":"L'objet sonore maintenant: Pierre schaeffer, sound objects and the phenomenological reduction","volume":"12","author":"Kane","year":"2007","journal-title":"Organised Sound"},{"key":"B75","doi-asserted-by":"publisher","first-page":"471","DOI":"10.3389\/fpsyg.2014.00471","article-title":"Shifting the paradigm of music instruction: implications of embodiment stemming from an augmented reality guitar learning system","volume":"5","author":"Keebler","year":"2014","journal-title":"Front. Psychol"},{"key":"B76","doi-asserted-by":"publisher","first-page":"304","DOI":"10.1080\/07494467.2023.2277564","article-title":"Approaches for working with the body in the design of electronic music performance systems. Contemp","volume":"42","author":"Kirby","year":"2023","journal-title":"Music Rev"},{"key":"B77","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/2442106.2442109","article-title":"Embodied cognition and the magical future of interaction design","volume":"20","author":"Kirsh","year":"2013","journal-title":"ACM Trans. Comput.-Hum. Interact"},{"key":"B78","doi-asserted-by":"publisher","first-page":"42","DOI":"10.2307\/3680115","article-title":"A bioelectric controller for computer music applications","volume":"14","author":"Knapp","year":"1990","journal-title":"Comput. Music J"},{"key":"B79","article-title":"\u201cAudiogen: textually guided audio generation,\u201d","author":"Kreuk","year":"2023","journal-title":"Proceedings of the 11th International Conference on Learning Representations"},{"key":"B80","first-page":"12","article-title":"\u201cMelGAN: generative adversarial networks for conditional waveform synthesis,\u201d","volume-title":"Proceedings of the 33rd Conference on Neural Information Processing Systems (NeurIPS 2019)","author":"Kumar","year":"2019"},{"key":"B81","doi-asserted-by":"publisher","first-page":"789","DOI":"10.3389\/fpsyg.2014.00789","article-title":"Musicians are more consistent: gestural cross-modal mappings of pitch, loudness and tempo in real-time","volume":"5","author":"K\u00fcssner","year":"2014","journal-title":"Front. Psychol"},{"key":"B82","volume-title":"Science in Action: How to Follow Scientists and Engineers Through Society","author":"Latour","year":"1987"},{"key":"B83","doi-asserted-by":"publisher","first-page":"236","DOI":"10.18061\/emr.v9i3-4.4498","article-title":"The role of embodiment in the perception of music","volume":"9","author":"Leman","year":"2014","journal-title":"Empir. Musicol. Rev"},{"key":"B84","doi-asserted-by":"crossref","first-page":"346","DOI":"10.1007\/978-3-319-12976-1_22","article-title":"\u201cA virtual reality platform for musical creation: genesis-RT,\u201d","volume-title":"Sound, Music, and Motion: 10th International Symposium, CMMR 2013, Marseille, France, October 15-18, 2013. Revised Selected Papers 10","author":"Leonard","year":"2014"},{"key":"B85","doi-asserted-by":"crossref","first-page":"205","DOI":"10.1109\/VR.1999.756952","article-title":"\u201cHand-held windows: towards effective 2D interaction in immersive virtual environments,\u201d","volume-title":"Proceedings IEEE Virtual Reality (Cat. No. 99CB36316)","author":"Lindeman","year":"1999"},{"key":"B86","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2408.14340","article-title":"Foundation models for music: a survey","author":"Ma","year":"2024","journal-title":"arXiv"},{"key":"B87","doi-asserted-by":"publisher","first-page":"168","DOI":"10.1017\/S1355771809000272","article-title":"Of epistemic tools: musical instruments as cognitive extensions","volume":"14","author":"Magnusson","year":"2009","journal-title":"Organised Sound"},{"key":"B88","unstructured":"\u201cCreative elenctics: playing with intelligent instruments,\u201d\n          \n          \n            \n              Magnusson\n              T.\n            \n          \n          Invited Talk at the Computer Human Interaction and Music nEtwork (CHIME) Seminar Series\n          \n          2023"},{"key":"B89","doi-asserted-by":"publisher","DOI":"10.21428\/92fbeb44.aa7de712","article-title":"\u201cReflexions upon feedback,\u201d","author":"Magnusson","year":"2022","journal-title":"Proceedings of the International Conference on New Interfaces for Musical Expression"},{"key":"B90","first-page":"11","article-title":"\u201cExperiments with virtual reality instruments,\u201d","author":"M\u00e4ki-Patola","year":"2005","journal-title":"Proceedings of the 2005 Conference on New Interfaces for Musical Expression"},{"key":"B91","doi-asserted-by":"crossref","first-page":"438","DOI":"10.4324\/9781315621364-48","article-title":"\u201cEmbodied cognition and digital musical instruments: design and performance,\u201d","volume-title":"The Routledge Companion to Embodied Music Interaction","author":"Malloch","year":"2017"},{"key":"B92","doi-asserted-by":"publisher","first-page":"19","DOI":"10.1080\/09298215.2023.2274832","article-title":"The stretchy strap: supporting encumbered interaction with guitars","volume":"52","author":"Martinez Avila","year":"2023","journal-title":"J. New Music Res"},{"key":"B93","first-page":"489","article-title":"\u201cSoma design for NIME,\u201d","author":"Martinez Avila","year":"2020","journal-title":"Proceedings of the International Conference on New Interfaces for Musical Expression"},{"key":"B94","doi-asserted-by":"crossref","DOI":"10.1007\/978-3-319-33464-6_20","article-title":"\u201cBeatfield: an open-meaning audiovisual exploration,\u201d","volume-title":"COOP 2016: Proceedings of the 12th International Conference on the Design of Cooperative Systems, 23-27 May 2016, Trento, Italy","author":"Masu","year":"2016"},{"key":"B95","doi-asserted-by":"crossref","first-page":"29","DOI":"10.1007\/978-1-4471-2990-5_2","article-title":"\u201cShould music interaction be easy?\u201d","volume-title":"Music and Human-Computer Interaction","author":"McDermott","year":"2013"},{"key":"B96","doi-asserted-by":"publisher","first-page":"1153232","DOI":"10.3389\/fcomp.2023.1153232","article-title":"Designing accessible musical instruments by addressing musician-instrument relationships","volume":"5","author":"McMillan","year":"2023","journal-title":"Front. Comput. Sci"},{"key":"B97","doi-asserted-by":"publisher","DOI":"10.1121\/1.4987761","article-title":"Bela: an embedded platform for low-latency feedback control of sound","author":"McPherson","year":"2017","journal-title":"J. Acoust. Soc. Am"},{"key":"B98","first-page":"20","article-title":"\u201cAction-sound latency: are our tools fast enough?\u201d","volume-title":"Proceedings of the International Conference on New Interfaces for Musical Expression","author":"McPherson","year":"2016"},{"key":"B99","first-page":"162","article-title":"\u201cExposing the scaffolding of digital instruments with hardware-software feedback loops,\u201d","author":"McPherson","year":"2015","journal-title":"Proceedings of the International Conference on New Interfaces for Musical Expression"},{"key":"B100","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.1612.07837","article-title":"Samplernn: an unconditional end-to-end neural audio generation model","author":"Mehri","year":"2016","journal-title":"arXiv"},{"key":"B101","doi-asserted-by":"publisher","DOI":"10.4324\/9780203720714","author":"Merleau-Ponty","year":"2013","journal-title":"Phenomenology of Perception"},{"key":"B102","first-page":"577","article-title":"\u201cEmbodied cognition in performers of large acoustic instruments as a method of designing new large digital musical instruments,\u201d","volume-title":"Proceedings of the 14th International Symposium on Computer Music Modeling and Retrieval","author":"Mice","year":"2021"},{"key":"B103","doi-asserted-by":"publisher","first-page":"19","DOI":"10.2307\/3679834","article-title":"The dysfunctions of midi","volume":"12","author":"Moore","year":"1988","journal-title":"Comput. Music J"},{"key":"B104","first-page":"102","article-title":"\u201cMusical agents, agency, & AI: towards a phenomenological understanding,\u201d","author":"Moore","year":"2024","journal-title":"Proceedings of the International Computer Music Conference"},{"key":"B105","doi-asserted-by":"publisher","first-page":"899621","DOI":"10.3389\/fpsyg.2022.899621","article-title":"Development of flow state self-regulation skills and coping with musical performance anxiety: design and evaluation of an electronically implemented psychological program","volume":"13","author":"Moral-Bofill","year":"2022","journal-title":"Front. Psychol"},{"key":"B106","article-title":"\u201cNIME identity from the performer?s perspective,\u201d","author":"Morreale","year":"2018","journal-title":"Proceedings of the International Conference on New Interfaces for Musical Expression"},{"key":"B107","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3613904.3642171","article-title":"\u201cEntangling entanglement: a diffractive dialogue on hci and musical interactions,\u201d","volume-title":"Proceedings of the CHI Conference on Human Factors in Computing Systems","author":"Morrison","year":"2024"},{"key":"B108","author":"Nash","year":"2011","journal-title":"Supporting Virtuosity and Flow in Computer Music"},{"key":"B109","first-page":"351","article-title":"\u201cReal-time singing voice conversion plug-in,\u201d","author":"Nercessian","year":"2023","journal-title":"Proceedings of the 26th International Conference on Digital Audio Effects"},{"key":"B110","article-title":"\u201cIsochronous control+ audio streams for acoustic interfaces,\u201d","author":"Neupert","year":"2019","journal-title":"Proceedings of the 17th Linux Audio Conference"},{"key":"B111","first-page":"112","article-title":"\u201cLive coding practice,\u201d","volume-title":"Proceedings of the 7th International Conference on New Interfaces for Musical Expression","author":"Nick","year":"2007"},{"key":"B112","doi-asserted-by":"crossref","DOI":"10.1007\/978-3-211-75540-2","volume-title":"Algorithmic Composition: Paradigms of Automated Music Generation","author":"Nierhaus","year":"2009"},{"key":"B113","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3677045.3685499","article-title":"\u201cIllustrating, annotating & extending design qualities of slow technology,\u201d","volume-title":"Adjunct Proceedings of the 2024 Nordic Conference on Human-Computer Interaction, NordiCHI '24 Adjunct","author":"Odom","year":"2024"},{"key":"B114","author":"O'Modhrain","year":"2001","journal-title":"Playing by Feel: Incorporating Haptic Feedback into Computer-based Musical Instruments"},{"key":"B115","doi-asserted-by":"publisher","first-page":"28","DOI":"10.1162\/COMJ_a_00038","article-title":"A framework for the evaluation of digital musical instruments","volume":"35","author":"O'Modhrain","year":"2011","journal-title":"Comput. Music J"},{"key":"B116","doi-asserted-by":"crossref","first-page":"11","DOI":"10.1007\/978-3-319-58316-7_2","article-title":"\u201cOnce more, with feeling: revisiting the role of touch in performer-instrument interaction,\u201d","volume-title":"Musical Haptics","author":"O'Modhrain","year":"2018"},{"key":"B117","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.1609.03499","article-title":"Wavenet: a generative model for raw audio","author":"Oord","year":"","journal-title":"arXiv [Preprint]"},{"key":"B118","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.1606.05328","article-title":"Conditional image generation with PixelCNN decoders","author":"Oord","year":"","journal-title":"arXiv"},{"key":"B119","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.1711.10433","article-title":"Parallel WaveNet: fast high-fidelity speech synthesis","author":"Oord","year":"2017","journal-title":"arXiv"},{"key":"B120","first-page":"60","article-title":"\u201cLearning advanced skills on new instruments,\u201d","author":"Oore","year":"2005","journal-title":"Proceedings of the International Conference on New interfaces for Musical Expression"},{"key":"B121","doi-asserted-by":"crossref","DOI":"10.21428\/92fbeb44.76beab02","article-title":"\u201cEmbedded AI for NIME: challenges and opportunities,\u201d","volume-title":"Proceedings of the International Conference on New Interfaces for Musical Expression","author":"Pelinski","year":"2022"},{"key":"B122","first-page":"89","article-title":"\u201cSketiching magnetic interactions for neural synthesis,\u201d","author":"Privato","year":"2024","journal-title":"Proceedings of the International Conference on Technologies for Music Notation and Representation"},{"key":"B123","article-title":"\u201cThe magnetic score: somatosensory inscriptions and relational design in the instrument-score,\u201d","volume-title":"Proceedings of the International Conference on Technologies for Music Notation and Representation","author":"Privato","year":"2023"},{"key":"B124","doi-asserted-by":"publisher","DOI":"10.21428\/92fbeb44.b304e4b1","article-title":"\u201cExploring experiences with new musical instruments through micro-phenomenology,\u201d","author":"Reed","year":"2022","journal-title":"Proceedings of the International Conference on New Interfaces for Musical Expression"},{"key":"B125","first-page":"293","article-title":"\u201cTensions and techniques in live coding performance,\u201d","volume-title":"The Oxford Handbook of Algorithmic Music","author":"Roberts","year":"2018"},{"key":"B126","volume-title":"Artificial Intelligence: A Modern Approach","author":"Russell","year":"2010"},{"key":"B127","volume-title":"The Art of Noise. A Great Bear Pamphlet","author":"Russolo","year":"1913"},{"key":"B128","doi-asserted-by":"publisher","first-page":"3","DOI":"10.1080\/07494469100640021","article-title":"Some remarks on musical instrument design at steim","volume":"6","author":"Ryan","year":"1991","journal-title":"Contemp. Music Rev"},{"key":"B129","doi-asserted-by":"publisher","first-page":"73","DOI":"10.1007\/978-3-319-58316-7_5","article-title":"\u201cThe role of haptic cues in musical instrument quality perception,\u201d","author":"Saitis","year":"2018","journal-title":"Musical Haptics"},{"key":"B130","doi-asserted-by":"publisher","first-page":"129","DOI":"10.1080\/14794713.2016.1227603","article-title":"Cognitive load and live coding: a comparison with improvisation using traditional instruments","volume":"12","author":"Sayer","year":"2016","journal-title":"Int. J. Performance Arts Digit. Media"},{"key":"B131","author":"Schaeffer","year":"1964","journal-title":"Trait\u00e9 des Objets Musicaux"},{"key":"B132","volume-title":"The Tuning of the World","author":"Schafer","year":"1977"},{"key":"B133","doi-asserted-by":"publisher","first-page":"22","DOI":"10.1162\/COMJ_a_00372","article-title":"Virtual reality musical instruments: State of the art, design principles, and future directions","volume":"40","author":"Serafin","year":"2016","journal-title":"Comput. Music J"},{"key":"B134","first-page":"536","article-title":"\u201cTungna\u00e1: a hyper-realistic voice synthesis instrument for real-time exploration of extended vocal expressions,\u201d","author":"Shepardson","year":"2024","journal-title":"Proceedings of the International Conference on New Interfaces for Musical Expression"},{"key":"B135","article-title":"\u201cReal-time timbre remapping with differentiable DSP,\u201d","author":"Shier","year":"2024","journal-title":"Proceedings of the International Conference on New Interfaces for Musical Expression"},{"key":"B136","doi-asserted-by":"crossref","DOI":"10.1017\/CBO9780511802829","volume-title":"Body Consciousness: A Philosophy of Mindfulness and Somaesthetics","author":"Shusterman","year":"2008"},{"key":"B137","volume-title":"Introduction to Genetic Algorithms","author":"Sivanandam","year":"2007"},{"key":"B138","doi-asserted-by":"publisher","first-page":"107","DOI":"10.1017\/S1355771897009059","article-title":"Spectromorphology: explaining sound-shapes","volume":"2","author":"Smalley","year":"1997","journal-title":"Organised Sound"},{"key":"B139","unstructured":"\u201cREPETITION and DESIRE: echo, narcissus, AI and I,\u201d\n          \n          \n            \n              Sonami\n              L.\n            \n          \n          Seoul\n          Keynote at the International Computer Music Conference 2024\n          \n          2024"},{"key":"B140","volume-title":"Four Criteria of Electronic Music with Examples from Kontakte","author":"Stockhausen","year":"1972"},{"key":"B141","volume-title":"Plans and Situated Actions: The Problem of Human-Machine Communication","author":"Suchman","year":"1987"},{"key":"B142","first-page":"88","article-title":"\u201cMapping out instruments, affordances, and mobiles,\u201d","author":"Tanaka","year":"2010","journal-title":"Proceedings of the International Conference on New interfaces for Musical Expression"},{"key":"B143","doi-asserted-by":"crossref","DOI":"10.21428\/92fbeb44.7e04cfc8","article-title":"\u201cBodily awareness through NIMEs: deautomatising music making processes,\u201d","volume-title":"Proceedings of the International Conference on New Interfaces for Musical Expression","author":"Tapparo","year":"2022"},{"key":"B144","volume-title":"Musical Agents Based on Self-organizing Maps for Audio Applications","author":"Tatar","year":"2019"},{"key":"B145","doi-asserted-by":"publisher","first-page":"67","DOI":"10.1007\/s00521-020-05424-2","article-title":"Latent timbre synthesis","volume":"33","author":"Tatar","year":"2020","journal-title":"Neural Comput. Appl"},{"key":"B146","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2305.15571","article-title":"Sound design strategies for latent audio space explorations using deep learning architectures","author":"Tatar","year":"2023","journal-title":"arXiv"},{"key":"B147","doi-asserted-by":"publisher","first-page":"56","DOI":"10.1080\/09298215.2018.1511736","article-title":"Musical agents: a typology and state of the art towards Musical Metacreation","volume":"48","author":"Tatar","year":"2019","journal-title":"J. New Music Res"},{"key":"B148","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-93158-2","author":"Tomczak","year":"2022","journal-title":"Deep Generative Modeling"},{"key":"B149","first-page":"367","article-title":"\u201cDesigning DMIS with (in) a music culture: a participatory design process with the xamb\u00e1 quilombola community,\u201d","author":"Tragtenberg","year":"2024","journal-title":"Proceedings of the International Conference on New Interfaces for Musical Expression"},{"key":"B150","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2104.12922","article-title":"one billion audio sounds from GPU-enabled modular synthesis","author":"Turian","year":"2021","journal-title":"arXiv"},{"key":"B151","doi-asserted-by":"publisher","first-page":"137","DOI":"10.1080\/09298215.2011.614951","article-title":"Formulating a revised taxonomy for modes of listening","volume":"41","author":"Tuuri","year":"2012","journal-title":"J. New Music Res"},{"key":"B152","doi-asserted-by":"crossref","DOI":"10.7551\/mitpress\/9780262529365.001.0001","volume-title":"The Embodied Mind, Revised Edition: Cognitive Science and Human Experience","author":"Varela","year":"2017"},{"key":"B153","doi-asserted-by":"publisher","first-page":"11","DOI":"10.2307\/832385","article-title":"The liberation of sound","volume":"5","author":"Var\u00e8se","year":"1966","journal-title":"Perspect. New Music"},{"key":"B154","doi-asserted-by":"publisher","first-page":"11","DOI":"10.1162\/014892602320582945","article-title":"Problems and prospects for intimate musical control of computers","volume":"26","author":"Wessel","year":"2002","journal-title":"Comput. Music J"},{"key":"B155","volume-title":"An Introduction to MultiAgent Systems","author":"Wooldridge","year":"2009"},{"key":"B156","doi-asserted-by":"publisher","first-page":"766","DOI":"10.3390\/app10030766","article-title":"Real-time guitar amplifier emulation with deep learning","volume":"10","author":"Wright","year":"2020","journal-title":"Appl. Sci"},{"key":"B157","doi-asserted-by":"publisher","first-page":"292","DOI":"10.1177\/0305735611425903","article-title":"The experience of the flow state in live music performance","volume":"41","author":"Wrigley","year":"2013","journal-title":"Psychol. Music"},{"key":"B158","first-page":"324","article-title":"\u201cMidinet: a convolutional generative adversarial network for symbolic-domain music generation,\u201d","author":"Yang","year":"2019","journal-title":"Proceedings of the 18th International Society for Music Information Retrieval Conference"},{"key":"B159","doi-asserted-by":"crossref","first-page":"95","DOI":"10.1007\/978-3-319-58316-7_6","article-title":"\u201cA functional analysis of haptic feedback in digital musical instrument interactions,\u201d","volume-title":"Musical Haptics","author":"Young","year":"2018"},{"key":"B160","author":"Zamborlin","year":"2015","journal-title":"Studies on Customisation-driven Digital Music Instruments"},{"key":"B161","doi-asserted-by":"publisher","first-page":"26","DOI":"10.3389\/fict.2018.00026","article-title":"Hackable instruments: supporting appropriation and modification in digital musical interaction","volume":"5","author":"Zappi","year":"2018","journal-title":"Front. ICT"},{"key":"B162","first-page":"455","article-title":"\u201cDimensionality and appropriation in digital musical instrument design,\u201d","volume-title":"Proceedings of the International Conference on New Interfaces for Musical Expression, Vol. 14","author":"Zappi","year":"2014"},{"key":"B163","first-page":"818","article-title":"\u201cVisualizing and understanding convolutional networks,\u201d","volume-title":"Proceedings of the 13th European Conference on Computer Vision, Part I","author":"Zeiler","year":"2014"}],"container-title":["Frontiers in Computer Science"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fcomp.2025.1575168\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,8,20]],"date-time":"2025-08-20T05:35:27Z","timestamp":1755668127000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fcomp.2025.1575168\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,8,20]]},"references-count":163,"alternative-id":["10.3389\/fcomp.2025.1575168"],"URL":"https:\/\/doi.org\/10.3389\/fcomp.2025.1575168","relation":{},"ISSN":["2624-9898"],"issn-type":[{"value":"2624-9898","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,8,20]]},"article-number":"1575168"}}