{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T04:19:54Z","timestamp":1750220394972,"version":"3.41.0"},"reference-count":69,"publisher":"Association for Computing Machinery (ACM)","issue":"CHI PLAY","license":[{"start":{"date-parts":[[2021,10,5]],"date-time":"2021-10-05T00:00:00Z","timestamp":1633392000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Hum.-Comput. Interact."],"published-print":{"date-parts":[[2021,10,5]]},"abstract":"<jats:p>The concept of gamified interactive models and its novel extensions, such as playification, has been widely approached in order to engage users in many fields. In fields such as HCI and AI, however, these approaches were not yet employed for supporting users to create different forms of artworks, like a musical corpus. While allowing novel forms of interactivity with partially-autonomous systems, these techniques could also foster the emergence of artworks not limited to experts. Hence, in this paper we introduce the concept of meta-interactivity for compositional interfaces, which extends an individual's capabilities by the translation of an effort into a proficiency. We present how this approach can be effective through a novel system that enables non-experts to compose coherent musical pieces through the use of imagetic elements in a virtual environment. We conduct experiments with a population of musical experts and non-experts, showing that non-experts were able to learn and create high-quality musical productions through our interactive approach.<\/jats:p>","DOI":"10.1145\/3474689","type":"journal-article","created":{"date-parts":[[2021,10,6]],"date-time":"2021-10-06T22:59:48Z","timestamp":1633561188000},"page":"1-32","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":3,"title":["A Meta-interactive Compositional Approach that Fosters Musical Emergence through Ludic Expressivity"],"prefix":"10.1145","volume":"5","author":[{"given":"M\u00e1rio","family":"Escarce Junior","sequence":"first","affiliation":[{"name":"Lancaster University, Lancaster, United Kingdom"}]},{"given":"Georgia","family":"Rossmann Martins","sequence":"additional","affiliation":[{"name":"Phersu Interactive, Belo Horizonte, Brazil"}]},{"given":"Leandro","family":"Soriano Marcolino","sequence":"additional","affiliation":[{"name":"Lancaster University, Lancaster, United Kingdom"}]},{"given":"Elisa","family":"Rubegni","sequence":"additional","affiliation":[{"name":"Lancaster University, Lancaster, United Kingdom"}]}],"member":"320","published-online":{"date-parts":[[2021,10,6]]},"reference":[{"key":"e_1_2_1_1_1","first-page":"1","article-title":"Music composition using recurrent neural networks. CS 224n","volume":"1","author":"Agarwala Nipun","year":"2017","unstructured":"Nipun Agarwala, Yuki Inoue, and Axel Sly. 2017. Music composition using recurrent neural networks. CS 224n: Natural Language Processing with Deep Learning, Spring , Vol. 1 (2017), 1--10.","journal-title":"Natural Language Processing with Deep Learning"},{"volume-title":"The Harvard dictionary of music","author":"Apel Willi","key":"e_1_2_1_2_1","unstructured":"Willi Apel. 2003. The Harvard dictionary of music . Vol. 16. Harvard University Press, Harvard University."},{"key":"e_1_2_1_3_1","volume-title":"TEDxStanford Conferences.","author":"Applebaum Mark","year":"2012","unstructured":"Mark Applebaum. 2012. The mad scientist of music. TEDxStanford Conferences."},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1109\/SIVE.2014.7006285"},{"key":"e_1_2_1_5_1","unstructured":"BitFinity. 2016. Tadpole Treble."},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1109\/3DUI.2015.7131769"},{"key":"e_1_2_1_7_1","volume-title":"Performing Structured Improvisations with pre-trained Deep Learning Models. arXiv preprint arXiv:1904.13285","author":"Castro Pablo Samuel","year":"2019","unstructured":"Pablo Samuel Castro. 2019. Performing Structured Improvisations with pre-trained Deep Learning Models. arXiv preprint arXiv:1904.13285 (2019), 7."},{"key":"e_1_2_1_8_1","volume-title":"Flow: The Psychology of Optimal Experience","author":"Csikszentmihalyi Mihaly","year":"1990","unstructured":"Mihaly Csikszentmihalyi. 1990. Flow: The Psychology of Optimal Experience .Harper & Row, USA."},{"key":"e_1_2_1_9_1","first-page":"10","article-title":"Kandinsky Compositions","volume":"5","author":"Dabrowski Magdalena","year":"1995","unstructured":"Magdalena Dabrowski. 1995. Kandinsky Compositions: The Music of the Spheres. MoMA , Vol. 5, 4 (1995), 10--13. http:\/\/www.jstor.org\/stable\/4381285","journal-title":"The Music of the Spheres. MoMA"},{"key":"e_1_2_1_10_1","unstructured":"Didier Dambrin. 1997. FLStudio."},{"volume-title":"Proceedings of the 21st International Conference on Intelligent User Interfaces. Association for Computing Machinery, Sonoma, California - USA.","author":"Davis N.","key":"e_1_2_1_11_1","unstructured":"N. Davis, C.-Pi. Hsiao, K. Yashraj Singh, L. Li, and B. Magerko. 2016. Empirically Studying Participatory Sense-Making in Abstract Drawing with a Co-Creative Cognitive Agent. In Proceedings of the 21st International Conference on Intelligent User Interfaces. Association for Computing Machinery, Sonoma, California - USA."},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/2181037.2181040"},{"key":"e_1_2_1_13_1","article-title":"Gamification in education: A systematic mapping study","volume":"18","author":"Dicheva Darina","year":"2015","unstructured":"Darina Dicheva, Christo Dichev, Gennady Agre, and Galia Angelova. 2015. Gamification in education: A systematic mapping study. Journal of Educational Technology & Society , Vol. 18, 3 (2015).","journal-title":"Journal of Educational Technology & Society"},{"key":"e_1_2_1_14_1","volume-title":"Proceedings of the 24th International Joint Conference on Artificial Intelligence. IJCAI 15","author":"Inverno Mark","year":"2015","unstructured":"Mark d'Inverno and Jon McCormack. 2015. Heroic versus Collaborative AI for the Arts. In Proceedings of the 24th International Joint Conference on Artificial Intelligence. IJCAI 15, Buenos Aires, Argentina."},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-20684-4_41"},{"key":"e_1_2_1_16_1","first-page":"663","article-title":"Systems and methods for simulating a rock band experience","volume":"8","author":"Egozy Eran B","year":"2014","unstructured":"Eran B Egozy, Daniel Teasdale, Brian Thomas Stephens, Daniel Schmidt, John R Eskew, Rafael Baptista, and Kasson Crooker. 2014. Systems and methods for simulating a rock band experience. US Patent 8,663,013.","journal-title":"US Patent"},{"key":"e_1_2_1_17_1","volume-title":"Audio Culture. Readings in Modern Music","volume":"9497","author":"Eno Brian","year":"2004","unstructured":"Brian Eno. 2004. Ambient music. Audio Culture. Readings in Modern Music , Vol. 9497 (2004)."},{"key":"e_1_2_1_18_1","unstructured":"Andromeda Entertainment. 2020. SoundSelf: A Technodelic."},{"key":"e_1_2_1_19_1","unstructured":"Peter Gotcher Evan Brooks. 1991. Pro Tools."},{"volume-title":"Real-time human interaction with supervised learning algorithms for music composition and performance .Citeseer","author":"Fiebrink Rebecca Anne","key":"e_1_2_1_20_1","unstructured":"Rebecca Anne Fiebrink. 2011. Real-time human interaction with supervised learning algorithms for music composition and performance .Citeseer, Princeton University, New Jersey, United States."},{"volume-title":"CHI 04 -- Extended Abstracts on Human Factors in Computing Systems. ACM","author":"Gaver William W","key":"e_1_2_1_21_1","unstructured":"William W Gaver, John Bowers, Andrew Boucher, Hans Gellerson, Sarah Pennington, Albrecht Schmidt, Anthony Steed, Nicholas Villars, and Brendan Walker. 2004. The drift table: designing for ludic engagement. In CHI 04 -- Extended Abstracts on Human Factors in Computing Systems. ACM, New York, NY, United States, 885--900."},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.2196\/12994"},{"key":"e_1_2_1_23_1","volume-title":"Proceedings of the 16th Sound and Music Computing Conference. SMC2019","author":"Gibson Darrell","year":"2019","unstructured":"Darrell Gibson and Richard Polfreman. 2019. A framework for the development and evaluation of graphical interpolation for synthesizer parameter mappings. In Proceedings of the 16th Sound and Music Computing Conference. SMC2019, Nottingham, United Kingdom, 8."},{"key":"e_1_2_1_24_1","unstructured":"Google. 2016. Chrome Music Lab."},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1109\/HICSS.2014.377"},{"key":"e_1_2_1_26_1","unstructured":"Harmonix. 2007. Rockband."},{"volume-title":"Music and human-computer interaction","author":"Holland Simon","key":"e_1_2_1_27_1","unstructured":"Simon Holland, Katie Wilkie, Paul Mulholland, and Allan Seago. 2013. Music interaction: understanding music and human-computer interaction. In Music and human-computer interaction . Springer, London, UK, 1--28."},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1162\/COMJ_a_00269"},{"key":"e_1_2_1_29_1","volume-title":"Deep Learning for Music. ArXiv","author":"Huang Allen","year":"2016","unstructured":"Allen Huang and Raymond Wu. 2016. Deep Learning for Music. ArXiv , Vol. abs\/1606.04930 (2016), 8."},{"key":"e_1_2_1_30_1","volume-title":"Mapping strategies for musical performance. Trends in gestural control of music","author":"Hunt Andy","year":"2000","unstructured":"Andy Hunt and Ross Kirk. 2000. Mapping strategies for musical performance. Trends in gestural control of music , Vol. 21, 2000 (2000), 231--258."},{"key":"e_1_2_1_31_1","unstructured":"T. Iwai. 2005. Electroplankton."},{"key":"e_1_2_1_32_1","volume-title":"Proceedings of the Sixth International Conference on Computational Creativity . ICCC","author":"Jacob Mikhail","year":"2015","unstructured":"Mikhail Jacob and Brian Magerko. 2015. Interaction-based Authoring for Scalable Co-creative Agent. In Proceedings of the Sixth International Conference on Computational Creativity . ICCC, Utah, USA, 236--246."},{"key":"e_1_2_1_33_1","volume-title":"In Proceedings of the International Conference on Computer Music -- ICMC . Association for Computing Machinery -- ACM","author":"Jord\u00e0 Sergi","year":"2005","unstructured":"Sergi Jord\u00e0, Martin Kaltenbrunner, G\u00fcnter Geiger, and Ross Bencina. 2005. The reacTable. In In Proceedings of the International Conference on Computer Music -- ICMC . Association for Computing Machinery -- ACM, New York, NY, United States."},{"key":"e_1_2_1_34_1","volume-title":"Proceedings of the Thirteenth AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment) . AAAI, Snowbird, Little Cottonwood Canyon","author":"Escarce Junior M\u00e1","year":"2017","unstructured":"M\u00e1 rio Escarce Junior, Georgia Rossmann Martins, Leandro Soriano Marcolino, and Yuri Tavares dos Passos. 2017. Emerging Sounds Through Implicit Cooperation: A Novel Model for Dynamic Music Generation. In Proceedings of the Thirteenth AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment) . AAAI, Snowbird, Little Cottonwood Canyon, Utah, USA, 186--192. https:\/\/aaai.org\/ocs\/index.php\/AIIDE\/AIIDE17\/paper\/view\/15887"},{"key":"e_1_2_1_35_1","unstructured":"Samantha Kalman. 2014. Sentris."},{"key":"e_1_2_1_36_1","volume-title":"Key","author":"Kanaga David","year":"2013","unstructured":"David Kanaga and Ed Key. 2013. Proteus."},{"volume-title":"Signal processing methods for music transcription","author":"Klapuri Anssi","key":"e_1_2_1_37_1","unstructured":"Anssi Klapuri and Manuel Davy. 2007. Signal processing methods for music transcription .Springer-Verlag US, United States. 440 pages."},{"key":"e_1_2_1_38_1","unstructured":"Hiroyuki Kotani. 2007. Patapon."},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/2590973"},{"key":"e_1_2_1_40_1","volume-title":"Proceedings of the 2005 conference on New interfaces for musical expression. New Interfaces for Musical Expression (NIME05)","author":"Patola Teemu","year":"2005","unstructured":"Teemu M\"aki-Patola, Juha Laitinen, Aki Kanerva, and Tapio Takala. 2005. Experiments with virtual reality instruments. In Proceedings of the 2005 conference on New interfaces for musical expression. New Interfaces for Musical Expression (NIME05), Vancouver, BC, Canada, 11--16."},{"volume-title":"Music cultures of the Pacific, the Near East, and Asia","author":"Malm William P","key":"e_1_2_1_41_1","unstructured":"William P Malm. 1996. Music cultures of the Pacific, the Near East, and Asia. Vol. 2. Pearson College Division, New Jersey, USA."},{"key":"e_1_2_1_42_1","volume-title":"Proceedings of the 2016 annual symposium on computer-human interaction in play. Association for Computing Machinery -- ACM","author":"Segura Elena M\u00e1rquez","year":"2016","unstructured":"Elena M\u00e1rquez Segura, Annika Waern, Luis M\u00e1rquez Segura, and David L\u00f3pez Recio. 2016. Playification: the physeear case. In Proceedings of the 2016 annual symposium on computer-human interaction in play. Association for Computing Machinery -- ACM, New York, NY, United States, 376--388."},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v30i1.9834"},{"key":"e_1_2_1_44_1","unstructured":"Masaya Matsuura. 1999. Vib Ribbon."},{"key":"e_1_2_1_45_1","first-page":"19","article-title":"The Bulletin of Historical Research in Music Education. www.jstor.org\/stable\/40214882","volume":"20","author":"McAnally J. Kent","year":"1995","unstructured":"J. Kent McAnally. 1995. The Bulletin of Historical Research in Music Education. www.jstor.org\/stable\/40214882 . SAGE Publishing , Vol. 20, 13 (1995), 19--58.","journal-title":"SAGE Publishing"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.2307\/3333144"},{"key":"e_1_2_1_48_1","unstructured":"Shigeru Miyamoto. 1983. Mario Bros."},{"key":"e_1_2_1_49_1","unstructured":"Tetsuya Mizuguchi. 2001. Rez."},{"key":"e_1_2_1_50_1","unstructured":"Tetsuya Mizuguchi. 2011. Child of Eden."},{"key":"e_1_2_1_51_1","volume-title":"Proceedings of the 14th International Society for Music Information Retrieval Conference . ISMIR","author":"Moreira Julian","year":"2013","unstructured":"Julian Moreira, Pierre Roy, and Fran\u00c3\u00a7ois Pachet. 2013. Virtualband: Interacting with Styslistically Consistent Agents. In Proceedings of the 14th International Society for Music Information Retrieval Conference . ISMIR, Curitiba, Brazil."},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1145\/2470654.2481303"},{"volume-title":"Making sense: cognition, computing, art, and embodiment","author":"Penny Simon","key":"e_1_2_1_53_1","unstructured":"Simon Penny. 2017. Making sense: cognition, computing, art, and embodiment .MIT Press, USA. 498 pages."},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.7557\/23.5964"},{"key":"e_1_2_1_55_1","volume-title":"Proceedings of the Thirtieth Annual Conference on Neural Information Processing Systems. NIPS","author":"Roberts Adam","year":"2017","unstructured":"Adam Roberts, Jesse Engel, Curtis Hawthorne, Ian Simon, Elliot Waite, Sageev Oore, Natasha Jaques, Cinjon Resnick, and Douglas Eck. 2017. Interactive musical improvisation with Magenta . In Proceedings of the Thirtieth Annual Conference on Neural Information Processing Systems. NIPS, Barcelona, Spain. (Demonstration)."},{"volume-title":"The physics and psychophysics of music: An introduction","author":"Roederer Juan G","key":"e_1_2_1_56_1","unstructured":"Juan G Roederer. 2008. The physics and psychophysics of music: An introduction .Springer Science & Business Media, University of Alaska, Fairbanks, AK, USA."},{"key":"e_1_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.1145\/3311350.3347158"},{"key":"e_1_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.1145\/3410404.3414246"},{"key":"e_1_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.1162\/COMJ_a_00372"},{"volume-title":"Play matters","author":"Sicart Miguel","key":"e_1_2_1_60_1","unstructured":"Miguel Sicart. 2014. Play matters .MIT Press, London, England."},{"key":"e_1_2_1_61_1","unstructured":"Inc. Survious. 2018. Survios."},{"key":"e_1_2_1_62_1","unstructured":"Harmonix Music Systems. 2005. Guitar Hero."},{"key":"e_1_2_1_63_1","unstructured":"Phosfiend Systems. 2014. Fract OSC."},{"key":"e_1_2_1_64_1","doi-asserted-by":"publisher","DOI":"10.1017\/S1355771819000475"},{"volume-title":"Music and probability","author":"Temperley David","key":"e_1_2_1_65_1","unstructured":"David Temperley. 2007. Music and probability .MIT Press, USA."},{"key":"e_1_2_1_66_1","unstructured":"Ubisoft. 2011. Rocksmith."},{"key":"e_1_2_1_67_1","unstructured":"Jan Ilavsky Vladimir Hrincar. 2018. Beat Saber."},{"key":"e_1_2_1_68_1","doi-asserted-by":"publisher","DOI":"10.4000\/rccs.6276"},{"key":"e_1_2_1_69_1","volume-title":"Metacreation: Art and Artificial Life","author":"Whitelaw Mitchell","year":"2004","unstructured":"Mitchell Whitelaw. 2004. Metacreation: Art and Artificial Life .MIT Press, USA. 296 pages."},{"key":"e_1_2_1_70_1","doi-asserted-by":"publisher","DOI":"10.1145\/3311350.3347152"}],"container-title":["Proceedings of the ACM on Human-Computer Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3474689","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3474689","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T20:18:42Z","timestamp":1750191522000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3474689"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,10,5]]},"references-count":69,"journal-issue":{"issue":"CHI PLAY","published-print":{"date-parts":[[2021,10,5]]}},"alternative-id":["10.1145\/3474689"],"URL":"https:\/\/doi.org\/10.1145\/3474689","relation":{},"ISSN":["2573-0142"],"issn-type":[{"type":"electronic","value":"2573-0142"}],"subject":[],"published":{"date-parts":[[2021,10,5]]},"assertion":[{"value":"2021-10-06","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}