{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,13]],"date-time":"2026-04-13T22:19:42Z","timestamp":1776118782402,"version":"3.50.1"},"reference-count":66,"publisher":"Association for Computing Machinery (ACM)","issue":"2","funder":[{"name":"FCT \u2013 Funda\u00e7\u00e3o para a Ci\u00eancia e a Tecnologia, I.P.","award":["UIDB\/00326\/2025 and UIDP\/00326\/2025"],"award-info":[{"award-number":["UIDB\/00326\/2025 and UIDP\/00326\/2025"]}]},{"name":"Portuguese Recovery and Resilience Plan","award":["C645008882-00000055"],"award-info":[{"award-number":["C645008882-00000055"]}]},{"name":"Funda\u00e7\u00e3o para a Ci\u00eancia e a Tecnologia (FCT), Portugal","award":["2021.07047.BD"],"award-info":[{"award-number":["2021.07047.BD"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Comput. Surv."],"published-print":{"date-parts":[[2026,1,31]]},"abstract":"<jats:p>In recent years, there has been a growing application of mixed-initiative co-creative approaches in the creation of video games. The rapid advances in the capabilities of artificial intelligence (AI) systems further propel creative collaboration between humans and computational agents. In this tutorial, we present guidelines for researchers and practitioners to develop game design tools with a high degree of mixed-initiative co-creativity (MI-CCy). We begin by reviewing a selection of current works that will serve as case studies and categorize them by the type of game content they address. We introduce the MI-CCy Quantifier, a framework that can be used by researchers and developers to assess co-creative tools on their level of MI-CCy through a visual scheme of quantifiable criteria scales. We demonstrate the usage of the MI-CCy Quantifier by applying it to the selected works. This analysis enabled us to discern prevalent patterns within these tools, as well as features that contribute to a higher level of MI-CCy. We highlight current gaps in MI-CCy approaches within game design, which we propose as pivotal aspects to tackle in the development of forthcoming approaches.<\/jats:p>","DOI":"10.1145\/3759914","type":"journal-article","created":{"date-parts":[[2025,8,14]],"date-time":"2025-08-14T11:40:35Z","timestamp":1755171635000},"page":"1-36","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":2,"title":["Boosting Mixed-Initiative Co-Creativity in Game Design: A Tutorial"],"prefix":"10.1145","volume":"58","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-8039-7188","authenticated-orcid":false,"given":"Solange","family":"Margarido","sequence":"first","affiliation":[{"name":"University of Coimbra, CISUC\/LASI, Department of Informatics Engineering","place":["Coimbra, Portugal"]}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6308-6484","authenticated-orcid":false,"given":"Penousal","family":"Machado","sequence":"additional","affiliation":[{"name":"University of Coimbra, CISUC\/LASI, Department of Informatics Engineering","place":["Coimbra, Portugal"]}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1911-2788","authenticated-orcid":false,"given":"Lic\u00ednio","family":"Roque","sequence":"additional","affiliation":[{"name":"University of Coimbra, CISUC\/LASI, Department of Informatics Engineering","place":["Coimbra, Portugal"]}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3630-7034","authenticated-orcid":false,"given":"Pedro","family":"Martins","sequence":"additional","affiliation":[{"name":"University of Coimbra, CISUC\/LASI, Department of Informatics Engineering","place":["Coimbra, Portugal"]}]}],"member":"320","published-online":{"date-parts":[[2025,9,8]]},"reference":[{"key":"e_1_3_2_2_2","doi-asserted-by":"publisher","DOI":"10.1145\/3235765.3235810"},{"key":"e_1_3_2_3_2","doi-asserted-by":"publisher","DOI":"10.1145\/3235765.3235815"},{"key":"e_1_3_2_4_2","doi-asserted-by":"publisher","DOI":"10.1109\/CIG.2019.8848022"},{"key":"e_1_3_2_5_2","doi-asserted-by":"publisher","DOI":"10.1145\/3555858.3555929"},{"key":"e_1_3_2_6_2","doi-asserted-by":"publisher","DOI":"10.1145\/3472538.3472544"},{"key":"e_1_3_2_7_2","doi-asserted-by":"publisher","DOI":"10.1109\/CIG.2017.8080411"},{"key":"e_1_3_2_8_2","doi-asserted-by":"publisher","DOI":"10.1145\/3102071.3110572"},{"key":"e_1_3_2_9_2","doi-asserted-by":"publisher","DOI":"10.1109\/CoG52621.2021.9619009"},{"key":"e_1_3_2_10_2","doi-asserted-by":"publisher","DOI":"10.4324\/9780203508527"},{"key":"e_1_3_2_11_2","unstructured":"Tom Brown Benjamin Mann Nick Ryder Melanie Subbiah Jared D Kaplan Prafulla Dhariwal Arvind Neelakantan Pranav Shyam Girish Sastry Amanda Askell Sandhini Agarwal Ariel Herbert-Voss Gretchen Krueger Tom Henighan Rewon Child Aditya Ramesh Daniel Ziegler Jeffrey Wu Clemens Winter Chris Hesse Mark Chen Eric Sigler Mateusz Litwin Scott Gray Benjamin Chess Jack Clark Christopher Berner Sam McCandlish Alec Radford Ilya Sutskever and Dario Amodei. 2020. Language Models are Few-Shot Learners. In Advances in Neural Information Processing Systems H. Larochelle M. Ranzato R. Hadsell M. F. Balcan and H. Lin (Eds.). Curran Associates Inc. 1877\u20131901. Retrieved from https:\/\/proceedings.neurips.cc\/paper_files\/paper\/2020\/file\/1457c0d6bfcb4967418bfb8ac142f64a-Paper.pd"},{"key":"e_1_3_2_12_2","doi-asserted-by":"publisher","DOI":"10.1145\/2501988.2502011"},{"key":"e_1_3_2_13_2","doi-asserted-by":"publisher","DOI":"10.1109\/CIG.2018.8490429"},{"key":"e_1_3_2_14_2","unstructured":"Jaime R. Carbonell. 1970. Mixed-initiative man-computer instructional dialogues. phdthesis. Massachusetts Institute of Technology."},{"key":"e_1_3_2_15_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2022.emnlp-main.460"},{"key":"e_1_3_2_16_2","doi-asserted-by":"publisher","unstructured":"M. Charity Isha Dave Ahmed Khalifa and Julian Togelius. 2024. Baba is Y\u2019all 2.0: Design and investigation of a collaborative mixed-initiative system. IEEE Transactions on Games 16 1 (March 2024) 75\u201389. DOI:10.1109\/TG.2022.3223527","DOI":"10.1109\/TG.2022.3223527"},{"key":"e_1_3_2_17_2","doi-asserted-by":"publisher","DOI":"10.1109\/CoG47356.2020.9231807"},{"key":"e_1_3_2_18_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.gmod.2024.101213"},{"key":"e_1_3_2_19_2","volume-title":"Proceedings of the 10th International Conference on the Foundations of Digital Games","author":"Dahlskog Steve","year":"2015","unstructured":"Steve Dahlskog, Staffan Bj\u00f6rk, and Julian Togelius. 2015. Patterns, dungeons and generators. In Proceedings of the 10th International Conference on the Foundations of Digital Games."},{"key":"e_1_3_2_20_2","volume-title":"Proceedings of the 9th Artificial Intelligence and Interactive Digital Entertainment Conference","author":"Davis Nicholas","year":"2013","unstructured":"Nicholas Davis. 2013. Human-computer co-creativity: Blending human and computational creativity. In Proceedings of the 9th Artificial Intelligence and Interactive Digital Entertainment Conference."},{"key":"e_1_3_2_21_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-72914-1_27"},{"key":"e_1_3_2_22_2","doi-asserted-by":"publisher","DOI":"10.1145\/3027063.3027072"},{"key":"e_1_3_2_23_2","doi-asserted-by":"publisher","DOI":"10.1145\/3641233.3664339"},{"key":"e_1_3_2_24_2","doi-asserted-by":"publisher","unstructured":"Roberto Gallotta Kai Arulkumaran and L. B. Soros. 2024. Preference-learning emitters for mixed-initiative quality-diversity algorithms. IEEE Transactions on Games 16 2 (June 2024) 303\u2013316. DOI:10.1109\/TG.2023.3264457","DOI":"10.1109\/TG.2023.3264457"},{"key":"e_1_3_2_25_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W17-3508"},{"key":"e_1_3_2_26_2","volume-title":"Proceeding of the 3rd Workshop on Human-AI Co-Creation with Generative Models (HAI-GEN \u201922) at ACM IUI Workshops","volume":"3124","author":"Grabe Imke","year":"2022","unstructured":"Imke Grabe, Miguel Gonz\u00e1lez-Duque, Sebastian Risi, and Jichen Zhu. 2022. Towards a framework for human-AI interaction patterns in co-creative GAN applications. In Proceeding of the 3rd Workshop on Human-AI Co-Creation with Generative Models (HAI-GEN \u201922) at ACM IUI Workshops, Vol. 3124."},{"key":"e_1_3_2_27_2","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300854"},{"key":"e_1_3_2_28_2","doi-asserted-by":"publisher","DOI":"10.1145\/2422956.2422957"},{"key":"e_1_3_2_29_2","volume-title":"Proceedings of the 7th International Conference on Computational Creativity","author":"Kantosalo Anna","year":"2016","unstructured":"Anna Kantosalo and Hannu Toivonen. 2016. Modes for creative human-computer collaboration: Alternating and task-divided co-creativity. In Proceedings of the 7th International Conference on Computational Creativity. Paris."},{"key":"e_1_3_2_30_2","volume-title":"Proceedings of the 10th International Conference on the Foundations of Digital Games","author":"Karavolos Daniel","year":"2015","unstructured":"Daniel Karavolos, Anders Bouwer, and Rafael Bidarra. 2015. Mixed-initiative design of game levels: integrating mission and space into level generation. In Proceedings of the 10th International Conference on the Foundations of Digital Games. Foundations of Digital Games. Retrieved from http:\/\/graphics.tudelft.nl\/Publications-new\/2015\/KBB15"},{"key":"e_1_3_2_31_2","doi-asserted-by":"publisher","DOI":"10.1145\/3377325.3377522"},{"key":"e_1_3_2_32_2","doi-asserted-by":"publisher","DOI":"10.1609\/aiide.v16i1.7417"},{"key":"e_1_3_2_33_2","doi-asserted-by":"publisher","DOI":"10.1609\/aiide.v18i1.21955"},{"key":"e_1_3_2_34_2","doi-asserted-by":"publisher","DOI":"10.1109\/TG.2022.3176215"},{"key":"e_1_3_2_35_2","doi-asserted-by":"publisher","DOI":"10.1145\/3555858.3563266"},{"key":"e_1_3_2_36_2","doi-asserted-by":"publisher","DOI":"10.1145\/3491102.3502030"},{"key":"e_1_3_2_37_2","doi-asserted-by":"publisher","unstructured":"Antonios Liapis Gillian Smith and Noor Shaker. 2016. Mixed-initiative content creation. In Procedural Content Generation in Games. Springer 195\u2013214. DOI:10.1007\/978-3-319-42716-4_11","DOI":"10.1007\/978-3-319-42716-4_11"},{"key":"e_1_3_2_38_2","doi-asserted-by":"publisher","DOI":"10.1109\/TCIAIG.2012.2192438"},{"key":"e_1_3_2_39_2","volume-title":"Proceedings of the 3rd International Conference on Computational Creativity","author":"Liapis Antonios","year":"2012","unstructured":"Antonios Liapis, Georgios N. Yannakakis, and Julian Togelius. 2012. Co-creating game content using an adaptive model of user taste. In Proceedings of the 3rd International Conference on Computational Creativity."},{"key":"e_1_3_2_40_2","volume-title":"Proceedings of the 8th International Conference on the Foundations of Digital Games","author":"Liapis Antonios","year":"2013","unstructured":"Antonios Liapis, Georgios N. Yannakakis, and Julian Togelius. 2013. Sentient sketchbook : Computer-assisted game level authoring. In Proceedings of the 8th International Conference on the Foundations of Digital Games. Foundations of Digital Games, Chania."},{"key":"e_1_3_2_41_2","doi-asserted-by":"publisher","DOI":"10.1609\/aiide.v18i1.21946"},{"key":"e_1_3_2_42_2","first-page":"334","volume-title":"Proceedings of the 11th International Conference on Computational Creativity","author":"Llano Maria Teresa","year":"2020","unstructured":"Maria Teresa Llano, Mark D\u2019Inverno, Matthew Yee-King, Jon McCormack, Alon Ilsar, Alison Pease, and Simon Colton. 2020. Explainable computational creativity. In Proceedings of the 11th International Conference on Computational Creativity. 334\u2013341."},{"key":"e_1_3_2_43_2","doi-asserted-by":"publisher","DOI":"10.1109\/CIG.2019.8848081"},{"key":"e_1_3_2_44_2","doi-asserted-by":"publisher","DOI":"10.1609\/aiide.v15i1.5240"},{"key":"e_1_3_2_45_2","doi-asserted-by":"publisher","DOI":"10.1109\/CoG51982.2022.9893636"},{"key":"e_1_3_2_46_2","doi-asserted-by":"publisher","DOI":"10.1609\/aiide.v14i1.13042"},{"key":"e_1_3_2_47_2","volume-title":"Proceedings of the Workshop The Future of Co-Creative Systems - A Workshop on Human-Computer Co-Creativity of the 11th International Conference on Computational Creativity","author":"Muller Michael","year":"2020","unstructured":"Michael Muller, Justin D. Weisz, and Werner Geyer. 2020. Mixed initiative generative AI interfaces: An analytic framework for generative AI applications. In Proceedings of the Workshop The Future of Co-Creative Systems - A Workshop on Human-Computer Co-Creativity of the 11th International Conference on Computational Creativity."},{"key":"e_1_3_2_48_2","volume-title":"Proceedings of the CHI\u201917 Workshop on Mixed-Initiative Creative Interfaces","author":"Nelson Mark J.","year":"2017","unstructured":"Mark J. Nelson, Simon Colton, Edward J. Powley, Swen E. Gaudl, Peter Ivey, Rob Saunders, Blanca P\u00e9rez Ferrer, and Michael Cook. 2017. Mixed-initiative approaches to on-device mobile game design. In Proceedings of the CHI\u201917 Workshop on Mixed-Initiative Creative Interfaces. Retrieved from http:\/\/repository.falmouth.ac.uk\/id\/eprint\/2568"},{"key":"e_1_3_2_49_2","doi-asserted-by":"publisher","DOI":"10.1145\/3555858.3555896"},{"key":"e_1_3_2_50_2","first-page":"444","volume-title":"Proceedings of the 12th International Conference on Computational Creativity","author":"Rezwana Jeba","year":"2021","unstructured":"Jeba Rezwana and Mary Lou Maher. 2021. COFI: A framework for modeling interaction in human-AI co-creative systems. In Proceedings of the 12th International Conference on Computational Creativity. 444\u2013448."},{"key":"e_1_3_2_51_2","doi-asserted-by":"publisher","DOI":"10.1145\/3519026"},{"key":"e_1_3_2_52_2","doi-asserted-by":"publisher","DOI":"10.1145\/3641520.3665303"},{"key":"e_1_3_2_53_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-48279-8_34"},{"key":"e_1_3_2_54_2","doi-asserted-by":"publisher","DOI":"10.1201\/9780080919171"},{"key":"e_1_3_2_55_2","doi-asserted-by":"publisher","DOI":"10.1609\/aiide.v9i1.12690"},{"key":"e_1_3_2_56_2","doi-asserted-by":"publisher","DOI":"10.1609\/aiide.v9i1.12611"},{"key":"e_1_3_2_57_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-42716-4"},{"key":"e_1_3_2_58_2","doi-asserted-by":"publisher","DOI":"10.1145\/1822348.1822376"},{"key":"e_1_3_2_59_2","doi-asserted-by":"publisher","DOI":"10.1109\/TCIAIG.2011.2159716"},{"key":"e_1_3_2_60_2","unstructured":"Angie Spoto and Natalia Oleynik. 2017. Library of Mixed-Initiative Creative Interfaces. Retrieved from http:\/\/mici.codingconduct.cc\/"},{"key":"e_1_3_2_61_2","doi-asserted-by":"publisher","DOI":"10.1609\/aiide.v14i1.13046"},{"key":"e_1_3_2_62_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-031-22298-6_42"},{"key":"e_1_3_2_63_2","doi-asserted-by":"publisher","DOI":"10.1145\/3628454.3628457"},{"key":"e_1_3_2_64_2","doi-asserted-by":"publisher","DOI":"10.1109\/TG.2021.3086215"},{"key":"e_1_3_2_65_2","volume-title":"Proceedings of the 9th International Conference on the Foundations of Digital Games","author":"Yannakakis Georgios N.","year":"2014","unstructured":"Georgios N. Yannakakis, Antonios Liapis, and Constantine Alexopoulos. 2014. Mixed-initiative co-creativity. In Proceedings of the 9th International Conference on the Foundations of Digital Games. Foundations of Digital Games. https:\/\/www.um.edu.mt\/library\/oar\/handle\/123456789\/29459"},{"key":"e_1_3_2_66_2","doi-asserted-by":"publisher","DOI":"10.1145\/3490099.3511105"},{"key":"e_1_3_2_67_2","doi-asserted-by":"publisher","DOI":"10.1109\/CIG.2018.8490433"}],"container-title":["ACM Computing Surveys"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3759914","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,9,18]],"date-time":"2025-09-18T12:35:32Z","timestamp":1758198932000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3759914"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,9,8]]},"references-count":66,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2026,1,31]]}},"alternative-id":["10.1145\/3759914"],"URL":"https:\/\/doi.org\/10.1145\/3759914","relation":{},"ISSN":["0360-0300","1557-7341"],"issn-type":[{"value":"0360-0300","type":"print"},{"value":"1557-7341","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,9,8]]},"assertion":[{"value":"2023-12-30","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-07-21","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-09-08","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}