{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,20]],"date-time":"2026-04-20T10:43:47Z","timestamp":1776681827628,"version":"3.51.2"},"publisher-location":"New York, NY, USA","reference-count":43,"publisher":"ACM","license":[{"start":{"date-parts":[[2021,8,3]],"date-time":"2021-08-03T00:00:00Z","timestamp":1627948800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2021,8,3]]},"DOI":"10.1145\/3472538.3472573","type":"proceedings-article","created":{"date-parts":[[2021,10,21]],"date-time":"2021-10-21T22:48:54Z","timestamp":1634856534000},"page":"1-12","source":"Crossref","is-referenced-by-count":12,"title":["Design-Driven Requirements for Computationally Co-Creative Game AI Design Tools"],"prefix":"10.1145","author":[{"given":"Nathan","family":"Partlan","sequence":"first","affiliation":[{"name":"Northeastern University, United States"}]},{"given":"Erica","family":"Kleinman","sequence":"additional","affiliation":[{"name":"University of California, Santa Cruz, United States"}]},{"given":"Jim","family":"Howe","sequence":"additional","affiliation":[{"name":"Northeastern University, United States"}]},{"given":"Sabbir","family":"Ahmad","sequence":"additional","affiliation":[{"name":"Northeastern University, United States"}]},{"given":"Stacy","family":"Marsella","sequence":"additional","affiliation":[{"name":"Northeastern University, United States"}]},{"given":"Magy","family":"Seif El-Nasr","sequence":"additional","affiliation":[{"name":"University of California, Santa Cruz, United States"}]}],"member":"320","published-online":{"date-parts":[[2021,10,21]]},"reference":[{"key":"e_1_3_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3174156"},{"key":"e_1_3_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/3235765.3235815"},{"key":"e_1_3_2_1_3_1","volume-title":"Applications of Evolutionary Computation(Lecture Notes in Computer Science), Pedro\u00a0A","author":"Alvarez Alberto","unstructured":"Alberto Alvarez and Jose Font . 2020. Learning the Designer\u2019s Preferences to Drive Evolution . In Applications of Evolutionary Computation(Lecture Notes in Computer Science), Pedro\u00a0A . Castillo, Juan\u00a0Luis Jim\u00e9nez\u00a0Laredo, and Francisco Fern\u00e1ndez\u00a0de Vega (Eds.). Springer International Publishing , Cham , 431\u2013445. https:\/\/doi.org\/10.1007\/978-3-030-43722-0_28 Alberto Alvarez and Jose Font. 2020. Learning the Designer\u2019s Preferences to Drive Evolution. In Applications of Evolutionary Computation(Lecture Notes in Computer Science), Pedro\u00a0A. Castillo, Juan\u00a0Luis Jim\u00e9nez\u00a0Laredo, and Francisco Fern\u00e1ndez\u00a0de Vega (Eds.). Springer International Publishing, Cham, 431\u2013445. https:\/\/doi.org\/10.1007\/978-3-030-43722-0_28"},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300233"},{"key":"e_1_3_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/3102071.3110572"},{"key":"e_1_3_2_1_6_1","volume-title":"A coefficient of agreement for nominal scales. Educational and psychological measurement 20, 1","author":"Cohen Jacob","year":"1960","unstructured":"Jacob Cohen . 1960. A coefficient of agreement for nominal scales. Educational and psychological measurement 20, 1 ( 1960 ), 37\u201346. Publisher : Sage Publications Sage CA: Thousand Oaks, CA. Jacob Cohen. 1960. A coefficient of agreement for nominal scales. Educational and psychological measurement 20, 1 (1960), 37\u201346. Publisher: Sage Publications Sage CA: Thousand Oaks, CA."},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/3001773.3001778"},{"key":"e_1_3_2_1_8_1","volume-title":"Creativity in the Digital Age","author":"Davis Nicholas","unstructured":"Nicholas Davis , Chih-Pin Hsiao , Yanna Popova , and Brian Magerko . 2015. An Enactive Model of Creativity for Computational Collaboration and Co-creation . In Creativity in the Digital Age , Nelson Zagalo and Pedro Branco (Eds.). Springer London , London, 109\u2013133. https:\/\/doi.org\/10.1007\/978-1-4471-6681-8_7 Nicholas Davis, Chih-Pin Hsiao, Yanna Popova, and Brian Magerko. 2015. An Enactive Model of Creativity for Computational Collaboration and Co-creation. In Creativity in the Digital Age, Nelson Zagalo and Pedro Branco (Eds.). Springer London, London, 109\u2013133. https:\/\/doi.org\/10.1007\/978-1-4471-6681-8_7"},{"key":"e_1_3_2_1_9_1","doi-asserted-by":"crossref","unstructured":"Heather Desurvire Martin Caplan and Jozsef\u00a0A Toth. 2004. Using heuristics to evaluate the playability of games. In CHI\u201904 extended abstracts on Human factors in computing systems. 1509\u20131512.  Heather Desurvire Martin Caplan and Jozsef\u00a0A Toth. 2004. Using heuristics to evaluate the playability of games. In CHI\u201904 extended abstracts on Human factors in computing systems. 1509\u20131512.","DOI":"10.1145\/985921.986102"},{"key":"e_1_3_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-02774-1_60"},{"key":"e_1_3_2_1_11_1","volume-title":"Game User Experience Evaluation","author":"Desurvire Heather","unstructured":"Heather Desurvire and Charlotte Wiberg . 2015. User Experience Design for Inexperienced Gamers: GAP\u2014Game Approachability Principles . In Game User Experience Evaluation . Springer , 169\u2013186. Heather Desurvire and Charlotte Wiberg. 2015. User Experience Design for Inexperienced Gamers: GAP\u2014Game Approachability Principles. In Game User Experience Evaluation. Springer, 169\u2013186."},{"key":"e_1_3_2_1_12_1","volume-title":"Participatory Design in Practice. UX Magazine","author":"Elizarova Olga","year":"2017","unstructured":"Olga Elizarova , Jen Briselli , and Kimberly Dowd . 2017. Participatory Design in Practice. UX Magazine ( 2017 ). https:\/\/uxmag.com\/articles\/participatory-design-in-practice Olga Elizarova, Jen Briselli, and Kimberly Dowd. 2017. Participatory Design in Practice. UX Magazine (2017). https:\/\/uxmag.com\/articles\/participatory-design-in-practice"},{"key":"e_1_3_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1080\/08900523.2014.863126"},{"key":"e_1_3_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300619"},{"key":"e_1_3_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1109\/2.507629"},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1109\/43.766725"},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300854"},{"key":"e_1_3_2_1_19_1","volume-title":"An Interaction Framework for Studying Co-Creative AI. In Human-Centered Machine Learning Perspectives Workshop at CHI 2019","author":"Guzdial Matthew","year":"2019","unstructured":"Matthew Guzdial and Mark Riedl . 2019 . An Interaction Framework for Studying Co-Creative AI. In Human-Centered Machine Learning Perspectives Workshop at CHI 2019 . Glasgow, Scotland, UK. http:\/\/arxiv.org\/abs\/ 1903.09709 arXiv:1903.09709. Matthew Guzdial and Mark Riedl. 2019. An Interaction Framework for Studying Co-Creative AI. In Human-Centered Machine Learning Perspectives Workshop at CHI 2019. Glasgow, Scotland, UK. http:\/\/arxiv.org\/abs\/1903.09709 arXiv:1903.09709."},{"key":"e_1_3_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/302979.303030"},{"key":"e_1_3_2_1_21_1","unstructured":"Tina Hsieh. 2018. 8 Tips for hosting your first participatory workshop. https:\/\/medium.com\/mozilla-taipei-ux\/8-tips-for-hosting-your-first-participatory-workshop-f63856d286a0  Tina Hsieh. 2018. 8 Tips for hosting your first participatory workshop. https:\/\/medium.com\/mozilla-taipei-ux\/8-tips-for-hosting-your-first-participatory-workshop-f63856d286a0"},{"key":"e_1_3_2_1_22_1","volume-title":"Game Developers Conference, Vol.\u00a02005","author":"Isla Damian","year":"2005","unstructured":"Damian Isla . 2005 . Handling Complexity in the Halo 2 AI . In Game Developers Conference, Vol.\u00a02005 . Damian Isla. 2005. Handling Complexity in the Halo 2 AI. In Game Developers Conference, Vol.\u00a02005."},{"key":"e_1_3_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1109\/ColumbianCC.2016.7750805"},{"key":"e_1_3_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/169059.169346"},{"key":"e_1_3_2_1_25_1","volume-title":"Proceedings of the 11th International Joint Conference on Artificial Intelligence -","volume":"774","author":"Koza R.","year":"1989","unstructured":"John\u00a0 R. Koza . 1989 . Hierarchical Genetic Algorithms Operating on Populations of Computer Programs . In Proceedings of the 11th International Joint Conference on Artificial Intelligence - Volume 1(IJCAI\u201989). Morgan Kaufmann Publishers Inc., San Francisco, CA, USA, 768\u2013 774 . http:\/\/dl.acm.org\/citation.cfm?id=1623755.1623877 John\u00a0R. Koza. 1989. Hierarchical Genetic Algorithms Operating on Populations of Computer Programs. In Proceedings of the 11th International Joint Conference on Artificial Intelligence - Volume 1(IJCAI\u201989). Morgan Kaufmann Publishers Inc., San Francisco, CA, USA, 768\u2013774. http:\/\/dl.acm.org\/citation.cfm?id=1623755.1623877"},{"key":"e_1_3_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/3337722.3341849"},{"key":"e_1_3_2_1_27_1","doi-asserted-by":"crossref","unstructured":"Gorm Lai William Latham and Frederic\u00a0Fol Leymarie. 2020. Towards Friendly Mixed Initiative Procedural Content Generation: Three Pillars of Industry. In Foundations of Digital Games. 4.  Gorm Lai William Latham and Frederic\u00a0Fol Leymarie. 2020. Towards Friendly Mixed Initiative Procedural Content Generation: Three Pillars of Industry. In Foundations of Digital Games. 4.","DOI":"10.1145\/3402942.3402946"},{"key":"e_1_3_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.2307\/2529310"},{"key":"e_1_3_2_1_29_1","volume-title":"Procedural Content Generation in Games","author":"Liapis Antonios","unstructured":"Antonios Liapis , Gillian Smith , and Noor Shaker . 2016. Mixed-initiative content creation . In Procedural Content Generation in Games . Springer , Cham , 195\u2013214. https:\/\/doi.org\/10.1007\/978-3-319-42716-4_11 Antonios Liapis, Gillian Smith, and Noor Shaker. 2016. Mixed-initiative content creation. In Procedural Content Generation in Games. Springer, Cham, 195\u2013214. https:\/\/doi.org\/10.1007\/978-3-319-42716-4_11"},{"key":"e_1_3_2_1_30_1","volume-title":"Proceedings of ACM Conference on Foundations of Digital Games","author":"Liapis Antonios","year":"2013","unstructured":"Antonios Liapis , Georgios\u00a0 N. Yannakakis , and Julian Togelius . 2013 . Sentient sketchbook: Computer-aided game level authoring . In Proceedings of ACM Conference on Foundations of Digital Games , 2013. Antonios Liapis, Georgios\u00a0N. Yannakakis, and Julian Togelius. 2013. Sentient sketchbook: Computer-aided game level authoring. In Proceedings of ACM Conference on Foundations of Digital Games, 2013."},{"key":"e_1_3_2_1_31_1","volume-title":"Applications of Evolutionary Computation, Vol.\u00a06024","author":"Lim U","unstructured":"Chong- U Lim , Robin Baumgarten , and Simon Colton . 2010. Evolving Behaviour Trees for the Commercial Game DEFCON . In Applications of Evolutionary Computation, Vol.\u00a06024 . Springer , Berlin, Heidelberg , 100\u2013110. https:\/\/doi.org\/10.1007\/978-3-642-12239-2_11 Chong-U Lim, Robin Baumgarten, and Simon Colton. 2010. Evolving Behaviour Trees for the Commercial Game DEFCON. In Applications of Evolutionary Computation, Vol.\u00a06024. Springer, Berlin, Heidelberg, 100\u2013110. https:\/\/doi.org\/10.1007\/978-3-642-12239-2_11"},{"key":"e_1_3_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/800049.801756"},{"key":"e_1_3_2_1_33_1","unstructured":"Mozilla. [n.d.]. Participatory Design\/Co-Design Worksession. https:\/\/toolkit.mozilla.org\/method\/participatory-designco-design-worksession\/  Mozilla. [n.d.]. Participatory Design\/Co-Design Worksession. https:\/\/toolkit.mozilla.org\/method\/participatory-designco-design-worksession\/"},{"key":"e_1_3_2_1_34_1","unstructured":"Jakob Nielsen. 2005. Ten usability heuristics. https:\/\/web.archive.org\/web\/20121113142238http:\/\/www.useit.com\/papers\/heuristic\/heuristic_list.html  Jakob Nielsen. 2005. Ten usability heuristics. https:\/\/web.archive.org\/web\/20121113142238http:\/\/www.useit.com\/papers\/heuristic\/heuristic_list.html"},{"key":"e_1_3_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/1357054.1357282"},{"key":"e_1_3_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/1531674.1531700"},{"key":"e_1_3_2_1_37_1","volume-title":"Technical Report. NSF Workshop on Creativity Support Tools","author":"Resnick Mitchel","year":"2005","unstructured":"Mitchel Resnick , Brad Myers , Kumiyo Nakakoji , Ben Shneiderman , Randy Pausch , Ted Selker , and Mike Eisenberg . 2005 . Design principles for tools to support creative thinking . Technical Report. NSF Workshop on Creativity Support Tools , Washington, DC, USA. 25\u201336 pages. Mitchel Resnick, Brad Myers, Kumiyo Nakakoji, Ben Shneiderman, Randy Pausch, Ted Selker, and Mike Eisenberg. 2005. Design principles for tools to support creative thinking. Technical Report. NSF Workshop on Creativity Support Tools, Washington, DC, USA. 25\u201336 pages."},{"key":"e_1_3_2_1_38_1","volume-title":"The coding manual for qualitative researchers","author":"Salda\u00f1a Johnny","unstructured":"Johnny Salda\u00f1a . 2015. The coding manual for qualitative researchers . Sage . Johnny Salda\u00f1a. 2015. The coding manual for qualitative researchers. Sage."},{"key":"e_1_3_2_1_39_1","volume-title":"International Journal of Human\u2013Computer Interaction 36, 6(2020), 495\u2013504","author":"Shneiderman Ben","unstructured":"Ben Shneiderman . 2020. Human-centered artificial intelligence: Reliable, safe & trustworthy . International Journal of Human\u2013Computer Interaction 36, 6(2020), 495\u2013504 . Publisher : Taylor & Francis. Ben Shneiderman. 2020. Human-centered artificial intelligence: Reliable, safe & trustworthy. International Journal of Human\u2013Computer Interaction 36, 6(2020), 495\u2013504. Publisher: Taylor & Francis."},{"key":"e_1_3_2_1_40_1","volume-title":"ICML 2020 Workshop on Participatory Approaches to Machine Learning. https:\/\/arxiv.org\/pdf\/2007","author":"Sloane Mona","year":"2020","unstructured":"Mona Sloane , Emanuel Moss , Olaitan Awomolo , and Laura Forlano . 2020 . Participation is not a Design Fix for Machine Learning . In ICML 2020 Workshop on Participatory Approaches to Machine Learning. https:\/\/arxiv.org\/pdf\/2007 .02423.pdf Mona Sloane, Emanuel Moss, Olaitan Awomolo, and Laura Forlano. 2020. Participation is not a Design Fix for Machine Learning. In ICML 2020 Workshop on Participatory Approaches to Machine Learning. https:\/\/arxiv.org\/pdf\/2007.02423.pdf"},{"key":"e_1_3_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/1822348.1822376"},{"key":"e_1_3_2_1_42_1","volume-title":"Plans and situated actions: The problem of human-machine communication","author":"Suchman A.","unstructured":"Lucy\u00a0 A. Suchman . 1987. Plans and situated actions: The problem of human-machine communication . Cambridge university press . Lucy\u00a0A. Suchman. 1987. Plans and situated actions: The problem of human-machine communication. Cambridge university press."},{"key":"e_1_3_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/2968120.2987729"},{"key":"e_1_3_2_1_44_1","volume-title":"Proceedings of the SIGCHI Conference on Human Factors in Computing Systems.","author":"Zhu Jichen","year":"2021","unstructured":"Jichen Zhu , Jennifer Villareale , Nithesh Javvaji , Sebastian Risi , Mathias L\u00f6we , and Casper Harteveld . 2021 . Player-AI Interaction: What Neural Network Games Reveal About AI as Play . In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. Jichen Zhu, Jennifer Villareale, Nithesh Javvaji, Sebastian Risi, Mathias L\u00f6we, and Casper Harteveld. 2021. Player-AI Interaction: What Neural Network Games Reveal About AI as Play. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems."}],"event":{"name":"FDG'21: The 16th International Conference on the Foundations of Digital Games 2021","location":"Montreal QC Canada","acronym":"FDG'21"},"container-title":["The 16th International Conference on the Foundations of Digital Games (FDG) 2021"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3472538.3472573","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3472538.3472573","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T20:17:23Z","timestamp":1750191443000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3472538.3472573"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,8,3]]},"references-count":43,"alternative-id":["10.1145\/3472538.3472573","10.1145\/3472538"],"URL":"https:\/\/doi.org\/10.1145\/3472538.3472573","relation":{},"subject":[],"published":{"date-parts":[[2021,8,3]]}}}