{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,18]],"date-time":"2026-05-18T10:52:46Z","timestamp":1779101566459,"version":"3.51.4"},"reference-count":51,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2017,12,4]],"date-time":"2017-12-04T00:00:00Z","timestamp":1512345600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["CHS-1320520"],"award-info":[{"award-number":["CHS-1320520"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Interact. Intell. Syst."],"published-print":{"date-parts":[[2017,12,31]]},"abstract":"<jats:p>\n            This article describes a new technique for quantifying creative collaboration and applies it to the user study evaluation of a co-creative drawing agent. We present a cognitive framework called\n            <jats:italic>creative sense-making<\/jats:italic>\n            that provides a new method to visualize and quantify the interaction dynamics of creative collaboration, for example, the rhythm of interaction, style of turn taking, and the manner in which participants are mutually making sense of a situation. The creative sense-making framework includes a qualitative coding technique, interaction coding software, an analysis method, and the cognitive theory behind these applications. This framework and analysis method are applied to empirical studies of the\n            <jats:italic>Drawing Apprentice<\/jats:italic>\n            collaborative sketching system to compare human collaboration with a co-creative AI agent vs. a Wizard of Oz setup. The analysis demonstrates how the proposed technique can be used to analyze interaction data using continuous functions (e.g., integrations and moving averages) to measure and evaluate how collaborations unfold through time.\n          <\/jats:p>","DOI":"10.1145\/3009981","type":"journal-article","created":{"date-parts":[[2017,12,4]],"date-time":"2017-12-04T19:18:27Z","timestamp":1512415107000},"page":"1-25","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":13,"title":["Quantifying Collaboration with a Co-Creative Drawing Agent"],"prefix":"10.1145","volume":"7","author":[{"given":"N.","family":"Davis","sequence":"first","affiliation":[{"name":"Georgia Institute of Technology, Atlanta, GA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"C.","family":"Hsiao","sequence":"additional","affiliation":[{"name":"Georgia Institute of Technology, Atlanta, GA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"K. Y.","family":"Singh","sequence":"additional","affiliation":[{"name":"Georgia Institute of Technology, Atlanta, GA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"B.","family":"Lin","sequence":"additional","affiliation":[{"name":"Georgia Institute of Technology, Atlanta, GA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"B.","family":"Magerko","sequence":"additional","affiliation":[{"name":"Georgia Institute of Technology"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2017,12,4]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.newideapsych.2007.12.002"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.3200\/MONO.132.4.355-430"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1098\/rstb.2009.0148"},{"key":"e_1_2_1_4_1","volume-title":"Proceedings of the 10th Annual Conference of the International Speech Communication Association.","author":"Benus Stefan","year":"2009"},{"key":"e_1_2_1_5_1","unstructured":"Margaret A. Boden. 1990. The Creative Mind: Myths and Mechanisms. Weidenfeld 8 Nicolson London.   Margaret A. Boden. 1990. The Creative Mind: Myths and Mechanisms. Weidenfeld 8 Nicolson London."},{"key":"e_1_2_1_6_1","volume-title":"Proceedings of Graphical Interface","author":"Erin","year":"2012"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/1640233.1640255"},{"key":"e_1_2_1_8_1","volume-title":"Proceedings of the AAAI Spring Symposium: Creative Intelligent Systems. 14--20","author":"Colton Simon","year":"2008"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.5555\/3007337.3007345"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11097-014-9404-9"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/2757226.2757254"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/2069618.2069650"},{"key":"e_1_2_1_13_1","volume-title":"Creativity in the Digital Age","author":"Davis Nicholas"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/2856767.2856795"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11097-007-9076-9"},{"key":"e_1_2_1_16_1","first-page":"33","article-title":"Making sense in participation: An enactive approach to social cognition","volume":"10","author":"Jaegher Hanne De","year":"2008","journal-title":"Emerging Communications"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.tics.2010.06.009"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.newideapsych.2007.07.006"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijhcs.2005.04.001"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.3389\/fpsyg.2014.00874"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1037\/h0031619"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.tics.2009.04.005"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1038\/nrn2787"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jphysparis.2006.10.001"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1038\/srep03672"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1109\/TOH.2011.57"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.artint.2008.12.001"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11097-009-9136-4"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1017\/S0140525X97470012"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijhcs.2005.08.006"},{"key":"e_1_2_1_31_1","first-page":"460","article-title":"An experimental method for measuring the emergence of new ideas in information discovery. Intl. J. Hum.--Comput","volume":"24","author":"Kerne Andruid","year":"2008","journal-title":"Interact."},{"key":"e_1_2_1_32_1","first-page":"81","article-title":"Comparison of designers using a tangible user interface and graphical user interface and impact on spatial cognition","volume":"5","author":"Kim M.","year":"2005","journal-title":"Proceedings of Human Behavior in Design"},{"key":"e_1_2_1_33_1","unstructured":"Harold A. Linstone and Murray Turoff. 1975. The Delphi Method: Techniques and Applications. Addison-Wesley Reading MA.  Harold A. Linstone and Murray Turoff. 1975. The Delphi Method: Techniques and Applications. Addison-Wesley Reading MA."},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijhcs.2005.04.002"},{"key":"e_1_2_1_35_1","volume-title":"Proceedings of the 2nd International Conference on Design Creativity","volume":"1","author":"Maher Mary Lou"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1098\/rstb.2009.0168"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1162\/089976603322297278"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.3389\/fpsyg.2014.00895"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.3389\/fpsyg.2015.00175"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICHR.2004.1442111"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1037\/a0013282"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/1323688.1323689"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.3389\/fpsyg.2013.00710"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1207\/s15327590ijhc2002_1"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11097-009-9139-1"},{"key":"e_1_2_1_46_1","doi-asserted-by":"crossref","unstructured":"John Robert Stewart Olivier Gapenne and Ezequiel A. Di Paolo. 2010. Enaction: Toward a New Paradigm for Cognitive Science. MIT Press.  John Robert Stewart Olivier Gapenne and Ezequiel A. Di Paolo. 2010. Enaction: Toward a New Paradigm for Cognitive Science. MIT Press.","DOI":"10.7551\/mitpress\/9780262014601.001.0001"},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.2478\/s13230-010-0016-y"},{"key":"e_1_2_1_48_1","unstructured":"David Vernon. 2014. Artificial Cognitive Systems: A Primer. MIT Press.   David Vernon. 2014. Artificial Cognitive Systems: A Primer. MIT Press."},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-29863-9_13"},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF03037332"},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.knosys.2006.04.009"}],"container-title":["ACM Transactions on Interactive Intelligent Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3009981","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3009981","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3009981","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T03:50:35Z","timestamp":1750218635000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3009981"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2017,12,4]]},"references-count":51,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2017,12,31]]}},"alternative-id":["10.1145\/3009981"],"URL":"https:\/\/doi.org\/10.1145\/3009981","relation":{},"ISSN":["2160-6455","2160-6463"],"issn-type":[{"value":"2160-6455","type":"print"},{"value":"2160-6463","type":"electronic"}],"subject":[],"published":{"date-parts":[[2017,12,4]]},"assertion":[{"value":"2016-07-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2017-08-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2017-12-04","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}