{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,4]],"date-time":"2026-03-04T18:25:07Z","timestamp":1772648707909,"version":"3.50.1"},"reference-count":69,"publisher":"Association for Computing Machinery (ACM)","issue":"CSCW","license":[{"start":{"date-parts":[[2019,11,7]],"date-time":"2019-11-07T00:00:00Z","timestamp":1573084800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/100005246","name":"Institute of Education Sciences","doi-asserted-by":"publisher","award":["R305A170432"],"award-info":[{"award-number":["R305A170432"]}],"id":[{"id":"10.13039\/100005246","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["DUE 1745442"],"award-info":[{"award-number":["DUE 1745442"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Hum.-Comput. Interact."],"published-print":{"date-parts":[[2019,11,7]]},"abstract":"<jats:p>Collaborative problem solving (CPS) is a crucial 21st century skill; however, current technologies fall short of effectively supporting CPS processes, especially for remote, computer-enabled interactions. In order to develop next-generation computer-supported collaborative systems that enhance CPS processes and outcomes by monitoring and responding to the unfolding collaboration, we investigate automated detection of three critical CPS process ? construction of shared knowledge, negotiation\/coordination, and maintaining team function ? derived from a validated CPS framework. Our data consists of 32 triads who were tasked with collaboratively solving a challenging visual computer programming task for 20 minutes using commercial videoconferencing software. We used automatic speech recognition to generate transcripts of 11,163 utterances, which trained humans coded for evidence of the above three CPS processes using a set of behavioral indicators. We aimed to automate the trained human-raters' codes in a team-independent fashion (current study) in order to provide automatic real-time or offline feedback (future work). We used Random Forest classifiers trained on the words themselves (bag of n-grams) or with word categories (e.g., emotions, thinking styles, social constructs) from the Linguistic Inquiry Word Count (LIWC) tool. Despite imperfect automatic speech recognition, the n-gram models achieved AUROC (area under the receiver operating characteristic curve) scores of .85, .77, and .77 for construction of shared knowledge, negotiation\/coordination, and maintaining team function, respectively; these reflect 70%, 54%, and 54% improvements over chance. The LIWC-category models achieved similar scores of .82, .74, and .73 (64%, 48%, and 46% improvement over chance). Further, the LIWC model-derived scores predicted CPS outcomes more similar to human codes, demonstrating predictive validity. We discuss embedding our models in collaborative interfaces for assessment and dynamic intervention aimed at improving CPS outcomes.<\/jats:p>","DOI":"10.1145\/3359296","type":"journal-article","created":{"date-parts":[[2019,11,8]],"date-time":"2019-11-08T13:40:21Z","timestamp":1573220421000},"page":"1-19","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":40,"title":["I Say, You Say, We Say"],"prefix":"10.1145","volume":"3","author":[{"given":"Angela E.B.","family":"Stewart","sequence":"first","affiliation":[{"name":"University of Colorado Boulder, Boulder, CO, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hana","family":"Vrzakova","sequence":"additional","affiliation":[{"name":"University of Colorado Boulder, Boulder, CO, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Chen","family":"Sun","sequence":"additional","affiliation":[{"name":"Florida State University, Tallahasse, FL, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jade","family":"Yonehiro","sequence":"additional","affiliation":[{"name":"Arizona State University, Glendale, AZ, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Cathlyn Adele","family":"Stone","sequence":"additional","affiliation":[{"name":"University of Colorado Boulder, Boulder, CO, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Nicholas D.","family":"Duran","sequence":"additional","affiliation":[{"name":"Arizona State University, Glendale, AZ, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Valerie","family":"Shute","sequence":"additional","affiliation":[{"name":"Florida State University, Tallahassee, FL, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Sidney K.","family":"D'Mello","sequence":"additional","affiliation":[{"name":"University of Colorado Boulder, Boulder, CO, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2019,11,7]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11412-017-9250-1"},{"key":"e_1_2_1_2_1","volume-title":"Simultaneous analysis of verbal and nonverbal data during conversation: symmetry and turn-taking","author":"Ashenfelter Kathleen T","unstructured":"Kathleen T Ashenfelter . 2007. Simultaneous analysis of verbal and nonverbal data during conversation: symmetry and turn-taking . University of Notre Dame . Kathleen T Ashenfelter. 2007. Simultaneous analysis of verbal and nonverbal data during conversation: symmetry and turn-taking. University of Notre Dame."},{"key":"e_1_2_1_3_1","volume-title":"Fitting linear mixed-effects models using lme4. arXiv Prepr. arXiv1406.5823 67, 1","author":"Bates Douglas","year":"2014","unstructured":"Douglas Bates , Martin M\u00e4chler , Ben Bolker , and Steve Walker . 2014. Fitting linear mixed-effects models using lme4. arXiv Prepr. arXiv1406.5823 67, 1 ( 2014 ), 1--48. DOI:https:\/\/doi.org\/10.18637\/jss.v067.i01 Douglas Bates, Martin M\u00e4chler, Ben Bolker, and Steve Walker. 2014. Fitting linear mixed-effects models using lme4. arXiv Prepr. arXiv1406.5823 67, 1 (2014), 1--48. DOI:https:\/\/doi.org\/10.18637\/jss.v067.i01"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.3115\/1219044.1219075"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1177\/1754073912451630"},{"key":"e_1_2_1_6_1","volume-title":"Breakout: An Open Measurement and Intervention Tool for Distributed Peer Learning Groups. CoRR abs\/1607.0","author":"Calacci Dan","year":"2016","unstructured":"Dan Calacci , Oren Lederman , David Shrier , and Alex ?Sandy\" Pentland . 2016 . Breakout: An Open Measurement and Intervention Tool for Distributed Peer Learning Groups. CoRR abs\/1607.0 , (2016). Retrieved from http:\/\/arxiv.org\/abs\/1607.01443 Dan Calacci, Oren Lederman, David Shrier, and Alex ?Sandy\" Pentland. 2016. Breakout: An Open Measurement and Intervention Tool for Distributed Peer Learning Groups. CoRR abs\/1607.0, (2016). Retrieved from http:\/\/arxiv.org\/abs\/1607.01443"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/2998181.2998250"},{"key":"e_1_2_1_8_1","first-page":"1","article-title":"Word Association Norms, Mutual Information, and","volume":"16","author":"Church Kenneth Ward","year":"1990","unstructured":"Kenneth Ward Church and Patrick Hanks . 1990 . Word Association Norms, Mutual Information, and Lexicography. Comput. Linguist. 16 , 1 (March 1990), 22--29. Retrieved from http:\/\/dl.acm.org\/citation.cfm?id=89086.89095 Kenneth Ward Church and Patrick Hanks. 1990. Word Association Norms, Mutual Information, and Lexicography. Comput. Linguist. 16, 1 (March 1990), 22--29. Retrieved from http:\/\/dl.acm.org\/citation.cfm?id=89086.89095","journal-title":"Lexicography. Comput. Linguist."},{"key":"e_1_2_1_9_1","volume-title":"A power primer","author":"Cohen Jacob","unstructured":"Jacob Cohen . 2003. A power primer . American Psychological Association , Washington, DC, US. Jacob Cohen. 2003. A power primer. American Psychological Association, Washington, DC, US."},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/3025453.3025573"},{"key":"e_1_2_1_11_1","volume-title":"Psychology of learning and motivation","author":"Dale Rick","unstructured":"Rick Dale , Riccardo Fusaroli , Nicholas D Duran , and Daniel C Richardson . 2013. The self-organization of human interaction . In Psychology of learning and motivation . Elsevier , 43--95. Rick Dale, Riccardo Fusaroli, Nicholas D Duran, and Daniel C Richardson. 2013. The self-organization of human interaction. In Psychology of learning and motivation. Elsevier, 43--95."},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.dcn.2011.05.003"},{"key":"e_1_2_1_13_1","first-page":"1","article-title":"Using Intelligent Tutor Technology to Implement Adaptive Support for Student","volume":"22","author":"Diziol Dejana","year":"2010","unstructured":"Dejana Diziol , Erin Walker , Nikol Rummel , and Kenneth R Koedinger . 2010 . Using Intelligent Tutor Technology to Implement Adaptive Support for Student Collaboration. Educ. Psychol. Rev. 22 , 1 (March 2010), 89--102. DOI:https:\/\/doi.org\/10.1007\/s10648-009--9116--9 Dejana Diziol, Erin Walker, Nikol Rummel, and Kenneth R Koedinger. 2010. Using Intelligent Tutor Technology to Implement Adaptive Support for Student Collaboration. Educ. Psychol. Rev. 22, 1 (March 2010), 89--102. DOI:https:\/\/doi.org\/10.1007\/s10648-009--9116--9","journal-title":"Collaboration. Educ. Psychol. Rev."},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/3134679"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W16-0504"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.imavis.2009.01.004"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1177\/1529100618808244"},{"key":"e_1_2_1_18_1","volume-title":"Esther Care, and Barry McGaw","author":"Griffin Patrick","year":"2012","unstructured":"Patrick Griffin , Esther Care, and Barry McGaw . 2012 . The Changing Role of Education and Schools. In Assessment and Teaching of 21st Century Skills, Patrick Griffin, Barry McGaw and Esther Care (eds.). Springer Netherlands , Dordrecht, 1--15. DOI:https:\/\/doi.org\/10.1007\/978--94-007--2324--5_1 Patrick Griffin, Esther Care, and Barry McGaw. 2012. The Changing Role of Education and Schools. In Assessment and Teaching of 21st Century Skills, Patrick Griffin, Barry McGaw and Esther Care (eds.). Springer Netherlands, Dordrecht, 1--15. DOI:https:\/\/doi.org\/10.1007\/978--94-007--2324--5_1"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1006\/obhd.1996.0061"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/2998181.2998226"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1148\/radiology.143.1.7063747"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1002\/ets2.12184"},{"key":"e_1_2_1_23_1","volume-title":"Juergen Buder, Kai Sassenberg, and Patrick Griffin.","author":"Hesse Friedrich","year":"2015","unstructured":"Friedrich Hesse , Esther Care , Juergen Buder, Kai Sassenberg, and Patrick Griffin. 2015 . A Framework for Teachable Collaborative Problem Solving Skills. In Assessment and Teaching of 21st Century Skills : Methods and Approach, Patrick Griffin and Esther Care (eds.). Springer Netherlands , Dordrecht, 37--56. DOI:https:\/\/doi.org\/10.1007\/978--94-017--9395--7_2 Friedrich Hesse, Esther Care, Juergen Buder, Kai Sassenberg, and Patrick Griffin. 2015. A Framework for Teachable Collaborative Problem Solving Skills. In Assessment and Teaching of 21st Century Skills: Methods and Approach, Patrick Griffin and Esther Care (eds.). Springer Netherlands, Dordrecht, 37--56. DOI:https:\/\/doi.org\/10.1007\/978--94-017--9395--7_2"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1109\/TMM.2010.2055233"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1016\/0167-6393(90)90008-W"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.apergo.2010.08.005"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/3005467.3005472"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/3242969.3242978"},{"key":"e_1_2_1_29_1","volume-title":"Proceedings of the ACM 2012 conference on Computer Supported Cooperative Work, 1125--1134","author":"Jermann Patrick","year":"2012","unstructured":"Patrick Jermann and Marc-Antoine N\u00fcssli . 2012 . Effects of sharing text selections on gaze cross-recurrence and interaction quality in a pair programming task . In Proceedings of the ACM 2012 conference on Computer Supported Cooperative Work, 1125--1134 . Patrick Jermann and Marc-Antoine N\u00fcssli. 2012. Effects of sharing text selections on gaze cross-recurrence and interaction quality in a pair programming task. In Proceedings of the ACM 2012 conference on Computer Supported Cooperative Work, 1125--1134."},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/2499474.2499481"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1006\/obhd.2001.2974"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.5555\/3122009.3122026"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.5555\/2382029.2382032"},{"key":"e_1_2_1_34_1","volume-title":"First workshop on computational terminology, 57--63","author":"Lin Dekang","year":"1998","unstructured":"Dekang Lin . 1998 . Extracting collocations from text corpora . In First workshop on computational terminology, 57--63 . Dekang Lin. 1998. Extracting collocations from text corpora. In First workshop on computational terminology, 57--63."},{"key":"e_1_2_1_35_1","volume-title":"Journal on Digital Information Management: Special Issue on the 5th Dutch-Belgian Information Retrieval Workshop (DIR), 17--24","author":"Tsz-Wai Lo Rachel","year":"2005","unstructured":"Rachel Tsz-Wai Lo , Ben He , and Iadh Ounis . 2005 . Automatically building a stopword list for an information retrieval system . In Journal on Digital Information Management: Special Issue on the 5th Dutch-Belgian Information Retrieval Workshop (DIR), 17--24 . Rachel Tsz-Wai Lo, Ben He, and Iadh Ounis. 2005. Automatically building a stopword list for an information retrieval system. In Journal on Digital Information Management: Special Issue on the 5th Dutch-Belgian Information Retrieval Workshop (DIR), 17--24."},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/2998181.2998335"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1007\/3-540-44566-8_3"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/3172944.3172969"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/3242969.3243027"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/2663204.2663248"},{"key":"e_1_2_1_41_1","volume-title":"Bates","author":"Pinheiro Jos\u00e9 C.","year":"2000","unstructured":"Jos\u00e9 C. Pinheiro and Douglas M . Bates . 2000 . Mixed-effects models in S and S-PLUS. Springer Verlag , New York, NY. Jos\u00e9 C. Pinheiro and Douglas M. Bates. 2000. Mixed-effects models in S and S-PLUS. Springer Verlag, New York, NY."},{"key":"e_1_2_1_42_1","volume-title":"Snowball: A Language for Stemming Algorithms.","author":"Porter Martin F.","year":"2001","unstructured":"Martin F. Porter . 2001 . Snowball: A Language for Stemming Algorithms. Martin F. Porter. 2001. Snowball: A Language for Stemming Algorithms."},{"key":"e_1_2_1_43_1","volume-title":"Evandro d B Costa, Carolyn P Ros\u00e9, Yue Cui, and Adriana M J B De Carvalho.","author":"Prata David Nadler","year":"2009","unstructured":"David Nadler Prata , Ryan S J d Baker , Evandro d B Costa, Carolyn P Ros\u00e9, Yue Cui, and Adriana M J B De Carvalho. 2009 . Detecting and Understanding the Impact of Cognitive and Interpersonal Conflict in Computer Supported Collaborative Learning Environments. Int. Work. Gr. Educ. Data Min . (2009). David Nadler Prata, Ryan S J d Baker, Evandro d B Costa, Carolyn P Ros\u00e9, Yue Cui, and Adriana M J B De Carvalho. 2009. Detecting and Understanding the Impact of Cognitive and Interpersonal Conflict in Computer Supported Collaborative Learning Environments. Int. Work. Gr. Educ. Data Min. (2009)."},{"key":"e_1_2_1_44_1","doi-asserted-by":"crossref","unstructured":"Jeremy Roschelle and Stephanie D Teasley. 1995. The Construction of Shared Knowledge in Collaborative Problem Solving. In Computer Supported Collaborative Learning 69--97.  Jeremy Roschelle and Stephanie D Teasley. 1995. The Construction of Shared Knowledge in Collaborative Problem Solving. In Computer Supported Collaborative Learning 69--97.","DOI":"10.1007\/978-3-642-85098-1_5"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11412-007-9034-0"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1007\/s40593-015-0042-3"},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1145\/3161186"},{"key":"e_1_2_1_48_1","volume-title":"Supporting Dyadic Chat Communication with Eye Tracking Based Reading Awareness. In 2018 IEEE 18th International Conference on Advanced Learning Technologies (ICALT), 149--151","author":"Schl\u00f6sser C","year":"2018","unstructured":"C Schl\u00f6sser , A Harrer , and A Kienle . 2018 . Supporting Dyadic Chat Communication with Eye Tracking Based Reading Awareness. In 2018 IEEE 18th International Conference on Advanced Learning Technologies (ICALT), 149--151 . DOI:https:\/\/doi.org\/10.1109\/ICALT.2018.00042 C Schl\u00f6sser, A Harrer, and A Kienle. 2018. Supporting Dyadic Chat Communication with Eye Tracking Based Reading Awareness. In 2018 IEEE 18th International Conference on Advanced Learning Technologies (ICALT), 149--151. DOI:https:\/\/doi.org\/10.1109\/ICALT.2018.00042"},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1145\/3204493.3207416"},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11412-013-9181-4"},{"key":"e_1_2_1_51_1","first-page":"1","article-title":"The ?virtual team player\": A review and initial model of knowledge, skills, abilities, and other characteristics for virtual collaboration","volume":"7","author":"Schulze Julian","year":"2017","unstructured":"Julian Schulze and Stefan Krumm . 2017 . The ?virtual team player\": A review and initial model of knowledge, skills, abilities, and other characteristics for virtual collaboration . Organ. Psychol. Rev. 7 , 1 (February 2017), 66--95. DOI:https:\/\/doi.org\/10.1177\/2041386616675522 Julian Schulze and Stefan Krumm. 2017. The ?virtual team player\": A review and initial model of knowledge, skills, abilities, and other characteristics for virtual collaboration. Organ. Psychol. Rev. 7, 1 (February 2017), 66--95. DOI:https:\/\/doi.org\/10.1177\/2041386616675522","journal-title":"Organ. Psychol. Rev."},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0073791"},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.3102\/0034654307313795"},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1145\/2823513.2823516"},{"key":"e_1_2_1_55_1","volume-title":"International Conference on Artificial Intelligence in Education, 545--556","author":"Angela E.","unstructured":"Angela E. B. Stewart and Sidney K D'Mello. 2018. Connecting the Dots Towards Collaborative AIED: Linking Group Makeup to Process to Learning . In International Conference on Artificial Intelligence in Education, 545--556 . Angela E. B. Stewart and Sidney K D'Mello. 2018. Connecting the Dots Towards Collaborative AIED: Linking Group Makeup to Process to Learning. In International Conference on Artificial Intelligence in Education, 545--556."},{"key":"e_1_2_1_56_1","doi-asserted-by":"crossref","unstructured":"Kristin Stoeffler Yigal Rosen Maria Bolsinova and Alina von Davier. 2018. Gamified Assessment of Collaborative Skills with Chatbots. . 343--347. DOI:https:\/\/doi.org\/10.1007\/978--3--319--93846--2_64  Kristin Stoeffler Yigal Rosen Maria Bolsinova and Alina von Davier. 2018. Gamified Assessment of Collaborative Skills with Chatbots. . 343--347. DOI:https:\/\/doi.org\/10.1007\/978--3--319--93846--2_64","DOI":"10.1007\/978-3-319-93846-2_64"},{"key":"e_1_2_1_57_1","volume-title":"D'Mello. Toward a generalized competency model of collaborative problem solving","author":"Sun Chen","unstructured":"Chen Sun , Valerie Shute , Angela E.B. Stewart , Jade Yonehiro , Nicholas Duran , and Sidney K . D'Mello. Toward a generalized competency model of collaborative problem solving . In Press Computers and Education . Chen Sun, Valerie Shute, Angela E.B. Stewart, Jade Yonehiro, Nicholas Duran, and Sidney K. D'Mello. Toward a generalized competency model of collaborative problem solving. In Press Computers and Education."},{"key":"e_1_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.1177\/0261927X09351676"},{"key":"e_1_2_1_59_1","volume-title":"The Antiquity of Empathy. Science (80-. ). 336, 6083 (May","author":"de Waal F. B. M.","year":"2012","unstructured":"F. B. M. de Waal . 2012. The Antiquity of Empathy. Science (80-. ). 336, 6083 (May 2012 ), 874--876. DOI:https:\/\/doi.org\/10.1126\/science.1220999 F. B. M. de Waal. 2012. The Antiquity of Empathy. Science (80-. ). 336, 6083 (May 2012), 874--876. DOI:https:\/\/doi.org\/10.1126\/science.1220999"},{"key":"e_1_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10639-015-9413-5"},{"key":"e_1_2_1_61_1","doi-asserted-by":"crossref","unstructured":"Miaomiao Wen Diyi Yang and Carolyn Penstein Ros\u00e9. 2015. Virtual Teams in Massive Open Online Courses. In Artificial Intelligence in Education 820--824.  Miaomiao Wen Diyi Yang and Carolyn Penstein Ros\u00e9. 2015. Virtual Teams in Massive Open Online Courses. In Artificial Intelligence in Education 820--824.","DOI":"10.1007\/978-3-319-19773-9_124"},{"key":"e_1_2_1_62_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0883-0355(03)00014-4"},{"key":"e_1_2_1_63_1","doi-asserted-by":"publisher","DOI":"10.1145\/3170427.3188453"},{"key":"e_1_2_1_64_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-73105-4_111"},{"key":"e_1_2_1_65_1","doi-asserted-by":"publisher","DOI":"10.1145\/3172944.3172997"},{"key":"e_1_2_1_66_1","unstructured":"Code Studio. Retrieved April 1 2018 from https:\/\/studio.code.org\/s\/mc\/stage\/1\/puzzle\/1  Code Studio. Retrieved April 1 2018 from https:\/\/studio.code.org\/s\/mc\/stage\/1\/puzzle\/1"},{"key":"e_1_2_1_67_1","unstructured":"IBM. Retrieved May 2 2018 from https:\/\/www.ibm.com\/watson\/services\/speech-to-text\/  IBM. Retrieved May 2 2018 from https:\/\/www.ibm.com\/watson\/services\/speech-to-text\/"},{"key":"e_1_2_1_68_1","unstructured":"Scikit Learn. Retrieved May 3 2018 from https:\/\/github.com\/scikit-learn\/scikit-learn  Scikit Learn. Retrieved May 3 2018 from https:\/\/github.com\/scikit-learn\/scikit-learn"},{"key":"e_1_2_1_69_1","volume-title":"PISA 2015 Collaborative Problem Solving Framework.","unstructured":"2015. PISA 2015 Collaborative Problem Solving Framework. 2015. PISA 2015 Collaborative Problem Solving Framework."}],"container-title":["Proceedings of the ACM on Human-Computer Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3359296","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3359296","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3359296","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T23:23:54Z","timestamp":1750202634000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3359296"}},"subtitle":["Using Spoken Language to Model Socio-Cognitive Processes during Computer-Supported Collaborative Problem Solving"],"short-title":[],"issued":{"date-parts":[[2019,11,7]]},"references-count":69,"journal-issue":{"issue":"CSCW","published-print":{"date-parts":[[2019,11,7]]}},"alternative-id":["10.1145\/3359296"],"URL":"https:\/\/doi.org\/10.1145\/3359296","relation":{},"ISSN":["2573-0142"],"issn-type":[{"value":"2573-0142","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,11,7]]},"assertion":[{"value":"2019-11-07","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}