{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,21]],"date-time":"2026-02-21T00:58:37Z","timestamp":1771635517210,"version":"3.50.1"},"reference-count":65,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2016,2,17]],"date-time":"2016-02-17T00:00:00Z","timestamp":1455667200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Comput. Educ."],"published-print":{"date-parts":[[2016,3,28]]},"abstract":"<jats:p>Although teamwork has been identified as an essential skill for Computer Science (CS) graduates, these skills are identified as lacking by industry employers, which suggests a need for more proactive measures to teach and assess teamwork. In one CS course, students worked in teams to create a wiki solution to problem-based questions. Through a case-study approach, we test a developed teamwork framework, using manual content analysis and sentiment analysis, to determine if the framework can provide insight into students\u2019 teamwork behavior and to determine if the wiki task encouraged students to collaborate, share knowledge, and self-adopt teamwork roles. Analysis revealed the identification of both active and cohesive teams, disengaged students, and particular roles and behaviors that were lacking. Furthermore, sentiment analysis revealed that teams moved through positive and negative emotions over the course of developing their solution, toward satisfaction. The findings demonstrate the value of the detailed analysis of online teamwork. However, we propose the need for automated measures that provide real-time feedback to assist educators in the fair and efficient assessment of teamwork. We present a prototype system and recommendations, based on our analysis, for automated teamwork analysis tools.<\/jats:p>","DOI":"10.1145\/2793507","type":"journal-article","created":{"date-parts":[[2016,2,22]],"date-time":"2016-02-22T13:07:16Z","timestamp":1456146436000},"page":"1-28","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":32,"title":["A Method to Analyze Computer Science Students\u2019 Teamwork in Online Collaborative Learning Environments"],"prefix":"10.1145","volume":"16","author":[{"given":"Rebecca","family":"Vivian","sequence":"first","affiliation":[{"name":"The University of Adelaide, South Australia, Australia"}]},{"given":"Katrina","family":"Falkner","sequence":"additional","affiliation":[{"name":"The University of Adelaide, South Australia, Australia"}]},{"given":"Nickolas","family":"Falkner","sequence":"additional","affiliation":[{"name":"The University of Adelaide, South Australia, Australia"}]},{"given":"Hamid","family":"Tarmazdi","sequence":"additional","affiliation":[{"name":"The University of Adelaide, South Australia, Australia"}]}],"member":"320","published-online":{"date-parts":[[2016,2,17]]},"reference":[{"key":"e_1_2_1_1_1","unstructured":"W. Archer and J. Davison. 2008. Graduate employability: What do employers think and want? In Graduate Employability: The Views of Employers R. Brown and K. Herrmann (Eds.). The Council for Industry and Higher Education London 1--18.  W. Archer and J. Davison. 2008. Graduate employability: What do employers think and want? In Graduate Employability: The Views of Employers R. Brown and K. Herrmann (Eds.). The Council for Industry and Higher Education London 1--18."},{"key":"e_1_2_1_2_1","unstructured":"K. Beck M. Beedle A. van Bennekum A. Cockburn W. Cunningham M. Fowler and D. Thomas. 2001. Manifesto for Agile Software Development. Retrieved from http:\/\/agilemanifesto.org\/.  K. Beck M. Beedle A. van Bennekum A. Cockburn W. Cunningham M. Fowler and D. Thomas. 2001. Manifesto for Agile Software Development. Retrieved from http:\/\/agilemanifesto.org\/."},{"key":"e_1_2_1_3_1","volume-title":"Digital Age: Designing and Delivering e-Learning","author":"Beetham H.","year":"2007"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/1404520.1404522"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/1352135.1352218"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/2361276.2361285"},{"key":"e_1_2_1_7_1","doi-asserted-by":"crossref","unstructured":"S. Bull and J. Kay. 2010. Open learner models. In Advances in Intelligent Tutoring Systems R. Nkambou J. Bourdeau and R. Mizoguchi (Eds.). Springer-Verlag Berlin 301--322.  S. Bull and J. Kay. 2010. Open learner models. In Advances in Intelligent Tutoring Systems R. Nkambou J. Bourdeau and R. Mizoguchi (Eds.). Springer-Verlag Berlin 301--322.","DOI":"10.1007\/978-3-642-14363-2_15"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.sbspro.2010.03.033"},{"key":"e_1_2_1_9_1","volume-title":"Proceedings of the Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies.","author":"Chen Z."},{"key":"e_1_2_1_10_1","volume-title":"Educational Research: Planning, Conducting, and Evaluating Quantitative and Qualitative Research","author":"Creswell J.","year":"2008","edition":"3"},{"key":"e_1_2_1_11_1","volume-title":"Qualitative Inquiry and Research Design: Choosing Among Five Approaches","author":"Creswell J.","edition":"3"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1186\/1471-2288-11-100"},{"key":"e_1_2_1_13_1","volume-title":"Proceedings of the 7th International Conference on Networked Learning.","author":"Dawson S."},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/2090116.2090120"},{"key":"e_1_2_1_15_1","volume-title":"Team Performance Assessment and Measurement: Theory, Methods, and Applications","author":"Dickinson T."},{"key":"e_1_2_1_16_1","volume-title":"Proceedings of the International Workshop on Cooperative and Human Aspects of Software Engineering.","author":"Dingsoyr T."},{"key":"e_1_2_1_17_1","first-page":"19","article-title":"Evaluating agile principles in CS Education","volume":"10","author":"El-Abbassy A.","year":"2010","journal-title":"International Journal of Computer Science and Network Security"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1080\/08993408.2012.727713"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/2445196.2445268"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/1296951.1296955"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/2090116.2090131"},{"key":"e_1_2_1_22_1","volume-title":"Proceedings of the 9th International Conference on Web-based Learning.","author":"Govaerts S."},{"key":"e_1_2_1_23_1","volume-title":"Analyzing Interactions in CSCL","author":"Gweon G."},{"key":"e_1_2_1_24_1","unstructured":"A. Hadwin S. J\u00e4rvel\u00e4 and M. Miller. 2011. Self-regulated co-regulated and socially shared regulation. In Handbook of Self-Regulation of Learning and Performance B. Zimmerman and D. Schunk (Eds.). Taylor & Francis New York 65--63.  A. Hadwin S. J\u00e4rvel\u00e4 and M. Miller. 2011. Self-regulated co-regulated and socially shared regulation. In Handbook of Self-Regulation of Learning and Performance B. Zimmerman and D. Schunk (Eds.). Taylor & Francis New York 65--63."},{"key":"e_1_2_1_25_1","doi-asserted-by":"crossref","unstructured":"T. Heafner and A. Friedman. 2008. Wikis and constructivism in secondary social studies: Fostering a deeper understanding. Computers in the Schools 253--254 288--302.  T. Heafner and A. Friedman. 2008. Wikis and constructivism in secondary social studies: Fostering a deeper understanding. Computers in the Schools 253--254 288--302.","DOI":"10.1080\/07380560802371003"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.compedu.2003.07.001"},{"key":"e_1_2_1_27_1","volume-title":"Proceedings of the 6th International Conference on Learning Sciences.","author":"Hmelo-Silver C."},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11251-008-9063-8"},{"key":"e_1_2_1_29_1","volume-title":"Whitehill (Eds.)","volume":"8","author":"Hmelo-Silver C."},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1177\/1049732305276687"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1002\/ir.380"},{"key":"e_1_2_1_32_1","volume-title":"Content Analysis: An Introduction to its Methodology","author":"Krippendorff K.","edition":"2"},{"key":"e_1_2_1_33_1","volume-title":"New York: Springer","author":"Law N.","year":"2011"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1109\/FIE.2011.6143000"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/1953163.1953199"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/1013367.1013393"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1080\/13614560701712667"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/2526968.2526984"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1109\/TE.2007.901982"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1561\/1500000011"},{"key":"e_1_2_1_41_1","volume-title":"AAAI Spring Symposium Series.","author":"Polanya L."},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/1047788.1047794"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/2445196.2445351"},{"key":"#cr-split#-e_1_2_1_44_1.1","doi-asserted-by":"crossref","unstructured":"M. Robles. 2012. Executive perceptions of the top 10 soft skills needed in today's workplace. Business Communication Quarterly. DOI: 10.1177\/1080569912460400 10.1177\/1080569912460400","DOI":"10.1177\/1080569912460400"},{"key":"#cr-split#-e_1_2_1_44_1.2","doi-asserted-by":"crossref","unstructured":"M. Robles. 2012. Executive perceptions of the top 10 soft skills needed in today's workplace. Business Communication Quarterly. DOI: 10.1177\/1080569912460400","DOI":"10.1177\/1080569912460400"},{"key":"e_1_2_1_45_1","volume-title":"Proceedings of the Frontiers in Education Conference.","author":"Ruff S."},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1002\/nur.4770180211"},{"key":"e_1_2_1_47_1","volume-title":"Proceedings of the 1st Workshop on Exploring the Fitness and Evolvability of Personal Learning Environments.","author":"Santos J."},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1365-2923.2011.04035.x"},{"key":"e_1_2_1_49_1","doi-asserted-by":"crossref","unstructured":"H. Schmitz M. Scheffel M. Friedrich M. Jahn K. Niemann and M. Wolpers. 2009. Learning in the synergy of multiple disciplines. In Lecture Notes in Computer Science U. Cress V. Dimitrova and M. Specht (Eds.). Springer. 507--520  H. Schmitz M. Scheffel M. Friedrich M. Jahn K. Niemann and M. Wolpers. 2009. Learning in the synergy of multiple disciplines. In Lecture Notes in Computer Science U. Cress V. Dimitrova and M. Specht (Eds.). Springer. 507--520","DOI":"10.1007\/978-3-642-04636-0_47"},{"key":"e_1_2_1_50_1","volume-title":"Learning Theories: An Educational Perspective","author":"Schunk D.","edition":"5"},{"key":"e_1_2_1_51_1","volume-title":"Proceedings of the Computer Support for Collaborative Learning Conference.","author":"Strijbos J.-W."},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1365-2729.2008.00276.x"},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1145\/2090116.2090129"},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1145\/2526968.2526980"},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1109\/LaTiCE.2013.22"},{"key":"e_1_2_1_56_1","doi-asserted-by":"crossref","volume-title":"Basic Content Analysis","author":"Weber R.","DOI":"10.4135\/9781412983488"},{"key":"e_1_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.compedu.2005.04.003"},{"key":"e_1_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.1021\/ed085p1446"},{"key":"e_1_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.compcom.2008.06.001"},{"key":"e_1_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.3115\/1220575.1220619"},{"key":"e_1_2_1_61_1","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0038869"},{"key":"e_1_2_1_62_1","first-page":"1","article-title":"Case study as a research method","volume":"9","author":"Zanial Z.","year":"2007","journal-title":"Jurnal Kemanusiaan"},{"key":"e_1_2_1_63_1","doi-asserted-by":"publisher","DOI":"10.1016\/0361-476X(86)90027-5"},{"key":"e_1_2_1_64_1","doi-asserted-by":"publisher","DOI":"10.3102\/00028312023004614"}],"container-title":["ACM Transactions on Computing Education"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2793507","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/2793507","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T06:16:51Z","timestamp":1750227411000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2793507"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2016,2,17]]},"references-count":65,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2016,3,28]]}},"alternative-id":["10.1145\/2793507"],"URL":"https:\/\/doi.org\/10.1145\/2793507","relation":{},"ISSN":["1946-6226"],"issn-type":[{"value":"1946-6226","type":"electronic"}],"subject":[],"published":{"date-parts":[[2016,2,17]]},"assertion":[{"value":"2014-03-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2015-04-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2016-02-17","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}