{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,19]],"date-time":"2026-03-19T06:55:42Z","timestamp":1773903342426,"version":"3.50.1"},"reference-count":44,"publisher":"Association for Computing Machinery (ACM)","issue":"1","license":[{"start":{"date-parts":[[2009,3,1]],"date-time":"2009-03-01T00:00:00Z","timestamp":1235865600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Comput. Educ."],"published-print":{"date-parts":[[2009,3]]},"abstract":"<jats:p>\n            As collaborative learning in general, and pair programming in particular, has become widely adopted in computer science education, so has the use of pedagogical visualization tools for facilitating collaboration. However, there is little theory on collaborative learning with visualization, and few studies on their effect on each other. We build on the concept of the\n            <jats:italic>engagement taxonomy<\/jats:italic>\n            and extend it to classify finer variations in the engagement that result from the use of a visualization tool. We analyze the applicability of the taxonomy to the description of the differences in the collaboration process when visualization is used. Our hypothesis is that increasing the level of engagement between learners and the visualization tool results in a higher positive impact of the visualization on the collaboration process. This article describes an empirical investigation designed to test the hypothesis. The results provide support for our extended engagement taxonomy and hypothesis by showing that the collaborative activities of the students and the engagement levels are correlated.\n          <\/jats:p>","DOI":"10.1145\/1513593.1513600","type":"journal-article","created":{"date-parts":[[2009,12,1]],"date-time":"2009-12-01T14:35:04Z","timestamp":1259678104000},"page":"1-27","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":58,"title":["Extending the Engagement Taxonomy"],"prefix":"10.1145","volume":"9","author":[{"given":"Niko","family":"Myller","sequence":"first","affiliation":[{"name":"University of Joensuu"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Roman","family":"Bednarik","sequence":"additional","affiliation":[{"name":"University of Joensuu"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Erkki","family":"Sutinen","sequence":"additional","affiliation":[{"name":"University of Joensuu"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Mordechai","family":"Ben-Ari","sequence":"additional","affiliation":[{"name":"Weizmann Institute of Science"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2009,3]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0360-1315(02)00076-3"},{"key":"e_1_2_1_2_1","first-page":"399","article-title":"Measuring the development of features in moral discussion","volume":"29","author":"Berkowitz M. W.","year":"1983","unstructured":"Berkowitz , M. W. and Gibbs , J. C. 1983 . Measuring the development of features in moral discussion . Merill-Palmer Quar. 29 , 399 -- 410 . Berkowitz, M. W. and Gibbs, J. C. 1983. Measuring the development of features in moral discussion. Merill-Palmer Quar. 29, 399--410.","journal-title":"Merill-Palmer Quar."},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/1099203.1099264"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/1151588.1151590"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.compedu.2006.01.008"},{"key":"e_1_2_1_6_1","volume-title":"Educational Research: An Introduction","author":"Gall M. D.","year":"2006","unstructured":"Gall , M. D. , Gall , J. P. , and Borg , W. R . 2006 . Educational Research: An Introduction 8 th Ed. Allyn &amp; Bacon . Gall, M. D., Gall, J. P., and Borg, W. R. 2006. Educational Research: An Introduction 8th Ed. Allyn &amp; Bacon.","edition":"8"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1006\/jvlc.1996.0009"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/774833.774846"},{"key":"e_1_2_1_9_1","volume-title":"Proceedings of Informing Science + IT Education Conference (InSITE\u201904)","author":"Haaster K. V.","unstructured":"Haaster , K. V. and Hagan , D . 2004. Teaching and learning with BlueJ: An evaluation of a pedagogical tool . In Proceedings of Informing Science + IT Education Conference (InSITE\u201904) . Informing Science Institute, 455--470. Haaster, K. V. and Hagan, D. 2004. Teaching and learning with BlueJ: An evaluation of a pedagogical tool. In Proceedings of Informing Science + IT Education Conference (InSITE\u201904). Informing Science Institute, 455--470."},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/792548.611919"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0360-1315(02)00044-1"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jvlc.2004.11.002"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/1089786.1089791"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jvlc.2006.03.002"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.compedu.2006.06.002"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1006\/jvlc.2002.0237"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.compedu.2006.01.004"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0747-5632(98)00015-6"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1076\/csed.13.4.249.17496"},{"key":"e_1_2_1_20_1","volume-title":"5th International Conference on Web Information Systems and Technologies (WEBIST\u201909)","author":"Korhonen A.","unstructured":"Korhonen , A. , Laakso , M. , and Myller , N . 2008. How does algorithm visualization affect collaboration? Video analysis of engagement and discussions . 5th International Conference on Web Information Systems and Technologies (WEBIST\u201909) . Submitted. Korhonen, A., Laakso, M., and Myller, N. 2008. How does algorithm visualization affect collaboration? Video analysis of engagement and discussions. 5th International Conference on Web Information Systems and Technologies (WEBIST\u201909). Submitted."},{"key":"e_1_2_1_21_1","article-title":"Analyzing the extended engagement taxonomy in collaborative algorithm visualization","author":"Laakso M.-J.","year":"2008","unstructured":"Laakso , M.-J. , Myller , N. , and Korhonen , A. 2008 . Analyzing the extended engagement taxonomy in collaborative algorithm visualization . J. Ed. Technol. Soc. To appear. Laakso, M.-J., Myller, N., and Korhonen, A. 2008. Analyzing the extended engagement taxonomy in collaborative algorithm visualization. J. Ed. Technol. Soc. To appear.","journal-title":"J. Ed. Technol. Soc. To appear."},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.2307\/2529310"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/1145287.1145293"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11412-006-9005-x"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/989863.989928"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.entcs.2007.01.034"},{"key":"e_1_2_1_27_1","doi-asserted-by":"crossref","unstructured":"Myller N. Bednarik R. and Moreno A. 2007a. Integrating dynamic program visualization into BlueJ: The Jeliot 3 extension. In Proceedings of the 7th IEEE International Conference on Advanced Learning Technologies J. M. Spector D. G. Sampson T. Okamoto Kinshuk S. A. Cerri M. Ueno and A. Kashihara Eds. IEEE Computer Society 505--506. Myller N. Bednarik R. and Moreno A. 2007a. Integrating dynamic program visualization into BlueJ: The Jeliot 3 extension. In Proceedings of the 7th IEEE International Conference on Advanced Learning Technologies J. M. Spector D. G. Sampson T. Okamoto Kinshuk S. A. Cerri M. Ueno and A. Kashihara Eds. IEEE Computer Society 505--506.","DOI":"10.1109\/ICALT.2007.165"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/1268784.1268857"},{"key":"e_1_2_1_29_1","doi-asserted-by":"crossref","first-page":"267","DOI":"10.15388\/infedu.2006.19","article-title":"JeCo: Combining program visualization and story weaving","volume":"5","author":"Myller N.","year":"2006","unstructured":"Myller , N. and Nuutinen , J. 2006 . JeCo: Combining program visualization and story weaving . Informatics Ed. 5 , 2, 267 -- 276 . Myller, N. and Nuutinen, J. 2006. JeCo: Combining program visualization and story weaving. Informatics Ed. 5, 2, 267--276.","journal-title":"Informatics Ed."},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/611892.612006"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1109\/MCG.2005.110"},{"key":"e_1_2_1_32_1","first-page":"88","article-title":"The effective use of quicksort visualizations in the classroom","volume":"18","author":"Naps T. L.","year":"2002","unstructured":"Naps , T. L. and Grissom , S. 2002 . The effective use of quicksort visualizations in the classroom . J. Comput. Sci. Coll 18 , 1, 88 -- 96 . Naps, T. L. and Grissom, S. 2002. The effective use of quicksort visualizations in the classroom. J. Comput. Sci. Coll 18, 1, 88--96.","journal-title":"J. Comput. Sci. Coll"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/960568.782998"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.entcs.2007.01.047"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/1047124.1047425"},{"key":"e_1_2_1_36_1","volume-title":"Computers, Communication &amp","author":"Roschelle J.","unstructured":"Roschelle , J. 1996. Designing for cognitive communication: Epistemic fidelity or mediating collaborative inquiry . In Computers, Communication &amp ; Mental Models, D. L. Day and D. K. Kovacs Eds. Taylor &amp; Francis, London, UK. 13--25. Roschelle, J. 1996. Designing for cognitive communication: Epistemic fidelity or mediating collaborative inquiry. In Computers, Communication &amp; Mental Models, D. L. Day and D. K. Kovacs Eds. Taylor &amp; Francis, London, UK. 13--25."},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/544414.544446"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1006\/ijhc.1996.0048"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/1007996.1008053"},{"key":"e_1_2_1_40_1","doi-asserted-by":"crossref","unstructured":"Spada H. Meier A. Rummel N. and Hauser S. 2005. A new method to assess the quality of collaborative process in CSCL. In Computer Supported Collaborative Learning 2005: The Next 10 Years T. Koschmann D. Suthers and T. W. Chan Eds. Lawrence Erlbaum Mahwah NJ. 622--631. Spada H. Meier A. Rummel N. and Hauser S. 2005. A new method to assess the quality of collaborative process in CSCL. In Computer Supported Collaborative Learning 2005: The Next 10 Years T. Koschmann D. Suthers and T. W. Chan Eds. Lawrence Erlbaum Mahwah NJ. 622--631.","DOI":"10.3115\/1149293.1149375"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1207\/S15327809JLS1202_2"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.compedu.2003.04.001"},{"key":"e_1_2_1_43_1","volume-title":"Discourse, Tools and Reasoning: Essays on Situated Cognition","author":"Teasley S.","unstructured":"Teasley , S. 1997. Talking about reasoning: How important is the peer in peer collaboration . In Discourse, Tools and Reasoning: Essays on Situated Cognition , L. Resnick, R. S\u00e4lj\u00f6, C. Pontecorvo, and B. Burge Eds. Springer , Berlin, Germany . 361--384. Teasley, S. 1997. Talking about reasoning: How important is the peer in peer collaboration. In Discourse, Tools and Reasoning: Essays on Situated Cognition, L. Resnick, R. S\u00e4lj\u00f6, C. Pontecorvo, and B. Burge Eds. Springer, Berlin, Germany. 361--384."},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1109\/52.854064"}],"container-title":["ACM Transactions on Computing Education"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1513593.1513600","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/1513593.1513600","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T13:57:58Z","timestamp":1750255078000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1513593.1513600"}},"subtitle":["Software Visualization and Collaborative Learning"],"short-title":[],"issued":{"date-parts":[[2009,3]]},"references-count":44,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2009,3]]}},"alternative-id":["10.1145\/1513593.1513600"],"URL":"https:\/\/doi.org\/10.1145\/1513593.1513600","relation":{},"ISSN":["1946-6226"],"issn-type":[{"value":"1946-6226","type":"electronic"}],"subject":[],"published":{"date-parts":[[2009,3]]},"assertion":[{"value":"2008-01-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2008-11-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2009-03-01","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}