{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T04:14:27Z","timestamp":1750220067386,"version":"3.41.0"},"reference-count":45,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2022,12,31]],"date-time":"2022-12-31T00:00:00Z","timestamp":1672444800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["ACM Trans. Comput. Educ."],"published-print":{"date-parts":[[2022,12,31]]},"abstract":"<jats:p>In many countries, computer programming is becoming an integral part of the secondary school curriculum. However, many teachers, especially in the first years of Flemish secondary school, have limited experience with teaching programming. To improve their knowledge about programming, many different types of professional development programs have been proposed. Nevertheless, these programs mostly focus on technical skills and less on pedagogical skills. One aspect that is often overlooked in these programs is how teachers can assess code. To get insight into what teachers currently value when assessing code, we designed an experiment that analyzes the different aspects teachers consider during the assessment of code. During the experiment, the teachers (N=13) assess a set of programs from five different fictional learners. After the assessment, they participated in a semi-structured interview, giving us insight into the assessment process. We evaluated the transcripts of the interviews using deductive thematic analysis using a coding schema defining the different aspects of code that can be assessed. Additionally, we linked the assessment strategies of teachers to their teaching experience. Our results indicate that many teachers are unaware of the different concepts that can be part of the assessment of code, which might lead to inaccurate or invalid feedback. Moreover, although our experimental group was too small to draw hard conclusions about the inter-case results, our results indicate that the number of concepts considered by teachers seems to increase with experience. These results provide an initial insight into the code assessment practices of teachers and reveals interesting pathways for future research into the assessment of code.<\/jats:p>","DOI":"10.1145\/3517133","type":"journal-article","created":{"date-parts":[[2022,3,25]],"date-time":"2022-03-25T06:20:52Z","timestamp":1648189252000},"page":"1-27","source":"Crossref","is-referenced-by-count":2,"title":["Assessment of Code, Which Aspects Do Teachers Consider and How Are They Valued?"],"prefix":"10.1145","volume":"22","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-1850-224X","authenticated-orcid":false,"given":"Tom","family":"Neutens","sequence":"first","affiliation":[{"name":"Ghent University- imec - IDLab - AIRO, Oost-Vlaanderen, Belgium"}]},{"given":"Kris","family":"Coolsaet","sequence":"additional","affiliation":[{"name":"Ghent University, Oost-Vlaanderen, Belgium"}]},{"given":"Francis","family":"Wyffels","sequence":"additional","affiliation":[{"name":"Ghent University- imec - IDLab - AIRO, Oost-Vlaanderen, Belgium"}]}],"member":"320","reference":[{"key":"e_1_3_2_2_2","doi-asserted-by":"publisher","DOI":"10.1002\/9781118410868.wbehibs395"},{"key":"e_1_3_2_3_2","unstructured":"Sarah Elsie Baker and Rosalind Edwards. 2012. How many qualitative interviews is enough. https:\/\/eprints.ncrm.ac.uk\/id\/eprint\/2273\/4\/how_many_interviews.pdf."},{"key":"e_1_3_2_4_2","doi-asserted-by":"publisher","DOI":"10.1145\/3287324.3287412"},{"key":"e_1_3_2_5_2","doi-asserted-by":"publisher","DOI":"10.1145\/3328778.3366849"},{"key":"e_1_3_2_6_2","doi-asserted-by":"publisher","DOI":"10.1109\/TLA.2018.8408443"},{"key":"e_1_3_2_7_2","doi-asserted-by":"publisher","DOI":"10.1145\/3174781.3174785"},{"key":"e_1_3_2_8_2","doi-asserted-by":"publisher","DOI":"10.1191\/1478088706qp063oa"},{"key":"e_1_3_2_9_2","volume-title":"Proceedings of the Annual Meeting of the American Educational Research Association","author":"Brennan Karen","year":"2012","unstructured":"Karen Brennan and Mitchel Resnick. 2012. New frameworks for studying and assessing the development of computational thinking. In Proceedings of the Annual Meeting of the American Educational Research Association."},{"key":"e_1_3_2_10_2","doi-asserted-by":"publisher","DOI":"10.1177\/0049124113500475"},{"key":"e_1_3_2_11_2","doi-asserted-by":"publisher","DOI":"10.1145\/3328778.3366937"},{"key":"e_1_3_2_12_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.compedu.2017.03.001"},{"key":"e_1_3_2_13_2","volume-title":"The Inmates Are Running the Asylum: Why High-tech Products Drive Us Crazy and How to Restore the Sanity","author":"Cooper Alan","year":"2004","unstructured":"Alan Cooper et\u00a0al. 2004. The Inmates Are Running the Asylum: Why High-tech Products Drive Us Crazy and How to Restore the Sanity. Vol. 2. Sams Technical Publishing, Indianapolis, IN."},{"key":"e_1_3_2_14_2","doi-asserted-by":"publisher","DOI":"10.1177\/0049124118799377"},{"key":"e_1_3_2_15_2","doi-asserted-by":"publisher","DOI":"10.1145\/3304221.3319772"},{"key":"e_1_3_2_16_2","doi-asserted-by":"publisher","DOI":"10.1145\/2716316"},{"key":"e_1_3_2_17_2","doi-asserted-by":"publisher","DOI":"10.1145\/3364510.3364517"},{"issue":"9","key":"e_1_3_2_18_2","first-page":"1408","article-title":"Are we there yet? Data saturation in qualitative research","volume":"20","author":"Fusch Patricia I.","year":"2015","unstructured":"Patricia I. Fusch and Lawrence R. Ness. 2015. Are we there yet? Data saturation in qualitative research. Qualitat. Rep. 20, 9 (2015), 1408.","journal-title":"Qualitat. Rep."},{"key":"e_1_3_2_19_2","doi-asserted-by":"publisher","DOI":"10.1007\/11915355_15"},{"key":"e_1_3_2_20_2","doi-asserted-by":"publisher","DOI":"10.1145\/3017680.3017723"},{"key":"e_1_3_2_21_2","doi-asserted-by":"publisher","DOI":"10.1080\/0969594X.2018.1555515"},{"key":"e_1_3_2_22_2","first-page":"1904","volume-title":"Proceedings of the Society for Information Technology & Teacher Education International Conference","author":"Hestness Emily","year":"2018","unstructured":"Emily Hestness, Diane Jass Ketelhut, J. Randy McGinnis, Jandelyn Plane, Bonnie Razler, Kelly Mills, Lautaro Cabrera, and Elias Gonzalez. 2018. Computational thinking professional development for elementary science educators: Examining the design process. In Proceedings of the Society for Information Technology & Teacher Education International Conference. Association for the Advancement of Computing in Education (AACE), 1904\u20131912."},{"issue":"4","key":"e_1_3_2_23_2","first-page":"6","article-title":"The role of computer programming in education","volume":"2","author":"Kahn Ken","year":"1999","unstructured":"Ken Kahn and Harriette L. Spiegel. 1999. The role of computer programming in education. J. Educ. Technol. Societ. 2, 4 (1999), 6\u20139.","journal-title":"J. Educ. Technol. Societ."},{"key":"e_1_3_2_24_2","doi-asserted-by":"publisher","DOI":"10.1111\/jan.13031"},{"key":"e_1_3_2_25_2","doi-asserted-by":"publisher","DOI":"10.1007\/s11251-018-9453-5"},{"key":"e_1_3_2_26_2","doi-asserted-by":"publisher","DOI":"10.1145\/3428029.3428047"},{"key":"e_1_3_2_27_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.chb.2017.01.005"},{"key":"e_1_3_2_28_2","doi-asserted-by":"publisher","DOI":"10.1109\/VLHCC.2014.6883023"},{"key":"e_1_3_2_29_2","doi-asserted-by":"publisher","DOI":"10.1145\/3421590.3421598"},{"issue":"46","key":"e_1_3_2_30_2","first-page":"1","article-title":"Dr. Scratch: Automatic analysis of Scratch projects to assess and foster computational thinking","author":"Moreno-Le\u00f3n Jes\u00fas","year":"2015","unstructured":"Jes\u00fas Moreno-Le\u00f3n, Gregorio Robles, and Marcos Rom\u00e1n-Gonz\u00e1lez. 2015. Dr. Scratch: Automatic analysis of Scratch projects to assess and foster computational thinking. RED. Revista de Educaci\u00f3n a Distancia46 (2015), 1\u201323.","journal-title":"RED. Revista de Educaci\u00f3n a Distancia"},{"key":"e_1_3_2_31_2","doi-asserted-by":"publisher","DOI":"10.1145\/1352322.1352191"},{"key":"e_1_3_2_32_2","doi-asserted-by":"publisher","DOI":"10.1007\/s11858-018-0963-z"},{"issue":"1","key":"e_1_3_2_33_2","article-title":"Applying constant comparative method with multiple investigators and inter-coder reliability.","volume":"21","author":"Olson Joel D.","year":"2016","unstructured":"Joel D. Olson, Chad McAllister, Lynn D. Grinnell, Kimberly Gehrke Walters, and Frank Appunn. 2016. Applying constant comparative method with multiple investigators and inter-coder reliability. Qualitat. Rep. 21, 1 (2016).","journal-title":"Qualitat. Rep."},{"key":"e_1_3_2_34_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.chb.2016.08.047"},{"key":"e_1_3_2_35_2","doi-asserted-by":"publisher","DOI":"10.1080\/10400419.2012.652929"},{"key":"e_1_3_2_36_2","doi-asserted-by":"publisher","DOI":"10.1080\/10400419.2012.650092"},{"key":"e_1_3_2_37_2","doi-asserted-by":"publisher","DOI":"10.1515\/ctra-2017-0013"},{"key":"e_1_3_2_38_2","doi-asserted-by":"publisher","DOI":"10.1037\/edu0000314"},{"issue":"46","key":"e_1_3_2_39_2","first-page":"1","article-title":"Analyzing the effects of coding education through pair programming for the computational thinking and creativity of elementary school students","volume":"9","author":"Seo Young-Ho","year":"2016","unstructured":"Young-Ho Seo and Jong-Hoon Kim. 2016. Analyzing the effects of coding education through pair programming for the computational thinking and creativity of elementary school students. Ind. J. Sci. Technol. 9, 46 (2016), 1\u20135.","journal-title":"Ind. J. Sci. Technol."},{"key":"e_1_3_2_40_2","doi-asserted-by":"publisher","DOI":"10.1145\/3287324.3287456"},{"key":"e_1_3_2_41_2","doi-asserted-by":"publisher","DOI":"10.1145\/2674683.2674702"},{"key":"e_1_3_2_42_2","doi-asserted-by":"publisher","DOI":"10.1145\/2999541.2999555"},{"key":"e_1_3_2_43_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.compedu.2019.103798"},{"key":"e_1_3_2_44_2","article-title":"Assessing creativity: A guide for educators.","author":"Treffinger Donald J.","year":"2002","unstructured":"Donald J. Treffinger, Grover C. Young, Edwin C. Selby, and Cindy Shepardson. 2002. Assessing creativity: A guide for educators. Nat. Res. Cent. Gift. Talent. (2002). https:\/\/eric.ed.gov\/?id=ED505548.","journal-title":"Nat. Res. Cent. Gift. Talent."},{"key":"e_1_3_2_45_2","unstructured":"Onderwijs Vlaanderen. 1999. Onderwijsdoelen - Resultaten. Retrieved from https:\/\/onderwijsdoelen.be\/uitgangspunten\/4814."},{"key":"e_1_3_2_46_2","volume-title":"Proceedings of the 6th International CDIO Conference","author":"Ystr\u00f6m Anna","year":"2010","unstructured":"Anna Ystr\u00f6m, Lena Peterson, Bj\u00f6rn von Sydow, and Johan Malmqvist. 2010. Using personas to guide education needs analysis and program design. In Proceedings of the 6th International CDIO Conference."}],"container-title":["ACM Transactions on Computing Education"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3517133","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3517133","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T18:09:02Z","timestamp":1750183742000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3517133"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,12,31]]},"references-count":45,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2022,12,31]]}},"alternative-id":["10.1145\/3517133"],"URL":"https:\/\/doi.org\/10.1145\/3517133","relation":{},"ISSN":["1946-6226","1946-6226"],"issn-type":[{"type":"print","value":"1946-6226"},{"type":"electronic","value":"1946-6226"}],"subject":[],"published":{"date-parts":[[2022,12,31]]}}}