{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,19]],"date-time":"2026-02-19T10:15:13Z","timestamp":1771496113813,"version":"3.50.1"},"reference-count":31,"publisher":"ICT in Practice","issue":"3","license":[{"start":{"date-parts":[[2026,2,19]],"date-time":"2026-02-19T00:00:00Z","timestamp":1771459200000},"content-version":"unspecified","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["IJCSES"],"abstract":"<jats:p>An objective evaluation and assessment of individual student-designed projects are challenging. Appropriate tools are currently lagging and have to be developed. Block-based programming languages, such as Snap!, are often used for teaching programming basics and the subsequent development of student-designed programming projects. The current research qualitatively developed a rating rubric for Snap! projects to investigate how novices\u2019 programming skills can be evaluated and assessed in a criterion-guided manner. For this purpose, an evaluation was conducted on a baseline dataset of 36 student projects created over three school years after a programming course for novices. Based on this database an assessment rubric was designed. A team of experts reviewed and evaluated the assessment rubric. Following expert evaluation, the rubric was improved and expanded. Finally, a test data set consisting of ten other Snap! projects of varying complexity was presented to prospective teachers for comparative evaluation with and without the resulting rubric. The results show that the rating rubric significantly improves the comparability of assessments. In addition, a clear differentiation of the projects by level is achieved for the test data set. Furthermore, the assessment rubric enables a more precise achieved result evaluation in particular rubric categories.<\/jats:p>","DOI":"10.21585\/ijcses.v7i3.226","type":"journal-article","created":{"date-parts":[[2026,2,19]],"date-time":"2026-02-19T09:00:23Z","timestamp":1771491623000},"source":"Crossref","is-referenced-by-count":0,"title":["Rubric for the qualitative assessment of student-designed Snap! projects"],"prefix":"10.21585","volume":"7","author":[{"given":"Nicole","family":"Marm\u00e9","sequence":"first","affiliation":[]},{"given":"Jens-Peter","family":"Knemeyer","sequence":"additional","affiliation":[]},{"given":"Alexandra","family":"Svedkijs","sequence":"additional","affiliation":[]}],"member":"9038","published-online":{"date-parts":[[2026,2,19]]},"reference":[{"key":"6596","unstructured":"Andrade, H. G. (2000). Using Rubrics to Promote Thinking and Learning."},{"key":"6597","doi-asserted-by":"crossref","unstructured":"Ball, M. A., & Garcia, D. D. (2016, Februar). Autograding and Feedback for Snap!: A Visual Program-ming Language (Abstract Only). Proceedings of the 47th ACM Technical Symposium on Compu-ting Science Education. 47th ACM Technical Symposium on Computing Science Education. https:\/\/doi.org\/10.1145\/2839509.2850572","DOI":"10.1145\/2839509.2850572"},{"key":"6598","doi-asserted-by":"crossref","unstructured":"Balouktsis, I. (2016). Learning Renewable Energy by Scratch Programming. \u0395\u03c0\u03b9\u03c3\u03c4\u03b7\u03bc\u03bf\u03bd\u03b9\u03ba\u03ae \u0395\u03c0\u03b5\u03c4\u03b7\u03c1\u03af\u03b4\u03b1 \u03a0\u03b1\u03b9\u03b4\u03b1\u03b3\u03c9\u03b3\u03b9\u03ba\u03bf\u03cd \u03a4\u03bc\u03ae\u03bc\u03b1\u03c4\u03bf\u03c2 \u039d\u03b7\u03c0\u03b9\u03b1\u03b3\u03c9\u03b3\u03ce\u03bd \u03a0\u03b1\u03bd\u03b5\u03c0\u03b9\u03c3\u03c4\u03b7\u03bc\u03af\u03bf\u03c5 \u0399\u03c9\u03b1\u03bd\u03bd\u03af\u03bd\u03c9\u03bd, 9(1), 129. https:\/\/doi.org\/10.12681\/jret.8916","DOI":"10.12681\/jret.8916"},{"key":"6599","doi-asserted-by":"crossref","unstructured":"Boe, B., Hill, C., Len, M., Dreschler, G., Conrad, P., & Franklin, D. (2013). Hairball: Lint-inspired static analysis of scratch projects. Proceeding of the 44th ACM Technical Symposium on Comput-er Science Education, 215\u2013220. https:\/\/doi.org\/10.1145\/2445196.2445265","DOI":"10.1145\/2445196.2445265"},{"key":"6600","doi-asserted-by":"crossref","unstructured":"Da Cruz Alves, N., Gresse von Wangenheim, C., & Hauck, J. C. R. (2019). Approaches to Assess Com-putational Thinking Competences Based on Code Analysis in K-12 Education: A Systematic Mapping Study. Informatics in Education, 18, 17\u201339. https:\/\/doi.org\/10.15388\/infedu.2019.02","DOI":"10.15388\/infedu.2019.02"},{"key":"6601","doi-asserted-by":"crossref","unstructured":"Denner, J., Werner, L., & Ortiz, E. (2012). Computer games created by middle school girls: Can they be used to measure understanding of computer science concepts? Computers & Education, 58(1), 240\u2013249. https:\/\/doi.org\/10.1016\/j.compedu.2011.08.006","DOI":"10.1016\/j.compedu.2011.08.006"},{"key":"6602","unstructured":"D\u00f6ring, N., & Bortz, J. (2016). Forschungsmethoden und Evaluation in den Sozial- und Humanwissen-schaften. Springer Berlin, Heidelberg. https:\/\/doi.org\/10.1007%2F978-3-642-41089-5"},{"key":"6603","doi-asserted-by":"crossref","unstructured":"Funke, A., & Geldreich, K. (2017). Measurement and Visualization of Programming Processes of Primary School Students in Scratch. Proceedings of the 12th Workshop on Primary and Secondary Com-puting Education - WiPSCE \u201917, 101\u2013102. https:\/\/doi.org\/10.1145\/3137065.3137086","DOI":"10.1145\/3137065.3137086"},{"key":"6604","doi-asserted-by":"crossref","unstructured":"Garcia, D. D., Harvey, B., & Segars, L. (2012). CS principles pilot at University of California, Berkeley. ACM Inroads, 3(2), 58. https:\/\/doi.org\/10.1145\/2189835.2189853","DOI":"10.1145\/2189835.2189853"},{"key":"6605","unstructured":"Gesellschaft f\u00fcr Informatik (Hrsg.). (2016). Bildungsstandards Informatik\u2014Sekundarstufe II. Empfehlun-gen der Gesellschaft f\u00fcr Informatik e. V. erarbeitet vom Arbeitskreis \u00bbBildungsstandards SII\u00ab, 183\/184, 88."},{"key":"6606","doi-asserted-by":"crossref","unstructured":"Gummels, I. (2020). Wie kooperatives Lernen im inklusiven Unterricht gelingt. Springer Spektrum Wies-baden. https:\/\/doi.org\/10.1007\/978-3-658-29114-3","DOI":"10.1007\/978-3-658-29114-3"},{"key":"6607","unstructured":"Harel, I., Massachusetts Institute of Technology, & Media Laboratory (Hrsg.). (1993). Constructionism: Research reports and essays, 1985-1990 (2. print). Ablex Publ. Corp."},{"key":"6608","unstructured":"Hattie, J. (2009). Visible learning: A synthesis of over 800 meta-analyses relating to achievement. Rout-ledge."},{"key":"6609","unstructured":"J\u00fcrgens, E., & Lissmann, U. (2015). P\u00e4dagogische Diagnostik. Beltz Verlag."},{"key":"6610","doi-asserted-by":"crossref","unstructured":"Koh, K. H., Basawapatna, A., Nickerson, H., & Repenning, A. (2014). Real Time Assessment of Compu-tational Thinking. 2014 IEEE Symposium on Visual Languages and Human-Centric Computing (VL\/HCC), 49\u201352. https:\/\/doi.org\/10.1109\/VLHCC.2014.6883021","DOI":"10.1109\/VLHCC.2014.6883021"},{"key":"6611","doi-asserted-by":"crossref","unstructured":"Maloney, J., Resnick, M., Rusk, N., Silverman, B., & Eastmond, E. (2010). The Scratch Programming Language and Environment. ACM Transactions on Computing Education, 10(4), 1\u201315. https:\/\/doi.org\/10.1145\/1868358.1868363","DOI":"10.1145\/1868358.1868363"},{"key":"6612","doi-asserted-by":"crossref","unstructured":"Mladenovi\u0107, M., Mladenovi\u0107, S., & \u017danko, \u017d. (2020). Impact of used programming language for K-12 students\u2019 understanding of the loop concept. International Journal of Technology Enhanced Learning, 12(1), 79. https:\/\/doi.org\/10.1504\/IJTEL.2020.103817","DOI":"10.1504\/IJTEL.2020.103817"},{"key":"6613","unstructured":"Modrow, E. (2018). Informatik mit Snap!, Snap! In Beispielen. http:\/\/ddi-mod.uni-goettingen.de\/InformatikMitSnap.pdf"},{"key":"6614","doi-asserted-by":"crossref","unstructured":"Moreno-Le\u00f3n, J., Rom\u00e1n-Gonz\u00e1lez, M., Harteveld, C., & Robles, G. (2017). On the Automatic Assess-ment of Computational Thinking Skills: A Comparison with Human Experts. Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems, 2788\u20132795. https:\/\/doi.org\/10.1145\/3027063.3053216","DOI":"10.1145\/3027063.3053216"},{"key":"6615","doi-asserted-by":"crossref","unstructured":"Perera, P., Tennakoon, G., Ahangama, S., Panditharathna, R., & Chathuranga, B. (2021). A Systematic Mapping of Introductory Programming Languages for Novice Learners. IEEE Access, 9, 88121\u201388136. https:\/\/doi.org\/10.1109\/ACCESS.2021.3089560","DOI":"10.1109\/ACCESS.2021.3089560"},{"key":"6616","doi-asserted-by":"crossref","unstructured":"Price, T. W., & Barnes, T. (2015). Comparing Textual and Block Interfaces in a Novice Programming Environment. Comparing Textual and Block Interfaces in a Novice Programming Environment. https:\/\/doi.org\/10.1145\/2787622.2787712","DOI":"10.1145\/2787622.2787712"},{"key":"6617","doi-asserted-by":"crossref","unstructured":"Seiter, L., & Foreman, B. (2013). Modeling the learning progressions of computational thinking of prima-ry grade students. Proceedings of the Ninth Annual International ACM Conference on Interna-tional Computing Education Research, 59\u201366. https:\/\/doi.org\/10.1145\/2493394.2493403","DOI":"10.1145\/2493394.2493403"},{"key":"6618","doi-asserted-by":"crossref","unstructured":"Shute, V. J. (2008). Focus on Formative Feedback. Review of Educational Research, 78(1), 153\u2013189. https:\/\/doi.org\/10.3102\/0034654307313795","DOI":"10.3102\/0034654307313795"},{"key":"6619","doi-asserted-by":"crossref","unstructured":"Svedkijs, A., Knemeyer, J.-P., & Marm\u00e9, N. (2022). F\u00f6rderung von Computational Thinking durch ein digitales Leitprogramm zur blockbasierten Programmiersprache Snap! In B. Stadl (Hrsg.), Digita-le Lehre nachhaltig gestalten. Waxmann Verlag. https:\/\/doi.org\/10.31244\/9783830996330","DOI":"10.31244\/9783830996330"},{"key":"6620","doi-asserted-by":"crossref","unstructured":"Wang, W., Zhang, C., & Stahlbauer, A. (2021, April 23). SnapCheck: Automated Testing for Snap! Pro-grams. ITiCSE 2021. https:\/\/doi.org\/10.1145\/3430665.3456367","DOI":"10.1145\/3430665.3456367"},{"key":"6621","doi-asserted-by":"crossref","unstructured":"Weintrop, D., & Wilensky, U. (2015). To Block or Not to Block, That is the Question: Students\u2019 Percep-tions of Blocks-Based Programming. Proceedings of the 14th International Conference on Inter-action Design and Children, 199\u2013208. https:\/\/doi.org\/10.1145\/2771839.2771860","DOI":"10.1145\/2771839.2771860"},{"key":"6622","doi-asserted-by":"crossref","unstructured":"Weintrop, D., & Wilensky, U. (2017). Comparing block-based and text-based programming in high school computer science classrooms. ACM Transactions on Computing Education (TOCE), 18(1), 3.","DOI":"10.1145\/3089799"},{"key":"6623","doi-asserted-by":"crossref","unstructured":"Werner, L., Denner, J., Campe, S., & Kawamoto, D. C. (2012). The fairy performance assessment: Meas-uring computational thinking in middle school. ACM Transactions on Computing Education, 215\u2013220. https:\/\/dl.acm.org\/doi\/10.1145\/2157136.2157200","DOI":"10.1145\/2157136.2157200"},{"key":"6624","unstructured":"Wiliam, D. (2011). Embedded formative assessment. Solution Tree Press."},{"key":"6625","unstructured":"Wolf, K., & Stevens, E. (2007). The Role of Rubrics in Advancing and Assessing Student Learning. 7(1)."},{"key":"6626","doi-asserted-by":"crossref","unstructured":"Zhang, N., & Biswas, G. (2019). Defining and Assessing Students\u2019 Computational Thinking in a Learning by Modeling Environment. In S.-C. Kong & H. Abelson (Hrsg.), Computational Thinking Edu-cation (S. 203\u2013221). Springer Singapore. https:\/\/doi.org\/10.1007\/978-981-13-6528-7_12","DOI":"10.1007\/978-981-13-6528-7_12"}],"container-title":["International Journal of Computer Science Education in Schools"],"original-title":[],"deposited":{"date-parts":[[2026,2,19]],"date-time":"2026-02-19T09:00:58Z","timestamp":1771491658000},"score":1,"resource":{"primary":{"URL":"https:\/\/ijcses.org\/index.php\/ijcses\/article\/view\/226"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,2,19]]},"references-count":31,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2026,2,19]]}},"URL":"https:\/\/doi.org\/10.21585\/ijcses.v7i3.226","relation":{},"ISSN":["2513-8359"],"issn-type":[{"value":"2513-8359","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,2,19]]}}}