{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T01:53:04Z","timestamp":1760147584594,"version":"build-2065373602"},"reference-count":59,"publisher":"MDPI AG","issue":"2","license":[{"start":{"date-parts":[[2023,2,13]],"date-time":"2023-02-13T00:00:00Z","timestamp":1676246400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Greece and the European Union (European Social Fund-ESF)"},{"name":"a Doctoral Research\u201d Sub-action 2: IKY Scholarship Programme for PhD candidates from Greek Universities"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Information"],"abstract":"<jats:p>Computational Thinking (CT) has emerged as an umbrella term that refers to a broad set of problem-solving skills. New generations must conquer these skills in order to thrive in a computer-based world. Teachers, as agents of change, must also be familiar, trained and well-prepared in order to train children in CT. This paper examines STEM (Science, Technology, Engineering and Mathematics) and non-STEM teachers\u2019 attitudes and readiness to adopt and utilize Computational Thinking concepts in the curriculum. The research was conducted through a descriptive assessment of students using thematically related criteria (rubrics) and a criterion on Computational Thinking usage and utilization. Fifteen teachers (n = 15) were invited to a focus group discussion in which they were asked to complete a questionnaire and, subsequently, to openly analyze their answers. The results show that the majority of teachers used computational thinking as an assessment criterion and stated that they did not face any significant problems with it. At the end of the focus group questions, they concluded that they consider participation in a training program regarding the concept and principles of computational thinking and the way they could integrate into the educational process necessary. Teachers expressed their confidence in using a set of criteria (rubric) to make students\u2019 assessments more effective and stated that they can easily use at least one criterion for Computational Thinking.<\/jats:p>","DOI":"10.3390\/info14020118","type":"journal-article","created":{"date-parts":[[2023,2,13]],"date-time":"2023-02-13T01:48:56Z","timestamp":1676252936000},"page":"118","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":4,"title":["How a Rubric Score Application Empowers Teachers\u2019 Attitudes over Computational Thinking Leverage"],"prefix":"10.3390","volume":"14","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-6219-6788","authenticated-orcid":false,"given":"Ioannis","family":"Dimos","sequence":"first","affiliation":[{"name":"Department of Computer Science and Biomedical Informatics, University of Thessaly, 35101 Lamia, Greece"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8138-5656","authenticated-orcid":false,"given":"Chrysoula","family":"Velaora","sequence":"additional","affiliation":[{"name":"Department of Computer Science and Biomedical Informatics, University of Thessaly, 35101 Lamia, Greece"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Konstantinos","family":"Louvaris","sequence":"additional","affiliation":[{"name":"Didactics of Geosciences, National and Kapodistrian University of Athens, 15772 Athens, Greece"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5431-2454","authenticated-orcid":false,"given":"Athanasios","family":"Kakarountas","sequence":"additional","affiliation":[{"name":"Department of Computer Science and Biomedical Informatics, University of Thessaly, 35101 Lamia, Greece"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8901-8423","authenticated-orcid":false,"given":"Assimina","family":"Antonarakou","sequence":"additional","affiliation":[{"name":"Didactics of Geosciences, National and Kapodistrian University of Athens, 15772 Athens, Greece"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2023,2,13]]},"reference":[{"key":"ref_1","first-page":"7","article-title":"Computational thinking\u2019s influence on research and education for all","volume":"25","author":"Wing","year":"2017","journal-title":"Ital. J. Educ. Technol."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"33","DOI":"10.1145\/1118178.1118215","article-title":"Computational thinking","volume":"49","author":"Wing","year":"2006","journal-title":"Commun. ACM"},{"key":"ref_3","first-page":"20","article-title":"Research notebook: Computational thinking\u2014What and why","volume":"6","author":"Wing","year":"2011","journal-title":"Link Mag."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"38","DOI":"10.3102\/0013189X12463051","article-title":"Computational thinking in K\u201312: A review of the state of the field","volume":"42","author":"Grover","year":"2013","journal-title":"Educ. Res."},{"key":"ref_5","unstructured":"Selby, C., and Woollard, J. (2014). Refining an Understanding of Computational Thinking, University of Southampton."},{"key":"ref_6","unstructured":"Avila, C.O., Foss, L., Bordini, A., Debacco, M.S., and da Costa Cavalheiro, S.A. (2019, January 15\u201318). Evaluation rubric for computational thinking concepts. Proceedings of the 2019 IEEE 19th International Conference on Advanced Learning Technologies (ICALT), Alagoas, Brazil."},{"key":"ref_7","first-page":"8","article-title":"Rethinking Computational Thinking","volume":"59","author":"Martin","year":"2018","journal-title":"Commun. ACM"},{"key":"ref_8","first-page":"34","article-title":"Critical thinking: Why we must transform our teaching","volume":"18","author":"Elder","year":"1994","journal-title":"J. Dev. Educ."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Paul, R., and Elder, L. (2019). The Miniature Guide to Critical Thinking Concepts and Tools, Rowman & Littlefield.","DOI":"10.5771\/9781538133842"},{"key":"ref_10","unstructured":"Bell, T., and Vahrenhold, J. (2018). Adventures Between Lower Bounds and Higher Altitudes, Springer."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"de Araujo, A.L.S.O., Andrade, W.L., and Guerrero, D.D.S. (2016, January 12\u201315). A systematic mapping study on assessing computational thinking abilities. Proceedings of the 2016 IEEE Frontiers in Education Conference (FIE), Eire, PA, USA.","DOI":"10.1109\/FIE.2016.7757678"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"1147","DOI":"10.5753\/cbie.wcbie.2016.1147","article-title":"Um mapeamento sistem\u00e1tico sobre a avalia\u00e7ao do pensamento computacional no brasil","volume":"5","author":"Araujo","year":"2016","journal-title":"Anais dos Workshops do Congresso Brasileiro de Inform\u00e1tica na Educa\u00e7\u00e3o"},{"key":"ref_13","first-page":"113","article-title":"Metodologias de Avalia\u00e7\u00e3o do Pensamento Computacional: Uma revis\u00e3o sistem\u00e1tica","volume":"28","author":"Avila","year":"2017","journal-title":"Braz. Symp. Comput. Educ."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"466","DOI":"10.1111\/j.1467-8527.2005.00307.x","article-title":"Assessment\u2013summative and formative\u2013some theoretical reflections","volume":"53","author":"Taras","year":"2005","journal-title":"Br. J. Educ. Stud."},{"key":"ref_15","unstructured":"Roman-Gonzalez, M., Moreno-Leon, J., and Robles, G. (2017, January 13\u201315). Complementary Tools for Computational Thinking Assessment. Proceedings of the International Conference on Computational Thinking Education, Hong Kong."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"162","DOI":"10.1007\/s10956-019-09796-6","article-title":"Practicing Formative Assessment for Computational Thinking in Making Environments","volume":"29","author":"Hadad","year":"2020","journal-title":"J. Sci. Educ. Technol."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Guggemos, J., Seufert, S., and Rom\u00e1n-Gonz\u00e1lez, M. (2022). Computational Thinking Assessment\u2014Towards More Vivid Interpretations. Tech. Know Learn.","DOI":"10.1007\/s10758-021-09587-2"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"4","DOI":"10.1002\/bs.3830280103","article-title":"On the definition of feedback","volume":"28","author":"Ramaprasad","year":"1983","journal-title":"Behav. Sci."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Fong, C.J., and Schallert, D.L. (2023). Feedback to the future: Advancing motivational and emotional perspectives in feedback research. Educ. Psychol.","DOI":"10.1080\/00461520.2022.2134135"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"61","DOI":"10.5539\/ies.v12n1p61","article-title":"Application of rubrics in the classroom: A vital tool for improvement in assessment, feedback and learning","volume":"12","author":"Chowdhury","year":"2019","journal-title":"Int. Educ. Stud."},{"key":"ref_21","first-page":"72","article-title":"What\u2019s Wrong\u2013and What\u2019s Right\u2013with Rubrics","volume":"55","author":"Popham","year":"1997","journal-title":"Educ. Leadersh."},{"key":"ref_22","first-page":"79","article-title":"Rubrics and their use in inclusive science","volume":"34","author":"Finson","year":"1998","journal-title":"Interv. Sch. Clin."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Sanger, C.S., and Gleason, N.W. (2020). Diversity and Inclusion in Global Higher Education: Lessons from across Asia, Palgrave Macmillan Singapore; Springer Nature.","DOI":"10.1007\/978-981-15-1628-3"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"347","DOI":"10.1080\/02602938.2015.1111294","article-title":"Assessment rubrics: Towards clearer and more replicable design, research and practice","volume":"42","author":"Dawson","year":"2017","journal-title":"Assess. Eval. High. Educ."},{"key":"ref_25","unstructured":"Johnson, R.L., Penny, J.A., and Gordon, B. (2008). Assessing Performance: Designing, Scoring, and Validating Performance Tasks, The Guilford Press."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"101964","DOI":"10.1016\/j.ijer.2022.101964","article-title":"Rubrics and formative assessment in K-12 education: A scoping review of literature","volume":"113","author":"English","year":"2022","journal-title":"Int. J. Educ. Res."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Basu, S. (2019, January 13). Using Rubrics Integrating Design and Coding to Assess Middle School Students\u2019 Open-ended Block-based Programming Projects. Proceedings of the Proceedings of the 50th ACM Technical Symposium on Computer Science Education, New York, NY, USA.","DOI":"10.1145\/3287324.3287412"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Alves, N.d.C., von Wangenheim, C.G., Hauck, J.C.R., and Borgatto, A.F. (2020, January 11\u201314). A large-scale evaluation of a rubric for the automatic assessment of algorithms and programming concepts. Proceedings of the 51st ACM Technical Symposium on Computer Science Education, Portland, OR, USA.","DOI":"10.1145\/3328778.3366840"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Park, Y., and Shin, Y. (2019). Comparing the effectiveness of scratch and app inventor with regard to learning computational thinking concepts. Electronics, 8.","DOI":"10.3390\/electronics8111269"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s40594-020-00208-5","article-title":"Rubrics to assess critical thinking and information processing in undergraduate STEM courses","volume":"7","author":"Reynders","year":"2020","journal-title":"Int. J. STEM Educ."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"951","DOI":"10.1007\/s11423-022-10097-w","article-title":"Developing effective and accessible activities to improve and assess computational thinking and engineering learning","volume":"70","author":"Yin","year":"2022","journal-title":"Educ. Technol. Res. Dev."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"22","DOI":"10.3389\/feduc.2018.00022","article-title":"Appropriate criteria: Key to effective rubrics","volume":"3","author":"Brookhart","year":"2018","journal-title":"Front. Educ."},{"key":"ref_33","first-page":"3559","article-title":"Assessment of student competence using electronic rubric","volume":"15","author":"Ana","year":"2020","journal-title":"J. Eng. Sci. Technol"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Battaglia, N., Neil, C., and De Vincenzi, M. (2021, January 14\u201317). Software Engineering Competence-Based Learning in Collaborative Virtual Environments. Proceedings of the 2021 IEEE World Conference on Engineering Education (EDUNINE), Guatemala, Guatemala.","DOI":"10.1109\/EDUNINE51952.2021.9429119"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Efthymiou, L., Zarifis, A., and Orphanidou, Y. (2021). A Measurement Model for Collaborative Online Learning in Postgraduate Engineering Management Studies. Cases Eng. Manag. Educ. Pract., 1\u201321.","DOI":"10.4018\/978-1-7998-4063-3.ch001"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"319","DOI":"10.2307\/249008","article-title":"Perceived Usefulness, Perceived Ease of Use, and User Acceptance of Information Technology","volume":"13","author":"Davis","year":"1989","journal-title":"MIS Q."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"982","DOI":"10.1287\/mnsc.35.8.982","article-title":"User Acceptance of Computer Technology: A Comparison of Two Theoretical Models","volume":"35","author":"Davis","year":"1989","journal-title":"Manag. Sci."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Lamond, B., Mo, S., and Cunningham, T. (2022). Teachers\u2019 perceived usefulness of assistive technology in Ontario classrooms. J. Enabling Technol.","DOI":"10.1108\/JET-05-2022-0040"},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Nicholas, N., Hartono, K., Vincent, V., and Gui, A. (2022, January 13\u201315). A Study on Student\u2019s Satisfaction of using E-learning System During the COVID-19 Pandemic. Proceedings of the 2022 26th International Conference on Information Technology (IT), Penang, Malaysia.","DOI":"10.1109\/IT54280.2022.9743522"},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Prasetyo, Y.T., Tumanan, S.A.R., Yarte, L.A.F., Ogoy, M.C.C., and Ong, A.K.S. (2020, January 14\u201317). Blackboard E-learning system acceptance and satisfaction among filipino high school students: An extended technology acceptance model (TAM) approach. Proceedings of the 2020 IEEE International Conference on Industrial Engineering and Engineering Management (IEEM), Singapore.","DOI":"10.1109\/IEEM45057.2020.9309876"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Al-Chalabi, H.K.M. (2021, January 1\u20133). Evaluation of a Multi-Parameter E-learning System using Web 3.0 Technologies. Proceedings of the 2021 13th International Conference on Electronics, Computers and Artificial Intelligence (ECAI), Pitesti, Romania.","DOI":"10.1109\/ECAI52376.2021.9515191"},{"key":"ref_42","first-page":"17","article-title":"Technological Acceptance of Virtual Platforms in University Students: An Analysis in Times of Pandemic","volume":"17","author":"Barrios","year":"2022","journal-title":"IEEE Rev. Iberoam. Tecnol. Aprendiz."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"657","DOI":"10.12973\/eu-jer.10.2.657","article-title":"Development of Handbooks of Guidance and Counseling to Enhance Elementary School Teachers\u2019 Competence in Cultivating Students\u2019 Creativity","volume":"10","author":"Rahim","year":"2021","journal-title":"Eur. J. Educ. Res."},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Cohen, L., Manion, L., and Morrison, K. (2007). Research Methods in Education, Routledge. [6th ed.].","DOI":"10.4324\/9780203029053"},{"key":"ref_45","unstructured":"Gall, M.D., Borg, W.R., and Gall, J.P. (2006). Educational Research: An Introduction, Pearson. [8th ed.]."},{"key":"ref_46","unstructured":"Creswell, J.W. (2009). Research Design:Quantitative, Qualitative, and Mixed Methods Approaches, Sage Publication Inc."},{"key":"ref_47","unstructured":"Merriam, S.B. (1998). Qualitative Research and Case Study Applications in Education. Revised and Expanded from: \u201cCase Study Research in Education\u201d, Jossey-Bass. [2nd ed.]."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"299","DOI":"10.1136\/bmj.311.7000.299","article-title":"Qualitative research: Introducing focus groups","volume":"311","author":"Kitzinger","year":"1995","journal-title":"BMJ"},{"key":"ref_49","unstructured":"Krueger, R.A., and Casey, M.A. (2002). Designing and Conducting Focus Group Interviews, University of Minnesota."},{"key":"ref_50","unstructured":"Oman, K.S., Krugman, M.E., and Fink, R.M. (2003). Nursing Research Secrets, Hanley & Belfus. [1st ed.]."},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"13","DOI":"10.20982\/tqmp.04.1.p013","article-title":"The Mann-Whitney U: A test for assessing whether two independent samples come from the same distribution","volume":"4","author":"Nachar","year":"2008","journal-title":"Tutor. Quant. Methods Psychol."},{"key":"ref_52","unstructured":"Gonzalez, H.B., and Kuenzi, J.J. (2012). Congressional Research Service, Library of Congress."},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"20","DOI":"10.1111\/2041-210X.12860","article-title":"The use of focus group discussion methodology: Insights from two decades of application in conservation","volume":"9","author":"Wilson","year":"2018","journal-title":"Methods Ecol. Evol."},{"key":"ref_54","unstructured":"The Next Generation Science Standards (2022, December 01). Criteria for Producing and Evaluating High-Quality and Aligned Summative Science Assessments. Available online: https:\/\/www.nextgenscience.org\/resources\/criteria-procuring-and-evaluating-high-quality-and-aligned-summative-science-assessments."},{"key":"ref_55","unstructured":"National Assessment of Educational Progress (2018). The Nation\u2019s Report Card, U.S. Department of Education."},{"key":"ref_56","doi-asserted-by":"crossref","unstructured":"Dimos, I., Velaora, C., and Kakarountas, A. (2022, January 2\u20133). Computational Thinking in Greek Educational System for K-12: Towards the future teaching approach. Proceedings of the 2022 Panhellenic Conference on Electronics & Telecommunications (PACET), Tripolis, Greece.","DOI":"10.1109\/PACET56979.2022.9976359"},{"key":"ref_57","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1016\/j.stueduc.2011.03.001","article-title":"What is assessment for learning?","volume":"37","author":"Wiliam","year":"2011","journal-title":"Stud. Educ. Eval."},{"key":"ref_58","unstructured":"Tang, X., Yin, Y., Lin, Q., and Hadad, R. (2018). Assessing Computational Thinking: A Systematic Review of the Literature, American Educational Research Association (AERA)."},{"key":"ref_59","doi-asserted-by":"crossref","first-page":"336","DOI":"10.18844\/wjet.v13i3.5918","article-title":"Computational thinking assessment at primary school in the context of learning programming","volume":"13","author":"Mukasheva","year":"2021","journal-title":"World J. Educ. Technol. Curr. Issues"}],"container-title":["Information"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2078-2489\/14\/2\/118\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T18:33:01Z","timestamp":1760121181000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2078-2489\/14\/2\/118"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,2,13]]},"references-count":59,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2023,2]]}},"alternative-id":["info14020118"],"URL":"https:\/\/doi.org\/10.3390\/info14020118","relation":{},"ISSN":["2078-2489"],"issn-type":[{"type":"electronic","value":"2078-2489"}],"subject":[],"published":{"date-parts":[[2023,2,13]]}}}